Sep 06 19:09:05.285692 ip-10-0-135-37 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 06 19:09:05.285706 ip-10-0-135-37 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 06 19:09:05.285717 ip-10-0-135-37 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 06 19:09:05.286007 ip-10-0-135-37 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 06 19:09:14.514914 ip-10-0-135-37 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 06 19:09:14.514928 ip-10-0-135-37 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot a683d2cd253b42c5bfac956278c91a63 --
Sep 06 19:10:53.631805 ip-10-0-135-37 systemd[1]: Starting Kubernetes Kubelet...
Sep 06 19:10:54.072743 ip-10-0-135-37 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 06 19:10:54.072743 ip-10-0-135-37 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 06 19:10:54.072743 ip-10-0-135-37 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 06 19:10:54.072743 ip-10-0-135-37 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 06 19:10:54.072743 ip-10-0-135-37 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 06 19:10:54.075570 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.075462    2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 06 19:10:54.079681 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079663    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 19:10:54.079681 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079680    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 19:10:54.079755 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079684    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 19:10:54.079755 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079687    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 19:10:54.079755 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079691    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 19:10:54.079755 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079694    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 19:10:54.079755 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079700    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 19:10:54.079755 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079703    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 19:10:54.079755 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079706    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 19:10:54.079755 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079709    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 19:10:54.079755 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079712    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 19:10:54.079755 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079714    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 19:10:54.079755 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079717    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 19:10:54.079755 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079719    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 19:10:54.079755 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079722    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 19:10:54.079755 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079725    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 19:10:54.079755 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079727    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 19:10:54.079755 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079732    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 19:10:54.079755 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079734    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 19:10:54.079755 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079737    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 19:10:54.079755 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079739    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 19:10:54.079755 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079742    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 19:10:54.080241 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079744    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 19:10:54.080241 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079747    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 19:10:54.080241 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079750    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 19:10:54.080241 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079754    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 19:10:54.080241 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079759    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 19:10:54.080241 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079764    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 19:10:54.080241 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079768    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 19:10:54.080241 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079777    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 19:10:54.080241 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079780    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 19:10:54.080241 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079783    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 19:10:54.080241 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079786    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 19:10:54.080241 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079789    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 19:10:54.080241 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079791    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 19:10:54.080241 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079794    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 19:10:54.080241 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079797    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 19:10:54.080241 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079800    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 19:10:54.080241 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079803    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 19:10:54.080241 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079806    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 19:10:54.080241 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079808    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 19:10:54.080739 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079811    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 19:10:54.080739 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079814    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 19:10:54.080739 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079816    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 19:10:54.080739 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079819    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 19:10:54.080739 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079821    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 19:10:54.080739 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079824    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 19:10:54.080739 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079827    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 19:10:54.080739 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079829    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 19:10:54.080739 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079832    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 19:10:54.080739 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079835    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 19:10:54.080739 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079837    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 19:10:54.080739 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079840    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 19:10:54.080739 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079842    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 19:10:54.080739 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079845    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 19:10:54.080739 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079849    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 19:10:54.080739 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079852    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 19:10:54.080739 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079854    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 19:10:54.080739 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079857    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 19:10:54.080739 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079860    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 19:10:54.080739 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079863    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 19:10:54.081234 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079865    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 19:10:54.081234 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079868    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 19:10:54.081234 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079873    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 19:10:54.081234 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079876    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 19:10:54.081234 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079879    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 19:10:54.081234 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079882    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 19:10:54.081234 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079884    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 19:10:54.081234 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079887    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 19:10:54.081234 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079890    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 19:10:54.081234 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079893    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 19:10:54.081234 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079896    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 19:10:54.081234 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079898    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 19:10:54.081234 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079901    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 19:10:54.081234 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079903    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 19:10:54.081234 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079906    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 19:10:54.081234 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079908    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 19:10:54.081234 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079911    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 19:10:54.081234 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079913    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 19:10:54.081234 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079916    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 19:10:54.081766 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079919    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 19:10:54.081766 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079922    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 19:10:54.081766 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079924    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 19:10:54.081766 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079927    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 19:10:54.081766 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079929    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 19:10:54.081766 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079932    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 19:10:54.081766 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079935    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 19:10:54.081766 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079938    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 19:10:54.081766 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079941    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 19:10:54.081766 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079943    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 19:10:54.081766 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079946    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 19:10:54.081766 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079949    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 19:10:54.081766 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079952    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 19:10:54.081766 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079954    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 19:10:54.081766 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079957    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 19:10:54.081766 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079959    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 19:10:54.081766 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079962    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 19:10:54.081766 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079964    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 19:10:54.081766 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.079967    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 19:10:54.081766 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080684    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 19:10:54.082255 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080693    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 19:10:54.082255 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080697    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 19:10:54.082255 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080700    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 19:10:54.082255 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080703    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 19:10:54.082255 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080706    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 19:10:54.082255 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080709    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 19:10:54.082255 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080712    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 19:10:54.082255 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080715    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 19:10:54.082255 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080718    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 19:10:54.082255 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080721    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 19:10:54.082255 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080724    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 19:10:54.082255 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080728    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 19:10:54.082255 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080732    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 19:10:54.082255 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080736    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 19:10:54.082255 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080739    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 19:10:54.082255 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080742    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 19:10:54.082255 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080745    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 19:10:54.082255 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080748    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 19:10:54.082255 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080751    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 19:10:54.082753 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080754    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 19:10:54.082753 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080757    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 19:10:54.082753 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080760    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 19:10:54.082753 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080762    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 19:10:54.082753 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080765    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 19:10:54.082753 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080768    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 19:10:54.082753 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080771    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 19:10:54.082753 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080773    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 19:10:54.082753 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080777    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 19:10:54.082753 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080779    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 19:10:54.082753 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080782    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 19:10:54.082753 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080784    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 19:10:54.082753 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080787    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 19:10:54.082753 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080790    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 19:10:54.082753 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080792    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 19:10:54.082753 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080795    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 19:10:54.082753 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080797    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 19:10:54.082753 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080800    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 19:10:54.082753 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080803    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 19:10:54.082753 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080806    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 19:10:54.083250 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080809    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 19:10:54.083250 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080811    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 19:10:54.083250 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080814    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 19:10:54.083250 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080817    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 19:10:54.083250 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080820    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 19:10:54.083250 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080822    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 19:10:54.083250 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080825    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 19:10:54.083250 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080828    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 19:10:54.083250 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080830    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 19:10:54.083250 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080833    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 19:10:54.083250 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080835    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 19:10:54.083250 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080838    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 19:10:54.083250 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080841    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 19:10:54.083250 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080843    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 19:10:54.083250 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080846    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 19:10:54.083250 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080848    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 19:10:54.083250 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080851    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 19:10:54.083250 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080853    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 19:10:54.083250 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080856    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 19:10:54.083250 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080859    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 19:10:54.083767 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080861    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 19:10:54.083767 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080863    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 19:10:54.083767 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080866    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 19:10:54.083767 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080868    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 19:10:54.083767 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080871    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 19:10:54.083767 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080873    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 19:10:54.083767 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080877    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 19:10:54.083767 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080879    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 19:10:54.083767 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080882    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 19:10:54.083767 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080884    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 19:10:54.083767 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080888    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 19:10:54.083767 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080892    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 19:10:54.083767 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080897    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 19:10:54.083767 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080900    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 19:10:54.083767 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080903    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 19:10:54.083767 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080906    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 19:10:54.083767 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080908    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 19:10:54.083767 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080911    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 19:10:54.083767 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080913    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 19:10:54.084246 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080916    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 19:10:54.084246 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080919    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 19:10:54.084246 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080921    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 19:10:54.084246 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080924    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 19:10:54.084246 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080926    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 19:10:54.084246 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080929    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 19:10:54.084246 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080932    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 19:10:54.084246 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080934    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 19:10:54.084246 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080937    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 19:10:54.084246 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080939    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 19:10:54.084246 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080942    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 19:10:54.084246 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080945    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 19:10:54.084246 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080947    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 19:10:54.084246 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080950    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 19:10:54.084246 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080952    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 19:10:54.084246 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080962    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 19:10:54.084246 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080965    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 19:10:54.084246 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080967    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 19:10:54.084246 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080970    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 19:10:54.084726 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.080972    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 19:10:54.084726 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081398    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 19:10:54.084726 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081403    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 19:10:54.084726 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081407    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 19:10:54.084726 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081410    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 19:10:54.084726 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081413    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 19:10:54.084726 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081417    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 19:10:54.084726 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081421    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 19:10:54.084726 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081423    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 19:10:54.084726 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081429    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 19:10:54.084726 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081433    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 19:10:54.084726 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081437    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 19:10:54.084726 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081440    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 19:10:54.084726 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081443    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 19:10:54.084726 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081446    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 19:10:54.084726 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081449    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 19:10:54.084726 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081452    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 19:10:54.084726 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081456    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 19:10:54.084726 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081459    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 19:10:54.085198 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081462    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 19:10:54.085198 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081479    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 19:10:54.085198 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081482    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 19:10:54.085198 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081485    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 19:10:54.085198 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081487    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 19:10:54.085198 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081491    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 19:10:54.085198 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081493    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 19:10:54.085198 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081497    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 19:10:54.085198 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081501    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 19:10:54.085198 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081504    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 19:10:54.085198 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081506    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 19:10:54.085198 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081509    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 19:10:54.085198 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081512    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 19:10:54.085198 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081515    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 19:10:54.085198 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081517    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 19:10:54.085198 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081520    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 19:10:54.085198 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081523    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 19:10:54.085198 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081525    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 19:10:54.085198 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081528    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 19:10:54.085671 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081532    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 19:10:54.085671 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081534    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 19:10:54.085671 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081537    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 19:10:54.085671 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081541    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 19:10:54.085671 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081544    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 19:10:54.085671 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081547    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 19:10:54.085671 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081549    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 19:10:54.085671 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081552    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 19:10:54.085671 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081555    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 19:10:54.085671 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081557    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 19:10:54.085671 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081560    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 19:10:54.085671 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081563    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 19:10:54.085671 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081565    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 19:10:54.085671 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081568    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 19:10:54.085671 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081570    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 19:10:54.085671 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081573    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 19:10:54.085671 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081576    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 19:10:54.085671 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081578    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 19:10:54.085671 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081581    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 19:10:54.085671 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081583    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 19:10:54.086169 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081586    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 19:10:54.086169 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081588    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 19:10:54.086169 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081591    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 19:10:54.086169 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081594    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 19:10:54.086169 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081596    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 19:10:54.086169 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081599    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 19:10:54.086169 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081602    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 19:10:54.086169 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081604    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 19:10:54.086169 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081609    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 19:10:54.086169 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081611    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 19:10:54.086169 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081614    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 19:10:54.086169 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081617    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 19:10:54.086169 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081619    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 19:10:54.086169 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081623    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 19:10:54.086169 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081626    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 19:10:54.086169 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081630    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 19:10:54.086169 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081633    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 19:10:54.086169 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081635    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 19:10:54.086169 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081638    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 19:10:54.086169 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081641    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 19:10:54.086716 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081643    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 19:10:54.086716 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081646    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 19:10:54.086716 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081648    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 19:10:54.086716 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081651    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 19:10:54.086716 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081653    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 19:10:54.086716 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081656    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 19:10:54.086716 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081658    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 19:10:54.086716 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081661    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 19:10:54.086716 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081664    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 19:10:54.086716 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081666    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 19:10:54.086716 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081669    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 19:10:54.086716 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081671    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 19:10:54.086716 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081674    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 19:10:54.086716 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081677    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 19:10:54.086716 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081679    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 19:10:54.086716 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081682    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 19:10:54.086716 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081685    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 19:10:54.086716 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081687    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 19:10:54.086716 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081690    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 19:10:54.086716 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081692    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 19:10:54.087206 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081695    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 19:10:54.087206 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.081698    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 19:10:54.087206 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081768    2577 flags.go:64] FLAG: --address="0.0.0.0"
Sep 06 19:10:54.087206 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081808    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 06 19:10:54.087206 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081816    2577 flags.go:64] FLAG: --anonymous-auth="true"
Sep 06 19:10:54.087206 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081821    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 06 19:10:54.087206 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081825    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 06 19:10:54.087206 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081830    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 06 19:10:54.087206 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081834    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 06 19:10:54.087206 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081839    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 06 19:10:54.087206 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081842    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 06 19:10:54.087206 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081845    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 06 19:10:54.087206 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081848    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 06 19:10:54.087206 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081852    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 06 19:10:54.087206 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081855    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 06 19:10:54.087206 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081858    2577 flags.go:64] FLAG: --cgroup-root=""
Sep 06 19:10:54.087206 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081861    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 06 19:10:54.087206 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081863    2577 flags.go:64] FLAG: --client-ca-file=""
Sep 06 19:10:54.087206 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081866    2577 flags.go:64] FLAG: --cloud-provider="external"
Sep 06 19:10:54.087206 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081870    2577 flags.go:64] FLAG: --cluster-dns="[]"
Sep 06 19:10:54.087206 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081875    2577 flags.go:64] FLAG: --cluster-domain=""
Sep 06 19:10:54.087206 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081877    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 06 19:10:54.087206 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081881    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 06 19:10:54.087800 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081884    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 06 19:10:54.087800 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081887    2577 flags.go:64] FLAG: --container-log-max-files="5"
Sep 06 19:10:54.087800 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081891    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 06 19:10:54.087800 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081894    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 06 19:10:54.087800 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081897    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 06 19:10:54.087800 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081902    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 06 19:10:54.087800 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081905    2577 flags.go:64] FLAG: --contention-profiling="false"
Sep 06 19:10:54.087800 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081908    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 06 19:10:54.087800 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081911    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 06 19:10:54.087800 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081914    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 06 19:10:54.087800 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081917    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 06 19:10:54.087800 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081922    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 06 19:10:54.087800 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081925    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 06 19:10:54.087800 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081927    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 06 19:10:54.087800 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081930    2577 flags.go:64] FLAG: --enable-load-reader="false"
Sep 06 19:10:54.087800 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081933    2577 flags.go:64] FLAG: --enable-server="true"
Sep 06 19:10:54.087800 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081939    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 06 19:10:54.087800 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081943    2577 flags.go:64] FLAG: --event-burst="100"
Sep 06 19:10:54.087800 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081946    2577 flags.go:64] FLAG: --event-qps="50"
Sep 06 19:10:54.087800 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081949    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 06 19:10:54.087800 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081952    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 06 19:10:54.087800 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081955    2577 flags.go:64] FLAG: --eviction-hard=""
Sep 06 19:10:54.087800 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081959    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 06 19:10:54.087800 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081962    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 06 19:10:54.088381 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081973    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 06 19:10:54.088381 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081976    2577 flags.go:64] FLAG: --eviction-soft=""
Sep 06 19:10:54.088381 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081979    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 06 19:10:54.088381 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081982    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 06 19:10:54.088381 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081985    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 06 19:10:54.088381 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081988    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 06 19:10:54.088381 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081991    2577 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 06 19:10:54.088381 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081994    2577 flags.go:64] FLAG: --fail-swap-on="true"
Sep 06 19:10:54.088381 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.081997    2577 flags.go:64] FLAG: --feature-gates=""
Sep 06 19:10:54.088381 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082001    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 06 19:10:54.088381 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082004    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 06 19:10:54.088381 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082007    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 06 19:10:54.088381 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082010    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 06 19:10:54.088381 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082015    2577 flags.go:64] FLAG: --healthz-port="10248"
Sep 06 19:10:54.088381 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082018    2577 flags.go:64] FLAG: --help="false"
Sep 06 19:10:54.088381 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082021    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-135-37.ec2.internal"
Sep 06 19:10:54.088381 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082024    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 06 19:10:54.088381 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082027    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 06 19:10:54.088381 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082030    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 06 19:10:54.088381 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082033    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 06 19:10:54.088381 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082037    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 06 19:10:54.088381 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082040    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 06 19:10:54.088381 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082042    2577 flags.go:64] FLAG: --image-service-endpoint=""
Sep 06 19:10:54.089000 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082046    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 06 19:10:54.089000 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082050    2577 flags.go:64] FLAG: --kube-api-burst="100"
Sep 06 19:10:54.089000 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082053    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 06 19:10:54.089000 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082056    2577 flags.go:64] FLAG: --kube-api-qps="50"
Sep 06 19:10:54.089000 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082059    2577 flags.go:64] FLAG: --kube-reserved=""
Sep 06 19:10:54.089000 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082062    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 06 19:10:54.089000 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082065    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 06 19:10:54.089000 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082068    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 06 19:10:54.089000 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082071    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 06 19:10:54.089000 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082074    2577 flags.go:64] FLAG: --lock-file=""
Sep 06 19:10:54.089000 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082077    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 06 19:10:54.089000 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082080    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 06 19:10:54.089000 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082083    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 06 19:10:54.089000 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082088    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 06 19:10:54.089000 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082091    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 06 19:10:54.089000 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082094    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 06 19:10:54.089000 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082096    2577 flags.go:64] FLAG: --logging-format="text"
Sep 06 19:10:54.089000 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082100    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 06 19:10:54.089000 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082103    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 06 19:10:54.089000 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082106    2577 flags.go:64] FLAG: --manifest-url=""
Sep 06 19:10:54.089000 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082109    2577 flags.go:64] FLAG: --manifest-url-header=""
Sep 06 19:10:54.089000 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082113    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 06 19:10:54.089000 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082118    2577 flags.go:64] FLAG: --max-open-files="1000000"
Sep 06 19:10:54.089000 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082122    2577 flags.go:64] FLAG: --max-pods="110"
Sep 06 19:10:54.089000 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082125    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 06 19:10:54.089641 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082128    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 06 19:10:54.089641 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082131    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 06 19:10:54.089641 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082139    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 06 19:10:54.089641 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082142    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 06 19:10:54.089641 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082145    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 06 19:10:54.089641 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082149    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 06 19:10:54.089641 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082156    2577 flags.go:64] FLAG: --node-status-max-images="50"
Sep 06 19:10:54.089641 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082160    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 06 19:10:54.089641 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082164    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 06 19:10:54.089641 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082167    2577 flags.go:64] FLAG: --pod-cidr=""
Sep 06 19:10:54.089641 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082171    2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 06 19:10:54.089641 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082177    2577 flags.go:64] FLAG: --pod-manifest-path=""
Sep 06 19:10:54.089641 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082180    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 06 19:10:54.089641 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082183    2577 flags.go:64] FLAG: --pods-per-core="0"
Sep 06 19:10:54.089641 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082186    2577 flags.go:64] FLAG: --port="10250"
Sep 06 19:10:54.089641 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082189    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 06 19:10:54.089641 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082192    2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c2943026e3e8a4d3"
Sep 06 19:10:54.089641 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082196    2577 flags.go:64] FLAG: --qos-reserved=""
Sep 06 19:10:54.089641 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082199    2577 flags.go:64] FLAG: --read-only-port="10255"
Sep 06 19:10:54.089641 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082202    2577 flags.go:64] FLAG: --register-node="true"
Sep 06 19:10:54.089641 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082205    2577 flags.go:64] FLAG: --register-with-taints=""
Sep 06 19:10:54.089641 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082209    2577 flags.go:64] FLAG: --registry-burst="10"
Sep 06 19:10:54.089641 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082212    2577 flags.go:64] FLAG: --registry-qps="5"
Sep 06 19:10:54.089641 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082215    2577 flags.go:64] FLAG: --reserved-cpus=""
Sep 06 19:10:54.090342 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082218    2577 flags.go:64] FLAG: --reserved-memory=""
Sep 06 19:10:54.090342 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082225    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 06 19:10:54.090342 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082229    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 06 19:10:54.090342 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082232    2577 flags.go:64] FLAG: --rotate-certificates="false"
Sep 06 19:10:54.090342 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082235    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 06 19:10:54.090342 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082238    2577 flags.go:64] FLAG: --runonce="false"
Sep 06 19:10:54.090342 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082243    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 06 19:10:54.090342 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082246    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 06 19:10:54.090342 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082249    2577 flags.go:64] FLAG: --seccomp-default="false"
Sep 06 19:10:54.090342 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082252    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 06 19:10:54.090342 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082255    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 06 19:10:54.090342 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082259    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 06 19:10:54.090342 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082262    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 06 19:10:54.090342 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082266    2577 flags.go:64] FLAG: --storage-driver-password="root"
Sep 06 19:10:54.090342 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082269    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 06 19:10:54.090342 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082272    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 06 19:10:54.090342 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082276    2577 flags.go:64] FLAG: --storage-driver-user="root"
Sep 06 19:10:54.090342 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082279    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 06 19:10:54.090342 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082282    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 06 19:10:54.090342 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082286    2577 flags.go:64] FLAG: --system-cgroups=""
Sep 06 19:10:54.090342 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082289    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 06 19:10:54.090342 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082294    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 06 19:10:54.090342 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082297    2577 flags.go:64] FLAG: --tls-cert-file=""
Sep 06 19:10:54.090342 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082300    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 06 19:10:54.090342 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082304    2577 flags.go:64] FLAG: --tls-min-version=""
Sep 06 19:10:54.091005 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082307    2577 flags.go:64] FLAG: --tls-private-key-file=""
Sep 06 19:10:54.091005 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082310    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 06 19:10:54.091005 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082313    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 06 19:10:54.091005 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082316    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 06 19:10:54.091005 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082319    2577 flags.go:64] FLAG: --v="2"
Sep 06 19:10:54.091005 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082324    2577 flags.go:64] FLAG: --version="false"
Sep 06 19:10:54.091005 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082328    2577 flags.go:64] FLAG: --vmodule=""
Sep 06 19:10:54.091005 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082331    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 06 19:10:54.091005 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.082334    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 06 19:10:54.091005 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082449    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 19:10:54.091005 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082453    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 19:10:54.091005 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082457    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 19:10:54.091005 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082460    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 19:10:54.091005 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082464    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 19:10:54.091005 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082479    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 19:10:54.091005 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082483    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 19:10:54.091005 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082486    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 19:10:54.091005 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082489    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 19:10:54.091005 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082492    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 19:10:54.091005 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082495    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 19:10:54.091005 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082498    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 19:10:54.091005 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082501    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 19:10:54.091568 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082503    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 19:10:54.091568 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082506    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 19:10:54.091568 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082509    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 19:10:54.091568 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082511    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 19:10:54.091568 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082514    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 19:10:54.091568 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082517    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 19:10:54.091568 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082520    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 19:10:54.091568 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082523    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 19:10:54.091568 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082526    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 19:10:54.091568 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082528    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 19:10:54.091568 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082531    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 19:10:54.091568 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082533    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 19:10:54.091568 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082536    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 19:10:54.091568 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082538    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 19:10:54.091568 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082541    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 19:10:54.091568 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082543    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 19:10:54.091568 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082546    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 19:10:54.091568 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082548    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 19:10:54.091568 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082551    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 19:10:54.091568 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082553    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 19:10:54.092055 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082556    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 19:10:54.092055 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082559    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 19:10:54.092055 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082562    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 19:10:54.092055 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082567    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 19:10:54.092055 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082569    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 19:10:54.092055 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082572    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 19:10:54.092055 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082575    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 19:10:54.092055 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082578    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 19:10:54.092055 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082580    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 19:10:54.092055 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082583    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 19:10:54.092055 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082585    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 19:10:54.092055 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082588    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 19:10:54.092055 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082590    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 19:10:54.092055 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082593    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 19:10:54.092055 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082596    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 19:10:54.092055 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082598    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 19:10:54.092055 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082601    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 19:10:54.092055 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082604    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 19:10:54.092055 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082607    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 19:10:54.092055 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082610    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 19:10:54.092564 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082613    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 19:10:54.092564 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082616    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 19:10:54.092564 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082618    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 19:10:54.092564 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082621    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 19:10:54.092564 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082623    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 19:10:54.092564 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082626    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 19:10:54.092564 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082628    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 19:10:54.092564 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082631    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 19:10:54.092564 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082634    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 19:10:54.092564 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082637    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 19:10:54.092564 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082641    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 19:10:54.092564 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082645    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 19:10:54.092564 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082649    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 19:10:54.092564 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082652    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 19:10:54.092564 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082655    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 19:10:54.092564 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082659    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 19:10:54.092564 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082662    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 19:10:54.092564 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082665    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 19:10:54.092564 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082668    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 19:10:54.093046 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082671    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 19:10:54.093046 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082673    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 19:10:54.093046 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082676    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 19:10:54.093046 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082678    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 19:10:54.093046 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082681    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 19:10:54.093046 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082684    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 19:10:54.093046 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082686    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 19:10:54.093046 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082690    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 19:10:54.093046 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082694    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 19:10:54.093046 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082703    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 19:10:54.093046 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082706    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 19:10:54.093046 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082709    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 19:10:54.093046 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082712    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 19:10:54.093046 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082715    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 19:10:54.093046 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082717    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 19:10:54.093046 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082720    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 19:10:54.093046 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082722    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 19:10:54.093046 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082725    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 19:10:54.093046 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082727    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 19:10:54.093563 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082730    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 19:10:54.093563 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082733    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 19:10:54.093563 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082736    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 19:10:54.093563 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082738    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 19:10:54.093563 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082741    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 19:10:54.093563 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082743    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 19:10:54.093563 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082746    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 19:10:54.093563 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.082748    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 19:10:54.093563 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.083454    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 06 19:10:54.093563 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.091886    2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 06 19:10:54.093563 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.091906    2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 06 19:10:54.093563 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.092894    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 06 19:10:54.093563 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.092901    2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 06 19:10:54.093563 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.092966    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 19:10:54.093563 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.092971    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 19:10:54.093947 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.092975    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 19:10:54.093947 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.092978    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 19:10:54.093947 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.092981    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 19:10:54.093947 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.092984    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 19:10:54.093947 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.092987    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 19:10:54.093947 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.092989    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 19:10:54.093947 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.092992    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 19:10:54.093947 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.092995    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 19:10:54.093947 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.092998    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 19:10:54.093947 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093001    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 19:10:54.093947 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093003    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 19:10:54.093947 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093007    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 19:10:54.093947 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093010    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 19:10:54.093947 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093013    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 19:10:54.093947 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093015    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 19:10:54.093947 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093018    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 19:10:54.093947 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093021    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 19:10:54.093947 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093023    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 19:10:54.093947 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093026    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 19:10:54.093947 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093028    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 19:10:54.094435 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093031    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 19:10:54.094435 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093033    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 19:10:54.094435 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093036    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 19:10:54.094435 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093039    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 19:10:54.094435 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093041    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 19:10:54.094435 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093044    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 19:10:54.094435 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093046    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 19:10:54.094435 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093051    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 19:10:54.094435 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093054    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 19:10:54.094435 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093057    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 19:10:54.094435 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093060    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 19:10:54.094435 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093062    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 19:10:54.094435 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093065    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 19:10:54.094435 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093068    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 19:10:54.094435 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093070    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 19:10:54.094435 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093073    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 19:10:54.094435 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093075    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 19:10:54.094435 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093078    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 19:10:54.094435 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093080    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 19:10:54.094435 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093083    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 19:10:54.094939 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093085    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 19:10:54.094939 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093088    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 19:10:54.094939 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093091    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 19:10:54.094939 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093094    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 19:10:54.094939 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093097    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 19:10:54.094939 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093099    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 19:10:54.094939 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093102    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 19:10:54.094939 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093105    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 19:10:54.094939 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093107    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 19:10:54.094939 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093110    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 19:10:54.094939 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093112    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 19:10:54.094939 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093115    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 19:10:54.094939 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093119    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 19:10:54.094939 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093123    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 19:10:54.094939 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093126    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 19:10:54.094939 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093129    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 19:10:54.094939 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093131    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 19:10:54.094939 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093134    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 19:10:54.094939 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093137    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 19:10:54.095402 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093141    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 19:10:54.095402 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093144    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 19:10:54.095402 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093147    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 19:10:54.095402 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093149    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 19:10:54.095402 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093152    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 19:10:54.095402 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093154    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 19:10:54.095402 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093157    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 19:10:54.095402 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093159    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 19:10:54.095402 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093161    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 19:10:54.095402 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093164    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 19:10:54.095402 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093166    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 19:10:54.095402 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093169    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 19:10:54.095402 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093172    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 19:10:54.095402 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093174    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 19:10:54.095402 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093177    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 19:10:54.095402 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093179    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 19:10:54.095402 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093183    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 19:10:54.095402 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093185    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 19:10:54.095402 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093190    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 19:10:54.095978 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093193    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 19:10:54.095978 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093196    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 19:10:54.095978 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093199    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 19:10:54.095978 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093201    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 19:10:54.095978 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093204    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 19:10:54.095978 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093206    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 19:10:54.095978 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093209    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 19:10:54.095978 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093211    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 19:10:54.095978 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093214    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 19:10:54.095978 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093217    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 19:10:54.095978 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093221    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 19:10:54.095978 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093224    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 19:10:54.095978 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093227    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 19:10:54.095978 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093230    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 19:10:54.095978 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093233    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 19:10:54.095978 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093236    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 19:10:54.095978 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093239    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 19:10:54.095978 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093241    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 19:10:54.095978 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093244    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 19:10:54.096494 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.093249    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 06 19:10:54.096494 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093361    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 19:10:54.096494 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093365    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 19:10:54.096494 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093368    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 19:10:54.096494 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093371    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 19:10:54.096494 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093374    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 19:10:54.096494 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093377    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 19:10:54.096494 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093380    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 19:10:54.096494 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093383    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 19:10:54.096494 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093385    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 19:10:54.096494 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093389    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 19:10:54.096494 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093391    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 19:10:54.096494 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093394    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 19:10:54.096494 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093396    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 19:10:54.096494 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093399    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 19:10:54.096858 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093402    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 19:10:54.096858 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093405    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 19:10:54.096858 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093407    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 19:10:54.096858 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093410    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 19:10:54.096858 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093413    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 19:10:54.096858 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093416    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 19:10:54.096858 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093419    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 19:10:54.096858 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093421    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 19:10:54.096858 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093424    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 19:10:54.096858 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093426    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 19:10:54.096858 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093429    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 19:10:54.096858 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093431    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 19:10:54.096858 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093434    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 19:10:54.096858 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093437    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 19:10:54.096858 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093440    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 19:10:54.096858 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093443    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 19:10:54.096858 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093445    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 19:10:54.096858 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093448    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 19:10:54.096858 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093451    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 19:10:54.096858 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093453    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 19:10:54.097432 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093456    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 19:10:54.097432 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093458    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 19:10:54.097432 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093461    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 19:10:54.097432 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093463    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 19:10:54.097432 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093478    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 19:10:54.097432 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093483    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 19:10:54.097432 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093486    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 19:10:54.097432 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093493    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 19:10:54.097432 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093499    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 19:10:54.097432 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093503    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 19:10:54.097432 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093507    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 19:10:54.097432 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093510    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 19:10:54.097432 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093512    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 19:10:54.097432 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093515    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 19:10:54.097432 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093518    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 19:10:54.097432 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093521    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 19:10:54.097432 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093523    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 19:10:54.097432 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093526    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 19:10:54.097432 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093529    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 19:10:54.097934 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093531    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 19:10:54.097934 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093534    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 19:10:54.097934 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093537    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 19:10:54.097934 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093539    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 19:10:54.097934 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093542    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 19:10:54.097934 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093544    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 19:10:54.097934 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093547    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 19:10:54.097934 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093550    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 19:10:54.097934 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093553    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 19:10:54.097934 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093556    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 19:10:54.097934 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093559    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 19:10:54.097934 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093561    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 19:10:54.097934 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093564    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 19:10:54.097934 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093568    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 19:10:54.097934 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093572    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 19:10:54.097934 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093575    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 19:10:54.097934 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093577    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 19:10:54.097934 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093580    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 19:10:54.097934 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093583    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 19:10:54.098412 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093585    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 19:10:54.098412 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093588    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 19:10:54.098412 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093590    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 19:10:54.098412 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093593    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 19:10:54.098412 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093595    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 19:10:54.098412 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093598    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 19:10:54.098412 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093600    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 19:10:54.098412 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093619    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 19:10:54.098412 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093624    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 19:10:54.098412 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093627    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 19:10:54.098412 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093630    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 19:10:54.098412 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093633    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 19:10:54.098412 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093636    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 19:10:54.098412 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093638    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 19:10:54.098412 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093641    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 19:10:54.098412 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093644    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 19:10:54.098412 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093646    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 19:10:54.098412 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093649    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 19:10:54.098412 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093651    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 19:10:54.098412 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093654    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 19:10:54.099182 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093657    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 19:10:54.099182 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093659    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 19:10:54.099182 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093665    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 19:10:54.099182 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093668    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 19:10:54.099182 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093671    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 19:10:54.099182 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093674    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 19:10:54.099182 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:54.093676    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 19:10:54.099182 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.093681    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 06 19:10:54.099182 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.093802    2577 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 06 19:10:54.099182 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.096107    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 06 19:10:54.099182 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.097176    2577 server.go:1019] "Starting client certificate rotation"
Sep 06 19:10:54.099182 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.097303    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 06 19:10:54.099182 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.097360    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 06 19:10:54.099937 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.099922    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 06 19:10:54.105665 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.105641    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 06 19:10:54.115931 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.115913    2577 log.go:25] "Validated CRI v1 runtime API"
Sep 06 19:10:54.119280 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.119265    2577 log.go:25] "Validated CRI v1 image API"
Sep 06 19:10:54.120146 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.120130    2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 06 19:10:54.124366 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.124344    2577 fs.go:135] Filesystem UUIDs: map[78c5b7a9-5da2-443b-a9ea-8112978e26c1:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8f15211c-297f-4970-bd2f-b099f8b8db72:/dev/nvme0n1p3]
Sep 06 19:10:54.124446 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.124364    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 06 19:10:54.127902 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.127875    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 06 19:10:54.129789 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.129681    2577 manager.go:216] Machine: {Timestamp:2026-09-06 19:10:54.128345493 +0000 UTC m=+0.369230849 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100862 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28aec97811d7f79fb28df62c34a27a SystemUUID:ec28aec9-7811-d7f7-9fb2-8df62c34a27a BootID:a683d2cd-253b-42c5-bfac-956278c91a63 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4f:ca:fb:b3:21 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4f:ca:fb:b3:21 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:96:3b:4e:34:13:fd Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 06 19:10:54.129789 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.129787    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 06 19:10:54.129906 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.129872    2577 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 06 19:10:54.133350 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.133324    2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 06 19:10:54.133506 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.133352    2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-37.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 06 19:10:54.134225 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.134214    2577 topology_manager.go:138] "Creating topology manager with none policy"
Sep 06 19:10:54.134256 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.134228    2577 container_manager_linux.go:309] "Creating device plugin manager"
Sep 06 19:10:54.134256 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.134235    2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 06 19:10:54.134256 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.134250    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 06 19:10:54.135579 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.135569    2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 06 19:10:54.140186 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.140174    2577 state_mem.go:36] "Initialized new in-memory state store"
Sep 06 19:10:54.140298 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.140289    2577 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 06 19:10:54.140334 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.140325    2577 kubelet.go:486] "Attempting to sync node with API server"
Sep 06 19:10:54.140364 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.140339    2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 06 19:10:54.140364 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.140356    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 06 19:10:54.140364 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.140364    2577 kubelet.go:398] "Adding apiserver pod source"
Sep 06 19:10:54.140441 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.140373    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 06 19:10:54.140762 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.140751    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 06 19:10:54.140808 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.140771    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 06 19:10:54.143105 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.143085    2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 06 19:10:54.145999 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.145985    2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 06 19:10:54.146050 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.146040    2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 06 19:10:54.147531 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.147519    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 06 19:10:54.147573 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.147536    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 06 19:10:54.147573 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.147543    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 06 19:10:54.147573 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.147549    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 06 19:10:54.147573 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.147557    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 06 19:10:54.147573 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.147562    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 06 19:10:54.147573 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.147575    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 06 19:10:54.147727 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.147581    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 06 19:10:54.147727 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.147588    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 06 19:10:54.147727 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.147594    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 06 19:10:54.147727 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.147603    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 06 19:10:54.147727 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.147608    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 06 19:10:54.148690 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.148674    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 06 19:10:54.148904 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.148890    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 06 19:10:54.152831 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.152707    2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-37.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 06 19:10:54.153387 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.153370    2577 server.go:1268] "Started kubelet"
Sep 06 19:10:54.153454 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.153429    2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 06 19:10:54.153546 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:54.153526    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-37.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 06 19:10:54.153595 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:54.153523    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 06 19:10:54.153595 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.153552    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 06 19:10:54.153686 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.153595    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 06 19:10:54.154218 ip-10-0-135-37 systemd[1]: Started Kubernetes Kubelet.
Sep 06 19:10:54.155081 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.155060    2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 06 19:10:54.155685 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.155669    2577 server.go:310] "Adding debug handlers to kubelet server"
Sep 06 19:10:54.159302 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:54.158081    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-37.ec2.internal.18d2d10c9ec99f2b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-37.ec2.internal,UID:ip-10-0-135-37.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-37.ec2.internal,},FirstTimestamp:2026-09-06 19:10:54.153334571 +0000 UTC m=+0.394219907,LastTimestamp:2026-09-06 19:10:54.153334571 +0000 UTC m=+0.394219907,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-37.ec2.internal,}"
Sep 06 19:10:54.159402 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:54.159382    2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 06 19:10:54.175680 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.175660    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vpp5m"
Sep 06 19:10:54.182720 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.182703    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vpp5m"
Sep 06 19:10:54.306983 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.306956    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 06 19:10:54.307684 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.307657    2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 06 19:10:54.307800 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:54.307783    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-37.ec2.internal\" not found"
Sep 06 19:10:54.308501 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.308483    2577 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 06 19:10:54.308501 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.308503    2577 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 06 19:10:54.308644 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.308485    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 06 19:10:54.308644 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.308579    2577 reconstruct.go:97] "Volume reconstruction finished"
Sep 06 19:10:54.308644 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.308581    2577 factory.go:55] Registering systemd factory
Sep 06 19:10:54.308644 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.308599    2577 factory.go:223] Registration of the systemd container factory successfully
Sep 06 19:10:54.308644 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.308587    2577 reconciler.go:29] "Reconciler: start to sync state"
Sep 06 19:10:54.308823 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.308801    2577 factory.go:153] Registering CRI-O factory
Sep 06 19:10:54.308823 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.308815    2577 factory.go:223] Registration of the crio container factory successfully
Sep 06 19:10:54.308876 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.308862    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 06 19:10:54.308876 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.308875    2577 factory.go:103] Registering Raw factory
Sep 06 19:10:54.308937 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.308886    2577 manager.go:1196] Started watching for new ooms in manager
Sep 06 19:10:54.309285 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.309272    2577 manager.go:349] Starting recovery of all containers
Sep 06 19:10:54.320161 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.320012    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 19:10:54.320313 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.320068    2577 manager.go:354] Recovery completed
Sep 06 19:10:54.323201 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:54.323090    2577 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-37.ec2.internal\" not found" node="ip-10-0-135-37.ec2.internal"
Sep 06 19:10:54.325869 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.325855    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 19:10:54.327655 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.327637    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-37.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 19:10:54.327742 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.327668    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-37.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 19:10:54.327742 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.327681    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-37.ec2.internal" event="NodeHasSufficientPID"
Sep 06 19:10:54.328248 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.328234    2577 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 06 19:10:54.328248 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.328246    2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 06 19:10:54.328335 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.328267    2577 state_mem.go:36] "Initialized new in-memory state store"
Sep 06 19:10:54.328335 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.328275    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 19:10:54.329013 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.328996    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-37.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 19:10:54.329085 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.329022    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-37.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 19:10:54.329085 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.329032    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-37.ec2.internal" event="NodeHasSufficientPID"
Sep 06 19:10:54.330315 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.330295    2577 policy_none.go:49] "None policy: Start"
Sep 06 19:10:54.330315 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.330311    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 06 19:10:54.330456 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.330321    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 06 19:10:54.332265 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.332251    2577 policy_none.go:47] "Start"
Sep 06 19:10:54.376171 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.376153    2577 manager.go:337] "Starting Device Plugin manager"
Sep 06 19:10:54.385976 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:54.376199    2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 06 19:10:54.385976 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.376213    2577 server.go:87] "Starting device plugin registration server"
Sep 06 19:10:54.385976 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.376620    2577 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 06 19:10:54.385976 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.376633    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 06 19:10:54.385976 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.376732    2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 06 19:10:54.385976 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.376832    2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 06 19:10:54.385976 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.376842    2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 06 19:10:54.385976 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:54.377296    2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 06 19:10:54.385976 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:54.377340    2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-37.ec2.internal\" not found"
Sep 06 19:10:54.385976 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.380229    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 06 19:10:54.385976 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.381444    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 06 19:10:54.385976 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.381516    2577 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 06 19:10:54.385976 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.381545    2577 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 06 19:10:54.385976 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:54.381627    2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 06 19:10:54.385976 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.383383    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 19:10:54.477380 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.477349    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 19:10:54.478814 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.478797    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-37.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 19:10:54.478909 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.478827    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-37.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 19:10:54.478909 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.478838    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-37.ec2.internal" event="NodeHasSufficientPID"
Sep 06 19:10:54.478909 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.478864    2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-37.ec2.internal"
Sep 06 19:10:54.481935 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.481918    2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-37.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-37.ec2.internal"]
Sep 06 19:10:54.481992 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.481984    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 19:10:54.483916 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.483900    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-37.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 19:10:54.484007 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.483923    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-37.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 19:10:54.484007 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.483933    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-37.ec2.internal" event="NodeHasSufficientPID"
Sep 06 19:10:54.486130 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.486118    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 19:10:54.486256 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.486240    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-37.ec2.internal"
Sep 06 19:10:54.486297 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.486270    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 19:10:54.487624 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.487610    2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-37.ec2.internal"
Sep 06 19:10:54.487717 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:54.487629    2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-37.ec2.internal\": node \"ip-10-0-135-37.ec2.internal\" not found"
Sep 06 19:10:54.488161 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.488146    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-37.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 19:10:54.488224 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.488167    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-37.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 19:10:54.488224 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.488177    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-37.ec2.internal" event="NodeHasSufficientPID"
Sep 06 19:10:54.488224 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.488192    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-37.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 19:10:54.488224 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.488207    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-37.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 19:10:54.488224 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.488215    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-37.ec2.internal" event="NodeHasSufficientPID"
Sep 06 19:10:54.490319 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.490304    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-37.ec2.internal"
Sep 06 19:10:54.490410 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.490327    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 19:10:54.491040 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.491020    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-37.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 19:10:54.491127 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.491049    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-37.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 19:10:54.491127 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.491059    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-37.ec2.internal" event="NodeHasSufficientPID"
Sep 06 19:10:54.504050 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:54.504031    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-37.ec2.internal\" not found" node="ip-10-0-135-37.ec2.internal"
Sep 06 19:10:54.507459 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:54.507444    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-37.ec2.internal\" not found" node="ip-10-0-135-37.ec2.internal"
Sep 06 19:10:54.513559 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:54.513540    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-37.ec2.internal\" not found"
Sep 06 19:10:54.610379 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.610283    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7c9c7b18f6dc58d7d47ef7d8bc6dcd79-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-37.ec2.internal\" (UID: \"7c9c7b18f6dc58d7d47ef7d8bc6dcd79\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-37.ec2.internal"
Sep 06 19:10:54.610379 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.610343    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c9c7b18f6dc58d7d47ef7d8bc6dcd79-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-37.ec2.internal\" (UID: \"7c9c7b18f6dc58d7d47ef7d8bc6dcd79\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-37.ec2.internal"
Sep 06 19:10:54.610379 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.610361    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6ec9d6b0deae2fcae3f224177b618fa3-config\") pod \"kube-apiserver-proxy-ip-10-0-135-37.ec2.internal\" (UID: \"6ec9d6b0deae2fcae3f224177b618fa3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-37.ec2.internal"
Sep 06 19:10:54.614412 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:54.614395    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-37.ec2.internal\" not found"
Sep 06 19:10:54.710935 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.710897    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7c9c7b18f6dc58d7d47ef7d8bc6dcd79-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-37.ec2.internal\" (UID: \"7c9c7b18f6dc58d7d47ef7d8bc6dcd79\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-37.ec2.internal"
Sep 06 19:10:54.710935 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.710938    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c9c7b18f6dc58d7d47ef7d8bc6dcd79-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-37.ec2.internal\" (UID: \"7c9c7b18f6dc58d7d47ef7d8bc6dcd79\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-37.ec2.internal"
Sep 06 19:10:54.711042 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.710955    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6ec9d6b0deae2fcae3f224177b618fa3-config\") pod \"kube-apiserver-proxy-ip-10-0-135-37.ec2.internal\" (UID: \"6ec9d6b0deae2fcae3f224177b618fa3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-37.ec2.internal"
Sep 06 19:10:54.711042 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.710996    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7c9c7b18f6dc58d7d47ef7d8bc6dcd79-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-37.ec2.internal\" (UID: \"7c9c7b18f6dc58d7d47ef7d8bc6dcd79\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-37.ec2.internal"
Sep 06 19:10:54.711042 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.710993    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6ec9d6b0deae2fcae3f224177b618fa3-config\") pod \"kube-apiserver-proxy-ip-10-0-135-37.ec2.internal\" (UID: \"6ec9d6b0deae2fcae3f224177b618fa3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-37.ec2.internal"
Sep 06 19:10:54.711042 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.711023    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c9c7b18f6dc58d7d47ef7d8bc6dcd79-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-37.ec2.internal\" (UID: \"7c9c7b18f6dc58d7d47ef7d8bc6dcd79\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-37.ec2.internal"
Sep 06 19:10:54.715013 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:54.714996    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-37.ec2.internal\" not found"
Sep 06 19:10:54.807453 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.807414    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-37.ec2.internal"
Sep 06 19:10:54.811904 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:54.811879    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-37.ec2.internal"
Sep 06 19:10:54.815142 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:54.815120    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-37.ec2.internal\" not found"
Sep 06 19:10:54.915837 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:54.915724    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-37.ec2.internal\" not found"
Sep 06 19:10:55.016147 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:55.016111    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-37.ec2.internal\" not found"
Sep 06 19:10:55.102111 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:55.102074    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 06 19:10:55.102584 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:55.102267    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 06 19:10:55.102584 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:55.102284    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 06 19:10:55.116495 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:55.116455    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-37.ec2.internal\" not found"
Sep 06 19:10:55.217228 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:55.217144    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-37.ec2.internal\" not found"
Sep 06 19:10:55.286143 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:55.286106    2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 19:10:55.306137 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:55.306098    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-05 19:05:55 +0000 UTC" deadline="2028-04-10 15:05:27.894926173 +0000 UTC"
Sep 06 19:10:55.306137 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:55.306131    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13963h54m32.588797853s"
Sep 06 19:10:55.307285 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:55.307271    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 06 19:10:55.308466 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:55.308448    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-37.ec2.internal"
Sep 06 19:10:55.318680 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:55.318655    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 06 19:10:55.322829 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:55.322805    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 06 19:10:55.325084 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:55.325070    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-37.ec2.internal"
Sep 06 19:10:55.334011 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:55.333995    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 06 19:10:55.338614 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:55.338599    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-r2prk"
Sep 06 19:10:55.346139 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:55.346121    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-r2prk"
Sep 06 19:10:55.623447 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:55.623407    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c9c7b18f6dc58d7d47ef7d8bc6dcd79.slice/crio-c347e0d0cb5d432a455bbaf08d6e71a5c2a041dc524515b4c172ae98519ec3d7 WatchSource:0}: Error finding container c347e0d0cb5d432a455bbaf08d6e71a5c2a041dc524515b4c172ae98519ec3d7: Status 404 returned error can't find the container with id c347e0d0cb5d432a455bbaf08d6e71a5c2a041dc524515b4c172ae98519ec3d7
Sep 06 19:10:55.623927 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:55.623900    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ec9d6b0deae2fcae3f224177b618fa3.slice/crio-0a92ef1c8bbd7e84b50be9f3879d9accddd75c504371bad30ed0c538c6d6d42f WatchSource:0}: Error finding container 0a92ef1c8bbd7e84b50be9f3879d9accddd75c504371bad30ed0c538c6d6d42f: Status 404 returned error can't find the container with id 0a92ef1c8bbd7e84b50be9f3879d9accddd75c504371bad30ed0c538c6d6d42f
Sep 06 19:10:55.629718 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:55.629700    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 19:10:55.636597 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:55.636577    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 19:10:56.142302 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.142266    2577 apiserver.go:52] "Watching apiserver"
Sep 06 19:10:56.151906 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.151878    2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 06 19:10:56.152293 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.152267    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-vzktl","openshift-network-diagnostics/network-check-target-bx7w2","openshift-network-operator/iptables-alerter-qrlmt","openshift-ovn-kubernetes/ovnkube-node-2bxw2","kube-system/global-pull-secret-syncer-dtlr6","kube-system/konnectivity-agent-q6xzx","kube-system/kube-apiserver-proxy-ip-10-0-135-37.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhmxz","openshift-dns/node-resolver-d7s2q","openshift-image-registry/node-ca-fxkhd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-37.ec2.internal","openshift-multus/multus-xx8sw","openshift-cluster-node-tuning-operator/tuned-pz2qc","openshift-multus/multus-additional-cni-plugins-l5h99"]
Sep 06 19:10:56.156436 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.156413    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fxkhd"
Sep 06 19:10:56.158539 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.158513    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-x5qlk\""
Sep 06 19:10:56.158539 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.158513    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 06 19:10:56.158720 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.158601    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 06 19:10:56.158720 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.158614    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 06 19:10:56.158831 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.158725    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.160536 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.160511    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8wxbg\""
Sep 06 19:10:56.160728 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.160710    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 06 19:10:56.160822 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.160805    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 06 19:10:56.161035 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.161020    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qrlmt"
Sep 06 19:10:56.162909 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.162886    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 06 19:10:56.163067 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.163041    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 06 19:10:56.163147 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.163137    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 06 19:10:56.163234 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.163160    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pgb29\""
Sep 06 19:10:56.163679 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.163513    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.165353 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.165327    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 06 19:10:56.165452 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.165352    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 06 19:10:56.165452 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.165356    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 06 19:10:56.165452 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.165438    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-nkn8c\""
Sep 06 19:10:56.165668 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.165654    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 06 19:10:56.165748 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.165732    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 06 19:10:56.165976 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.165962    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtlr6"
Sep 06 19:10:56.166059 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:56.166037    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtlr6" podUID="d89b285b-cadd-4b89-be22-17b20170f51c"
Sep 06 19:10:56.166097 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.166069    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 06 19:10:56.168557 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.168527    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q6xzx"
Sep 06 19:10:56.170763 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.170710    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-57bcl\""
Sep 06 19:10:56.170989 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.170967    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 06 19:10:56.171126 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.171009    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 06 19:10:56.171126 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.171098    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-d7s2q"
Sep 06 19:10:56.173425 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.173392    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 06 19:10:56.173547 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.173427    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 06 19:10:56.173547 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.173442    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4ztjq\""
Sep 06 19:10:56.173754 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.173736    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l5h99"
Sep 06 19:10:56.176325 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.176302    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 06 19:10:56.176424 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.176375    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bx7w2"
Sep 06 19:10:56.176424 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.176402    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-crhzb\""
Sep 06 19:10:56.176533 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:56.176448    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bx7w2" podUID="f989fafb-d7c2-4079-93ed-61da8f78e53b"
Sep 06 19:10:56.176671 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.176642    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 06 19:10:56.176778 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.176703    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 06 19:10:56.176778 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.176729    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 06 19:10:56.177179 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.177162    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 06 19:10:56.179259 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.179241    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzktl"
Sep 06 19:10:56.179340 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:56.179316    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzktl" podUID="2f48c221-e457-4c65-b433-902fa3a75f09"
Sep 06 19:10:56.182136 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.182114    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhmxz"
Sep 06 19:10:56.184079 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.184055    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.184632 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.184611    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 06 19:10:56.184736 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.184660    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 06 19:10:56.184736 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.184671    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wpgkz\""
Sep 06 19:10:56.184971 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.184827    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 06 19:10:56.186077 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.186057    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 06 19:10:56.186212 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.186195    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6dkxz\""
Sep 06 19:10:56.210765 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.210735    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 06 19:10:56.219898 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.219866    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f2q4\" (UniqueName: \"kubernetes.io/projected/f989fafb-d7c2-4079-93ed-61da8f78e53b-kube-api-access-8f2q4\") pod \"network-check-target-bx7w2\" (UID: \"f989fafb-d7c2-4079-93ed-61da8f78e53b\") " pod="openshift-network-diagnostics/network-check-target-bx7w2"
Sep 06 19:10:56.220025 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.219911    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8m98\" (UniqueName: \"kubernetes.io/projected/1dcb8c05-bebe-4e55-bee3-fcda70b424b4-kube-api-access-f8m98\") pod \"node-resolver-d7s2q\" (UID: \"1dcb8c05-bebe-4e55-bee3-fcda70b424b4\") " pod="openshift-dns/node-resolver-d7s2q"
Sep 06 19:10:56.220025 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.219936    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d-device-dir\") pod \"aws-ebs-csi-driver-node-hhmxz\" (UID: \"ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhmxz"
Sep 06 19:10:56.220025 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.219961    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d-etc-selinux\") pod \"aws-ebs-csi-driver-node-hhmxz\" (UID: \"ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhmxz"
Sep 06 19:10:56.220025 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.219985    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85954a2a-213c-4053-86bd-8ea8a7126d88-host-var-lib-cni-bin\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.220025 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.220012    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-var-lib-kubelet\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.220302 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.220037    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5f4qh\" (UniqueName: \"kubernetes.io/projected/9cdb696e-5c36-4c08-931f-b7fb59581f94-kube-api-access-5f4qh\") pod \"multus-additional-cni-plugins-l5h99\" (UID: \"9cdb696e-5c36-4c08-931f-b7fb59581f94\") " pod="openshift-multus/multus-additional-cni-plugins-l5h99"
Sep 06 19:10:56.220302 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.220065    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mbmp\" (UniqueName: \"kubernetes.io/projected/a436d469-ee20-4169-b87d-676eeb7210cf-kube-api-access-4mbmp\") pod \"iptables-alerter-qrlmt\" (UID: \"a436d469-ee20-4169-b87d-676eeb7210cf\") " pod="openshift-network-operator/iptables-alerter-qrlmt"
Sep 06 19:10:56.220302 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.220090    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9cdb696e-5c36-4c08-931f-b7fb59581f94-cnibin\") pod \"multus-additional-cni-plugins-l5h99\" (UID: \"9cdb696e-5c36-4c08-931f-b7fb59581f94\") " pod="openshift-multus/multus-additional-cni-plugins-l5h99"
Sep 06 19:10:56.220302 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.220116    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/00c5b89b-8ae6-4d75-9906-3b0ed677d9b2-host\") pod \"node-ca-fxkhd\" (UID: \"00c5b89b-8ae6-4d75-9906-3b0ed677d9b2\") " pod="openshift-image-registry/node-ca-fxkhd"
Sep 06 19:10:56.220302 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.220158    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d89b285b-cadd-4b89-be22-17b20170f51c-kubelet-config\") pod \"global-pull-secret-syncer-dtlr6\" (UID: \"d89b285b-cadd-4b89-be22-17b20170f51c\") " pod="kube-system/global-pull-secret-syncer-dtlr6"
Sep 06 19:10:56.220302 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.220226    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d89b285b-cadd-4b89-be22-17b20170f51c-original-pull-secret\") pod \"global-pull-secret-syncer-dtlr6\" (UID: \"d89b285b-cadd-4b89-be22-17b20170f51c\") " pod="kube-system/global-pull-secret-syncer-dtlr6"
Sep 06 19:10:56.220302 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.220246    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1dcb8c05-bebe-4e55-bee3-fcda70b424b4-tmp-dir\") pod \"node-resolver-d7s2q\" (UID: \"1dcb8c05-bebe-4e55-bee3-fcda70b424b4\") " pod="openshift-dns/node-resolver-d7s2q"
Sep 06 19:10:56.220302 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.220282    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85954a2a-213c-4053-86bd-8ea8a7126d88-multus-cni-dir\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.220687 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.220306    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85954a2a-213c-4053-86bd-8ea8a7126d88-etc-kubernetes\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.220687 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.220330    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-etc-sysctl-d\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.220687 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.220344    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-etc-tuned\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.220687 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.220364    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-run-ovn\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.220687 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.220383    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9cdb696e-5c36-4c08-931f-b7fb59581f94-cni-binary-copy\") pod \"multus-additional-cni-plugins-l5h99\" (UID: \"9cdb696e-5c36-4c08-931f-b7fb59581f94\") " pod="openshift-multus/multus-additional-cni-plugins-l5h99"
Sep 06 19:10:56.220687 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.220398    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9cdb696e-5c36-4c08-931f-b7fb59581f94-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l5h99\" (UID: \"9cdb696e-5c36-4c08-931f-b7fb59581f94\") " pod="openshift-multus/multus-additional-cni-plugins-l5h99"
Sep 06 19:10:56.220687 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.220412    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xj8v\" (UniqueName: \"kubernetes.io/projected/00c5b89b-8ae6-4d75-9906-3b0ed677d9b2-kube-api-access-4xj8v\") pod \"node-ca-fxkhd\" (UID: \"00c5b89b-8ae6-4d75-9906-3b0ed677d9b2\") " pod="openshift-image-registry/node-ca-fxkhd"
Sep 06 19:10:56.220687 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.220432    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-tmp\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.220687 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.220456    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9cdb696e-5c36-4c08-931f-b7fb59581f94-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l5h99\" (UID: \"9cdb696e-5c36-4c08-931f-b7fb59581f94\") " pod="openshift-multus/multus-additional-cni-plugins-l5h99"
Sep 06 19:10:56.220687 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.220510    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-etc-modprobe-d\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.220687 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.220543    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/85954a2a-213c-4053-86bd-8ea8a7126d88-multus-daemon-config\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.220687 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.220560    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-etc-kubernetes\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.220687 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.220588    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-host-slash\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.220687 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.220608    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-log-socket\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.220687 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.220622    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1dcb8c05-bebe-4e55-bee3-fcda70b424b4-hosts-file\") pod \"node-resolver-d7s2q\" (UID: \"1dcb8c05-bebe-4e55-bee3-fcda70b424b4\") " pod="openshift-dns/node-resolver-d7s2q"
Sep 06 19:10:56.220687 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.220647    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85954a2a-213c-4053-86bd-8ea8a7126d88-system-cni-dir\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.220687 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.220681    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85954a2a-213c-4053-86bd-8ea8a7126d88-host-run-netns\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.221542 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.220703    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-systemd-units\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.221542 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.220719    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d77df511-1f2b-4241-a1eb-8b46deadea8d-konnectivity-ca\") pod \"konnectivity-agent-q6xzx\" (UID: \"d77df511-1f2b-4241-a1eb-8b46deadea8d\") " pod="kube-system/konnectivity-agent-q6xzx"
Sep 06 19:10:56.221542 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.220737    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d89b285b-cadd-4b89-be22-17b20170f51c-dbus\") pod \"global-pull-secret-syncer-dtlr6\" (UID: \"d89b285b-cadd-4b89-be22-17b20170f51c\") " pod="kube-system/global-pull-secret-syncer-dtlr6"
Sep 06 19:10:56.221542 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.220762    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrj6b\" (UniqueName: \"kubernetes.io/projected/2f48c221-e457-4c65-b433-902fa3a75f09-kube-api-access-hrj6b\") pod \"network-metrics-daemon-vzktl\" (UID: \"2f48c221-e457-4c65-b433-902fa3a75f09\") " pod="openshift-multus/network-metrics-daemon-vzktl"
Sep 06 19:10:56.221542 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.220791    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d-registration-dir\") pod \"aws-ebs-csi-driver-node-hhmxz\" (UID: \"ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhmxz"
Sep 06 19:10:56.221542 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.220815    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85954a2a-213c-4053-86bd-8ea8a7126d88-host-var-lib-kubelet\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.221542 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.220854    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-run\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.221542 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.220874    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-host\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.221542 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.220893    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-host-run-netns\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.221542 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.220925    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-run-systemd\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.221542 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.220952    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-ovnkube-script-lib\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.221542 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.220971    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a436d469-ee20-4169-b87d-676eeb7210cf-host-slash\") pod \"iptables-alerter-qrlmt\" (UID: \"a436d469-ee20-4169-b87d-676eeb7210cf\") " pod="openshift-network-operator/iptables-alerter-qrlmt"
Sep 06 19:10:56.221542 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.221014    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/85954a2a-213c-4053-86bd-8ea8a7126d88-multus-conf-dir\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.221542 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.221036    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-etc-sysconfig\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.221542 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.221051    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-host-run-ovn-kubernetes\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.221542 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.221089    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-env-overrides\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.222272 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.221117    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/00c5b89b-8ae6-4d75-9906-3b0ed677d9b2-serviceca\") pod \"node-ca-fxkhd\" (UID: \"00c5b89b-8ae6-4d75-9906-3b0ed677d9b2\") " pod="openshift-image-registry/node-ca-fxkhd"
Sep 06 19:10:56.222272 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.221153    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/85954a2a-213c-4053-86bd-8ea8a7126d88-cni-binary-copy\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.222272 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.221195    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/85954a2a-213c-4053-86bd-8ea8a7126d88-multus-socket-dir-parent\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.222272 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.221223    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-var-lib-openvswitch\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.222272 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.221257    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.222272 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.221280    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d77df511-1f2b-4241-a1eb-8b46deadea8d-agent-certs\") pod \"konnectivity-agent-q6xzx\" (UID: \"d77df511-1f2b-4241-a1eb-8b46deadea8d\") " pod="kube-system/konnectivity-agent-q6xzx"
Sep 06 19:10:56.222272 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.221304    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9cdb696e-5c36-4c08-931f-b7fb59581f94-system-cni-dir\") pod \"multus-additional-cni-plugins-l5h99\" (UID: \"9cdb696e-5c36-4c08-931f-b7fb59581f94\") " pod="openshift-multus/multus-additional-cni-plugins-l5h99"
Sep 06 19:10:56.222272 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.221327    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hhmxz\" (UID: \"ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhmxz"
Sep 06 19:10:56.222272 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.221346    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dctd8\" (UniqueName: \"kubernetes.io/projected/ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d-kube-api-access-dctd8\") pod \"aws-ebs-csi-driver-node-hhmxz\" (UID: \"ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhmxz"
Sep 06 19:10:56.222272 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.221373    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/85954a2a-213c-4053-86bd-8ea8a7126d88-cnibin\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.222272 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.221389    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/85954a2a-213c-4053-86bd-8ea8a7126d88-host-run-k8s-cni-cncf-io\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.222272 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.221427    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/85954a2a-213c-4053-86bd-8ea8a7126d88-host-var-lib-cni-multus\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.222272 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.221452    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-etc-sysctl-conf\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.222272 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.221476    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-host-kubelet\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.222272 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.221514    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-host-cni-netd\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.222272 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.221558    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d-socket-dir\") pod \"aws-ebs-csi-driver-node-hhmxz\" (UID: \"ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhmxz"
Sep 06 19:10:56.222927 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.221599    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpmdj\" (UniqueName: \"kubernetes.io/projected/85954a2a-213c-4053-86bd-8ea8a7126d88-kube-api-access-cpmdj\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.222927 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.221625    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-sys\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.222927 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.221661    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fs48\" (UniqueName: \"kubernetes.io/projected/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-kube-api-access-2fs48\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.222927 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.221687    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-node-log\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.222927 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.221713    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xms9\" (UniqueName: \"kubernetes.io/projected/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-kube-api-access-7xms9\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.222927 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.221738    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-host-cni-bin\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.222927 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.221784    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9cdb696e-5c36-4c08-931f-b7fb59581f94-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l5h99\" (UID: \"9cdb696e-5c36-4c08-931f-b7fb59581f94\") " pod="openshift-multus/multus-additional-cni-plugins-l5h99"
Sep 06 19:10:56.222927 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.221819    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/85954a2a-213c-4053-86bd-8ea8a7126d88-hostroot\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.222927 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.221848    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/85954a2a-213c-4053-86bd-8ea8a7126d88-host-run-multus-certs\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.222927 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.221874    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-run-openvswitch\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.222927 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.221898    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f48c221-e457-4c65-b433-902fa3a75f09-metrics-certs\") pod \"network-metrics-daemon-vzktl\" (UID: \"2f48c221-e457-4c65-b433-902fa3a75f09\") " pod="openshift-multus/network-metrics-daemon-vzktl"
Sep 06 19:10:56.222927 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.221922    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-etc-openvswitch\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.222927 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.221956    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-ovn-node-metrics-cert\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.222927 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.221982    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a436d469-ee20-4169-b87d-676eeb7210cf-iptables-alerter-script\") pod \"iptables-alerter-qrlmt\" (UID: \"a436d469-ee20-4169-b87d-676eeb7210cf\") " pod="openshift-network-operator/iptables-alerter-qrlmt"
Sep 06 19:10:56.222927 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.222015    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d-sys-fs\") pod \"aws-ebs-csi-driver-node-hhmxz\" (UID: \"ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhmxz"
Sep 06 19:10:56.222927 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.222039    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-etc-systemd\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.223610 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.222065    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-lib-modules\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.223610 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.222103    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-ovnkube-config\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.236129 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.236097    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 19:10:56.322558 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.322526    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/85954a2a-213c-4053-86bd-8ea8a7126d88-hostroot\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.322558 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.322568    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/85954a2a-213c-4053-86bd-8ea8a7126d88-host-run-multus-certs\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.322819 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.322593    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-run-openvswitch\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.322819 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.322616    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f48c221-e457-4c65-b433-902fa3a75f09-metrics-certs\") pod \"network-metrics-daemon-vzktl\" (UID: \"2f48c221-e457-4c65-b433-902fa3a75f09\") " pod="openshift-multus/network-metrics-daemon-vzktl"
Sep 06 19:10:56.322819 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.322637    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-etc-openvswitch\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.322819 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.322659    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-ovn-node-metrics-cert\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.322819 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.322666    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/85954a2a-213c-4053-86bd-8ea8a7126d88-host-run-multus-certs\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.322819 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.322665    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/85954a2a-213c-4053-86bd-8ea8a7126d88-hostroot\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.322819 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.322684    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a436d469-ee20-4169-b87d-676eeb7210cf-iptables-alerter-script\") pod \"iptables-alerter-qrlmt\" (UID: \"a436d469-ee20-4169-b87d-676eeb7210cf\") " pod="openshift-network-operator/iptables-alerter-qrlmt"
Sep 06 19:10:56.322819 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.322734    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d-sys-fs\") pod \"aws-ebs-csi-driver-node-hhmxz\" (UID: \"ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhmxz"
Sep 06 19:10:56.322819 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.322762    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-etc-systemd\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.322819 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:56.322808    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 19:10:56.323339 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.322795    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-lib-modules\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.323339 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.322871    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-ovnkube-config\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.323339 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.322897    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f2q4\" (UniqueName: \"kubernetes.io/projected/f989fafb-d7c2-4079-93ed-61da8f78e53b-kube-api-access-8f2q4\") pod \"network-check-target-bx7w2\" (UID: \"f989fafb-d7c2-4079-93ed-61da8f78e53b\") " pod="openshift-network-diagnostics/network-check-target-bx7w2"
Sep 06 19:10:56.323339 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.322924    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8m98\" (UniqueName: \"kubernetes.io/projected/1dcb8c05-bebe-4e55-bee3-fcda70b424b4-kube-api-access-f8m98\") pod \"node-resolver-d7s2q\" (UID: \"1dcb8c05-bebe-4e55-bee3-fcda70b424b4\") " pod="openshift-dns/node-resolver-d7s2q"
Sep 06 19:10:56.323339 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.322950    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d-device-dir\") pod \"aws-ebs-csi-driver-node-hhmxz\" (UID: \"ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhmxz"
Sep 06 19:10:56.323339 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.322976    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d-etc-selinux\") pod \"aws-ebs-csi-driver-node-hhmxz\" (UID: \"ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhmxz"
Sep 06 19:10:56.323339 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.323010    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85954a2a-213c-4053-86bd-8ea8a7126d88-host-var-lib-cni-bin\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.323339 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.323052    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-var-lib-kubelet\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.323339 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.323088    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5f4qh\" (UniqueName: \"kubernetes.io/projected/9cdb696e-5c36-4c08-931f-b7fb59581f94-kube-api-access-5f4qh\") pod \"multus-additional-cni-plugins-l5h99\" (UID: \"9cdb696e-5c36-4c08-931f-b7fb59581f94\") " pod="openshift-multus/multus-additional-cni-plugins-l5h99"
Sep 06 19:10:56.323339 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.323117    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mbmp\" (UniqueName: \"kubernetes.io/projected/a436d469-ee20-4169-b87d-676eeb7210cf-kube-api-access-4mbmp\") pod \"iptables-alerter-qrlmt\" (UID: \"a436d469-ee20-4169-b87d-676eeb7210cf\") " pod="openshift-network-operator/iptables-alerter-qrlmt"
Sep 06 19:10:56.323339 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.323152    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9cdb696e-5c36-4c08-931f-b7fb59581f94-cnibin\") pod \"multus-additional-cni-plugins-l5h99\" (UID: \"9cdb696e-5c36-4c08-931f-b7fb59581f94\") " pod="openshift-multus/multus-additional-cni-plugins-l5h99"
Sep 06 19:10:56.323339 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.323174    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/00c5b89b-8ae6-4d75-9906-3b0ed677d9b2-host\") pod \"node-ca-fxkhd\" (UID: \"00c5b89b-8ae6-4d75-9906-3b0ed677d9b2\") " pod="openshift-image-registry/node-ca-fxkhd"
Sep 06 19:10:56.323339 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.323198    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d89b285b-cadd-4b89-be22-17b20170f51c-kubelet-config\") pod \"global-pull-secret-syncer-dtlr6\" (UID: \"d89b285b-cadd-4b89-be22-17b20170f51c\") " pod="kube-system/global-pull-secret-syncer-dtlr6"
Sep 06 19:10:56.323339 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.323225    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d89b285b-cadd-4b89-be22-17b20170f51c-original-pull-secret\") pod \"global-pull-secret-syncer-dtlr6\" (UID: \"d89b285b-cadd-4b89-be22-17b20170f51c\") " pod="kube-system/global-pull-secret-syncer-dtlr6"
Sep 06 19:10:56.323339 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.323272    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1dcb8c05-bebe-4e55-bee3-fcda70b424b4-tmp-dir\") pod \"node-resolver-d7s2q\" (UID: \"1dcb8c05-bebe-4e55-bee3-fcda70b424b4\") " pod="openshift-dns/node-resolver-d7s2q"
Sep 06 19:10:56.323339 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.323296    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85954a2a-213c-4053-86bd-8ea8a7126d88-multus-cni-dir\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.323339 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.323323    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85954a2a-213c-4053-86bd-8ea8a7126d88-etc-kubernetes\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.324234 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.323331    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d-sys-fs\") pod \"aws-ebs-csi-driver-node-hhmxz\" (UID: \"ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhmxz"
Sep 06 19:10:56.324234 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.323335    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a436d469-ee20-4169-b87d-676eeb7210cf-iptables-alerter-script\") pod \"iptables-alerter-qrlmt\" (UID: \"a436d469-ee20-4169-b87d-676eeb7210cf\") " pod="openshift-network-operator/iptables-alerter-qrlmt"
Sep 06 19:10:56.324234 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.323356    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-etc-sysctl-d\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.324234 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.323393    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-etc-systemd\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.324234 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.323405    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-etc-tuned\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.324234 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.323438    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-run-ovn\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.324234 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.323466    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9cdb696e-5c36-4c08-931f-b7fb59581f94-cni-binary-copy\") pod \"multus-additional-cni-plugins-l5h99\" (UID: \"9cdb696e-5c36-4c08-931f-b7fb59581f94\") " pod="openshift-multus/multus-additional-cni-plugins-l5h99"
Sep 06 19:10:56.324234 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.323495    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9cdb696e-5c36-4c08-931f-b7fb59581f94-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l5h99\" (UID: \"9cdb696e-5c36-4c08-931f-b7fb59581f94\") " pod="openshift-multus/multus-additional-cni-plugins-l5h99"
Sep 06 19:10:56.324234 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.323521    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xj8v\" (UniqueName: \"kubernetes.io/projected/00c5b89b-8ae6-4d75-9906-3b0ed677d9b2-kube-api-access-4xj8v\") pod \"node-ca-fxkhd\" (UID: \"00c5b89b-8ae6-4d75-9906-3b0ed677d9b2\") " pod="openshift-image-registry/node-ca-fxkhd"
Sep 06 19:10:56.324234 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.323562    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-tmp\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.324234 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.323580    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-lib-modules\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.324234 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.323591    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9cdb696e-5c36-4c08-931f-b7fb59581f94-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l5h99\" (UID: \"9cdb696e-5c36-4c08-931f-b7fb59581f94\") " pod="openshift-multus/multus-additional-cni-plugins-l5h99"
Sep 06 19:10:56.324234 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.323621    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-etc-modprobe-d\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.324234 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.323651    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/85954a2a-213c-4053-86bd-8ea8a7126d88-multus-daemon-config\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.324234 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.323679    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-etc-kubernetes\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.324234 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.323704    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-host-slash\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.324234 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.323731    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-log-socket\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.325060 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.323756    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1dcb8c05-bebe-4e55-bee3-fcda70b424b4-hosts-file\") pod \"node-resolver-d7s2q\" (UID: \"1dcb8c05-bebe-4e55-bee3-fcda70b424b4\") " pod="openshift-dns/node-resolver-d7s2q"
Sep 06 19:10:56.325060 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.323787    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85954a2a-213c-4053-86bd-8ea8a7126d88-system-cni-dir\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.325060 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.323814    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85954a2a-213c-4053-86bd-8ea8a7126d88-host-run-netns\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.325060 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.323840    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-systemd-units\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.325060 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.323867    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d77df511-1f2b-4241-a1eb-8b46deadea8d-konnectivity-ca\") pod \"konnectivity-agent-q6xzx\" (UID: \"d77df511-1f2b-4241-a1eb-8b46deadea8d\") " pod="kube-system/konnectivity-agent-q6xzx"
Sep 06 19:10:56.325060 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.323893    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d89b285b-cadd-4b89-be22-17b20170f51c-dbus\") pod \"global-pull-secret-syncer-dtlr6\" (UID: \"d89b285b-cadd-4b89-be22-17b20170f51c\") " pod="kube-system/global-pull-secret-syncer-dtlr6"
Sep 06 19:10:56.325060 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.323922    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrj6b\" (UniqueName: \"kubernetes.io/projected/2f48c221-e457-4c65-b433-902fa3a75f09-kube-api-access-hrj6b\") pod \"network-metrics-daemon-vzktl\" (UID: \"2f48c221-e457-4c65-b433-902fa3a75f09\") " pod="openshift-multus/network-metrics-daemon-vzktl"
Sep 06 19:10:56.325060 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.323950    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d-registration-dir\") pod \"aws-ebs-csi-driver-node-hhmxz\" (UID: \"ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhmxz"
Sep 06 19:10:56.325060 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.323979    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85954a2a-213c-4053-86bd-8ea8a7126d88-host-var-lib-kubelet\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.325060 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.324004    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-run\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.325060 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.324029    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-host\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.325060 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.324075    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-host-run-netns\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.325060 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.324084    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d-device-dir\") pod \"aws-ebs-csi-driver-node-hhmxz\" (UID: \"ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhmxz"
Sep 06 19:10:56.325060 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.324101    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-run-systemd\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.325060 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.324102    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-ovnkube-config\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.325060 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:56.324134    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f48c221-e457-4c65-b433-902fa3a75f09-metrics-certs podName:2f48c221-e457-4c65-b433-902fa3a75f09 nodeName:}" failed. No retries permitted until 2026-09-06 19:10:56.824110079 +0000 UTC m=+3.064995412 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f48c221-e457-4c65-b433-902fa3a75f09-metrics-certs") pod "network-metrics-daemon-vzktl" (UID: "2f48c221-e457-4c65-b433-902fa3a75f09") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 19:10:56.325060 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.324152    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d-etc-selinux\") pod \"aws-ebs-csi-driver-node-hhmxz\" (UID: \"ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhmxz"
Sep 06 19:10:56.325894 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.324173    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-etc-openvswitch\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.325894 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.324174    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-ovnkube-script-lib\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.325894 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.324200    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85954a2a-213c-4053-86bd-8ea8a7126d88-host-var-lib-cni-bin\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.325894 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.324209    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a436d469-ee20-4169-b87d-676eeb7210cf-host-slash\") pod \"iptables-alerter-qrlmt\" (UID: \"a436d469-ee20-4169-b87d-676eeb7210cf\") " pod="openshift-network-operator/iptables-alerter-qrlmt"
Sep 06 19:10:56.325894 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.324242    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/85954a2a-213c-4053-86bd-8ea8a7126d88-multus-conf-dir\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.325894 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.324255    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-var-lib-kubelet\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.325894 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.323054    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-run-openvswitch\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.325894 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.324270    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-etc-sysconfig\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.325894 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.324334    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-etc-sysconfig\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.325894 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.324504    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-host-run-ovn-kubernetes\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.325894 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.324539    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-env-overrides\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.325894 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.324587    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/00c5b89b-8ae6-4d75-9906-3b0ed677d9b2-serviceca\") pod \"node-ca-fxkhd\" (UID: \"00c5b89b-8ae6-4d75-9906-3b0ed677d9b2\") " pod="openshift-image-registry/node-ca-fxkhd"
Sep 06 19:10:56.325894 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.324614    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/85954a2a-213c-4053-86bd-8ea8a7126d88-cni-binary-copy\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.325894 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.324642    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/85954a2a-213c-4053-86bd-8ea8a7126d88-multus-socket-dir-parent\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.325894 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.324671    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-var-lib-openvswitch\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.325894 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.324694    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-ovnkube-script-lib\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.325894 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.324701    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.326823 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.324729    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d77df511-1f2b-4241-a1eb-8b46deadea8d-agent-certs\") pod \"konnectivity-agent-q6xzx\" (UID: \"d77df511-1f2b-4241-a1eb-8b46deadea8d\") " pod="kube-system/konnectivity-agent-q6xzx"
Sep 06 19:10:56.326823 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.324757    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9cdb696e-5c36-4c08-931f-b7fb59581f94-system-cni-dir\") pod \"multus-additional-cni-plugins-l5h99\" (UID: \"9cdb696e-5c36-4c08-931f-b7fb59581f94\") " pod="openshift-multus/multus-additional-cni-plugins-l5h99"
Sep 06 19:10:56.326823 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.324794    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hhmxz\" (UID: \"ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhmxz"
Sep 06 19:10:56.326823 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:56.324806    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 19:10:56.326823 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.324806    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-run-ovn\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.326823 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.324821    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dctd8\" (UniqueName: \"kubernetes.io/projected/ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d-kube-api-access-dctd8\") pod \"aws-ebs-csi-driver-node-hhmxz\" (UID: \"ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhmxz"
Sep 06 19:10:56.326823 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:56.324852    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d89b285b-cadd-4b89-be22-17b20170f51c-original-pull-secret podName:d89b285b-cadd-4b89-be22-17b20170f51c nodeName:}" failed. No retries permitted until 2026-09-06 19:10:56.824836432 +0000 UTC m=+3.065721783 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d89b285b-cadd-4b89-be22-17b20170f51c-original-pull-secret") pod "global-pull-secret-syncer-dtlr6" (UID: "d89b285b-cadd-4b89-be22-17b20170f51c") : object "kube-system"/"original-pull-secret" not registered
Sep 06 19:10:56.326823 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.324869    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/85954a2a-213c-4053-86bd-8ea8a7126d88-cnibin\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.326823 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.324916    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/85954a2a-213c-4053-86bd-8ea8a7126d88-host-run-k8s-cni-cncf-io\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.326823 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.324944    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/85954a2a-213c-4053-86bd-8ea8a7126d88-host-var-lib-cni-multus\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.326823 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.324972    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-etc-sysctl-conf\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.326823 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.324995    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-host-kubelet\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.326823 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.325034    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-host-cni-netd\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.326823 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.325046    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-host-run-ovn-kubernetes\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.326823 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.325061    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d-socket-dir\") pod \"aws-ebs-csi-driver-node-hhmxz\" (UID: \"ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhmxz"
Sep 06 19:10:56.326823 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.325095    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpmdj\" (UniqueName: \"kubernetes.io/projected/85954a2a-213c-4053-86bd-8ea8a7126d88-kube-api-access-cpmdj\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.326823 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.325125    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-sys\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.327649 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.325144    2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 06 19:10:56.327649 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.325367    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9cdb696e-5c36-4c08-931f-b7fb59581f94-cni-binary-copy\") pod \"multus-additional-cni-plugins-l5h99\" (UID: \"9cdb696e-5c36-4c08-931f-b7fb59581f94\") " pod="openshift-multus/multus-additional-cni-plugins-l5h99"
Sep 06 19:10:56.327649 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.325384    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9cdb696e-5c36-4c08-931f-b7fb59581f94-cnibin\") pod \"multus-additional-cni-plugins-l5h99\" (UID: \"9cdb696e-5c36-4c08-931f-b7fb59581f94\") " pod="openshift-multus/multus-additional-cni-plugins-l5h99"
Sep 06 19:10:56.327649 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.325433    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-var-lib-openvswitch\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.327649 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.325436    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-env-overrides\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.327649 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.325484    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9cdb696e-5c36-4c08-931f-b7fb59581f94-system-cni-dir\") pod \"multus-additional-cni-plugins-l5h99\" (UID: \"9cdb696e-5c36-4c08-931f-b7fb59581f94\") " pod="openshift-multus/multus-additional-cni-plugins-l5h99"
Sep 06 19:10:56.327649 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.325505    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.327649 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.325613    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85954a2a-213c-4053-86bd-8ea8a7126d88-multus-cni-dir\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.327649 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.325879    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/85954a2a-213c-4053-86bd-8ea8a7126d88-multus-socket-dir-parent\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.327649 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.325931    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/85954a2a-213c-4053-86bd-8ea8a7126d88-host-var-lib-cni-multus\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.327649 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.325933    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/00c5b89b-8ae6-4d75-9906-3b0ed677d9b2-serviceca\") pod \"node-ca-fxkhd\" (UID: \"00c5b89b-8ae6-4d75-9906-3b0ed677d9b2\") " pod="openshift-image-registry/node-ca-fxkhd"
Sep 06 19:10:56.327649 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.325965    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1dcb8c05-bebe-4e55-bee3-fcda70b424b4-tmp-dir\") pod \"node-resolver-d7s2q\" (UID: \"1dcb8c05-bebe-4e55-bee3-fcda70b424b4\") " pod="openshift-dns/node-resolver-d7s2q"
Sep 06 19:10:56.327649 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.325982    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/00c5b89b-8ae6-4d75-9906-3b0ed677d9b2-host\") pod \"node-ca-fxkhd\" (UID: \"00c5b89b-8ae6-4d75-9906-3b0ed677d9b2\") " pod="openshift-image-registry/node-ca-fxkhd"
Sep 06 19:10:56.327649 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.326034    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d89b285b-cadd-4b89-be22-17b20170f51c-kubelet-config\") pod \"global-pull-secret-syncer-dtlr6\" (UID: \"d89b285b-cadd-4b89-be22-17b20170f51c\") " pod="kube-system/global-pull-secret-syncer-dtlr6"
Sep 06 19:10:56.327649 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.326048    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-etc-sysctl-conf\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.327649 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.326104    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-sys\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.327649 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.326116    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/85954a2a-213c-4053-86bd-8ea8a7126d88-cnibin\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.327649 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.326116    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d-socket-dir\") pod \"aws-ebs-csi-driver-node-hhmxz\" (UID: \"ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhmxz"
Sep 06 19:10:56.328611 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.326159    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/85954a2a-213c-4053-86bd-8ea8a7126d88-host-run-k8s-cni-cncf-io\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.328611 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.326170    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-host-kubelet\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.328611 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.326209    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hhmxz\" (UID: \"ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhmxz"
Sep 06 19:10:56.328611 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.326213    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-host-cni-netd\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.328611 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.326263    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85954a2a-213c-4053-86bd-8ea8a7126d88-etc-kubernetes\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.328611 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.326302    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85954a2a-213c-4053-86bd-8ea8a7126d88-host-run-netns\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.328611 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.326353    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85954a2a-213c-4053-86bd-8ea8a7126d88-host-var-lib-kubelet\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.328611 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.326362    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9cdb696e-5c36-4c08-931f-b7fb59581f94-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l5h99\" (UID: \"9cdb696e-5c36-4c08-931f-b7fb59581f94\") " pod="openshift-multus/multus-additional-cni-plugins-l5h99"
Sep 06 19:10:56.328611 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.326379    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-etc-sysctl-d\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.328611 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.326399    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-systemd-units\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.328611 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.325991    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/85954a2a-213c-4053-86bd-8ea8a7126d88-cni-binary-copy\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.328611 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.326447    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d89b285b-cadd-4b89-be22-17b20170f51c-dbus\") pod \"global-pull-secret-syncer-dtlr6\" (UID: \"d89b285b-cadd-4b89-be22-17b20170f51c\") " pod="kube-system/global-pull-secret-syncer-dtlr6"
Sep 06 19:10:56.328611 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.326483    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d-registration-dir\") pod \"aws-ebs-csi-driver-node-hhmxz\" (UID: \"ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhmxz"
Sep 06 19:10:56.328611 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.326743    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-host-run-netns\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.328611 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.326812    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-run\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.328611 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.326866    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-host\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.328611 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.326914    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a436d469-ee20-4169-b87d-676eeb7210cf-host-slash\") pod \"iptables-alerter-qrlmt\" (UID: \"a436d469-ee20-4169-b87d-676eeb7210cf\") " pod="openshift-network-operator/iptables-alerter-qrlmt"
Sep 06 19:10:56.328611 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.326921    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9cdb696e-5c36-4c08-931f-b7fb59581f94-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l5h99\" (UID: \"9cdb696e-5c36-4c08-931f-b7fb59581f94\") " pod="openshift-multus/multus-additional-cni-plugins-l5h99"
Sep 06 19:10:56.329470 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.326957    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-run-systemd\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.329470 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.327012    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-host-slash\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.329470 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.327019    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-etc-modprobe-d\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.329470 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.327068    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-log-socket\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.329470 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.327116    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1dcb8c05-bebe-4e55-bee3-fcda70b424b4-hosts-file\") pod \"node-resolver-d7s2q\" (UID: \"1dcb8c05-bebe-4e55-bee3-fcda70b424b4\") " pod="openshift-dns/node-resolver-d7s2q"
Sep 06 19:10:56.329470 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.325152    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fs48\" (UniqueName: \"kubernetes.io/projected/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-kube-api-access-2fs48\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.329470 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.327207    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-node-log\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.329470 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.327225    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85954a2a-213c-4053-86bd-8ea8a7126d88-system-cni-dir\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.329470 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.327245    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xms9\" (UniqueName: \"kubernetes.io/projected/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-kube-api-access-7xms9\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.329470 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.327263    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-etc-kubernetes\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.329470 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.327273    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-node-log\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.329470 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.327158    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d77df511-1f2b-4241-a1eb-8b46deadea8d-konnectivity-ca\") pod \"konnectivity-agent-q6xzx\" (UID: \"d77df511-1f2b-4241-a1eb-8b46deadea8d\") " pod="kube-system/konnectivity-agent-q6xzx"
Sep 06 19:10:56.329470 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.327273    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-host-cni-bin\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.329470 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.327214    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/85954a2a-213c-4053-86bd-8ea8a7126d88-multus-conf-dir\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.329470 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.327322    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9cdb696e-5c36-4c08-931f-b7fb59581f94-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l5h99\" (UID: \"9cdb696e-5c36-4c08-931f-b7fb59581f94\") " pod="openshift-multus/multus-additional-cni-plugins-l5h99"
Sep 06 19:10:56.329470 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.327327    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-host-cni-bin\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.329470 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.327485    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/85954a2a-213c-4053-86bd-8ea8a7126d88-multus-daemon-config\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.329470 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.327800    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9cdb696e-5c36-4c08-931f-b7fb59581f94-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l5h99\" (UID: \"9cdb696e-5c36-4c08-931f-b7fb59581f94\") " pod="openshift-multus/multus-additional-cni-plugins-l5h99"
Sep 06 19:10:56.330459 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.330439    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-tmp\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.330556 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.330501    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-etc-tuned\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.330995 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.330972    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d77df511-1f2b-4241-a1eb-8b46deadea8d-agent-certs\") pod \"konnectivity-agent-q6xzx\" (UID: \"d77df511-1f2b-4241-a1eb-8b46deadea8d\") " pod="kube-system/konnectivity-agent-q6xzx"
Sep 06 19:10:56.331546 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.331523    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-ovn-node-metrics-cert\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.335403 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:56.335381    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 19:10:56.335581 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:56.335409    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 19:10:56.335581 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:56.335423    2577 projected.go:196] Error preparing data for projected volume kube-api-access-8f2q4 for pod openshift-network-diagnostics/network-check-target-bx7w2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 19:10:56.335581 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:56.335488    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f989fafb-d7c2-4079-93ed-61da8f78e53b-kube-api-access-8f2q4 podName:f989fafb-d7c2-4079-93ed-61da8f78e53b nodeName:}" failed. No retries permitted until 2026-09-06 19:10:56.835470325 +0000 UTC m=+3.076355665 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8f2q4" (UniqueName: "kubernetes.io/projected/f989fafb-d7c2-4079-93ed-61da8f78e53b-kube-api-access-8f2q4") pod "network-check-target-bx7w2" (UID: "f989fafb-d7c2-4079-93ed-61da8f78e53b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 19:10:56.341876 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.341853    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mbmp\" (UniqueName: \"kubernetes.io/projected/a436d469-ee20-4169-b87d-676eeb7210cf-kube-api-access-4mbmp\") pod \"iptables-alerter-qrlmt\" (UID: \"a436d469-ee20-4169-b87d-676eeb7210cf\") " pod="openshift-network-operator/iptables-alerter-qrlmt"
Sep 06 19:10:56.345320 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.345280    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8m98\" (UniqueName: \"kubernetes.io/projected/1dcb8c05-bebe-4e55-bee3-fcda70b424b4-kube-api-access-f8m98\") pod \"node-resolver-d7s2q\" (UID: \"1dcb8c05-bebe-4e55-bee3-fcda70b424b4\") " pod="openshift-dns/node-resolver-d7s2q"
Sep 06 19:10:56.345491 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.345451    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xj8v\" (UniqueName: \"kubernetes.io/projected/00c5b89b-8ae6-4d75-9906-3b0ed677d9b2-kube-api-access-4xj8v\") pod \"node-ca-fxkhd\" (UID: \"00c5b89b-8ae6-4d75-9906-3b0ed677d9b2\") " pod="openshift-image-registry/node-ca-fxkhd"
Sep 06 19:10:56.346608 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.346582    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dctd8\" (UniqueName: \"kubernetes.io/projected/ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d-kube-api-access-dctd8\") pod \"aws-ebs-csi-driver-node-hhmxz\" (UID: \"ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhmxz"
Sep 06 19:10:56.347520 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.347495    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fs48\" (UniqueName: \"kubernetes.io/projected/ee3f065a-5f47-4351-9d60-ffbbf765e1b6-kube-api-access-2fs48\") pod \"tuned-pz2qc\" (UID: \"ee3f065a-5f47-4351-9d60-ffbbf765e1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.347843 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.347821    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5f4qh\" (UniqueName: \"kubernetes.io/projected/9cdb696e-5c36-4c08-931f-b7fb59581f94-kube-api-access-5f4qh\") pod \"multus-additional-cni-plugins-l5h99\" (UID: \"9cdb696e-5c36-4c08-931f-b7fb59581f94\") " pod="openshift-multus/multus-additional-cni-plugins-l5h99"
Sep 06 19:10:56.347896 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.347826    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpmdj\" (UniqueName: \"kubernetes.io/projected/85954a2a-213c-4053-86bd-8ea8a7126d88-kube-api-access-cpmdj\") pod \"multus-xx8sw\" (UID: \"85954a2a-213c-4053-86bd-8ea8a7126d88\") " pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.349289 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.349246    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-05 19:05:56 +0000 UTC" deadline="2028-03-02 02:55:54.974560419 +0000 UTC"
Sep 06 19:10:56.349289 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.349282    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13015h44m58.625281229s"
Sep 06 19:10:56.349563 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.349528    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrj6b\" (UniqueName: \"kubernetes.io/projected/2f48c221-e457-4c65-b433-902fa3a75f09-kube-api-access-hrj6b\") pod \"network-metrics-daemon-vzktl\" (UID: \"2f48c221-e457-4c65-b433-902fa3a75f09\") " pod="openshift-multus/network-metrics-daemon-vzktl"
Sep 06 19:10:56.350280 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.350262    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xms9\" (UniqueName: \"kubernetes.io/projected/51e51b01-c5d9-4723-b198-72fc8c1ae0b0-kube-api-access-7xms9\") pod \"ovnkube-node-2bxw2\" (UID: \"51e51b01-c5d9-4723-b198-72fc8c1ae0b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.386135 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.386080    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-37.ec2.internal" event={"ID":"6ec9d6b0deae2fcae3f224177b618fa3","Type":"ContainerStarted","Data":"0a92ef1c8bbd7e84b50be9f3879d9accddd75c504371bad30ed0c538c6d6d42f"}
Sep 06 19:10:56.387424 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.387396    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-37.ec2.internal" event={"ID":"7c9c7b18f6dc58d7d47ef7d8bc6dcd79","Type":"ContainerStarted","Data":"c347e0d0cb5d432a455bbaf08d6e71a5c2a041dc524515b4c172ae98519ec3d7"}
Sep 06 19:10:56.467917 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.467848    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fxkhd"
Sep 06 19:10:56.473773 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.473745    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pz2qc"
Sep 06 19:10:56.483315 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.483128    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qrlmt"
Sep 06 19:10:56.485784 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:56.485753    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee3f065a_5f47_4351_9d60_ffbbf765e1b6.slice/crio-a4f615d62ba0f92b7a74364c146ed7d8c0999b66c0c997475562efcf7642291b WatchSource:0}: Error finding container a4f615d62ba0f92b7a74364c146ed7d8c0999b66c0c997475562efcf7642291b: Status 404 returned error can't find the container with id a4f615d62ba0f92b7a74364c146ed7d8c0999b66c0c997475562efcf7642291b
Sep 06 19:10:56.488034 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.488011    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:10:56.495269 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.494889    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q6xzx"
Sep 06 19:10:56.496087 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:56.496057    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda436d469_ee20_4169_b87d_676eeb7210cf.slice/crio-61ec30e224cd978a4b1d959bbf0deab97564cfc67e6bb8ba59cc6095f3d6ddb5 WatchSource:0}: Error finding container 61ec30e224cd978a4b1d959bbf0deab97564cfc67e6bb8ba59cc6095f3d6ddb5: Status 404 returned error can't find the container with id 61ec30e224cd978a4b1d959bbf0deab97564cfc67e6bb8ba59cc6095f3d6ddb5
Sep 06 19:10:56.498545 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:56.498471    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51e51b01_c5d9_4723_b198_72fc8c1ae0b0.slice/crio-2c34f1d78ed2e4b736ac86d057891e55a55e422a492e6396aa6941a1d4146189 WatchSource:0}: Error finding container 2c34f1d78ed2e4b736ac86d057891e55a55e422a492e6396aa6941a1d4146189: Status 404 returned error can't find the container with id 2c34f1d78ed2e4b736ac86d057891e55a55e422a492e6396aa6941a1d4146189
Sep 06 19:10:56.501275 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.501254    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-d7s2q"
Sep 06 19:10:56.506727 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:56.506701    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd77df511_1f2b_4241_a1eb_8b46deadea8d.slice/crio-b97d8b7892a8dfa35be7e4ab2e6dd187b133aded477154aa3b28dfa03cca4689 WatchSource:0}: Error finding container b97d8b7892a8dfa35be7e4ab2e6dd187b133aded477154aa3b28dfa03cca4689: Status 404 returned error can't find the container with id b97d8b7892a8dfa35be7e4ab2e6dd187b133aded477154aa3b28dfa03cca4689
Sep 06 19:10:56.507629 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.507609    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l5h99"
Sep 06 19:10:56.512652 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:56.512626    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dcb8c05_bebe_4e55_bee3_fcda70b424b4.slice/crio-2dae909a8bf748e5a23575c099565549c94cf4f1ae9e6b4138969e25a076dc8c WatchSource:0}: Error finding container 2dae909a8bf748e5a23575c099565549c94cf4f1ae9e6b4138969e25a076dc8c: Status 404 returned error can't find the container with id 2dae909a8bf748e5a23575c099565549c94cf4f1ae9e6b4138969e25a076dc8c
Sep 06 19:10:56.514495 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.514476    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhmxz"
Sep 06 19:10:56.518194 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:56.518168    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cdb696e_5c36_4c08_931f_b7fb59581f94.slice/crio-aaddcd17d7b400a64a118b272a6839b5d66f34cc1a61b7f6d41278e537549aaf WatchSource:0}: Error finding container aaddcd17d7b400a64a118b272a6839b5d66f34cc1a61b7f6d41278e537549aaf: Status 404 returned error can't find the container with id aaddcd17d7b400a64a118b272a6839b5d66f34cc1a61b7f6d41278e537549aaf
Sep 06 19:10:56.520810 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.520788    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xx8sw"
Sep 06 19:10:56.526148 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:56.526124    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff0e4adc_08a4_4f31_bc23_b2e5862d2d9d.slice/crio-a3ee016e5393c9fcd44ea00378ca9e14fc968bdfae129e72e48c4e94a6bb8370 WatchSource:0}: Error finding container a3ee016e5393c9fcd44ea00378ca9e14fc968bdfae129e72e48c4e94a6bb8370: Status 404 returned error can't find the container with id a3ee016e5393c9fcd44ea00378ca9e14fc968bdfae129e72e48c4e94a6bb8370
Sep 06 19:10:56.532261 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:10:56.532227    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85954a2a_213c_4053_86bd_8ea8a7126d88.slice/crio-64ad5645788f75ff52540078a67175dd9d4b756db4afb1dbb8116026229412c5 WatchSource:0}: Error finding container 64ad5645788f75ff52540078a67175dd9d4b756db4afb1dbb8116026229412c5: Status 404 returned error can't find the container with id 64ad5645788f75ff52540078a67175dd9d4b756db4afb1dbb8116026229412c5
Sep 06 19:10:56.566625 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.566589    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 19:10:56.831358 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.831260    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f48c221-e457-4c65-b433-902fa3a75f09-metrics-certs\") pod \"network-metrics-daemon-vzktl\" (UID: \"2f48c221-e457-4c65-b433-902fa3a75f09\") " pod="openshift-multus/network-metrics-daemon-vzktl"
Sep 06 19:10:56.831358 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.831333    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d89b285b-cadd-4b89-be22-17b20170f51c-original-pull-secret\") pod \"global-pull-secret-syncer-dtlr6\" (UID: \"d89b285b-cadd-4b89-be22-17b20170f51c\") " pod="kube-system/global-pull-secret-syncer-dtlr6"
Sep 06 19:10:56.831586 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:56.831428    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 19:10:56.831586 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:56.831457    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 19:10:56.831586 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:56.831523    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d89b285b-cadd-4b89-be22-17b20170f51c-original-pull-secret podName:d89b285b-cadd-4b89-be22-17b20170f51c nodeName:}" failed. No retries permitted until 2026-09-06 19:10:57.831499961 +0000 UTC m=+4.072385311 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d89b285b-cadd-4b89-be22-17b20170f51c-original-pull-secret") pod "global-pull-secret-syncer-dtlr6" (UID: "d89b285b-cadd-4b89-be22-17b20170f51c") : object "kube-system"/"original-pull-secret" not registered
Sep 06 19:10:56.831586 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:56.831583    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f48c221-e457-4c65-b433-902fa3a75f09-metrics-certs podName:2f48c221-e457-4c65-b433-902fa3a75f09 nodeName:}" failed. No retries permitted until 2026-09-06 19:10:57.831534736 +0000 UTC m=+4.072420067 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f48c221-e457-4c65-b433-902fa3a75f09-metrics-certs") pod "network-metrics-daemon-vzktl" (UID: "2f48c221-e457-4c65-b433-902fa3a75f09") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 19:10:56.932062 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:56.932028    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f2q4\" (UniqueName: \"kubernetes.io/projected/f989fafb-d7c2-4079-93ed-61da8f78e53b-kube-api-access-8f2q4\") pod \"network-check-target-bx7w2\" (UID: \"f989fafb-d7c2-4079-93ed-61da8f78e53b\") " pod="openshift-network-diagnostics/network-check-target-bx7w2"
Sep 06 19:10:56.932266 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:56.932241    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 19:10:56.932330 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:56.932278    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 19:10:56.932330 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:56.932294    2577 projected.go:196] Error preparing data for projected volume kube-api-access-8f2q4 for pod openshift-network-diagnostics/network-check-target-bx7w2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 19:10:56.932434 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:56.932362    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f989fafb-d7c2-4079-93ed-61da8f78e53b-kube-api-access-8f2q4 podName:f989fafb-d7c2-4079-93ed-61da8f78e53b nodeName:}" failed. No retries permitted until 2026-09-06 19:10:57.932342076 +0000 UTC m=+4.173227405 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8f2q4" (UniqueName: "kubernetes.io/projected/f989fafb-d7c2-4079-93ed-61da8f78e53b-kube-api-access-8f2q4") pod "network-check-target-bx7w2" (UID: "f989fafb-d7c2-4079-93ed-61da8f78e53b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 19:10:57.350251 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:57.350168    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-05 19:05:56 +0000 UTC" deadline="2028-02-16 05:06:26.11384067 +0000 UTC"
Sep 06 19:10:57.350251 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:57.350214    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12657h55m28.763631421s"
Sep 06 19:10:57.409756 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:57.409681    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-d7s2q" event={"ID":"1dcb8c05-bebe-4e55-bee3-fcda70b424b4","Type":"ContainerStarted","Data":"2dae909a8bf748e5a23575c099565549c94cf4f1ae9e6b4138969e25a076dc8c"}
Sep 06 19:10:57.414798 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:57.414654    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qrlmt" event={"ID":"a436d469-ee20-4169-b87d-676eeb7210cf","Type":"ContainerStarted","Data":"61ec30e224cd978a4b1d959bbf0deab97564cfc67e6bb8ba59cc6095f3d6ddb5"}
Sep 06 19:10:57.421823 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:57.421761    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fxkhd" event={"ID":"00c5b89b-8ae6-4d75-9906-3b0ed677d9b2","Type":"ContainerStarted","Data":"0c71c6913cf386c9d4b17d16dd46ba79a556f259a118b9bd4593ec8f1a343d20"}
Sep 06 19:10:57.424826 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:57.424801    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xx8sw" event={"ID":"85954a2a-213c-4053-86bd-8ea8a7126d88","Type":"ContainerStarted","Data":"64ad5645788f75ff52540078a67175dd9d4b756db4afb1dbb8116026229412c5"}
Sep 06 19:10:57.437879 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:57.437842    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhmxz" event={"ID":"ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d","Type":"ContainerStarted","Data":"a3ee016e5393c9fcd44ea00378ca9e14fc968bdfae129e72e48c4e94a6bb8370"}
Sep 06 19:10:57.439963 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:57.439937    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q6xzx" event={"ID":"d77df511-1f2b-4241-a1eb-8b46deadea8d","Type":"ContainerStarted","Data":"b97d8b7892a8dfa35be7e4ab2e6dd187b133aded477154aa3b28dfa03cca4689"}
Sep 06 19:10:57.445917 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:57.445887    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2" event={"ID":"51e51b01-c5d9-4723-b198-72fc8c1ae0b0","Type":"ContainerStarted","Data":"2c34f1d78ed2e4b736ac86d057891e55a55e422a492e6396aa6941a1d4146189"}
Sep 06 19:10:57.454997 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:57.454969    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pz2qc" event={"ID":"ee3f065a-5f47-4351-9d60-ffbbf765e1b6","Type":"ContainerStarted","Data":"a4f615d62ba0f92b7a74364c146ed7d8c0999b66c0c997475562efcf7642291b"}
Sep 06 19:10:57.457561 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:57.457527    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l5h99" event={"ID":"9cdb696e-5c36-4c08-931f-b7fb59581f94","Type":"ContainerStarted","Data":"aaddcd17d7b400a64a118b272a6839b5d66f34cc1a61b7f6d41278e537549aaf"}
Sep 06 19:10:57.837886 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:57.837854    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f48c221-e457-4c65-b433-902fa3a75f09-metrics-certs\") pod \"network-metrics-daemon-vzktl\" (UID: \"2f48c221-e457-4c65-b433-902fa3a75f09\") " pod="openshift-multus/network-metrics-daemon-vzktl"
Sep 06 19:10:57.838017 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:57.837926    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d89b285b-cadd-4b89-be22-17b20170f51c-original-pull-secret\") pod \"global-pull-secret-syncer-dtlr6\" (UID: \"d89b285b-cadd-4b89-be22-17b20170f51c\") " pod="kube-system/global-pull-secret-syncer-dtlr6"
Sep 06 19:10:57.838090 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:57.838068    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 19:10:57.838144 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:57.838131    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d89b285b-cadd-4b89-be22-17b20170f51c-original-pull-secret podName:d89b285b-cadd-4b89-be22-17b20170f51c nodeName:}" failed. No retries permitted until 2026-09-06 19:10:59.838111524 +0000 UTC m=+6.078996863 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d89b285b-cadd-4b89-be22-17b20170f51c-original-pull-secret") pod "global-pull-secret-syncer-dtlr6" (UID: "d89b285b-cadd-4b89-be22-17b20170f51c") : object "kube-system"/"original-pull-secret" not registered
Sep 06 19:10:57.838576 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:57.838537    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 19:10:57.838715 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:57.838624    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f48c221-e457-4c65-b433-902fa3a75f09-metrics-certs podName:2f48c221-e457-4c65-b433-902fa3a75f09 nodeName:}" failed. No retries permitted until 2026-09-06 19:10:59.838596466 +0000 UTC m=+6.079481796 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f48c221-e457-4c65-b433-902fa3a75f09-metrics-certs") pod "network-metrics-daemon-vzktl" (UID: "2f48c221-e457-4c65-b433-902fa3a75f09") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 19:10:57.939617 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:57.939524    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f2q4\" (UniqueName: \"kubernetes.io/projected/f989fafb-d7c2-4079-93ed-61da8f78e53b-kube-api-access-8f2q4\") pod \"network-check-target-bx7w2\" (UID: \"f989fafb-d7c2-4079-93ed-61da8f78e53b\") " pod="openshift-network-diagnostics/network-check-target-bx7w2"
Sep 06 19:10:57.943561 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:57.943521    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 19:10:57.943561 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:57.943559    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 19:10:57.943768 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:57.943576    2577 projected.go:196] Error preparing data for projected volume kube-api-access-8f2q4 for pod openshift-network-diagnostics/network-check-target-bx7w2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 19:10:57.943768 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:57.943655    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f989fafb-d7c2-4079-93ed-61da8f78e53b-kube-api-access-8f2q4 podName:f989fafb-d7c2-4079-93ed-61da8f78e53b nodeName:}" failed. No retries permitted until 2026-09-06 19:10:59.943634265 +0000 UTC m=+6.184519594 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8f2q4" (UniqueName: "kubernetes.io/projected/f989fafb-d7c2-4079-93ed-61da8f78e53b-kube-api-access-8f2q4") pod "network-check-target-bx7w2" (UID: "f989fafb-d7c2-4079-93ed-61da8f78e53b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 19:10:58.385777 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:58.385679    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzktl"
Sep 06 19:10:58.386444 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:58.385867    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzktl" podUID="2f48c221-e457-4c65-b433-902fa3a75f09"
Sep 06 19:10:58.386444 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:58.386337    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bx7w2"
Sep 06 19:10:58.386444 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:58.386431    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bx7w2" podUID="f989fafb-d7c2-4079-93ed-61da8f78e53b"
Sep 06 19:10:58.386653 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:58.386492    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtlr6"
Sep 06 19:10:58.387072 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:58.387045    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtlr6" podUID="d89b285b-cadd-4b89-be22-17b20170f51c"
Sep 06 19:10:58.473497 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:58.473381    2577 generic.go:356] "Generic (PLEG): container finished" podID="7c9c7b18f6dc58d7d47ef7d8bc6dcd79" containerID="b983bfd0c0745ed6e74233a07500e7561939fa5416916803ea6ce3e73ae57457" exitCode=0
Sep 06 19:10:58.473497 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:58.473439    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-37.ec2.internal" event={"ID":"7c9c7b18f6dc58d7d47ef7d8bc6dcd79","Type":"ContainerDied","Data":"b983bfd0c0745ed6e74233a07500e7561939fa5416916803ea6ce3e73ae57457"}
Sep 06 19:10:59.529479 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:59.528742    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-37.ec2.internal" event={"ID":"7c9c7b18f6dc58d7d47ef7d8bc6dcd79","Type":"ContainerStarted","Data":"030c605360989a924379d3e94713a8916f6aad29636516444107414241aefef5"}
Sep 06 19:10:59.855444 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:59.855332    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f48c221-e457-4c65-b433-902fa3a75f09-metrics-certs\") pod \"network-metrics-daemon-vzktl\" (UID: \"2f48c221-e457-4c65-b433-902fa3a75f09\") " pod="openshift-multus/network-metrics-daemon-vzktl"
Sep 06 19:10:59.855444 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:59.855405    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d89b285b-cadd-4b89-be22-17b20170f51c-original-pull-secret\") pod \"global-pull-secret-syncer-dtlr6\" (UID: \"d89b285b-cadd-4b89-be22-17b20170f51c\") " pod="kube-system/global-pull-secret-syncer-dtlr6"
Sep 06 19:10:59.855697 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:59.855573    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 19:10:59.855697 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:59.855637    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d89b285b-cadd-4b89-be22-17b20170f51c-original-pull-secret podName:d89b285b-cadd-4b89-be22-17b20170f51c nodeName:}" failed. No retries permitted until 2026-09-06 19:11:03.855618963 +0000 UTC m=+10.096504302 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d89b285b-cadd-4b89-be22-17b20170f51c-original-pull-secret") pod "global-pull-secret-syncer-dtlr6" (UID: "d89b285b-cadd-4b89-be22-17b20170f51c") : object "kube-system"/"original-pull-secret" not registered
Sep 06 19:10:59.856071 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:59.856051    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 19:10:59.856158 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:59.856108    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f48c221-e457-4c65-b433-902fa3a75f09-metrics-certs podName:2f48c221-e457-4c65-b433-902fa3a75f09 nodeName:}" failed. No retries permitted until 2026-09-06 19:11:03.856093109 +0000 UTC m=+10.096978442 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f48c221-e457-4c65-b433-902fa3a75f09-metrics-certs") pod "network-metrics-daemon-vzktl" (UID: "2f48c221-e457-4c65-b433-902fa3a75f09") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 19:10:59.956205 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:10:59.956165    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f2q4\" (UniqueName: \"kubernetes.io/projected/f989fafb-d7c2-4079-93ed-61da8f78e53b-kube-api-access-8f2q4\") pod \"network-check-target-bx7w2\" (UID: \"f989fafb-d7c2-4079-93ed-61da8f78e53b\") " pod="openshift-network-diagnostics/network-check-target-bx7w2"
Sep 06 19:10:59.956394 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:59.956370    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 19:10:59.956394 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:59.956391    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 19:10:59.956502 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:59.956404    2577 projected.go:196] Error preparing data for projected volume kube-api-access-8f2q4 for pod openshift-network-diagnostics/network-check-target-bx7w2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 19:10:59.956502 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:10:59.956468    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f989fafb-d7c2-4079-93ed-61da8f78e53b-kube-api-access-8f2q4 podName:f989fafb-d7c2-4079-93ed-61da8f78e53b nodeName:}" failed. No retries permitted until 2026-09-06 19:11:03.956446 +0000 UTC m=+10.197331339 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8f2q4" (UniqueName: "kubernetes.io/projected/f989fafb-d7c2-4079-93ed-61da8f78e53b-kube-api-access-8f2q4") pod "network-check-target-bx7w2" (UID: "f989fafb-d7c2-4079-93ed-61da8f78e53b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 19:11:00.382770 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:00.382736    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzktl"
Sep 06 19:11:00.382964 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:00.382898    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzktl" podUID="2f48c221-e457-4c65-b433-902fa3a75f09"
Sep 06 19:11:00.383354 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:00.383334    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bx7w2"
Sep 06 19:11:00.383465 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:00.383443    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bx7w2" podUID="f989fafb-d7c2-4079-93ed-61da8f78e53b"
Sep 06 19:11:00.383750 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:00.383609    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtlr6"
Sep 06 19:11:00.383750 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:00.383712    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtlr6" podUID="d89b285b-cadd-4b89-be22-17b20170f51c"
Sep 06 19:11:02.382459 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:02.382358    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bx7w2"
Sep 06 19:11:02.382459 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:02.382381    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzktl"
Sep 06 19:11:02.382459 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:02.382399    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtlr6"
Sep 06 19:11:02.383050 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:02.382558    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bx7w2" podUID="f989fafb-d7c2-4079-93ed-61da8f78e53b"
Sep 06 19:11:02.383050 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:02.383023    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzktl" podUID="2f48c221-e457-4c65-b433-902fa3a75f09"
Sep 06 19:11:02.383166 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:02.383117    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtlr6" podUID="d89b285b-cadd-4b89-be22-17b20170f51c"
Sep 06 19:11:03.889312 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:03.889051    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d89b285b-cadd-4b89-be22-17b20170f51c-original-pull-secret\") pod \"global-pull-secret-syncer-dtlr6\" (UID: \"d89b285b-cadd-4b89-be22-17b20170f51c\") " pod="kube-system/global-pull-secret-syncer-dtlr6"
Sep 06 19:11:03.889312 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:03.889145    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f48c221-e457-4c65-b433-902fa3a75f09-metrics-certs\") pod \"network-metrics-daemon-vzktl\" (UID: \"2f48c221-e457-4c65-b433-902fa3a75f09\") " pod="openshift-multus/network-metrics-daemon-vzktl"
Sep 06 19:11:03.889312 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:03.889225    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 19:11:03.889312 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:03.889256    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 19:11:03.889312 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:03.889307    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d89b285b-cadd-4b89-be22-17b20170f51c-original-pull-secret podName:d89b285b-cadd-4b89-be22-17b20170f51c nodeName:}" failed. No retries permitted until 2026-09-06 19:11:11.88928351 +0000 UTC m=+18.130168845 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d89b285b-cadd-4b89-be22-17b20170f51c-original-pull-secret") pod "global-pull-secret-syncer-dtlr6" (UID: "d89b285b-cadd-4b89-be22-17b20170f51c") : object "kube-system"/"original-pull-secret" not registered
Sep 06 19:11:03.889906 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:03.889330    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f48c221-e457-4c65-b433-902fa3a75f09-metrics-certs podName:2f48c221-e457-4c65-b433-902fa3a75f09 nodeName:}" failed. No retries permitted until 2026-09-06 19:11:11.889318311 +0000 UTC m=+18.130203636 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f48c221-e457-4c65-b433-902fa3a75f09-metrics-certs") pod "network-metrics-daemon-vzktl" (UID: "2f48c221-e457-4c65-b433-902fa3a75f09") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 19:11:03.990231 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:03.989614    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f2q4\" (UniqueName: \"kubernetes.io/projected/f989fafb-d7c2-4079-93ed-61da8f78e53b-kube-api-access-8f2q4\") pod \"network-check-target-bx7w2\" (UID: \"f989fafb-d7c2-4079-93ed-61da8f78e53b\") " pod="openshift-network-diagnostics/network-check-target-bx7w2"
Sep 06 19:11:03.990231 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:03.989781    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 19:11:03.990231 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:03.989806    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 19:11:03.990231 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:03.989819    2577 projected.go:196] Error preparing data for projected volume kube-api-access-8f2q4 for pod openshift-network-diagnostics/network-check-target-bx7w2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 19:11:03.990231 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:03.989874    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f989fafb-d7c2-4079-93ed-61da8f78e53b-kube-api-access-8f2q4 podName:f989fafb-d7c2-4079-93ed-61da8f78e53b nodeName:}" failed. No retries permitted until 2026-09-06 19:11:11.989855036 +0000 UTC m=+18.230740380 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8f2q4" (UniqueName: "kubernetes.io/projected/f989fafb-d7c2-4079-93ed-61da8f78e53b-kube-api-access-8f2q4") pod "network-check-target-bx7w2" (UID: "f989fafb-d7c2-4079-93ed-61da8f78e53b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 19:11:04.385138 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:04.384892    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtlr6"
Sep 06 19:11:04.385138 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:04.385027    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtlr6" podUID="d89b285b-cadd-4b89-be22-17b20170f51c"
Sep 06 19:11:04.385449 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:04.385427    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzktl"
Sep 06 19:11:04.385599 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:04.385571    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzktl" podUID="2f48c221-e457-4c65-b433-902fa3a75f09"
Sep 06 19:11:04.385827 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:04.385670    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bx7w2"
Sep 06 19:11:04.385827 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:04.385782    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bx7w2" podUID="f989fafb-d7c2-4079-93ed-61da8f78e53b"
Sep 06 19:11:06.382657 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:06.382619    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtlr6"
Sep 06 19:11:06.383124 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:06.383089    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtlr6" podUID="d89b285b-cadd-4b89-be22-17b20170f51c"
Sep 06 19:11:06.383197 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:06.383177    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzktl"
Sep 06 19:11:06.383351 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:06.383325    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzktl" podUID="2f48c221-e457-4c65-b433-902fa3a75f09"
Sep 06 19:11:06.383426 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:06.383394    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bx7w2"
Sep 06 19:11:06.383620 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:06.383589    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bx7w2" podUID="f989fafb-d7c2-4079-93ed-61da8f78e53b"
Sep 06 19:11:08.382203 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:08.382168    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bx7w2"
Sep 06 19:11:08.382203 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:08.382188    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzktl"
Sep 06 19:11:08.382203 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:08.382189    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtlr6"
Sep 06 19:11:08.382782 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:08.382281    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bx7w2" podUID="f989fafb-d7c2-4079-93ed-61da8f78e53b"
Sep 06 19:11:08.382782 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:08.382381    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzktl" podUID="2f48c221-e457-4c65-b433-902fa3a75f09"
Sep 06 19:11:08.382782 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:08.382479    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtlr6" podUID="d89b285b-cadd-4b89-be22-17b20170f51c"
Sep 06 19:11:10.382119 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:10.382083    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzktl"
Sep 06 19:11:10.382580 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:10.382083    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bx7w2"
Sep 06 19:11:10.382580 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:10.382214    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzktl" podUID="2f48c221-e457-4c65-b433-902fa3a75f09"
Sep 06 19:11:10.382580 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:10.382257    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bx7w2" podUID="f989fafb-d7c2-4079-93ed-61da8f78e53b"
Sep 06 19:11:10.382580 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:10.382084    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtlr6"
Sep 06 19:11:10.382580 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:10.382332    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtlr6" podUID="d89b285b-cadd-4b89-be22-17b20170f51c"
Sep 06 19:11:11.952304 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:11.952277    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f48c221-e457-4c65-b433-902fa3a75f09-metrics-certs\") pod \"network-metrics-daemon-vzktl\" (UID: \"2f48c221-e457-4c65-b433-902fa3a75f09\") " pod="openshift-multus/network-metrics-daemon-vzktl"
Sep 06 19:11:11.952663 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:11.952321    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d89b285b-cadd-4b89-be22-17b20170f51c-original-pull-secret\") pod \"global-pull-secret-syncer-dtlr6\" (UID: \"d89b285b-cadd-4b89-be22-17b20170f51c\") " pod="kube-system/global-pull-secret-syncer-dtlr6"
Sep 06 19:11:11.952663 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:11.952410    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 19:11:11.952663 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:11.952444    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 19:11:11.952663 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:11.952458    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d89b285b-cadd-4b89-be22-17b20170f51c-original-pull-secret podName:d89b285b-cadd-4b89-be22-17b20170f51c nodeName:}" failed. No retries permitted until 2026-09-06 19:11:27.952441416 +0000 UTC m=+34.193326756 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d89b285b-cadd-4b89-be22-17b20170f51c-original-pull-secret") pod "global-pull-secret-syncer-dtlr6" (UID: "d89b285b-cadd-4b89-be22-17b20170f51c") : object "kube-system"/"original-pull-secret" not registered
Sep 06 19:11:11.952663 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:11.952545    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f48c221-e457-4c65-b433-902fa3a75f09-metrics-certs podName:2f48c221-e457-4c65-b433-902fa3a75f09 nodeName:}" failed. No retries permitted until 2026-09-06 19:11:27.952530195 +0000 UTC m=+34.193415529 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f48c221-e457-4c65-b433-902fa3a75f09-metrics-certs") pod "network-metrics-daemon-vzktl" (UID: "2f48c221-e457-4c65-b433-902fa3a75f09") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 19:11:12.053149 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:12.053116    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f2q4\" (UniqueName: \"kubernetes.io/projected/f989fafb-d7c2-4079-93ed-61da8f78e53b-kube-api-access-8f2q4\") pod \"network-check-target-bx7w2\" (UID: \"f989fafb-d7c2-4079-93ed-61da8f78e53b\") " pod="openshift-network-diagnostics/network-check-target-bx7w2"
Sep 06 19:11:12.053291 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:12.053274    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 19:11:12.053332 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:12.053293    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 19:11:12.053332 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:12.053303    2577 projected.go:196] Error preparing data for projected volume kube-api-access-8f2q4 for pod openshift-network-diagnostics/network-check-target-bx7w2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 19:11:12.053404 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:12.053354    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f989fafb-d7c2-4079-93ed-61da8f78e53b-kube-api-access-8f2q4 podName:f989fafb-d7c2-4079-93ed-61da8f78e53b nodeName:}" failed. No retries permitted until 2026-09-06 19:11:28.053340563 +0000 UTC m=+34.294225889 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8f2q4" (UniqueName: "kubernetes.io/projected/f989fafb-d7c2-4079-93ed-61da8f78e53b-kube-api-access-8f2q4") pod "network-check-target-bx7w2" (UID: "f989fafb-d7c2-4079-93ed-61da8f78e53b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 19:11:12.382802 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:12.382716    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzktl"
Sep 06 19:11:12.382962 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:12.382716    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtlr6"
Sep 06 19:11:12.382962 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:12.382857    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzktl" podUID="2f48c221-e457-4c65-b433-902fa3a75f09"
Sep 06 19:11:12.382962 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:12.382868    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bx7w2"
Sep 06 19:11:12.383136 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:12.382966    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtlr6" podUID="d89b285b-cadd-4b89-be22-17b20170f51c"
Sep 06 19:11:12.383136 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:12.383053    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bx7w2" podUID="f989fafb-d7c2-4079-93ed-61da8f78e53b"
Sep 06 19:11:14.382870 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:14.382661    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzktl"
Sep 06 19:11:14.383305 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:14.382733    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bx7w2"
Sep 06 19:11:14.383305 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:14.382951    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzktl" podUID="2f48c221-e457-4c65-b433-902fa3a75f09"
Sep 06 19:11:14.383305 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:14.382758    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtlr6"
Sep 06 19:11:14.383305 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:14.383023    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bx7w2" podUID="f989fafb-d7c2-4079-93ed-61da8f78e53b"
Sep 06 19:11:14.383305 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:14.383102    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtlr6" podUID="d89b285b-cadd-4b89-be22-17b20170f51c"
Sep 06 19:11:16.382348 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:16.382158    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bx7w2"
Sep 06 19:11:16.383071 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:16.382161    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtlr6"
Sep 06 19:11:16.383071 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:16.382418    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bx7w2" podUID="f989fafb-d7c2-4079-93ed-61da8f78e53b"
Sep 06 19:11:16.383071 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:16.382334    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzktl"
Sep 06 19:11:16.383071 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:16.382543    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtlr6" podUID="d89b285b-cadd-4b89-be22-17b20170f51c"
Sep 06 19:11:16.383071 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:16.382649    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzktl" podUID="2f48c221-e457-4c65-b433-902fa3a75f09"
Sep 06 19:11:16.564410 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:16.564378    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q6xzx" event={"ID":"d77df511-1f2b-4241-a1eb-8b46deadea8d","Type":"ContainerStarted","Data":"6c14278eadaa85052b0e4c4b0d2c7e334045451886c57f61a78a5ba18f5efe05"}
Sep 06 19:11:16.567680 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:16.567651    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2" event={"ID":"51e51b01-c5d9-4723-b198-72fc8c1ae0b0","Type":"ContainerStarted","Data":"7348dabca75ae926e6eabb2dc287fa174ad86233e6eead239e9610723def4543"}
Sep 06 19:11:16.567815 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:16.567738    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2" event={"ID":"51e51b01-c5d9-4723-b198-72fc8c1ae0b0","Type":"ContainerStarted","Data":"506320e0f6739aa0b5f6346208058038b27746d02c7d6cf478ac176b9eab2e71"}
Sep 06 19:11:16.567815 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:16.567801    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2" event={"ID":"51e51b01-c5d9-4723-b198-72fc8c1ae0b0","Type":"ContainerStarted","Data":"9db813ea452e223f11ea10f32cb7e6d3c7ce9a5b11525297454e9386bba2fbdd"}
Sep 06 19:11:16.567919 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:16.567852    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2" event={"ID":"51e51b01-c5d9-4723-b198-72fc8c1ae0b0","Type":"ContainerStarted","Data":"c40ec081c88d41c701c88772e03d8356b976e509cc764bfec0b2bc93c6a57107"}
Sep 06 19:11:16.567959 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:16.567919    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2" event={"ID":"51e51b01-c5d9-4723-b198-72fc8c1ae0b0","Type":"ContainerStarted","Data":"de37658b9cdbd128e8d895b5afce0ca8df540706bd939df47417bfa79c87e9af"}
Sep 06 19:11:16.568003 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:16.567968    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2" event={"ID":"51e51b01-c5d9-4723-b198-72fc8c1ae0b0","Type":"ContainerStarted","Data":"473b5e0c9376aa695ae3b7d89b2b7f88184c0d08a3d08c178092533c6ce6357c"}
Sep 06 19:11:16.569286 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:16.569258    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pz2qc" event={"ID":"ee3f065a-5f47-4351-9d60-ffbbf765e1b6","Type":"ContainerStarted","Data":"73f17c91b72f3cb85c6e2b9091059b6bcbc125074e3cf32c329e8be4e9e06d23"}
Sep 06 19:11:16.570905 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:16.570880    2577 generic.go:356] "Generic (PLEG): container finished" podID="9cdb696e-5c36-4c08-931f-b7fb59581f94" containerID="8dfe81b94b3780bf994bc17cdf4b5278e799fbbbba37af4b26ac0814c4ab06a5" exitCode=0
Sep 06 19:11:16.570981 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:16.570961    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l5h99" event={"ID":"9cdb696e-5c36-4c08-931f-b7fb59581f94","Type":"ContainerDied","Data":"8dfe81b94b3780bf994bc17cdf4b5278e799fbbbba37af4b26ac0814c4ab06a5"}
Sep 06 19:11:16.572657 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:16.572637    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-d7s2q" event={"ID":"1dcb8c05-bebe-4e55-bee3-fcda70b424b4","Type":"ContainerStarted","Data":"a7f6effd81e570045ff93ad3571250fda9876af0010e2be745d15cb610c2d32b"}
Sep 06 19:11:16.574411 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:16.574386    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fxkhd" event={"ID":"00c5b89b-8ae6-4d75-9906-3b0ed677d9b2","Type":"ContainerStarted","Data":"00c80802dd1baecaf4bd2bdc6d3f7bc12d040adc8965c3722bb4e8ec91d7b380"}
Sep 06 19:11:16.575946 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:16.575918    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-37.ec2.internal" event={"ID":"6ec9d6b0deae2fcae3f224177b618fa3","Type":"ContainerStarted","Data":"8237d4f9ff494eb669e200405498a8f75c37529e6d0f38f2880574a8fa035153"}
Sep 06 19:11:16.577497 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:16.577439    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-q6xzx" podStartSLOduration=2.199477521 podStartE2EDuration="21.57742906s" totalImagesPullingTime="19.377951539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:10:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:11:16.577202282 +0000 UTC m=+22.818087628" watchObservedRunningTime="2026-09-06 19:11:16.57742906 +0000 UTC m=+22.818314407"
Sep 06 19:11:16.577780 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:16.577745    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-37.ec2.internal" podStartSLOduration=20.577735213 podStartE2EDuration="20.577735213s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 19:10:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:10:59.545879694 +0000 UTC m=+5.786765062" watchObservedRunningTime="2026-09-06 19:11:16.577735213 +0000 UTC m=+22.818620559"
Sep 06 19:11:16.578109 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:16.578088    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xx8sw" event={"ID":"85954a2a-213c-4053-86bd-8ea8a7126d88","Type":"ContainerStarted","Data":"14e4eab5a69d262382c9bbf03354fb7750cf4a1066e945db20ed2ed8e34d183f"}
Sep 06 19:11:16.579653 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:16.579634    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhmxz" event={"ID":"ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d","Type":"ContainerStarted","Data":"19e93bc5bf1ea9b4fd30137860364971a815fcfa48a8020e0824ca37ea4837d6"}
Sep 06 19:11:16.609092 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:16.609055    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-37.ec2.internal" podStartSLOduration=20.609042436 podStartE2EDuration="20.609042436s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 19:10:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:11:16.608538183 +0000 UTC m=+22.849423527" watchObservedRunningTime="2026-09-06 19:11:16.609042436 +0000 UTC m=+22.849927782"
Sep 06 19:11:16.619533 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:16.619497    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fxkhd" podStartSLOduration=2.218547692 podStartE2EDuration="21.619487727s" totalImagesPullingTime="19.400940035s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 19:10:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:11:16.619283129 +0000 UTC m=+22.860168474" watchObservedRunningTime="2026-09-06 19:11:16.619487727 +0000 UTC m=+22.860373064"
Sep 06 19:11:16.632952 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:16.632920    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pz2qc" podStartSLOduration=2.193672362 podStartE2EDuration="21.632910463s" totalImagesPullingTime="19.439238101s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 19:10:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:11:16.632853467 +0000 UTC m=+22.873738827" watchObservedRunningTime="2026-09-06 19:11:16.632910463 +0000 UTC m=+22.873795808"
Sep 06 19:11:16.649096 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:16.649040    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-d7s2q" podStartSLOduration=2.270448121 podStartE2EDuration="21.649029886s" totalImagesPullingTime="19.378581765s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 19:10:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:11:16.648626408 +0000 UTC m=+22.889511752" watchObservedRunningTime="2026-09-06 19:11:16.649029886 +0000 UTC m=+22.889915230"
Sep 06 19:11:16.669731 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:16.669698    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xx8sw" podStartSLOduration=2.216441949 podStartE2EDuration="21.6696863s" totalImagesPullingTime="19.453244351s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 19:10:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:11:16.667448589 +0000 UTC m=+22.908333935" watchObservedRunningTime="2026-09-06 19:11:16.6696863 +0000 UTC m=+22.910571646"
Sep 06 19:11:17.583903 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:17.583655    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qrlmt" event={"ID":"a436d469-ee20-4169-b87d-676eeb7210cf","Type":"ContainerStarted","Data":"561225cd98a8a6d36fde04c8eedfc53f59f3486058d6ef0b10259aa8b90aa714"}
Sep 06 19:11:17.596943 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:17.596882    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qrlmt" podStartSLOduration=3.202417014 podStartE2EDuration="22.596861063s" totalImagesPullingTime="19.394444049s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 19:10:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:11:17.596594393 +0000 UTC m=+23.837479738" watchObservedRunningTime="2026-09-06 19:11:17.596861063 +0000 UTC m=+23.837746410"
Sep 06 19:11:17.638151 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:17.638122    2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 06 19:11:18.382584 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:18.382544    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzktl"
Sep 06 19:11:18.382840 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:18.382544    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bx7w2"
Sep 06 19:11:18.382840 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:18.382698    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtlr6"
Sep 06 19:11:18.382840 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:18.382716    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzktl" podUID="2f48c221-e457-4c65-b433-902fa3a75f09"
Sep 06 19:11:18.382840 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:18.382787    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtlr6" podUID="d89b285b-cadd-4b89-be22-17b20170f51c"
Sep 06 19:11:18.382995 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:18.382858    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bx7w2" podUID="f989fafb-d7c2-4079-93ed-61da8f78e53b"
Sep 06 19:11:18.393415 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:18.393312    2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-06T19:11:17.638143601Z","UUID":"5ccbf6c6-4441-4354-a0f8-5d4adb9a0c5d","Handler":null,"Name":"","Endpoint":""}
Sep 06 19:11:18.395317 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:18.395288    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 06 19:11:18.395442 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:18.395325    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 06 19:11:18.588495 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:18.588449    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhmxz" event={"ID":"ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d","Type":"ContainerStarted","Data":"a809fa22fd709b0116eb113c89710874748c358407582182c98d5b050a15e036"}
Sep 06 19:11:19.593405 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:19.593372    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhmxz" event={"ID":"ff0e4adc-08a4-4f31-bc23-b2e5862d2d9d","Type":"ContainerStarted","Data":"3e8da3d69dea2b446a4f516fe4c29da269cbf8bbafd1c135a37f514bac67eef2"}
Sep 06 19:11:19.599980 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:19.597668    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2" event={"ID":"51e51b01-c5d9-4723-b198-72fc8c1ae0b0","Type":"ContainerStarted","Data":"1211ec8f28e75a994b7d6898408210fb740bf42cf8554e8f61fe85c35e051d35"}
Sep 06 19:11:19.609027 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:19.608978    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhmxz" podStartSLOduration=2.189318847 podStartE2EDuration="24.608964554s" totalImagesPullingTime="22.419645707s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 19:10:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:11:19.608842513 +0000 UTC m=+25.849727861" watchObservedRunningTime="2026-09-06 19:11:19.608964554 +0000 UTC m=+25.849849898"
Sep 06 19:11:20.381854 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:20.381814    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtlr6"
Sep 06 19:11:20.381854 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:20.381830    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzktl"
Sep 06 19:11:20.382046 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:20.381920    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtlr6" podUID="d89b285b-cadd-4b89-be22-17b20170f51c"
Sep 06 19:11:20.382222 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:20.382202    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bx7w2"
Sep 06 19:11:20.382354 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:20.382316    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bx7w2" podUID="f989fafb-d7c2-4079-93ed-61da8f78e53b"
Sep 06 19:11:20.382354 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:20.382350    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzktl" podUID="2f48c221-e457-4c65-b433-902fa3a75f09"
Sep 06 19:11:21.444370 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:21.444348    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-q6xzx"
Sep 06 19:11:21.444857 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:21.444837    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-q6xzx"
Sep 06 19:11:21.606999 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:21.606817    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2" event={"ID":"51e51b01-c5d9-4723-b198-72fc8c1ae0b0","Type":"ContainerStarted","Data":"c0bf7794e059e59bb08403eefe5f0e4fa7d467aefbf9d7a98cf4e5866ea3e48d"}
Sep 06 19:11:21.607231 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:21.607200    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-q6xzx"
Sep 06 19:11:21.607664 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:21.607647    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-q6xzx"
Sep 06 19:11:21.628533 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:21.628464    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2" podStartSLOduration=7.185092654 podStartE2EDuration="26.628445955s" totalImagesPullingTime="19.443353301s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 19:10:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:11:21.6279404 +0000 UTC m=+27.868825768" watchObservedRunningTime="2026-09-06 19:11:21.628445955 +0000 UTC m=+27.869331299"
Sep 06 19:11:22.381819 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:22.381784    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtlr6"
Sep 06 19:11:22.382009 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:22.381794    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzktl"
Sep 06 19:11:22.382009 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:22.381905    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtlr6" podUID="d89b285b-cadd-4b89-be22-17b20170f51c"
Sep 06 19:11:22.382009 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:22.381918    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bx7w2"
Sep 06 19:11:22.382174 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:22.382022    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzktl" podUID="2f48c221-e457-4c65-b433-902fa3a75f09"
Sep 06 19:11:22.382174 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:22.382111    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bx7w2" podUID="f989fafb-d7c2-4079-93ed-61da8f78e53b"
Sep 06 19:11:22.610414 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:22.610384    2577 generic.go:356] "Generic (PLEG): container finished" podID="9cdb696e-5c36-4c08-931f-b7fb59581f94" containerID="d8e4ed8c3c8084e6ff0af571401655f6e148d7c2c521b16b6da0dd21dd530113" exitCode=0
Sep 06 19:11:22.611007 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:22.610487    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l5h99" event={"ID":"9cdb696e-5c36-4c08-931f-b7fb59581f94","Type":"ContainerDied","Data":"d8e4ed8c3c8084e6ff0af571401655f6e148d7c2c521b16b6da0dd21dd530113"}
Sep 06 19:11:22.611007 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:22.610929    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:11:22.611007 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:22.611001    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:11:22.611284 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:22.611180    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:11:22.626846 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:22.626822    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:11:22.627040 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:22.626954    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:11:23.331487 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:23.331432    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dtlr6"]
Sep 06 19:11:23.331665 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:23.331564    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtlr6"
Sep 06 19:11:23.331718 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:23.331656    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtlr6" podUID="d89b285b-cadd-4b89-be22-17b20170f51c"
Sep 06 19:11:23.334796 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:23.334771    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bx7w2"]
Sep 06 19:11:23.334909 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:23.334865    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bx7w2"
Sep 06 19:11:23.334971 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:23.334950    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bx7w2" podUID="f989fafb-d7c2-4079-93ed-61da8f78e53b"
Sep 06 19:11:23.335509 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:23.335483    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vzktl"]
Sep 06 19:11:23.335627 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:23.335569    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzktl"
Sep 06 19:11:23.335688 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:23.335654    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzktl" podUID="2f48c221-e457-4c65-b433-902fa3a75f09"
Sep 06 19:11:25.382130 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:25.382081    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bx7w2"
Sep 06 19:11:25.382130 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:25.382117    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtlr6"
Sep 06 19:11:25.382130 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:25.382131    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzktl"
Sep 06 19:11:25.382802 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:25.382215    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bx7w2" podUID="f989fafb-d7c2-4079-93ed-61da8f78e53b"
Sep 06 19:11:25.382802 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:25.382283    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtlr6" podUID="d89b285b-cadd-4b89-be22-17b20170f51c"
Sep 06 19:11:25.382802 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:25.382356    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzktl" podUID="2f48c221-e457-4c65-b433-902fa3a75f09"
Sep 06 19:11:25.620220 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:25.619995    2577 generic.go:356] "Generic (PLEG): container finished" podID="9cdb696e-5c36-4c08-931f-b7fb59581f94" containerID="afa375ee7601d5d2c7a7cfdec31cd6d791036d372cf2c53dfc86b871eec42e87" exitCode=0
Sep 06 19:11:25.620396 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:25.620077    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l5h99" event={"ID":"9cdb696e-5c36-4c08-931f-b7fb59581f94","Type":"ContainerDied","Data":"afa375ee7601d5d2c7a7cfdec31cd6d791036d372cf2c53dfc86b871eec42e87"}
Sep 06 19:11:27.381769 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:27.381719    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bx7w2"
Sep 06 19:11:27.381769 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:27.381767    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtlr6"
Sep 06 19:11:27.381769 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:27.381771    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzktl"
Sep 06 19:11:27.382316 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:27.381847    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bx7w2" podUID="f989fafb-d7c2-4079-93ed-61da8f78e53b"
Sep 06 19:11:27.382316 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:27.381917    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtlr6" podUID="d89b285b-cadd-4b89-be22-17b20170f51c"
Sep 06 19:11:27.382316 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:27.381980    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzktl" podUID="2f48c221-e457-4c65-b433-902fa3a75f09"
Sep 06 19:11:27.628257 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:27.628171    2577 generic.go:356] "Generic (PLEG): container finished" podID="9cdb696e-5c36-4c08-931f-b7fb59581f94" containerID="bc925f40c1db3c88b4c45cbe5192123ac7e74bf72b31c1dc399446cacaeea42f" exitCode=0
Sep 06 19:11:27.628257 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:27.628233    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l5h99" event={"ID":"9cdb696e-5c36-4c08-931f-b7fb59581f94","Type":"ContainerDied","Data":"bc925f40c1db3c88b4c45cbe5192123ac7e74bf72b31c1dc399446cacaeea42f"}
Sep 06 19:11:27.967388 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:27.967301    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f48c221-e457-4c65-b433-902fa3a75f09-metrics-certs\") pod \"network-metrics-daemon-vzktl\" (UID: \"2f48c221-e457-4c65-b433-902fa3a75f09\") " pod="openshift-multus/network-metrics-daemon-vzktl"
Sep 06 19:11:27.967388 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:27.967352    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d89b285b-cadd-4b89-be22-17b20170f51c-original-pull-secret\") pod \"global-pull-secret-syncer-dtlr6\" (UID: \"d89b285b-cadd-4b89-be22-17b20170f51c\") " pod="kube-system/global-pull-secret-syncer-dtlr6"
Sep 06 19:11:27.967644 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:27.967439    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 19:11:27.967644 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:27.967439    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 19:11:27.967644 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:27.967517    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d89b285b-cadd-4b89-be22-17b20170f51c-original-pull-secret podName:d89b285b-cadd-4b89-be22-17b20170f51c nodeName:}" failed. No retries permitted until 2026-09-06 19:11:59.967499428 +0000 UTC m=+66.208384755 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d89b285b-cadd-4b89-be22-17b20170f51c-original-pull-secret") pod "global-pull-secret-syncer-dtlr6" (UID: "d89b285b-cadd-4b89-be22-17b20170f51c") : object "kube-system"/"original-pull-secret" not registered
Sep 06 19:11:27.967644 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:27.967547    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f48c221-e457-4c65-b433-902fa3a75f09-metrics-certs podName:2f48c221-e457-4c65-b433-902fa3a75f09 nodeName:}" failed. No retries permitted until 2026-09-06 19:11:59.96752815 +0000 UTC m=+66.208413483 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f48c221-e457-4c65-b433-902fa3a75f09-metrics-certs") pod "network-metrics-daemon-vzktl" (UID: "2f48c221-e457-4c65-b433-902fa3a75f09") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 19:11:28.068419 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:28.068383    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f2q4\" (UniqueName: \"kubernetes.io/projected/f989fafb-d7c2-4079-93ed-61da8f78e53b-kube-api-access-8f2q4\") pod \"network-check-target-bx7w2\" (UID: \"f989fafb-d7c2-4079-93ed-61da8f78e53b\") " pod="openshift-network-diagnostics/network-check-target-bx7w2"
Sep 06 19:11:28.068623 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:28.068572    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 19:11:28.068623 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:28.068593    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 19:11:28.068623 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:28.068605    2577 projected.go:196] Error preparing data for projected volume kube-api-access-8f2q4 for pod openshift-network-diagnostics/network-check-target-bx7w2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 19:11:28.068767 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:28.068662    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f989fafb-d7c2-4079-93ed-61da8f78e53b-kube-api-access-8f2q4 podName:f989fafb-d7c2-4079-93ed-61da8f78e53b nodeName:}" failed. No retries permitted until 2026-09-06 19:12:00.068643413 +0000 UTC m=+66.309528742 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8f2q4" (UniqueName: "kubernetes.io/projected/f989fafb-d7c2-4079-93ed-61da8f78e53b-kube-api-access-8f2q4") pod "network-check-target-bx7w2" (UID: "f989fafb-d7c2-4079-93ed-61da8f78e53b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 19:11:29.085911 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.085875    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-37.ec2.internal" event="NodeReady"
Sep 06 19:11:29.086334 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.086012    2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 06 19:11:29.117553 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.117520    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74d4ddf68d-vfcgt"]
Sep 06 19:11:29.120709 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.120673    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-g982h"]
Sep 06 19:11:29.120841 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.120727    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74d4ddf68d-vfcgt"
Sep 06 19:11:29.123556 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.123509    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 06 19:11:29.124239 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.124091    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 06 19:11:29.124239 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.124108    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 06 19:11:29.124239 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.124109    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 06 19:11:29.124541 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.124304    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-g982h"
Sep 06 19:11:29.124599 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.124304    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6964544647-pbxn2"]
Sep 06 19:11:29.125505 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.125313    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-jt8px\""
Sep 06 19:11:29.126532 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.126509    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 06 19:11:29.126776 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.126758    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 06 19:11:29.127175 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.127158    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-j6tpp\""
Sep 06 19:11:29.127890 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.127873    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cb66cd76-46xk5"]
Sep 06 19:11:29.128013 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.127996    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6964544647-pbxn2"
Sep 06 19:11:29.133993 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.133762    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 06 19:11:29.133993 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.133854    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cb66cd76-46xk5"
Sep 06 19:11:29.134122 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.134046    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 06 19:11:29.134177 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.133767    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f84cb857-z9fh7"]
Sep 06 19:11:29.134825 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.134510    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 06 19:11:29.134825 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.134669    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ptdbl\""
Sep 06 19:11:29.137117 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.136980    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 06 19:11:29.140180 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.140164    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 06 19:11:29.140264 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.140228    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74d4ddf68d-vfcgt"]
Sep 06 19:11:29.140264 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.140250    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jnw6x"]
Sep 06 19:11:29.140676 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.140562    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f84cb857-z9fh7"
Sep 06 19:11:29.143411 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.143331    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 06 19:11:29.143521 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.143441    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 06 19:11:29.143590 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.143352    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 06 19:11:29.143878 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.143857    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 06 19:11:29.144216 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.143953    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jnw6x"
Sep 06 19:11:29.144216 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.143886    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2s46l"]
Sep 06 19:11:29.145866 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.145844    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 06 19:11:29.146113 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.146097    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 06 19:11:29.146186 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.146130    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qk5sj\""
Sep 06 19:11:29.146283 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.146268    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 06 19:11:29.147530 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.147511    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-g982h"]
Sep 06 19:11:29.147620 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.147546    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cb66cd76-46xk5"]
Sep 06 19:11:29.147620 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.147568    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f84cb857-z9fh7"]
Sep 06 19:11:29.147620 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.147586    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6964544647-pbxn2"]
Sep 06 19:11:29.147786 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.147661    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2s46l"
Sep 06 19:11:29.149770 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.149753    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 06 19:11:29.150322 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.149759    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 06 19:11:29.150427 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.150283    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nxfsd\""
Sep 06 19:11:29.151322 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.151300    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2s46l"]
Sep 06 19:11:29.155679 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.155271    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jnw6x"]
Sep 06 19:11:29.277163 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.277132    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e3ab0344-ff86-4036-9813-69eddfa00b55-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-74d4ddf68d-vfcgt\" (UID: \"e3ab0344-ff86-4036-9813-69eddfa00b55\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74d4ddf68d-vfcgt"
Sep 06 19:11:29.277318 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.277167    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a29c8bfe-e1d3-45eb-9665-f7770cad94f3-klusterlet-config\") pod \"klusterlet-addon-workmgr-64cb66cd76-46xk5\" (UID: \"a29c8bfe-e1d3-45eb-9665-f7770cad94f3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cb66cd76-46xk5"
Sep 06 19:11:29.277318 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.277191    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f028f00d-b01c-42bf-babe-63aa84ea6b53-cert\") pod \"ingress-canary-jnw6x\" (UID: \"f028f00d-b01c-42bf-babe-63aa84ea6b53\") " pod="openshift-ingress-canary/ingress-canary-jnw6x"
Sep 06 19:11:29.277318 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.277240    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d59fb326-5ce6-4955-8d91-1c4f2dda0b15-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-g982h\" (UID: \"d59fb326-5ce6-4955-8d91-1c4f2dda0b15\") " pod="openshift-network-console/networking-console-plugin-79977f9844-g982h"
Sep 06 19:11:29.277420 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.277323    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bdd70125-96a1-41de-a36d-edec1a41e56b-trusted-ca\") pod \"image-registry-6964544647-pbxn2\" (UID: \"bdd70125-96a1-41de-a36d-edec1a41e56b\") " pod="openshift-image-registry/image-registry-6964544647-pbxn2"
Sep 06 19:11:29.277420 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.277367    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj8mh\" (UniqueName: \"kubernetes.io/projected/a29c8bfe-e1d3-45eb-9665-f7770cad94f3-kube-api-access-bj8mh\") pod \"klusterlet-addon-workmgr-64cb66cd76-46xk5\" (UID: \"a29c8bfe-e1d3-45eb-9665-f7770cad94f3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cb66cd76-46xk5"
Sep 06 19:11:29.277420 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.277407    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd2r7\" (UniqueName: \"kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-kube-api-access-fd2r7\") pod \"image-registry-6964544647-pbxn2\" (UID: \"bdd70125-96a1-41de-a36d-edec1a41e56b\") " pod="openshift-image-registry/image-registry-6964544647-pbxn2"
Sep 06 19:11:29.277540 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.277431    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d95lr\" (UniqueName: \"kubernetes.io/projected/e3ab0344-ff86-4036-9813-69eddfa00b55-kube-api-access-d95lr\") pod \"managed-serviceaccount-addon-agent-74d4ddf68d-vfcgt\" (UID: \"e3ab0344-ff86-4036-9813-69eddfa00b55\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74d4ddf68d-vfcgt"
Sep 06 19:11:29.277540 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.277457    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-registry-tls\") pod \"image-registry-6964544647-pbxn2\" (UID: \"bdd70125-96a1-41de-a36d-edec1a41e56b\") " pod="openshift-image-registry/image-registry-6964544647-pbxn2"
Sep 06 19:11:29.277540 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.277508    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/20a52446-bfd0-4bf5-a34c-5f930c3f5833-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-f84cb857-z9fh7\" (UID: \"20a52446-bfd0-4bf5-a34c-5f930c3f5833\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f84cb857-z9fh7"
Sep 06 19:11:29.277540 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.277527    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bdd70125-96a1-41de-a36d-edec1a41e56b-installation-pull-secrets\") pod \"image-registry-6964544647-pbxn2\" (UID: \"bdd70125-96a1-41de-a36d-edec1a41e56b\") " pod="openshift-image-registry/image-registry-6964544647-pbxn2"
Sep 06 19:11:29.277690 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.277542    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/342dbbef-dc3c-4b6c-bbe6-77727df044e5-tmp-dir\") pod \"dns-default-2s46l\" (UID: \"342dbbef-dc3c-4b6c-bbe6-77727df044e5\") " pod="openshift-dns/dns-default-2s46l"
Sep 06 19:11:29.277690 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.277567    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/20a52446-bfd0-4bf5-a34c-5f930c3f5833-ca\") pod \"cluster-proxy-proxy-agent-f84cb857-z9fh7\" (UID: \"20a52446-bfd0-4bf5-a34c-5f930c3f5833\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f84cb857-z9fh7"
Sep 06 19:11:29.277690 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.277593    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h25lb\" (UniqueName: \"kubernetes.io/projected/f028f00d-b01c-42bf-babe-63aa84ea6b53-kube-api-access-h25lb\") pod \"ingress-canary-jnw6x\" (UID: \"f028f00d-b01c-42bf-babe-63aa84ea6b53\") " pod="openshift-ingress-canary/ingress-canary-jnw6x"
Sep 06 19:11:29.277690 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.277624    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/20a52446-bfd0-4bf5-a34c-5f930c3f5833-additional-service-ca\") pod \"cluster-proxy-proxy-agent-f84cb857-z9fh7\" (UID: \"20a52446-bfd0-4bf5-a34c-5f930c3f5833\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f84cb857-z9fh7"
Sep 06 19:11:29.277690 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.277640    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bdd70125-96a1-41de-a36d-edec1a41e56b-ca-trust-extracted\") pod \"image-registry-6964544647-pbxn2\" (UID: \"bdd70125-96a1-41de-a36d-edec1a41e56b\") " pod="openshift-image-registry/image-registry-6964544647-pbxn2"
Sep 06 19:11:29.277690 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.277655    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/20a52446-bfd0-4bf5-a34c-5f930c3f5833-hub\") pod \"cluster-proxy-proxy-agent-f84cb857-z9fh7\" (UID: \"20a52446-bfd0-4bf5-a34c-5f930c3f5833\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f84cb857-z9fh7"
Sep 06 19:11:29.277690 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.277679    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swjpt\" (UniqueName: \"kubernetes.io/projected/20a52446-bfd0-4bf5-a34c-5f930c3f5833-kube-api-access-swjpt\") pod \"cluster-proxy-proxy-agent-f84cb857-z9fh7\" (UID: \"20a52446-bfd0-4bf5-a34c-5f930c3f5833\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f84cb857-z9fh7"
Sep 06 19:11:29.277920 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.277701    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-bound-sa-token\") pod \"image-registry-6964544647-pbxn2\" (UID: \"bdd70125-96a1-41de-a36d-edec1a41e56b\") " pod="openshift-image-registry/image-registry-6964544647-pbxn2"
Sep 06 19:11:29.277920 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.277715    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/342dbbef-dc3c-4b6c-bbe6-77727df044e5-metrics-tls\") pod \"dns-default-2s46l\" (UID: \"342dbbef-dc3c-4b6c-bbe6-77727df044e5\") " pod="openshift-dns/dns-default-2s46l"
Sep 06 19:11:29.277920 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.277728    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a29c8bfe-e1d3-45eb-9665-f7770cad94f3-tmp\") pod \"klusterlet-addon-workmgr-64cb66cd76-46xk5\" (UID: \"a29c8bfe-e1d3-45eb-9665-f7770cad94f3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cb66cd76-46xk5"
Sep 06 19:11:29.277920 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.277752    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bdd70125-96a1-41de-a36d-edec1a41e56b-registry-certificates\") pod \"image-registry-6964544647-pbxn2\" (UID: \"bdd70125-96a1-41de-a36d-edec1a41e56b\") " pod="openshift-image-registry/image-registry-6964544647-pbxn2"
Sep 06 19:11:29.277920 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.277786    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvvnf\" (UniqueName: \"kubernetes.io/projected/342dbbef-dc3c-4b6c-bbe6-77727df044e5-kube-api-access-xvvnf\") pod \"dns-default-2s46l\" (UID: \"342dbbef-dc3c-4b6c-bbe6-77727df044e5\") " pod="openshift-dns/dns-default-2s46l"
Sep 06 19:11:29.277920 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.277806    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d59fb326-5ce6-4955-8d91-1c4f2dda0b15-nginx-conf\") pod \"networking-console-plugin-79977f9844-g982h\" (UID: \"d59fb326-5ce6-4955-8d91-1c4f2dda0b15\") " pod="openshift-network-console/networking-console-plugin-79977f9844-g982h"
Sep 06 19:11:29.277920 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.277843    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/20a52446-bfd0-4bf5-a34c-5f930c3f5833-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-f84cb857-z9fh7\" (UID: \"20a52446-bfd0-4bf5-a34c-5f930c3f5833\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f84cb857-z9fh7"
Sep 06 19:11:29.277920 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.277859    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/342dbbef-dc3c-4b6c-bbe6-77727df044e5-config-volume\") pod \"dns-default-2s46l\" (UID: \"342dbbef-dc3c-4b6c-bbe6-77727df044e5\") " pod="openshift-dns/dns-default-2s46l"
Sep 06 19:11:29.277920 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.277876    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bdd70125-96a1-41de-a36d-edec1a41e56b-image-registry-private-configuration\") pod \"image-registry-6964544647-pbxn2\" (UID: \"bdd70125-96a1-41de-a36d-edec1a41e56b\") " pod="openshift-image-registry/image-registry-6964544647-pbxn2"
Sep 06 19:11:29.378234 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.378150    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/20a52446-bfd0-4bf5-a34c-5f930c3f5833-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-f84cb857-z9fh7\" (UID: \"20a52446-bfd0-4bf5-a34c-5f930c3f5833\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f84cb857-z9fh7"
Sep 06 19:11:29.378234 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.378189    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bdd70125-96a1-41de-a36d-edec1a41e56b-installation-pull-secrets\") pod \"image-registry-6964544647-pbxn2\" (UID: \"bdd70125-96a1-41de-a36d-edec1a41e56b\") " pod="openshift-image-registry/image-registry-6964544647-pbxn2"
Sep 06 19:11:29.378234 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.378207    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/342dbbef-dc3c-4b6c-bbe6-77727df044e5-tmp-dir\") pod \"dns-default-2s46l\" (UID: \"342dbbef-dc3c-4b6c-bbe6-77727df044e5\") " pod="openshift-dns/dns-default-2s46l"
Sep 06 19:11:29.378234 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.378234    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/20a52446-bfd0-4bf5-a34c-5f930c3f5833-ca\") pod \"cluster-proxy-proxy-agent-f84cb857-z9fh7\" (UID: \"20a52446-bfd0-4bf5-a34c-5f930c3f5833\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f84cb857-z9fh7"
Sep 06 19:11:29.378606 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.378259    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h25lb\" (UniqueName: \"kubernetes.io/projected/f028f00d-b01c-42bf-babe-63aa84ea6b53-kube-api-access-h25lb\") pod \"ingress-canary-jnw6x\" (UID: \"f028f00d-b01c-42bf-babe-63aa84ea6b53\") " pod="openshift-ingress-canary/ingress-canary-jnw6x"
Sep 06 19:11:29.378606 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.378294    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/20a52446-bfd0-4bf5-a34c-5f930c3f5833-additional-service-ca\") pod \"cluster-proxy-proxy-agent-f84cb857-z9fh7\" (UID: \"20a52446-bfd0-4bf5-a34c-5f930c3f5833\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f84cb857-z9fh7"
Sep 06 19:11:29.378606 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.378318    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bdd70125-96a1-41de-a36d-edec1a41e56b-ca-trust-extracted\") pod \"image-registry-6964544647-pbxn2\" (UID: \"bdd70125-96a1-41de-a36d-edec1a41e56b\") " pod="openshift-image-registry/image-registry-6964544647-pbxn2"
Sep 06 19:11:29.378606 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.378341    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/20a52446-bfd0-4bf5-a34c-5f930c3f5833-hub\") pod \"cluster-proxy-proxy-agent-f84cb857-z9fh7\" (UID: \"20a52446-bfd0-4bf5-a34c-5f930c3f5833\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f84cb857-z9fh7"
Sep 06 19:11:29.378606 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.378364    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swjpt\" (UniqueName: \"kubernetes.io/projected/20a52446-bfd0-4bf5-a34c-5f930c3f5833-kube-api-access-swjpt\") pod \"cluster-proxy-proxy-agent-f84cb857-z9fh7\" (UID: \"20a52446-bfd0-4bf5-a34c-5f930c3f5833\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f84cb857-z9fh7"
Sep 06 19:11:29.378606 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.378389    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-bound-sa-token\") pod \"image-registry-6964544647-pbxn2\" (UID: \"bdd70125-96a1-41de-a36d-edec1a41e56b\") " pod="openshift-image-registry/image-registry-6964544647-pbxn2"
Sep 06 19:11:29.378606 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.378410    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/342dbbef-dc3c-4b6c-bbe6-77727df044e5-metrics-tls\") pod \"dns-default-2s46l\" (UID: \"342dbbef-dc3c-4b6c-bbe6-77727df044e5\") " pod="openshift-dns/dns-default-2s46l"
Sep 06 19:11:29.378606 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.378433    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a29c8bfe-e1d3-45eb-9665-f7770cad94f3-tmp\") pod \"klusterlet-addon-workmgr-64cb66cd76-46xk5\" (UID: \"a29c8bfe-e1d3-45eb-9665-f7770cad94f3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cb66cd76-46xk5"
Sep 06 19:11:29.378606 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.378460    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bdd70125-96a1-41de-a36d-edec1a41e56b-registry-certificates\") pod \"image-registry-6964544647-pbxn2\" (UID: \"bdd70125-96a1-41de-a36d-edec1a41e56b\") " pod="openshift-image-registry/image-registry-6964544647-pbxn2"
Sep 06 19:11:29.378606 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.378510    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvvnf\" (UniqueName: \"kubernetes.io/projected/342dbbef-dc3c-4b6c-bbe6-77727df044e5-kube-api-access-xvvnf\") pod \"dns-default-2s46l\" (UID: \"342dbbef-dc3c-4b6c-bbe6-77727df044e5\") " pod="openshift-dns/dns-default-2s46l"
Sep 06 19:11:29.378606 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.378535    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d59fb326-5ce6-4955-8d91-1c4f2dda0b15-nginx-conf\") pod \"networking-console-plugin-79977f9844-g982h\" (UID: \"d59fb326-5ce6-4955-8d91-1c4f2dda0b15\") " pod="openshift-network-console/networking-console-plugin-79977f9844-g982h"
Sep 06 19:11:29.378606 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.378570    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/20a52446-bfd0-4bf5-a34c-5f930c3f5833-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-f84cb857-z9fh7\" (UID: \"20a52446-bfd0-4bf5-a34c-5f930c3f5833\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f84cb857-z9fh7"
Sep 06 19:11:29.378606 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.378588    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/342dbbef-dc3c-4b6c-bbe6-77727df044e5-config-volume\") pod \"dns-default-2s46l\" (UID: \"342dbbef-dc3c-4b6c-bbe6-77727df044e5\") " pod="openshift-dns/dns-default-2s46l"
Sep 06 19:11:29.378606 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.378612    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bdd70125-96a1-41de-a36d-edec1a41e56b-image-registry-private-configuration\") pod \"image-registry-6964544647-pbxn2\" (UID: \"bdd70125-96a1-41de-a36d-edec1a41e56b\") " pod="openshift-image-registry/image-registry-6964544647-pbxn2"
Sep 06 19:11:29.379337 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.378642    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/342dbbef-dc3c-4b6c-bbe6-77727df044e5-tmp-dir\") pod \"dns-default-2s46l\" (UID: \"342dbbef-dc3c-4b6c-bbe6-77727df044e5\") " pod="openshift-dns/dns-default-2s46l"
Sep 06 19:11:29.379337 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.378650    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e3ab0344-ff86-4036-9813-69eddfa00b55-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-74d4ddf68d-vfcgt\" (UID: \"e3ab0344-ff86-4036-9813-69eddfa00b55\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74d4ddf68d-vfcgt"
Sep 06 19:11:29.379337 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.378675    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a29c8bfe-e1d3-45eb-9665-f7770cad94f3-klusterlet-config\") pod \"klusterlet-addon-workmgr-64cb66cd76-46xk5\" (UID: \"a29c8bfe-e1d3-45eb-9665-f7770cad94f3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cb66cd76-46xk5"
Sep 06 19:11:29.379337 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.378700    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f028f00d-b01c-42bf-babe-63aa84ea6b53-cert\") pod \"ingress-canary-jnw6x\" (UID: \"f028f00d-b01c-42bf-babe-63aa84ea6b53\") " pod="openshift-ingress-canary/ingress-canary-jnw6x"
Sep 06 19:11:29.379337 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.378722    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d59fb326-5ce6-4955-8d91-1c4f2dda0b15-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-g982h\" (UID: \"d59fb326-5ce6-4955-8d91-1c4f2dda0b15\") " pod="openshift-network-console/networking-console-plugin-79977f9844-g982h"
Sep 06 19:11:29.379337 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.378758    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bdd70125-96a1-41de-a36d-edec1a41e56b-trusted-ca\") pod \"image-registry-6964544647-pbxn2\" (UID: \"bdd70125-96a1-41de-a36d-edec1a41e56b\") " pod="openshift-image-registry/image-registry-6964544647-pbxn2"
Sep 06 19:11:29.379337 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.378778    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bj8mh\" (UniqueName: \"kubernetes.io/projected/a29c8bfe-e1d3-45eb-9665-f7770cad94f3-kube-api-access-bj8mh\") pod \"klusterlet-addon-workmgr-64cb66cd76-46xk5\" (UID: \"a29c8bfe-e1d3-45eb-9665-f7770cad94f3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cb66cd76-46xk5"
Sep 06 19:11:29.379337 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.378808    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd2r7\" (UniqueName: \"kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-kube-api-access-fd2r7\") pod \"image-registry-6964544647-pbxn2\" (UID: \"bdd70125-96a1-41de-a36d-edec1a41e56b\") " pod="openshift-image-registry/image-registry-6964544647-pbxn2"
Sep 06 19:11:29.379337 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.378831    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d95lr\" (UniqueName: \"kubernetes.io/projected/e3ab0344-ff86-4036-9813-69eddfa00b55-kube-api-access-d95lr\") pod \"managed-serviceaccount-addon-agent-74d4ddf68d-vfcgt\" (UID: \"e3ab0344-ff86-4036-9813-69eddfa00b55\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74d4ddf68d-vfcgt"
Sep 06 19:11:29.379337 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.378869    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-registry-tls\") pod \"image-registry-6964544647-pbxn2\" (UID: \"bdd70125-96a1-41de-a36d-edec1a41e56b\") " pod="openshift-image-registry/image-registry-6964544647-pbxn2"
Sep 06 19:11:29.379337 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:29.378977    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 19:11:29.379337 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:29.378991    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6964544647-pbxn2: secret "image-registry-tls" not found
Sep 06 19:11:29.379337 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:29.379065    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-registry-tls podName:bdd70125-96a1-41de-a36d-edec1a41e56b nodeName:}" failed. No retries permitted until 2026-09-06 19:11:29.879041601 +0000 UTC m=+36.119926940 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-registry-tls") pod "image-registry-6964544647-pbxn2" (UID: "bdd70125-96a1-41de-a36d-edec1a41e56b") : secret "image-registry-tls" not found
Sep 06 19:11:29.379337 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.379125    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/20a52446-bfd0-4bf5-a34c-5f930c3f5833-additional-service-ca\") pod \"cluster-proxy-proxy-agent-f84cb857-z9fh7\" (UID: \"20a52446-bfd0-4bf5-a34c-5f930c3f5833\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f84cb857-z9fh7"
Sep 06 19:11:29.379337 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.379263    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bdd70125-96a1-41de-a36d-edec1a41e56b-registry-certificates\") pod \"image-registry-6964544647-pbxn2\" (UID: \"bdd70125-96a1-41de-a36d-edec1a41e56b\") " pod="openshift-image-registry/image-registry-6964544647-pbxn2"
Sep 06 19:11:29.380101 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.379374    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d59fb326-5ce6-4955-8d91-1c4f2dda0b15-nginx-conf\") pod \"networking-console-plugin-79977f9844-g982h\" (UID: \"d59fb326-5ce6-4955-8d91-1c4f2dda0b15\") " pod="openshift-network-console/networking-console-plugin-79977f9844-g982h"
Sep 06 19:11:29.380101 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.379616    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bdd70125-96a1-41de-a36d-edec1a41e56b-ca-trust-extracted\") pod \"image-registry-6964544647-pbxn2\" (UID: \"bdd70125-96a1-41de-a36d-edec1a41e56b\") " pod="openshift-image-registry/image-registry-6964544647-pbxn2"
Sep 06 19:11:29.382430 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.381021    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bdd70125-96a1-41de-a36d-edec1a41e56b-trusted-ca\") pod \"image-registry-6964544647-pbxn2\" (UID: \"bdd70125-96a1-41de-a36d-edec1a41e56b\") " pod="openshift-image-registry/image-registry-6964544647-pbxn2"
Sep 06 19:11:29.382430 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:29.381416    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 19:11:29.382430 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:29.381513    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/342dbbef-dc3c-4b6c-bbe6-77727df044e5-metrics-tls podName:342dbbef-dc3c-4b6c-bbe6-77727df044e5 nodeName:}" failed. No retries permitted until 2026-09-06 19:11:29.88148523 +0000 UTC m=+36.122370570 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/342dbbef-dc3c-4b6c-bbe6-77727df044e5-metrics-tls") pod "dns-default-2s46l" (UID: "342dbbef-dc3c-4b6c-bbe6-77727df044e5") : secret "dns-default-metrics-tls" not found
Sep 06 19:11:29.382430 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.381837    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a29c8bfe-e1d3-45eb-9665-f7770cad94f3-tmp\") pod \"klusterlet-addon-workmgr-64cb66cd76-46xk5\" (UID: \"a29c8bfe-e1d3-45eb-9665-f7770cad94f3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cb66cd76-46xk5"
Sep 06 19:11:29.382430 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:29.381939    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 06 19:11:29.382430 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:29.381994    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d59fb326-5ce6-4955-8d91-1c4f2dda0b15-networking-console-plugin-cert podName:d59fb326-5ce6-4955-8d91-1c4f2dda0b15 nodeName:}" failed. No retries permitted until 2026-09-06 19:11:29.881978838 +0000 UTC m=+36.122864178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d59fb326-5ce6-4955-8d91-1c4f2dda0b15-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-g982h" (UID: "d59fb326-5ce6-4955-8d91-1c4f2dda0b15") : secret "networking-console-plugin-cert" not found
Sep 06 19:11:29.383195 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.382982    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/342dbbef-dc3c-4b6c-bbe6-77727df044e5-config-volume\") pod \"dns-default-2s46l\" (UID: \"342dbbef-dc3c-4b6c-bbe6-77727df044e5\") " pod="openshift-dns/dns-default-2s46l"
Sep 06 19:11:29.384223 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.384092    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/20a52446-bfd0-4bf5-a34c-5f930c3f5833-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-f84cb857-z9fh7\" (UID: \"20a52446-bfd0-4bf5-a34c-5f930c3f5833\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f84cb857-z9fh7"
Sep 06 19:11:29.384332 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.384290    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/20a52446-bfd0-4bf5-a34c-5f930c3f5833-hub\") pod \"cluster-proxy-proxy-agent-f84cb857-z9fh7\" (UID: \"20a52446-bfd0-4bf5-a34c-5f930c3f5833\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f84cb857-z9fh7"
Sep 06 19:11:29.384332 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.384292    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e3ab0344-ff86-4036-9813-69eddfa00b55-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-74d4ddf68d-vfcgt\" (UID: \"e3ab0344-ff86-4036-9813-69eddfa00b55\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74d4ddf68d-vfcgt"
Sep 06 19:11:29.385166 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.384746    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bdd70125-96a1-41de-a36d-edec1a41e56b-installation-pull-secrets\") pod \"image-registry-6964544647-pbxn2\" (UID: \"bdd70125-96a1-41de-a36d-edec1a41e56b\") " pod="openshift-image-registry/image-registry-6964544647-pbxn2"
Sep 06 19:11:29.385267 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.385226    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtlr6"
Sep 06 19:11:29.385378 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.385340    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/20a52446-bfd0-4bf5-a34c-5f930c3f5833-ca\") pod \"cluster-proxy-proxy-agent-f84cb857-z9fh7\" (UID: \"20a52446-bfd0-4bf5-a34c-5f930c3f5833\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f84cb857-z9fh7"
Sep 06 19:11:29.386139 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.385783    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bx7w2"
Sep 06 19:11:29.386139 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.385993    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bdd70125-96a1-41de-a36d-edec1a41e56b-image-registry-private-configuration\") pod \"image-registry-6964544647-pbxn2\" (UID: \"bdd70125-96a1-41de-a36d-edec1a41e56b\") " pod="openshift-image-registry/image-registry-6964544647-pbxn2"
Sep 06 19:11:29.386738 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.386550    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzktl"
Sep 06 19:11:29.387110 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.387089    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a29c8bfe-e1d3-45eb-9665-f7770cad94f3-klusterlet-config\") pod \"klusterlet-addon-workmgr-64cb66cd76-46xk5\" (UID: \"a29c8bfe-e1d3-45eb-9665-f7770cad94f3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cb66cd76-46xk5"
Sep 06 19:11:29.388711 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.388691    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 06 19:11:29.388812 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.388791    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 06 19:11:29.390555 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.390386    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd2r7\" (UniqueName: \"kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-kube-api-access-fd2r7\") pod \"image-registry-6964544647-pbxn2\" (UID: \"bdd70125-96a1-41de-a36d-edec1a41e56b\") " pod="openshift-image-registry/image-registry-6964544647-pbxn2"
Sep 06 19:11:29.390647 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.390588    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 06 19:11:29.390882 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.390861    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6p7v7\""
Sep 06 19:11:29.391871 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.391122    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 06 19:11:29.391871 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.391431    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-57svr\""
Sep 06 19:11:29.392016 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.391942    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-bound-sa-token\") pod \"image-registry-6964544647-pbxn2\" (UID: \"bdd70125-96a1-41de-a36d-edec1a41e56b\") " pod="openshift-image-registry/image-registry-6964544647-pbxn2"
Sep 06 19:11:29.392074 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.392021    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvvnf\" (UniqueName: \"kubernetes.io/projected/342dbbef-dc3c-4b6c-bbe6-77727df044e5-kube-api-access-xvvnf\") pod \"dns-default-2s46l\" (UID: \"342dbbef-dc3c-4b6c-bbe6-77727df044e5\") " pod="openshift-dns/dns-default-2s46l"
Sep 06 19:11:29.392991 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.392728    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f028f00d-b01c-42bf-babe-63aa84ea6b53-cert\") pod \"ingress-canary-jnw6x\" (UID: \"f028f00d-b01c-42bf-babe-63aa84ea6b53\") " pod="openshift-ingress-canary/ingress-canary-jnw6x"
Sep 06 19:11:29.394612 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.394327    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/20a52446-bfd0-4bf5-a34c-5f930c3f5833-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-f84cb857-z9fh7\" (UID: \"20a52446-bfd0-4bf5-a34c-5f930c3f5833\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f84cb857-z9fh7"
Sep 06 19:11:29.394612 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.394432    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj8mh\" (UniqueName: \"kubernetes.io/projected/a29c8bfe-e1d3-45eb-9665-f7770cad94f3-kube-api-access-bj8mh\") pod \"klusterlet-addon-workmgr-64cb66cd76-46xk5\" (UID: \"a29c8bfe-e1d3-45eb-9665-f7770cad94f3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cb66cd76-46xk5"
Sep 06 19:11:29.394612 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.394514    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d95lr\" (UniqueName: \"kubernetes.io/projected/e3ab0344-ff86-4036-9813-69eddfa00b55-kube-api-access-d95lr\") pod \"managed-serviceaccount-addon-agent-74d4ddf68d-vfcgt\" (UID: \"e3ab0344-ff86-4036-9813-69eddfa00b55\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74d4ddf68d-vfcgt"
Sep 06 19:11:29.395003 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.394963    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swjpt\" (UniqueName: \"kubernetes.io/projected/20a52446-bfd0-4bf5-a34c-5f930c3f5833-kube-api-access-swjpt\") pod \"cluster-proxy-proxy-agent-f84cb857-z9fh7\" (UID: \"20a52446-bfd0-4bf5-a34c-5f930c3f5833\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f84cb857-z9fh7"
Sep 06 19:11:29.395092 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.395063    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h25lb\" (UniqueName: \"kubernetes.io/projected/f028f00d-b01c-42bf-babe-63aa84ea6b53-kube-api-access-h25lb\") pod \"ingress-canary-jnw6x\" (UID: \"f028f00d-b01c-42bf-babe-63aa84ea6b53\") " pod="openshift-ingress-canary/ingress-canary-jnw6x"
Sep 06 19:11:29.449968 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.449939    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74d4ddf68d-vfcgt"
Sep 06 19:11:29.473086 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.473061    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cb66cd76-46xk5"
Sep 06 19:11:29.479659 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.479633    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f84cb857-z9fh7"
Sep 06 19:11:29.498082 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.498046    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jnw6x"
Sep 06 19:11:29.735185 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.735117    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74d4ddf68d-vfcgt"]
Sep 06 19:11:29.738416 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:11:29.738396    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode3ab0344_ff86_4036_9813_69eddfa00b55.slice/crio-7838334d65b41babd59e132a43ca878db409bfb65d1ae79761e12af348634c49 WatchSource:0}: Error finding container 7838334d65b41babd59e132a43ca878db409bfb65d1ae79761e12af348634c49: Status 404 returned error can't find the container with id 7838334d65b41babd59e132a43ca878db409bfb65d1ae79761e12af348634c49
Sep 06 19:11:29.761342 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.761318    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cb66cd76-46xk5"]
Sep 06 19:11:29.765580 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:11:29.765525    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda29c8bfe_e1d3_45eb_9665_f7770cad94f3.slice/crio-7db8688f820fcad7b827e5186f6f779677a63e06fbb22f784c414d3a1bff1308 WatchSource:0}: Error finding container 7db8688f820fcad7b827e5186f6f779677a63e06fbb22f784c414d3a1bff1308: Status 404 returned error can't find the container with id 7db8688f820fcad7b827e5186f6f779677a63e06fbb22f784c414d3a1bff1308
Sep 06 19:11:29.766487 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.766452    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f84cb857-z9fh7"]
Sep 06 19:11:29.769991 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:11:29.769941    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod20a52446_bfd0_4bf5_a34c_5f930c3f5833.slice/crio-cda7aaf6da7b21975fcda8aa5ba86d71b7baadf6241606d7904b8bcd25105b6c WatchSource:0}: Error finding container cda7aaf6da7b21975fcda8aa5ba86d71b7baadf6241606d7904b8bcd25105b6c: Status 404 returned error can't find the container with id cda7aaf6da7b21975fcda8aa5ba86d71b7baadf6241606d7904b8bcd25105b6c
Sep 06 19:11:29.792543 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.792513    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jnw6x"]
Sep 06 19:11:29.797023 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:11:29.796988    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf028f00d_b01c_42bf_babe_63aa84ea6b53.slice/crio-58d66dd8979d76ff1847625a6af9c237b75938b71253299a943fd924fdad01c1 WatchSource:0}: Error finding container 58d66dd8979d76ff1847625a6af9c237b75938b71253299a943fd924fdad01c1: Status 404 returned error can't find the container with id 58d66dd8979d76ff1847625a6af9c237b75938b71253299a943fd924fdad01c1
Sep 06 19:11:29.882871 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.882835    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d59fb326-5ce6-4955-8d91-1c4f2dda0b15-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-g982h\" (UID: \"d59fb326-5ce6-4955-8d91-1c4f2dda0b15\") " pod="openshift-network-console/networking-console-plugin-79977f9844-g982h"
Sep 06 19:11:29.883047 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.882899    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-registry-tls\") pod \"image-registry-6964544647-pbxn2\" (UID: \"bdd70125-96a1-41de-a36d-edec1a41e56b\") " pod="openshift-image-registry/image-registry-6964544647-pbxn2"
Sep 06 19:11:29.883047 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:29.882936    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/342dbbef-dc3c-4b6c-bbe6-77727df044e5-metrics-tls\") pod \"dns-default-2s46l\" (UID: \"342dbbef-dc3c-4b6c-bbe6-77727df044e5\") " pod="openshift-dns/dns-default-2s46l"
Sep 06 19:11:29.883047 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:29.882986    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 06 19:11:29.883047 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:29.883041    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 19:11:29.883190 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:29.883045    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 19:11:29.883190 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:29.883058    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d59fb326-5ce6-4955-8d91-1c4f2dda0b15-networking-console-plugin-cert podName:d59fb326-5ce6-4955-8d91-1c4f2dda0b15 nodeName:}" failed. No retries permitted until 2026-09-06 19:11:30.883042362 +0000 UTC m=+37.123927688 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d59fb326-5ce6-4955-8d91-1c4f2dda0b15-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-g982h" (UID: "d59fb326-5ce6-4955-8d91-1c4f2dda0b15") : secret "networking-console-plugin-cert" not found
Sep 06 19:11:29.883190 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:29.883060    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6964544647-pbxn2: secret "image-registry-tls" not found
Sep 06 19:11:29.883190 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:29.883079    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/342dbbef-dc3c-4b6c-bbe6-77727df044e5-metrics-tls podName:342dbbef-dc3c-4b6c-bbe6-77727df044e5 nodeName:}" failed. No retries permitted until 2026-09-06 19:11:30.883068563 +0000 UTC m=+37.123953885 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/342dbbef-dc3c-4b6c-bbe6-77727df044e5-metrics-tls") pod "dns-default-2s46l" (UID: "342dbbef-dc3c-4b6c-bbe6-77727df044e5") : secret "dns-default-metrics-tls" not found
Sep 06 19:11:29.883190 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:29.883090    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-registry-tls podName:bdd70125-96a1-41de-a36d-edec1a41e56b nodeName:}" failed. No retries permitted until 2026-09-06 19:11:30.88308389 +0000 UTC m=+37.123969213 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-registry-tls") pod "image-registry-6964544647-pbxn2" (UID: "bdd70125-96a1-41de-a36d-edec1a41e56b") : secret "image-registry-tls" not found
Sep 06 19:11:30.641064 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:30.640988    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jnw6x" event={"ID":"f028f00d-b01c-42bf-babe-63aa84ea6b53","Type":"ContainerStarted","Data":"58d66dd8979d76ff1847625a6af9c237b75938b71253299a943fd924fdad01c1"}
Sep 06 19:11:30.642514 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:30.642386    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f84cb857-z9fh7" event={"ID":"20a52446-bfd0-4bf5-a34c-5f930c3f5833","Type":"ContainerStarted","Data":"cda7aaf6da7b21975fcda8aa5ba86d71b7baadf6241606d7904b8bcd25105b6c"}
Sep 06 19:11:30.644947 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:30.644889    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cb66cd76-46xk5" event={"ID":"a29c8bfe-e1d3-45eb-9665-f7770cad94f3","Type":"ContainerStarted","Data":"7db8688f820fcad7b827e5186f6f779677a63e06fbb22f784c414d3a1bff1308"}
Sep 06 19:11:30.646781 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:30.646741    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74d4ddf68d-vfcgt" event={"ID":"e3ab0344-ff86-4036-9813-69eddfa00b55","Type":"ContainerStarted","Data":"7838334d65b41babd59e132a43ca878db409bfb65d1ae79761e12af348634c49"}
Sep 06 19:11:30.893781 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:30.893658    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/342dbbef-dc3c-4b6c-bbe6-77727df044e5-metrics-tls\") pod \"dns-default-2s46l\" (UID: \"342dbbef-dc3c-4b6c-bbe6-77727df044e5\") " pod="openshift-dns/dns-default-2s46l"
Sep 06 19:11:30.893781 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:30.893757    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d59fb326-5ce6-4955-8d91-1c4f2dda0b15-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-g982h\" (UID: \"d59fb326-5ce6-4955-8d91-1c4f2dda0b15\") " pod="openshift-network-console/networking-console-plugin-79977f9844-g982h"
Sep 06 19:11:30.894079 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:30.893817    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-registry-tls\") pod \"image-registry-6964544647-pbxn2\" (UID: \"bdd70125-96a1-41de-a36d-edec1a41e56b\") " pod="openshift-image-registry/image-registry-6964544647-pbxn2"
Sep 06 19:11:30.894079 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:30.893958    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 19:11:30.894079 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:30.893975    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6964544647-pbxn2: secret "image-registry-tls" not found
Sep 06 19:11:30.894079 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:30.894034    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-registry-tls podName:bdd70125-96a1-41de-a36d-edec1a41e56b nodeName:}" failed. No retries permitted until 2026-09-06 19:11:32.894015103 +0000 UTC m=+39.134900431 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-registry-tls") pod "image-registry-6964544647-pbxn2" (UID: "bdd70125-96a1-41de-a36d-edec1a41e56b") : secret "image-registry-tls" not found
Sep 06 19:11:30.894575 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:30.894448    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 19:11:30.894575 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:30.894517    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/342dbbef-dc3c-4b6c-bbe6-77727df044e5-metrics-tls podName:342dbbef-dc3c-4b6c-bbe6-77727df044e5 nodeName:}" failed. No retries permitted until 2026-09-06 19:11:32.894500807 +0000 UTC m=+39.135386136 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/342dbbef-dc3c-4b6c-bbe6-77727df044e5-metrics-tls") pod "dns-default-2s46l" (UID: "342dbbef-dc3c-4b6c-bbe6-77727df044e5") : secret "dns-default-metrics-tls" not found
Sep 06 19:11:30.894681 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:30.894579    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 06 19:11:30.894681 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:30.894617    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d59fb326-5ce6-4955-8d91-1c4f2dda0b15-networking-console-plugin-cert podName:d59fb326-5ce6-4955-8d91-1c4f2dda0b15 nodeName:}" failed. No retries permitted until 2026-09-06 19:11:32.894605735 +0000 UTC m=+39.135491061 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d59fb326-5ce6-4955-8d91-1c4f2dda0b15-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-g982h" (UID: "d59fb326-5ce6-4955-8d91-1c4f2dda0b15") : secret "networking-console-plugin-cert" not found
Sep 06 19:11:32.915100 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:32.914695    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/342dbbef-dc3c-4b6c-bbe6-77727df044e5-metrics-tls\") pod \"dns-default-2s46l\" (UID: \"342dbbef-dc3c-4b6c-bbe6-77727df044e5\") " pod="openshift-dns/dns-default-2s46l"
Sep 06 19:11:32.915100 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:32.914791    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d59fb326-5ce6-4955-8d91-1c4f2dda0b15-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-g982h\" (UID: \"d59fb326-5ce6-4955-8d91-1c4f2dda0b15\") " pod="openshift-network-console/networking-console-plugin-79977f9844-g982h"
Sep 06 19:11:32.915100 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:32.914848    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-registry-tls\") pod \"image-registry-6964544647-pbxn2\" (UID: \"bdd70125-96a1-41de-a36d-edec1a41e56b\") " pod="openshift-image-registry/image-registry-6964544647-pbxn2"
Sep 06 19:11:32.915100 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:32.914864    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 19:11:32.915100 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:32.914926    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/342dbbef-dc3c-4b6c-bbe6-77727df044e5-metrics-tls podName:342dbbef-dc3c-4b6c-bbe6-77727df044e5 nodeName:}" failed. No retries permitted until 2026-09-06 19:11:36.914908388 +0000 UTC m=+43.155793728 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/342dbbef-dc3c-4b6c-bbe6-77727df044e5-metrics-tls") pod "dns-default-2s46l" (UID: "342dbbef-dc3c-4b6c-bbe6-77727df044e5") : secret "dns-default-metrics-tls" not found
Sep 06 19:11:32.915100 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:32.914944    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 19:11:32.915100 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:32.914955    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6964544647-pbxn2: secret "image-registry-tls" not found
Sep 06 19:11:32.915100 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:32.914990    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-registry-tls podName:bdd70125-96a1-41de-a36d-edec1a41e56b nodeName:}" failed. No retries permitted until 2026-09-06 19:11:36.914978254 +0000 UTC m=+43.155863579 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-registry-tls") pod "image-registry-6964544647-pbxn2" (UID: "bdd70125-96a1-41de-a36d-edec1a41e56b") : secret "image-registry-tls" not found
Sep 06 19:11:32.915100 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:32.915045    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 06 19:11:32.915100 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:32.915075    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d59fb326-5ce6-4955-8d91-1c4f2dda0b15-networking-console-plugin-cert podName:d59fb326-5ce6-4955-8d91-1c4f2dda0b15 nodeName:}" failed. No retries permitted until 2026-09-06 19:11:36.915064937 +0000 UTC m=+43.155950265 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d59fb326-5ce6-4955-8d91-1c4f2dda0b15-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-g982h" (UID: "d59fb326-5ce6-4955-8d91-1c4f2dda0b15") : secret "networking-console-plugin-cert" not found
Sep 06 19:11:36.947904 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:36.947865    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d59fb326-5ce6-4955-8d91-1c4f2dda0b15-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-g982h\" (UID: \"d59fb326-5ce6-4955-8d91-1c4f2dda0b15\") " pod="openshift-network-console/networking-console-plugin-79977f9844-g982h"
Sep 06 19:11:36.948508 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:36.947933    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-registry-tls\") pod \"image-registry-6964544647-pbxn2\" (UID: \"bdd70125-96a1-41de-a36d-edec1a41e56b\") " pod="openshift-image-registry/image-registry-6964544647-pbxn2"
Sep 06 19:11:36.948508 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:36.947987    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/342dbbef-dc3c-4b6c-bbe6-77727df044e5-metrics-tls\") pod \"dns-default-2s46l\" (UID: \"342dbbef-dc3c-4b6c-bbe6-77727df044e5\") " pod="openshift-dns/dns-default-2s46l"
Sep 06 19:11:36.948508 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:36.948018    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 06 19:11:36.948508 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:36.948077    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 19:11:36.948508 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:36.948097    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6964544647-pbxn2: secret "image-registry-tls" not found
Sep 06 19:11:36.948508 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:36.948080    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d59fb326-5ce6-4955-8d91-1c4f2dda0b15-networking-console-plugin-cert podName:d59fb326-5ce6-4955-8d91-1c4f2dda0b15 nodeName:}" failed. No retries permitted until 2026-09-06 19:11:44.948062622 +0000 UTC m=+51.188947966 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d59fb326-5ce6-4955-8d91-1c4f2dda0b15-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-g982h" (UID: "d59fb326-5ce6-4955-8d91-1c4f2dda0b15") : secret "networking-console-plugin-cert" not found
Sep 06 19:11:36.948508 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:36.948082    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 19:11:36.948508 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:36.948178    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-registry-tls podName:bdd70125-96a1-41de-a36d-edec1a41e56b nodeName:}" failed. No retries permitted until 2026-09-06 19:11:44.948152593 +0000 UTC m=+51.189037921 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-registry-tls") pod "image-registry-6964544647-pbxn2" (UID: "bdd70125-96a1-41de-a36d-edec1a41e56b") : secret "image-registry-tls" not found
Sep 06 19:11:36.948508 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:36.948200    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/342dbbef-dc3c-4b6c-bbe6-77727df044e5-metrics-tls podName:342dbbef-dc3c-4b6c-bbe6-77727df044e5 nodeName:}" failed. No retries permitted until 2026-09-06 19:11:44.948189337 +0000 UTC m=+51.189074664 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/342dbbef-dc3c-4b6c-bbe6-77727df044e5-metrics-tls") pod "dns-default-2s46l" (UID: "342dbbef-dc3c-4b6c-bbe6-77727df044e5") : secret "dns-default-metrics-tls" not found
Sep 06 19:11:40.674592 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:40.674519    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f84cb857-z9fh7" event={"ID":"20a52446-bfd0-4bf5-a34c-5f930c3f5833","Type":"ContainerStarted","Data":"1ad2e44ba940ee476bdb7f27986d4e8a5e36ec8585a6de62ee0f327e8d33e66b"}
Sep 06 19:11:40.674592 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:40.674569    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f84cb857-z9fh7" event={"ID":"20a52446-bfd0-4bf5-a34c-5f930c3f5833","Type":"ContainerStarted","Data":"56688586dedc9c738a484cb715c118006a199fa1573d50b5e5d18f1ed5cd5b83"}
Sep 06 19:11:40.674592 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:40.674587    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f84cb857-z9fh7" event={"ID":"20a52446-bfd0-4bf5-a34c-5f930c3f5833","Type":"ContainerStarted","Data":"9914e43e962e83a2d464a0d8c278dc20ab11cd7468fd4e127e1c97f604e9da6a"}
Sep 06 19:11:40.675959 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:40.675937    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cb66cd76-46xk5" event={"ID":"a29c8bfe-e1d3-45eb-9665-f7770cad94f3","Type":"ContainerStarted","Data":"e875ef77d80d2b6ac11aec52f07db825879ba7d8dd9a1d112c8478dbf6534be1"}
Sep 06 19:11:40.676059 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:40.676045    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cb66cd76-46xk5"
Sep 06 19:11:40.677444 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:40.677416    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74d4ddf68d-vfcgt" event={"ID":"e3ab0344-ff86-4036-9813-69eddfa00b55","Type":"ContainerStarted","Data":"11f837926e90e206ddbf373454da7d21b0fbd2158265632b29c5962a08982fd2"}
Sep 06 19:11:40.677706 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:40.677683    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cb66cd76-46xk5"
Sep 06 19:11:40.680056 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:40.680035    2577 generic.go:356] "Generic (PLEG): container finished" podID="9cdb696e-5c36-4c08-931f-b7fb59581f94" containerID="afc4cc915103c9b57f8b9cd00413a458d94dd4fe9386ea6e7d0fe0a8fe13b839" exitCode=0
Sep 06 19:11:40.680127 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:40.680109    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l5h99" event={"ID":"9cdb696e-5c36-4c08-931f-b7fb59581f94","Type":"ContainerDied","Data":"afc4cc915103c9b57f8b9cd00413a458d94dd4fe9386ea6e7d0fe0a8fe13b839"}
Sep 06 19:11:40.681574 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:40.681551    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jnw6x" event={"ID":"f028f00d-b01c-42bf-babe-63aa84ea6b53","Type":"ContainerStarted","Data":"04dd818e7967b9c7f5f8065cd8d940d9fc9d832bef00bb23dd9feb4ee9fe1e10"}
Sep 06 19:11:40.694056 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:40.694019    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f84cb857-z9fh7" podStartSLOduration=23.373847351 podStartE2EDuration="33.694005325s" totalImagesPullingTime="10.320157974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:11:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:11:40.693182584 +0000 UTC m=+46.934067929" watchObservedRunningTime="2026-09-06 19:11:40.694005325 +0000 UTC m=+46.934890670"
Sep 06 19:11:40.708052 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:40.708018    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jnw6x" podStartSLOduration=1.414830996 podStartE2EDuration="11.708006261s" totalImagesPullingTime="10.293175265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:11:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:11:40.707282871 +0000 UTC m=+46.948168215" watchObservedRunningTime="2026-09-06 19:11:40.708006261 +0000 UTC m=+46.948891600"
Sep 06 19:11:40.721421 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:40.721380    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74d4ddf68d-vfcgt" podStartSLOduration=23.337054214 podStartE2EDuration="33.721364739s" totalImagesPullingTime="10.384310525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:11:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:11:40.721100696 +0000 UTC m=+46.961986042" watchObservedRunningTime="2026-09-06 19:11:40.721364739 +0000 UTC m=+46.962250065"
Sep 06 19:11:40.756520 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:40.756457    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cb66cd76-46xk5" podStartSLOduration=23.406551841 podStartE2EDuration="33.756440996s" totalImagesPullingTime="10.349889155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:11:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:11:40.737536977 +0000 UTC m=+46.978422333" watchObservedRunningTime="2026-09-06 19:11:40.756440996 +0000 UTC m=+46.997326341"
Sep 06 19:11:41.687599 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:41.687562    2577 generic.go:356] "Generic (PLEG): container finished" podID="9cdb696e-5c36-4c08-931f-b7fb59581f94" containerID="2565c16dd35f45dab93c8391f0df6079283fef51e569c5d8333bdb4baa195a48" exitCode=0
Sep 06 19:11:41.688031 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:41.687676    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l5h99" event={"ID":"9cdb696e-5c36-4c08-931f-b7fb59581f94","Type":"ContainerDied","Data":"2565c16dd35f45dab93c8391f0df6079283fef51e569c5d8333bdb4baa195a48"}
Sep 06 19:11:42.694274 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:42.694236    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l5h99" event={"ID":"9cdb696e-5c36-4c08-931f-b7fb59581f94","Type":"ContainerStarted","Data":"03abf8bc41d0b14171cf367fca148a85f4ac37b5b9990a090fba1e0802a5da76"}
Sep 06 19:11:42.716206 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:42.716151    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-l5h99" podStartSLOduration=7.63513771 podStartE2EDuration="47.716136434s" totalImagesPullingTime="40.080998724s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 19:10:55 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:11:42.71580018 +0000 UTC m=+48.956685547" watchObservedRunningTime="2026-09-06 19:11:42.716136434 +0000 UTC m=+48.957021779"
Sep 06 19:11:45.011104 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:45.011064    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d59fb326-5ce6-4955-8d91-1c4f2dda0b15-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-g982h\" (UID: \"d59fb326-5ce6-4955-8d91-1c4f2dda0b15\") " pod="openshift-network-console/networking-console-plugin-79977f9844-g982h"
Sep 06 19:11:45.011533 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:45.011129    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-registry-tls\") pod \"image-registry-6964544647-pbxn2\" (UID: \"bdd70125-96a1-41de-a36d-edec1a41e56b\") " pod="openshift-image-registry/image-registry-6964544647-pbxn2"
Sep 06 19:11:45.011533 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:45.011174    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/342dbbef-dc3c-4b6c-bbe6-77727df044e5-metrics-tls\") pod \"dns-default-2s46l\" (UID: \"342dbbef-dc3c-4b6c-bbe6-77727df044e5\") " pod="openshift-dns/dns-default-2s46l"
Sep 06 19:11:45.011533 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:45.011220    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 06 19:11:45.011533 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:45.011282    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 19:11:45.011533 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:45.011294    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 19:11:45.011533 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:45.011308    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6964544647-pbxn2: secret "image-registry-tls" not found
Sep 06 19:11:45.011533 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:45.011313    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d59fb326-5ce6-4955-8d91-1c4f2dda0b15-networking-console-plugin-cert podName:d59fb326-5ce6-4955-8d91-1c4f2dda0b15 nodeName:}" failed. No retries permitted until 2026-09-06 19:12:01.011294144 +0000 UTC m=+67.252179481 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d59fb326-5ce6-4955-8d91-1c4f2dda0b15-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-g982h" (UID: "d59fb326-5ce6-4955-8d91-1c4f2dda0b15") : secret "networking-console-plugin-cert" not found
Sep 06 19:11:45.011533 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:45.011343    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/342dbbef-dc3c-4b6c-bbe6-77727df044e5-metrics-tls podName:342dbbef-dc3c-4b6c-bbe6-77727df044e5 nodeName:}" failed. No retries permitted until 2026-09-06 19:12:01.011327568 +0000 UTC m=+67.252212894 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/342dbbef-dc3c-4b6c-bbe6-77727df044e5-metrics-tls") pod "dns-default-2s46l" (UID: "342dbbef-dc3c-4b6c-bbe6-77727df044e5") : secret "dns-default-metrics-tls" not found
Sep 06 19:11:45.011533 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:11:45.011362    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-registry-tls podName:bdd70125-96a1-41de-a36d-edec1a41e56b nodeName:}" failed. No retries permitted until 2026-09-06 19:12:01.01135266 +0000 UTC m=+67.252238184 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-registry-tls") pod "image-registry-6964544647-pbxn2" (UID: "bdd70125-96a1-41de-a36d-edec1a41e56b") : secret "image-registry-tls" not found
Sep 06 19:11:54.631764 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:11:54.631732    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2bxw2"
Sep 06 19:12:00.017080 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:12:00.017040    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f48c221-e457-4c65-b433-902fa3a75f09-metrics-certs\") pod \"network-metrics-daemon-vzktl\" (UID: \"2f48c221-e457-4c65-b433-902fa3a75f09\") " pod="openshift-multus/network-metrics-daemon-vzktl"
Sep 06 19:12:00.017458 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:12:00.017101    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d89b285b-cadd-4b89-be22-17b20170f51c-original-pull-secret\") pod \"global-pull-secret-syncer-dtlr6\" (UID: \"d89b285b-cadd-4b89-be22-17b20170f51c\") " pod="kube-system/global-pull-secret-syncer-dtlr6"
Sep 06 19:12:00.020195 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:12:00.020172    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 06 19:12:00.020261 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:12:00.020244    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 06 19:12:00.028239 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:12:00.028222    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 06 19:12:00.028303 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:12:00.028287    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f48c221-e457-4c65-b433-902fa3a75f09-metrics-certs podName:2f48c221-e457-4c65-b433-902fa3a75f09 nodeName:}" failed. No retries permitted until 2026-09-06 19:13:04.02826352 +0000 UTC m=+130.269148855 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f48c221-e457-4c65-b433-902fa3a75f09-metrics-certs") pod "network-metrics-daemon-vzktl" (UID: "2f48c221-e457-4c65-b433-902fa3a75f09") : secret "metrics-daemon-secret" not found
Sep 06 19:12:00.031219 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:12:00.031200    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d89b285b-cadd-4b89-be22-17b20170f51c-original-pull-secret\") pod \"global-pull-secret-syncer-dtlr6\" (UID: \"d89b285b-cadd-4b89-be22-17b20170f51c\") " pod="kube-system/global-pull-secret-syncer-dtlr6"
Sep 06 19:12:00.118487 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:12:00.118429    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f2q4\" (UniqueName: \"kubernetes.io/projected/f989fafb-d7c2-4079-93ed-61da8f78e53b-kube-api-access-8f2q4\") pod \"network-check-target-bx7w2\" (UID: \"f989fafb-d7c2-4079-93ed-61da8f78e53b\") " pod="openshift-network-diagnostics/network-check-target-bx7w2"
Sep 06 19:12:00.121006 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:12:00.120984    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 06 19:12:00.131926 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:12:00.131905    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 06 19:12:00.142839 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:12:00.142810    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f2q4\" (UniqueName: \"kubernetes.io/projected/f989fafb-d7c2-4079-93ed-61da8f78e53b-kube-api-access-8f2q4\") pod \"network-check-target-bx7w2\" (UID: \"f989fafb-d7c2-4079-93ed-61da8f78e53b\") " pod="openshift-network-diagnostics/network-check-target-bx7w2"
Sep 06 19:12:00.318231 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:12:00.318151    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtlr6"
Sep 06 19:12:00.326170 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:12:00.326149    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-57svr\""
Sep 06 19:12:00.333919 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:12:00.333896    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bx7w2"
Sep 06 19:12:00.585006 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:12:00.584926    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dtlr6"]
Sep 06 19:12:00.588133 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:12:00.588095    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd89b285b_cadd_4b89_be22_17b20170f51c.slice/crio-1d45285768f6b6b7963875e8f7c556fdbada7f5c07a016d4ec92cecb65418329 WatchSource:0}: Error finding container 1d45285768f6b6b7963875e8f7c556fdbada7f5c07a016d4ec92cecb65418329: Status 404 returned error can't find the container with id 1d45285768f6b6b7963875e8f7c556fdbada7f5c07a016d4ec92cecb65418329
Sep 06 19:12:00.608245 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:12:00.608222    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bx7w2"]
Sep 06 19:12:00.611374 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:12:00.611353    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf989fafb_d7c2_4079_93ed_61da8f78e53b.slice/crio-9e428a4f2072fad4eac8b281ae504ef64d169df82ed0e8b54ea53176fa286c82 WatchSource:0}: Error finding container 9e428a4f2072fad4eac8b281ae504ef64d169df82ed0e8b54ea53176fa286c82: Status 404 returned error can't find the container with id 9e428a4f2072fad4eac8b281ae504ef64d169df82ed0e8b54ea53176fa286c82
Sep 06 19:12:00.747904 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:12:00.747860    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bx7w2" event={"ID":"f989fafb-d7c2-4079-93ed-61da8f78e53b","Type":"ContainerStarted","Data":"9e428a4f2072fad4eac8b281ae504ef64d169df82ed0e8b54ea53176fa286c82"}
Sep 06 19:12:00.749084 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:12:00.749062    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dtlr6" event={"ID":"d89b285b-cadd-4b89-be22-17b20170f51c","Type":"ContainerStarted","Data":"1d45285768f6b6b7963875e8f7c556fdbada7f5c07a016d4ec92cecb65418329"}
Sep 06 19:12:01.024957 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:12:01.024916    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d59fb326-5ce6-4955-8d91-1c4f2dda0b15-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-g982h\" (UID: \"d59fb326-5ce6-4955-8d91-1c4f2dda0b15\") " pod="openshift-network-console/networking-console-plugin-79977f9844-g982h"
Sep 06 19:12:01.025364 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:12:01.025000    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-registry-tls\") pod \"image-registry-6964544647-pbxn2\" (UID: \"bdd70125-96a1-41de-a36d-edec1a41e56b\") " pod="openshift-image-registry/image-registry-6964544647-pbxn2"
Sep 06 19:12:01.025364 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:12:01.025065    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/342dbbef-dc3c-4b6c-bbe6-77727df044e5-metrics-tls\") pod \"dns-default-2s46l\" (UID: \"342dbbef-dc3c-4b6c-bbe6-77727df044e5\") " pod="openshift-dns/dns-default-2s46l"
Sep 06 19:12:01.025364 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:12:01.025123    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 06 19:12:01.025364 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:12:01.025146    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 19:12:01.025364 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:12:01.025166    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6964544647-pbxn2: secret "image-registry-tls" not found
Sep 06 19:12:01.025364 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:12:01.025216    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d59fb326-5ce6-4955-8d91-1c4f2dda0b15-networking-console-plugin-cert podName:d59fb326-5ce6-4955-8d91-1c4f2dda0b15 nodeName:}" failed. No retries permitted until 2026-09-06 19:12:33.025191189 +0000 UTC m=+99.266076535 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d59fb326-5ce6-4955-8d91-1c4f2dda0b15-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-g982h" (UID: "d59fb326-5ce6-4955-8d91-1c4f2dda0b15") : secret "networking-console-plugin-cert" not found
Sep 06 19:12:01.025364 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:12:01.025219    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 19:12:01.025364 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:12:01.025239    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-registry-tls podName:bdd70125-96a1-41de-a36d-edec1a41e56b nodeName:}" failed. No retries permitted until 2026-09-06 19:12:33.025227655 +0000 UTC m=+99.266112978 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-registry-tls") pod "image-registry-6964544647-pbxn2" (UID: "bdd70125-96a1-41de-a36d-edec1a41e56b") : secret "image-registry-tls" not found
Sep 06 19:12:01.025364 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:12:01.025274    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/342dbbef-dc3c-4b6c-bbe6-77727df044e5-metrics-tls podName:342dbbef-dc3c-4b6c-bbe6-77727df044e5 nodeName:}" failed. No retries permitted until 2026-09-06 19:12:33.025257185 +0000 UTC m=+99.266142521 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/342dbbef-dc3c-4b6c-bbe6-77727df044e5-metrics-tls") pod "dns-default-2s46l" (UID: "342dbbef-dc3c-4b6c-bbe6-77727df044e5") : secret "dns-default-metrics-tls" not found
Sep 06 19:12:05.771514 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:12:05.771462    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bx7w2" event={"ID":"f989fafb-d7c2-4079-93ed-61da8f78e53b","Type":"ContainerStarted","Data":"e40b52c70cd3fc7de5bc57bbb70eb3cf6de18aba3df823d42f99d9c74c686bb0"}
Sep 06 19:12:05.772015 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:12:05.771590    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bx7w2"
Sep 06 19:12:05.772988 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:12:05.772966    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dtlr6" event={"ID":"d89b285b-cadd-4b89-be22-17b20170f51c","Type":"ContainerStarted","Data":"c732103dce69445e10932cd9fd3f8ca66ec1bda47bf633534951ad4d66bdc1a9"}
Sep 06 19:12:05.785462 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:12:05.785417    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bx7w2" podStartSLOduration=66.200294328 podStartE2EDuration="1m10.785405044s" totalImagesPullingTime="4.585110716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:10:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:12:05.784905849 +0000 UTC m=+72.025791216" watchObservedRunningTime="2026-09-06 19:12:05.785405044 +0000 UTC m=+72.026290390"
Sep 06 19:12:05.797245 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:12:05.797207    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dtlr6" podStartSLOduration=66.176891966 podStartE2EDuration="1m10.797194722s" totalImagesPullingTime="4.620302756s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 19:10:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:12:05.796630998 +0000 UTC m=+72.037516343" watchObservedRunningTime="2026-09-06 19:12:05.797194722 +0000 UTC m=+72.038080066"
Sep 06 19:12:33.085869 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:12:33.085820    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d59fb326-5ce6-4955-8d91-1c4f2dda0b15-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-g982h\" (UID: \"d59fb326-5ce6-4955-8d91-1c4f2dda0b15\") " pod="openshift-network-console/networking-console-plugin-79977f9844-g982h"
Sep 06 19:12:33.086356 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:12:33.085886    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-registry-tls\") pod \"image-registry-6964544647-pbxn2\" (UID: \"bdd70125-96a1-41de-a36d-edec1a41e56b\") " pod="openshift-image-registry/image-registry-6964544647-pbxn2"
Sep 06 19:12:33.086356 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:12:33.085931    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/342dbbef-dc3c-4b6c-bbe6-77727df044e5-metrics-tls\") pod \"dns-default-2s46l\" (UID: \"342dbbef-dc3c-4b6c-bbe6-77727df044e5\") " pod="openshift-dns/dns-default-2s46l"
Sep 06 19:12:33.086356 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:12:33.085972    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 06 19:12:33.086356 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:12:33.086035    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 19:12:33.086356 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:12:33.086038    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d59fb326-5ce6-4955-8d91-1c4f2dda0b15-networking-console-plugin-cert podName:d59fb326-5ce6-4955-8d91-1c4f2dda0b15 nodeName:}" failed. No retries permitted until 2026-09-06 19:13:37.086022674 +0000 UTC m=+163.326908001 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d59fb326-5ce6-4955-8d91-1c4f2dda0b15-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-g982h" (UID: "d59fb326-5ce6-4955-8d91-1c4f2dda0b15") : secret "networking-console-plugin-cert" not found
Sep 06 19:12:33.086356 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:12:33.086100    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/342dbbef-dc3c-4b6c-bbe6-77727df044e5-metrics-tls podName:342dbbef-dc3c-4b6c-bbe6-77727df044e5 nodeName:}" failed. No retries permitted until 2026-09-06 19:13:37.086083004 +0000 UTC m=+163.326968335 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/342dbbef-dc3c-4b6c-bbe6-77727df044e5-metrics-tls") pod "dns-default-2s46l" (UID: "342dbbef-dc3c-4b6c-bbe6-77727df044e5") : secret "dns-default-metrics-tls" not found
Sep 06 19:12:33.086356 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:12:33.086036    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 19:12:33.086356 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:12:33.086115    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6964544647-pbxn2: secret "image-registry-tls" not found
Sep 06 19:12:33.086356 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:12:33.086159    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-registry-tls podName:bdd70125-96a1-41de-a36d-edec1a41e56b nodeName:}" failed. No retries permitted until 2026-09-06 19:13:37.086147408 +0000 UTC m=+163.327032735 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-registry-tls") pod "image-registry-6964544647-pbxn2" (UID: "bdd70125-96a1-41de-a36d-edec1a41e56b") : secret "image-registry-tls" not found
Sep 06 19:12:36.778413 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:12:36.778383    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bx7w2"
Sep 06 19:13:04.115081 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:13:04.115042    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f48c221-e457-4c65-b433-902fa3a75f09-metrics-certs\") pod \"network-metrics-daemon-vzktl\" (UID: \"2f48c221-e457-4c65-b433-902fa3a75f09\") " pod="openshift-multus/network-metrics-daemon-vzktl"
Sep 06 19:13:04.115557 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:13:04.115163    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 06 19:13:04.115557 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:13:04.115222    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f48c221-e457-4c65-b433-902fa3a75f09-metrics-certs podName:2f48c221-e457-4c65-b433-902fa3a75f09 nodeName:}" failed. No retries permitted until 2026-09-06 19:15:06.115209269 +0000 UTC m=+252.356094593 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f48c221-e457-4c65-b433-902fa3a75f09-metrics-certs") pod "network-metrics-daemon-vzktl" (UID: "2f48c221-e457-4c65-b433-902fa3a75f09") : secret "metrics-daemon-secret" not found
Sep 06 19:13:32.157985 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:13:32.157937    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-79977f9844-g982h" podUID="d59fb326-5ce6-4955-8d91-1c4f2dda0b15"
Sep 06 19:13:32.165518 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:13:32.165497    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6964544647-pbxn2" podUID="bdd70125-96a1-41de-a36d-edec1a41e56b"
Sep 06 19:13:32.204642 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:13:32.204615    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2s46l" podUID="342dbbef-dc3c-4b6c-bbe6-77727df044e5"
Sep 06 19:13:32.428795 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:13:32.428729    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-vzktl" podUID="2f48c221-e457-4c65-b433-902fa3a75f09"
Sep 06 19:13:33.022424 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:13:33.021559    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-g982h"
Sep 06 19:13:33.022424 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:13:33.021923    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6964544647-pbxn2"
Sep 06 19:13:33.022424 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:13:33.022209    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2s46l"
Sep 06 19:13:37.144344 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:13:37.144298    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-registry-tls\") pod \"image-registry-6964544647-pbxn2\" (UID: \"bdd70125-96a1-41de-a36d-edec1a41e56b\") " pod="openshift-image-registry/image-registry-6964544647-pbxn2"
Sep 06 19:13:37.144344 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:13:37.144353    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/342dbbef-dc3c-4b6c-bbe6-77727df044e5-metrics-tls\") pod \"dns-default-2s46l\" (UID: \"342dbbef-dc3c-4b6c-bbe6-77727df044e5\") " pod="openshift-dns/dns-default-2s46l"
Sep 06 19:13:37.144834 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:13:37.144385    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d59fb326-5ce6-4955-8d91-1c4f2dda0b15-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-g982h\" (UID: \"d59fb326-5ce6-4955-8d91-1c4f2dda0b15\") " pod="openshift-network-console/networking-console-plugin-79977f9844-g982h"
Sep 06 19:13:37.144834 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:13:37.144460    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 06 19:13:37.144834 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:13:37.144462    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 19:13:37.144834 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:13:37.144500    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6964544647-pbxn2: secret "image-registry-tls" not found
Sep 06 19:13:37.144834 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:13:37.144511    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 19:13:37.144834 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:13:37.144526    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d59fb326-5ce6-4955-8d91-1c4f2dda0b15-networking-console-plugin-cert podName:d59fb326-5ce6-4955-8d91-1c4f2dda0b15 nodeName:}" failed. No retries permitted until 2026-09-06 19:15:39.144512414 +0000 UTC m=+285.385397737 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d59fb326-5ce6-4955-8d91-1c4f2dda0b15-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-g982h" (UID: "d59fb326-5ce6-4955-8d91-1c4f2dda0b15") : secret "networking-console-plugin-cert" not found
Sep 06 19:13:37.144834 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:13:37.144553    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-registry-tls podName:bdd70125-96a1-41de-a36d-edec1a41e56b nodeName:}" failed. No retries permitted until 2026-09-06 19:15:39.14453465 +0000 UTC m=+285.385419991 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-registry-tls") pod "image-registry-6964544647-pbxn2" (UID: "bdd70125-96a1-41de-a36d-edec1a41e56b") : secret "image-registry-tls" not found
Sep 06 19:13:37.144834 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:13:37.144569    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/342dbbef-dc3c-4b6c-bbe6-77727df044e5-metrics-tls podName:342dbbef-dc3c-4b6c-bbe6-77727df044e5 nodeName:}" failed. No retries permitted until 2026-09-06 19:15:39.144562355 +0000 UTC m=+285.385447678 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/342dbbef-dc3c-4b6c-bbe6-77727df044e5-metrics-tls") pod "dns-default-2s46l" (UID: "342dbbef-dc3c-4b6c-bbe6-77727df044e5") : secret "dns-default-metrics-tls" not found
Sep 06 19:13:40.677277 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:13:40.677177    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cb66cd76-46xk5" podUID="a29c8bfe-e1d3-45eb-9665-f7770cad94f3" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.9:8000/readyz\": dial tcp 10.132.0.9:8000: connect: connection refused"
Sep 06 19:13:41.045988 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:13:41.045953    2577 generic.go:356] "Generic (PLEG): container finished" podID="a29c8bfe-e1d3-45eb-9665-f7770cad94f3" containerID="e875ef77d80d2b6ac11aec52f07db825879ba7d8dd9a1d112c8478dbf6534be1" exitCode=1
Sep 06 19:13:41.046158 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:13:41.046021    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cb66cd76-46xk5" event={"ID":"a29c8bfe-e1d3-45eb-9665-f7770cad94f3","Type":"ContainerDied","Data":"e875ef77d80d2b6ac11aec52f07db825879ba7d8dd9a1d112c8478dbf6534be1"}
Sep 06 19:13:41.046361 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:13:41.046345    2577 scope.go:117] "RemoveContainer" containerID="e875ef77d80d2b6ac11aec52f07db825879ba7d8dd9a1d112c8478dbf6534be1"
Sep 06 19:13:41.047437 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:13:41.047418    2577 generic.go:356] "Generic (PLEG): container finished" podID="e3ab0344-ff86-4036-9813-69eddfa00b55" containerID="11f837926e90e206ddbf373454da7d21b0fbd2158265632b29c5962a08982fd2" exitCode=255
Sep 06 19:13:41.047537 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:13:41.047492    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74d4ddf68d-vfcgt" event={"ID":"e3ab0344-ff86-4036-9813-69eddfa00b55","Type":"ContainerDied","Data":"11f837926e90e206ddbf373454da7d21b0fbd2158265632b29c5962a08982fd2"}
Sep 06 19:13:41.047781 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:13:41.047765    2577 scope.go:117] "RemoveContainer" containerID="11f837926e90e206ddbf373454da7d21b0fbd2158265632b29c5962a08982fd2"
Sep 06 19:13:42.052257 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:13:42.052229    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cb66cd76-46xk5" event={"ID":"a29c8bfe-e1d3-45eb-9665-f7770cad94f3","Type":"ContainerStarted","Data":"f138df599365582cc568f8b96f0a93da3a65292b629f853b97518ba6bbf95c58"}
Sep 06 19:13:42.052730 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:13:42.052567    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cb66cd76-46xk5"
Sep 06 19:13:42.053142 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:13:42.053118    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cb66cd76-46xk5"
Sep 06 19:13:42.054043 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:13:42.054022    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74d4ddf68d-vfcgt" event={"ID":"e3ab0344-ff86-4036-9813-69eddfa00b55","Type":"ContainerStarted","Data":"3ea61e9d5d280a0b0e56c3c8dcdba7be2b5d68bef05617bb14b2b5f89bf74ead"}
Sep 06 19:13:44.384601 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:13:44.384565    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzktl"
Sep 06 19:15:03.739026 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:03.738991    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-45m4z"]
Sep 06 19:15:03.742255 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:03.742232    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-45m4z"
Sep 06 19:15:03.744346 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:03.744323    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 06 19:15:03.744431 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:03.744418    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 06 19:15:03.744580 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:03.744564    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 06 19:15:03.744689 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:03.744668    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 06 19:15:03.745183 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:03.745168    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-grwwn\""
Sep 06 19:15:03.753945 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:03.753924    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-45m4z"]
Sep 06 19:15:03.814125 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:03.814090    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nqqx\" (UniqueName: \"kubernetes.io/projected/8a2640d1-f766-4c7d-af33-ef7855731bae-kube-api-access-7nqqx\") pod \"insights-runtime-extractor-45m4z\" (UID: \"8a2640d1-f766-4c7d-af33-ef7855731bae\") " pod="openshift-insights/insights-runtime-extractor-45m4z"
Sep 06 19:15:03.814125 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:03.814122    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8a2640d1-f766-4c7d-af33-ef7855731bae-data-volume\") pod \"insights-runtime-extractor-45m4z\" (UID: \"8a2640d1-f766-4c7d-af33-ef7855731bae\") " pod="openshift-insights/insights-runtime-extractor-45m4z"
Sep 06 19:15:03.814307 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:03.814141    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a2640d1-f766-4c7d-af33-ef7855731bae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-45m4z\" (UID: \"8a2640d1-f766-4c7d-af33-ef7855731bae\") " pod="openshift-insights/insights-runtime-extractor-45m4z"
Sep 06 19:15:03.814307 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:03.814191    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a2640d1-f766-4c7d-af33-ef7855731bae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-45m4z\" (UID: \"8a2640d1-f766-4c7d-af33-ef7855731bae\") " pod="openshift-insights/insights-runtime-extractor-45m4z"
Sep 06 19:15:03.814307 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:03.814224    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8a2640d1-f766-4c7d-af33-ef7855731bae-crio-socket\") pod \"insights-runtime-extractor-45m4z\" (UID: \"8a2640d1-f766-4c7d-af33-ef7855731bae\") " pod="openshift-insights/insights-runtime-extractor-45m4z"
Sep 06 19:15:03.914913 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:03.914870    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nqqx\" (UniqueName: \"kubernetes.io/projected/8a2640d1-f766-4c7d-af33-ef7855731bae-kube-api-access-7nqqx\") pod \"insights-runtime-extractor-45m4z\" (UID: \"8a2640d1-f766-4c7d-af33-ef7855731bae\") " pod="openshift-insights/insights-runtime-extractor-45m4z"
Sep 06 19:15:03.914913 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:03.914914    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8a2640d1-f766-4c7d-af33-ef7855731bae-data-volume\") pod \"insights-runtime-extractor-45m4z\" (UID: \"8a2640d1-f766-4c7d-af33-ef7855731bae\") " pod="openshift-insights/insights-runtime-extractor-45m4z"
Sep 06 19:15:03.915082 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:03.914933    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a2640d1-f766-4c7d-af33-ef7855731bae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-45m4z\" (UID: \"8a2640d1-f766-4c7d-af33-ef7855731bae\") " pod="openshift-insights/insights-runtime-extractor-45m4z"
Sep 06 19:15:03.915082 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:03.914968    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a2640d1-f766-4c7d-af33-ef7855731bae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-45m4z\" (UID: \"8a2640d1-f766-4c7d-af33-ef7855731bae\") " pod="openshift-insights/insights-runtime-extractor-45m4z"
Sep 06 19:15:03.915082 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:03.914989    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8a2640d1-f766-4c7d-af33-ef7855731bae-crio-socket\") pod \"insights-runtime-extractor-45m4z\" (UID: \"8a2640d1-f766-4c7d-af33-ef7855731bae\") " pod="openshift-insights/insights-runtime-extractor-45m4z"
Sep 06 19:15:03.915082 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:03.915063    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8a2640d1-f766-4c7d-af33-ef7855731bae-crio-socket\") pod \"insights-runtime-extractor-45m4z\" (UID: \"8a2640d1-f766-4c7d-af33-ef7855731bae\") " pod="openshift-insights/insights-runtime-extractor-45m4z"
Sep 06 19:15:03.915082 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:15:03.915072    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 06 19:15:03.915247 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:15:03.915131    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 19:15:03.915247 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:15:03.915164    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a2640d1-f766-4c7d-af33-ef7855731bae-kube-rbac-proxy-cm podName:8a2640d1-f766-4c7d-af33-ef7855731bae nodeName:}" failed. No retries permitted until 2026-09-06 19:15:04.415144739 +0000 UTC m=+250.656030081 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8a2640d1-f766-4c7d-af33-ef7855731bae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-45m4z" (UID: "8a2640d1-f766-4c7d-af33-ef7855731bae") : configmap "kube-rbac-proxy" not found
Sep 06 19:15:03.915247 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:15:03.915203    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a2640d1-f766-4c7d-af33-ef7855731bae-insights-runtime-extractor-tls podName:8a2640d1-f766-4c7d-af33-ef7855731bae nodeName:}" failed. No retries permitted until 2026-09-06 19:15:04.415185394 +0000 UTC m=+250.656070730 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8a2640d1-f766-4c7d-af33-ef7855731bae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-45m4z" (UID: "8a2640d1-f766-4c7d-af33-ef7855731bae") : secret "insights-runtime-extractor-tls" not found
Sep 06 19:15:03.915247 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:03.915236    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8a2640d1-f766-4c7d-af33-ef7855731bae-data-volume\") pod \"insights-runtime-extractor-45m4z\" (UID: \"8a2640d1-f766-4c7d-af33-ef7855731bae\") " pod="openshift-insights/insights-runtime-extractor-45m4z"
Sep 06 19:15:03.922303 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:03.922275    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nqqx\" (UniqueName: \"kubernetes.io/projected/8a2640d1-f766-4c7d-af33-ef7855731bae-kube-api-access-7nqqx\") pod \"insights-runtime-extractor-45m4z\" (UID: \"8a2640d1-f766-4c7d-af33-ef7855731bae\") " pod="openshift-insights/insights-runtime-extractor-45m4z"
Sep 06 19:15:04.419112 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:04.419083    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a2640d1-f766-4c7d-af33-ef7855731bae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-45m4z\" (UID: \"8a2640d1-f766-4c7d-af33-ef7855731bae\") " pod="openshift-insights/insights-runtime-extractor-45m4z"
Sep 06 19:15:04.419276 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:04.419191    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a2640d1-f766-4c7d-af33-ef7855731bae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-45m4z\" (UID: \"8a2640d1-f766-4c7d-af33-ef7855731bae\") " pod="openshift-insights/insights-runtime-extractor-45m4z"
Sep 06 19:15:04.419276 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:15:04.419210    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 19:15:04.419276 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:15:04.419259    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 06 19:15:04.419276 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:15:04.419271    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a2640d1-f766-4c7d-af33-ef7855731bae-insights-runtime-extractor-tls podName:8a2640d1-f766-4c7d-af33-ef7855731bae nodeName:}" failed. No retries permitted until 2026-09-06 19:15:05.419256581 +0000 UTC m=+251.660141908 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8a2640d1-f766-4c7d-af33-ef7855731bae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-45m4z" (UID: "8a2640d1-f766-4c7d-af33-ef7855731bae") : secret "insights-runtime-extractor-tls" not found
Sep 06 19:15:04.419425 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:15:04.419306    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a2640d1-f766-4c7d-af33-ef7855731bae-kube-rbac-proxy-cm podName:8a2640d1-f766-4c7d-af33-ef7855731bae nodeName:}" failed. No retries permitted until 2026-09-06 19:15:05.419291145 +0000 UTC m=+251.660176488 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8a2640d1-f766-4c7d-af33-ef7855731bae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-45m4z" (UID: "8a2640d1-f766-4c7d-af33-ef7855731bae") : configmap "kube-rbac-proxy" not found
Sep 06 19:15:05.423851 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:05.423815    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a2640d1-f766-4c7d-af33-ef7855731bae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-45m4z\" (UID: \"8a2640d1-f766-4c7d-af33-ef7855731bae\") " pod="openshift-insights/insights-runtime-extractor-45m4z"
Sep 06 19:15:05.424245 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:05.423882    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a2640d1-f766-4c7d-af33-ef7855731bae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-45m4z\" (UID: \"8a2640d1-f766-4c7d-af33-ef7855731bae\") " pod="openshift-insights/insights-runtime-extractor-45m4z"
Sep 06 19:15:05.424245 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:15:05.423922    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 06 19:15:05.424245 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:15:05.423969    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a2640d1-f766-4c7d-af33-ef7855731bae-kube-rbac-proxy-cm podName:8a2640d1-f766-4c7d-af33-ef7855731bae nodeName:}" failed. No retries permitted until 2026-09-06 19:15:07.42395587 +0000 UTC m=+253.664841217 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8a2640d1-f766-4c7d-af33-ef7855731bae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-45m4z" (UID: "8a2640d1-f766-4c7d-af33-ef7855731bae") : configmap "kube-rbac-proxy" not found
Sep 06 19:15:05.424245 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:15:05.423994    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 19:15:05.424245 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:15:05.424048    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a2640d1-f766-4c7d-af33-ef7855731bae-insights-runtime-extractor-tls podName:8a2640d1-f766-4c7d-af33-ef7855731bae nodeName:}" failed. No retries permitted until 2026-09-06 19:15:07.42403361 +0000 UTC m=+253.664918933 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8a2640d1-f766-4c7d-af33-ef7855731bae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-45m4z" (UID: "8a2640d1-f766-4c7d-af33-ef7855731bae") : secret "insights-runtime-extractor-tls" not found
Sep 06 19:15:05.515137 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:05.515119    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-d7s2q_1dcb8c05-bebe-4e55-bee3-fcda70b424b4/dns-node-resolver/0.log"
Sep 06 19:15:06.130024 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:06.129996    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f48c221-e457-4c65-b433-902fa3a75f09-metrics-certs\") pod \"network-metrics-daemon-vzktl\" (UID: \"2f48c221-e457-4c65-b433-902fa3a75f09\") " pod="openshift-multus/network-metrics-daemon-vzktl"
Sep 06 19:15:06.130178 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:15:06.130126    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 06 19:15:06.130223 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:15:06.130190    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f48c221-e457-4c65-b433-902fa3a75f09-metrics-certs podName:2f48c221-e457-4c65-b433-902fa3a75f09 nodeName:}" failed. No retries permitted until 2026-09-06 19:17:08.130174025 +0000 UTC m=+374.371059367 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f48c221-e457-4c65-b433-902fa3a75f09-metrics-certs") pod "network-metrics-daemon-vzktl" (UID: "2f48c221-e457-4c65-b433-902fa3a75f09") : secret "metrics-daemon-secret" not found
Sep 06 19:15:06.516974 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:06.516942    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fxkhd_00c5b89b-8ae6-4d75-9906-3b0ed677d9b2/node-ca/0.log"
Sep 06 19:15:07.315612 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:07.315588    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jnw6x_f028f00d-b01c-42bf-babe-63aa84ea6b53/serve-healthcheck-canary/0.log"
Sep 06 19:15:07.439144 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:07.439112    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a2640d1-f766-4c7d-af33-ef7855731bae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-45m4z\" (UID: \"8a2640d1-f766-4c7d-af33-ef7855731bae\") " pod="openshift-insights/insights-runtime-extractor-45m4z"
Sep 06 19:15:07.439234 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:07.439155    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a2640d1-f766-4c7d-af33-ef7855731bae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-45m4z\" (UID: \"8a2640d1-f766-4c7d-af33-ef7855731bae\") " pod="openshift-insights/insights-runtime-extractor-45m4z"
Sep 06 19:15:07.439234 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:15:07.439224    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 06 19:15:07.439304 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:15:07.439257    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 19:15:07.439304 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:15:07.439276    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a2640d1-f766-4c7d-af33-ef7855731bae-kube-rbac-proxy-cm podName:8a2640d1-f766-4c7d-af33-ef7855731bae nodeName:}" failed. No retries permitted until 2026-09-06 19:15:11.439262475 +0000 UTC m=+257.680147797 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8a2640d1-f766-4c7d-af33-ef7855731bae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-45m4z" (UID: "8a2640d1-f766-4c7d-af33-ef7855731bae") : configmap "kube-rbac-proxy" not found
Sep 06 19:15:07.439304 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:15:07.439297    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a2640d1-f766-4c7d-af33-ef7855731bae-insights-runtime-extractor-tls podName:8a2640d1-f766-4c7d-af33-ef7855731bae nodeName:}" failed. No retries permitted until 2026-09-06 19:15:11.439283358 +0000 UTC m=+257.680168700 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8a2640d1-f766-4c7d-af33-ef7855731bae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-45m4z" (UID: "8a2640d1-f766-4c7d-af33-ef7855731bae") : secret "insights-runtime-extractor-tls" not found
Sep 06 19:15:11.467768 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:11.467739    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a2640d1-f766-4c7d-af33-ef7855731bae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-45m4z\" (UID: \"8a2640d1-f766-4c7d-af33-ef7855731bae\") " pod="openshift-insights/insights-runtime-extractor-45m4z"
Sep 06 19:15:11.468257 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:15:11.467870    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 19:15:11.468257 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:11.467903    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a2640d1-f766-4c7d-af33-ef7855731bae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-45m4z\" (UID: \"8a2640d1-f766-4c7d-af33-ef7855731bae\") " pod="openshift-insights/insights-runtime-extractor-45m4z"
Sep 06 19:15:11.468257 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:15:11.467921    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a2640d1-f766-4c7d-af33-ef7855731bae-insights-runtime-extractor-tls podName:8a2640d1-f766-4c7d-af33-ef7855731bae nodeName:}" failed. No retries permitted until 2026-09-06 19:15:19.467907107 +0000 UTC m=+265.708792445 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8a2640d1-f766-4c7d-af33-ef7855731bae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-45m4z" (UID: "8a2640d1-f766-4c7d-af33-ef7855731bae") : secret "insights-runtime-extractor-tls" not found
Sep 06 19:15:11.468257 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:15:11.467967    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 06 19:15:11.468257 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:15:11.468014    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a2640d1-f766-4c7d-af33-ef7855731bae-kube-rbac-proxy-cm podName:8a2640d1-f766-4c7d-af33-ef7855731bae nodeName:}" failed. No retries permitted until 2026-09-06 19:15:19.468002126 +0000 UTC m=+265.708887448 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8a2640d1-f766-4c7d-af33-ef7855731bae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-45m4z" (UID: "8a2640d1-f766-4c7d-af33-ef7855731bae") : configmap "kube-rbac-proxy" not found
Sep 06 19:15:19.480720 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:19.480646    2577 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f84cb857-z9fh7" podUID="20a52446-bfd0-4bf5-a34c-5f930c3f5833" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 06 19:15:19.524499 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:19.524455    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a2640d1-f766-4c7d-af33-ef7855731bae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-45m4z\" (UID: \"8a2640d1-f766-4c7d-af33-ef7855731bae\") " pod="openshift-insights/insights-runtime-extractor-45m4z"
Sep 06 19:15:19.524639 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:19.524515    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a2640d1-f766-4c7d-af33-ef7855731bae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-45m4z\" (UID: \"8a2640d1-f766-4c7d-af33-ef7855731bae\") " pod="openshift-insights/insights-runtime-extractor-45m4z"
Sep 06 19:15:19.524639 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:15:19.524635    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 19:15:19.524737 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:15:19.524680    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a2640d1-f766-4c7d-af33-ef7855731bae-insights-runtime-extractor-tls podName:8a2640d1-f766-4c7d-af33-ef7855731bae nodeName:}" failed. No retries permitted until 2026-09-06 19:15:35.524666593 +0000 UTC m=+281.765551915 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8a2640d1-f766-4c7d-af33-ef7855731bae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-45m4z" (UID: "8a2640d1-f766-4c7d-af33-ef7855731bae") : secret "insights-runtime-extractor-tls" not found
Sep 06 19:15:19.525077 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:19.525053    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a2640d1-f766-4c7d-af33-ef7855731bae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-45m4z\" (UID: \"8a2640d1-f766-4c7d-af33-ef7855731bae\") " pod="openshift-insights/insights-runtime-extractor-45m4z"
Sep 06 19:15:29.481389 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:29.481350    2577 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f84cb857-z9fh7" podUID="20a52446-bfd0-4bf5-a34c-5f930c3f5833" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 06 19:15:35.533574 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:35.533540    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a2640d1-f766-4c7d-af33-ef7855731bae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-45m4z\" (UID: \"8a2640d1-f766-4c7d-af33-ef7855731bae\") " pod="openshift-insights/insights-runtime-extractor-45m4z"
Sep 06 19:15:35.535692 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:35.535661    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a2640d1-f766-4c7d-af33-ef7855731bae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-45m4z\" (UID: \"8a2640d1-f766-4c7d-af33-ef7855731bae\") " pod="openshift-insights/insights-runtime-extractor-45m4z"
Sep 06 19:15:35.550632 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:35.550613    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-45m4z"
Sep 06 19:15:35.816365 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:35.816296    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-45m4z"]
Sep 06 19:15:35.819320 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:15:35.819298    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a2640d1_f766_4c7d_af33_ef7855731bae.slice/crio-6292007efb25cee47d3e0d1b4c659fc732ea66c9bceec2fcab1d26b917a02b6f WatchSource:0}: Error finding container 6292007efb25cee47d3e0d1b4c659fc732ea66c9bceec2fcab1d26b917a02b6f: Status 404 returned error can't find the container with id 6292007efb25cee47d3e0d1b4c659fc732ea66c9bceec2fcab1d26b917a02b6f
Sep 06 19:15:36.022343 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:15:36.022308    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-79977f9844-g982h" podUID="d59fb326-5ce6-4955-8d91-1c4f2dda0b15"
Sep 06 19:15:36.022343 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:15:36.022304    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6964544647-pbxn2" podUID="bdd70125-96a1-41de-a36d-edec1a41e56b"
Sep 06 19:15:36.023262 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:15:36.023248    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2s46l" podUID="342dbbef-dc3c-4b6c-bbe6-77727df044e5"
Sep 06 19:15:36.380965 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:36.380932    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-45m4z" event={"ID":"8a2640d1-f766-4c7d-af33-ef7855731bae","Type":"ContainerStarted","Data":"d456d2f95abf8329d7946cdbff7a5ca6c6ccfc6f922295a98555b3d173d6149a"}
Sep 06 19:15:36.381127 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:36.380969    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2s46l"
Sep 06 19:15:36.381127 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:36.380995    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-45m4z" event={"ID":"8a2640d1-f766-4c7d-af33-ef7855731bae","Type":"ContainerStarted","Data":"6292007efb25cee47d3e0d1b4c659fc732ea66c9bceec2fcab1d26b917a02b6f"}
Sep 06 19:15:36.381127 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:36.380974    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6964544647-pbxn2"
Sep 06 19:15:36.381127 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:36.380971    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-g982h"
Sep 06 19:15:37.388560 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:37.388523    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-45m4z" event={"ID":"8a2640d1-f766-4c7d-af33-ef7855731bae","Type":"ContainerStarted","Data":"d4bf1043916d781501bd87958bd13c82032efe1efe6f5a19f04dd8c0a3ae7ae3"}
Sep 06 19:15:38.394018 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:38.393941    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-45m4z" event={"ID":"8a2640d1-f766-4c7d-af33-ef7855731bae","Type":"ContainerStarted","Data":"8986a6adfb0e84a2b36512f0785e121f382231205769a9abc8a0f0fef3ba72b3"}
Sep 06 19:15:38.410214 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:38.410165    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-45m4z" podStartSLOduration=33.351917584 podStartE2EDuration="35.41015221s" totalImagesPullingTime="2.058234626s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 19:15:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:15:38.408928233 +0000 UTC m=+284.649813576" watchObservedRunningTime="2026-09-06 19:15:38.41015221 +0000 UTC m=+284.651037552"
Sep 06 19:15:39.159250 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:39.159199    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d59fb326-5ce6-4955-8d91-1c4f2dda0b15-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-g982h\" (UID: \"d59fb326-5ce6-4955-8d91-1c4f2dda0b15\") " pod="openshift-network-console/networking-console-plugin-79977f9844-g982h"
Sep 06 19:15:39.159250 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:39.159253    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-registry-tls\") pod \"image-registry-6964544647-pbxn2\" (UID: \"bdd70125-96a1-41de-a36d-edec1a41e56b\") " pod="openshift-image-registry/image-registry-6964544647-pbxn2"
Sep 06 19:15:39.159546 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:39.159274    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/342dbbef-dc3c-4b6c-bbe6-77727df044e5-metrics-tls\") pod \"dns-default-2s46l\" (UID: \"342dbbef-dc3c-4b6c-bbe6-77727df044e5\") " pod="openshift-dns/dns-default-2s46l"
Sep 06 19:15:39.161681 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:39.161653    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/342dbbef-dc3c-4b6c-bbe6-77727df044e5-metrics-tls\") pod \"dns-default-2s46l\" (UID: \"342dbbef-dc3c-4b6c-bbe6-77727df044e5\") " pod="openshift-dns/dns-default-2s46l"
Sep 06 19:15:39.161788 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:39.161738    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d59fb326-5ce6-4955-8d91-1c4f2dda0b15-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-g982h\" (UID: \"d59fb326-5ce6-4955-8d91-1c4f2dda0b15\") " pod="openshift-network-console/networking-console-plugin-79977f9844-g982h"
Sep 06 19:15:39.161788 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:39.161738    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-registry-tls\") pod \"image-registry-6964544647-pbxn2\" (UID: \"bdd70125-96a1-41de-a36d-edec1a41e56b\") " pod="openshift-image-registry/image-registry-6964544647-pbxn2"
Sep 06 19:15:39.384759 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:39.384729    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-j6tpp\""
Sep 06 19:15:39.384759 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:39.384747    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nxfsd\""
Sep 06 19:15:39.384925 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:39.384790    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ptdbl\""
Sep 06 19:15:39.391758 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:39.391740    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2s46l"
Sep 06 19:15:39.391854 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:39.391780    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6964544647-pbxn2"
Sep 06 19:15:39.391854 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:39.391742    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-g982h"
Sep 06 19:15:39.481723 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:39.481640    2577 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f84cb857-z9fh7" podUID="20a52446-bfd0-4bf5-a34c-5f930c3f5833" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 06 19:15:39.481723 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:39.481698    2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f84cb857-z9fh7"
Sep 06 19:15:39.482171 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:39.482142    2577 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"1ad2e44ba940ee476bdb7f27986d4e8a5e36ec8585a6de62ee0f327e8d33e66b"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f84cb857-z9fh7" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Sep 06 19:15:39.482208 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:39.482192    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f84cb857-z9fh7" podUID="20a52446-bfd0-4bf5-a34c-5f930c3f5833" containerName="service-proxy" containerID="cri-o://1ad2e44ba940ee476bdb7f27986d4e8a5e36ec8585a6de62ee0f327e8d33e66b" gracePeriod=30
Sep 06 19:15:39.668808 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:39.668695    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2s46l"]
Sep 06 19:15:39.671190 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:15:39.671156    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod342dbbef_dc3c_4b6c_bbe6_77727df044e5.slice/crio-074f5a913177722fd49b631b243934ce76117fc7ba22f8b329a0cf47d92682d5 WatchSource:0}: Error finding container 074f5a913177722fd49b631b243934ce76117fc7ba22f8b329a0cf47d92682d5: Status 404 returned error can't find the container with id 074f5a913177722fd49b631b243934ce76117fc7ba22f8b329a0cf47d92682d5
Sep 06 19:15:39.671974 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:39.671934    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6964544647-pbxn2"]
Sep 06 19:15:39.675078 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:39.674906    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-g982h"]
Sep 06 19:15:39.675181 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:15:39.675158    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdd70125_96a1_41de_a36d_edec1a41e56b.slice/crio-3b86dfb685b89ce6b88859b3c0f7a12f0fcf41b1d3264b569b7421fdebcc757c WatchSource:0}: Error finding container 3b86dfb685b89ce6b88859b3c0f7a12f0fcf41b1d3264b569b7421fdebcc757c: Status 404 returned error can't find the container with id 3b86dfb685b89ce6b88859b3c0f7a12f0fcf41b1d3264b569b7421fdebcc757c
Sep 06 19:15:39.678143 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:15:39.678123    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd59fb326_5ce6_4955_8d91_1c4f2dda0b15.slice/crio-a4ccc09dd6dca24c32db58fa8614f8f579efd27431a197b397b74bdbb5b02c4c WatchSource:0}: Error finding container a4ccc09dd6dca24c32db58fa8614f8f579efd27431a197b397b74bdbb5b02c4c: Status 404 returned error can't find the container with id a4ccc09dd6dca24c32db58fa8614f8f579efd27431a197b397b74bdbb5b02c4c
Sep 06 19:15:40.405045 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:40.404930    2577 generic.go:356] "Generic (PLEG): container finished" podID="20a52446-bfd0-4bf5-a34c-5f930c3f5833" containerID="1ad2e44ba940ee476bdb7f27986d4e8a5e36ec8585a6de62ee0f327e8d33e66b" exitCode=2
Sep 06 19:15:40.405045 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:40.404970    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f84cb857-z9fh7" event={"ID":"20a52446-bfd0-4bf5-a34c-5f930c3f5833","Type":"ContainerDied","Data":"1ad2e44ba940ee476bdb7f27986d4e8a5e36ec8585a6de62ee0f327e8d33e66b"}
Sep 06 19:15:40.405045 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:40.405010    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f84cb857-z9fh7" event={"ID":"20a52446-bfd0-4bf5-a34c-5f930c3f5833","Type":"ContainerStarted","Data":"3a9dcc12539222c2c11c358ae7d2de4296b996ebd2f73aa852001ec4a40b4dfc"}
Sep 06 19:15:40.407501 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:40.407452    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6964544647-pbxn2" event={"ID":"bdd70125-96a1-41de-a36d-edec1a41e56b","Type":"ContainerStarted","Data":"bdf801ae70209fbaa9859e3c07b8609276c9caf5f5d072b9b1ea9b0d1f000867"}
Sep 06 19:15:40.407614 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:40.407517    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6964544647-pbxn2" event={"ID":"bdd70125-96a1-41de-a36d-edec1a41e56b","Type":"ContainerStarted","Data":"3b86dfb685b89ce6b88859b3c0f7a12f0fcf41b1d3264b569b7421fdebcc757c"}
Sep 06 19:15:40.407748 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:40.407723    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6964544647-pbxn2"
Sep 06 19:15:40.409194 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:40.409169    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-g982h" event={"ID":"d59fb326-5ce6-4955-8d91-1c4f2dda0b15","Type":"ContainerStarted","Data":"a4ccc09dd6dca24c32db58fa8614f8f579efd27431a197b397b74bdbb5b02c4c"}
Sep 06 19:15:40.410794 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:40.410769    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2s46l" event={"ID":"342dbbef-dc3c-4b6c-bbe6-77727df044e5","Type":"ContainerStarted","Data":"074f5a913177722fd49b631b243934ce76117fc7ba22f8b329a0cf47d92682d5"}
Sep 06 19:15:40.439995 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:40.439904    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6964544647-pbxn2" podStartSLOduration=285.439890545 podStartE2EDuration="4m45.439890545s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:10:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:15:40.439615738 +0000 UTC m=+286.680501107" watchObservedRunningTime="2026-09-06 19:15:40.439890545 +0000 UTC m=+286.680775888"
Sep 06 19:15:41.416665 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:41.416621    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-g982h" event={"ID":"d59fb326-5ce6-4955-8d91-1c4f2dda0b15","Type":"ContainerStarted","Data":"8b6b42925534675671b790314b70384a5164f9ef7602a8a4021dc9b0f53bb915"}
Sep 06 19:15:41.430883 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:41.430831    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-g982h" podStartSLOduration=271.181171187 podStartE2EDuration="4m32.430814184s" totalImagesPullingTime="1.249642997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:11:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:15:41.429618008 +0000 UTC m=+287.670503370" watchObservedRunningTime="2026-09-06 19:15:41.430814184 +0000 UTC m=+287.671699530"
Sep 06 19:15:42.053386 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:42.053355    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cb66cd76-46xk5" podUID="a29c8bfe-e1d3-45eb-9665-f7770cad94f3" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.9:8000/readyz\": dial tcp 10.132.0.9:8000: connect: connection refused"
Sep 06 19:15:42.421264 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:42.421192    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2s46l" event={"ID":"342dbbef-dc3c-4b6c-bbe6-77727df044e5","Type":"ContainerStarted","Data":"635fab83cceb5ef06b5d11ad6c9ae704decde0a9c633da63a6aa549aad82f07a"}
Sep 06 19:15:42.421264 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:42.421245    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2s46l" event={"ID":"342dbbef-dc3c-4b6c-bbe6-77727df044e5","Type":"ContainerStarted","Data":"ee21fe453da0a210f72290394c2d1a5f8862252a640817339e5753ce3ff32918"}
Sep 06 19:15:42.421798 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:42.421273    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2s46l"
Sep 06 19:15:42.422942 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:42.422919    2577 generic.go:356] "Generic (PLEG): container finished" podID="a29c8bfe-e1d3-45eb-9665-f7770cad94f3" containerID="f138df599365582cc568f8b96f0a93da3a65292b629f853b97518ba6bbf95c58" exitCode=1
Sep 06 19:15:42.423032 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:42.422992    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cb66cd76-46xk5" event={"ID":"a29c8bfe-e1d3-45eb-9665-f7770cad94f3","Type":"ContainerDied","Data":"f138df599365582cc568f8b96f0a93da3a65292b629f853b97518ba6bbf95c58"}
Sep 06 19:15:42.423093 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:42.423055    2577 scope.go:117] "RemoveContainer" containerID="e875ef77d80d2b6ac11aec52f07db825879ba7d8dd9a1d112c8478dbf6534be1"
Sep 06 19:15:42.423329 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:42.423310    2577 scope.go:117] "RemoveContainer" containerID="f138df599365582cc568f8b96f0a93da3a65292b629f853b97518ba6bbf95c58"
Sep 06 19:15:42.423615 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:15:42.423496    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-64cb66cd76-46xk5_open-cluster-management-agent-addon(a29c8bfe-e1d3-45eb-9665-f7770cad94f3)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cb66cd76-46xk5" podUID="a29c8bfe-e1d3-45eb-9665-f7770cad94f3"
Sep 06 19:15:42.424888 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:42.424872    2577 generic.go:356] "Generic (PLEG): container finished" podID="e3ab0344-ff86-4036-9813-69eddfa00b55" containerID="3ea61e9d5d280a0b0e56c3c8dcdba7be2b5d68bef05617bb14b2b5f89bf74ead" exitCode=255
Sep 06 19:15:42.424965 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:42.424943    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74d4ddf68d-vfcgt" event={"ID":"e3ab0344-ff86-4036-9813-69eddfa00b55","Type":"ContainerDied","Data":"3ea61e9d5d280a0b0e56c3c8dcdba7be2b5d68bef05617bb14b2b5f89bf74ead"}
Sep 06 19:15:42.425251 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:42.425237    2577 scope.go:117] "RemoveContainer" containerID="3ea61e9d5d280a0b0e56c3c8dcdba7be2b5d68bef05617bb14b2b5f89bf74ead"
Sep 06 19:15:42.425364 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:15:42.425348    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-74d4ddf68d-vfcgt_open-cluster-management-agent-addon(e3ab0344-ff86-4036-9813-69eddfa00b55)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74d4ddf68d-vfcgt" podUID="e3ab0344-ff86-4036-9813-69eddfa00b55"
Sep 06 19:15:42.432354 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:42.432339    2577 scope.go:117] "RemoveContainer" containerID="11f837926e90e206ddbf373454da7d21b0fbd2158265632b29c5962a08982fd2"
Sep 06 19:15:42.437124 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:42.437046    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2s46l" podStartSLOduration=251.573560266 podStartE2EDuration="4m13.437031828s" totalImagesPullingTime="1.863471562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:11:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:15:42.436449088 +0000 UTC m=+288.677334451" watchObservedRunningTime="2026-09-06 19:15:42.437031828 +0000 UTC m=+288.677917173"
Sep 06 19:15:43.115377 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:43.115345    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jzdvv"]
Sep 06 19:15:43.119902 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:43.119882    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jzdvv"
Sep 06 19:15:43.122119 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:43.122096    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 06 19:15:43.122119 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:43.122111    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 06 19:15:43.122265 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:43.122247    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 06 19:15:43.122665 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:43.122647    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 06 19:15:43.123044 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:43.123028    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 06 19:15:43.123145 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:43.123050    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 06 19:15:43.123543 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:43.123527    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-w8pjt\""
Sep 06 19:15:43.288733 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:43.288707    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlmsl\" (UniqueName: \"kubernetes.io/projected/776dc5e7-889d-43ce-a675-bfc52276aebb-kube-api-access-nlmsl\") pod \"node-exporter-jzdvv\" (UID: \"776dc5e7-889d-43ce-a675-bfc52276aebb\") " pod="openshift-monitoring/node-exporter-jzdvv"
Sep 06 19:15:43.288834 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:43.288736    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/776dc5e7-889d-43ce-a675-bfc52276aebb-sys\") pod \"node-exporter-jzdvv\" (UID: \"776dc5e7-889d-43ce-a675-bfc52276aebb\") " pod="openshift-monitoring/node-exporter-jzdvv"
Sep 06 19:15:43.288834 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:43.288752    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/776dc5e7-889d-43ce-a675-bfc52276aebb-node-exporter-textfile\") pod \"node-exporter-jzdvv\" (UID: \"776dc5e7-889d-43ce-a675-bfc52276aebb\") " pod="openshift-monitoring/node-exporter-jzdvv"
Sep 06 19:15:43.288834 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:43.288768    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/776dc5e7-889d-43ce-a675-bfc52276aebb-node-exporter-wtmp\") pod \"node-exporter-jzdvv\" (UID: \"776dc5e7-889d-43ce-a675-bfc52276aebb\") " pod="openshift-monitoring/node-exporter-jzdvv"
Sep 06 19:15:43.288942 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:43.288839    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/776dc5e7-889d-43ce-a675-bfc52276aebb-root\") pod \"node-exporter-jzdvv\" (UID: \"776dc5e7-889d-43ce-a675-bfc52276aebb\") " pod="openshift-monitoring/node-exporter-jzdvv"
Sep 06 19:15:43.288942 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:43.288862    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/776dc5e7-889d-43ce-a675-bfc52276aebb-node-exporter-tls\") pod \"node-exporter-jzdvv\" (UID: \"776dc5e7-889d-43ce-a675-bfc52276aebb\") " pod="openshift-monitoring/node-exporter-jzdvv"
Sep 06 19:15:43.288942 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:43.288891    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/776dc5e7-889d-43ce-a675-bfc52276aebb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jzdvv\" (UID: \"776dc5e7-889d-43ce-a675-bfc52276aebb\") " pod="openshift-monitoring/node-exporter-jzdvv"
Sep 06 19:15:43.288942 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:43.288914    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/776dc5e7-889d-43ce-a675-bfc52276aebb-metrics-client-ca\") pod \"node-exporter-jzdvv\" (UID: \"776dc5e7-889d-43ce-a675-bfc52276aebb\") " pod="openshift-monitoring/node-exporter-jzdvv"
Sep 06 19:15:43.289070 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:43.288946    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/776dc5e7-889d-43ce-a675-bfc52276aebb-node-exporter-accelerators-collector-config\") pod \"node-exporter-jzdvv\" (UID: \"776dc5e7-889d-43ce-a675-bfc52276aebb\") " pod="openshift-monitoring/node-exporter-jzdvv"
Sep 06 19:15:43.389545 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:43.389497    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/776dc5e7-889d-43ce-a675-bfc52276aebb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jzdvv\" (UID: \"776dc5e7-889d-43ce-a675-bfc52276aebb\") " pod="openshift-monitoring/node-exporter-jzdvv"
Sep 06 19:15:43.389545 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:43.389526    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/776dc5e7-889d-43ce-a675-bfc52276aebb-metrics-client-ca\") pod \"node-exporter-jzdvv\" (UID: \"776dc5e7-889d-43ce-a675-bfc52276aebb\") " pod="openshift-monitoring/node-exporter-jzdvv"
Sep 06 19:15:43.389655 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:43.389544    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/776dc5e7-889d-43ce-a675-bfc52276aebb-node-exporter-accelerators-collector-config\") pod \"node-exporter-jzdvv\" (UID: \"776dc5e7-889d-43ce-a675-bfc52276aebb\") " pod="openshift-monitoring/node-exporter-jzdvv"
Sep 06 19:15:43.389655 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:43.389583    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlmsl\" (UniqueName: \"kubernetes.io/projected/776dc5e7-889d-43ce-a675-bfc52276aebb-kube-api-access-nlmsl\") pod \"node-exporter-jzdvv\" (UID: \"776dc5e7-889d-43ce-a675-bfc52276aebb\") " pod="openshift-monitoring/node-exporter-jzdvv"
Sep 06 19:15:43.389655 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:43.389609    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/776dc5e7-889d-43ce-a675-bfc52276aebb-sys\") pod \"node-exporter-jzdvv\" (UID: \"776dc5e7-889d-43ce-a675-bfc52276aebb\") " pod="openshift-monitoring/node-exporter-jzdvv"
Sep 06 19:15:43.389655 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:43.389628    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/776dc5e7-889d-43ce-a675-bfc52276aebb-node-exporter-textfile\") pod \"node-exporter-jzdvv\" (UID: \"776dc5e7-889d-43ce-a675-bfc52276aebb\") " pod="openshift-monitoring/node-exporter-jzdvv"
Sep 06 19:15:43.389655 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:43.389652    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/776dc5e7-889d-43ce-a675-bfc52276aebb-node-exporter-wtmp\") pod \"node-exporter-jzdvv\" (UID: \"776dc5e7-889d-43ce-a675-bfc52276aebb\") " pod="openshift-monitoring/node-exporter-jzdvv"
Sep 06 19:15:43.389875 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:43.389689    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/776dc5e7-889d-43ce-a675-bfc52276aebb-root\") pod \"node-exporter-jzdvv\" (UID: \"776dc5e7-889d-43ce-a675-bfc52276aebb\") " pod="openshift-monitoring/node-exporter-jzdvv"
Sep 06 19:15:43.389875 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:43.389706    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/776dc5e7-889d-43ce-a675-bfc52276aebb-sys\") pod \"node-exporter-jzdvv\" (UID: \"776dc5e7-889d-43ce-a675-bfc52276aebb\") " pod="openshift-monitoring/node-exporter-jzdvv"
Sep 06 19:15:43.389875 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:43.389709    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/776dc5e7-889d-43ce-a675-bfc52276aebb-node-exporter-tls\") pod \"node-exporter-jzdvv\" (UID: \"776dc5e7-889d-43ce-a675-bfc52276aebb\") " pod="openshift-monitoring/node-exporter-jzdvv"
Sep 06 19:15:43.389875 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:43.389758    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/776dc5e7-889d-43ce-a675-bfc52276aebb-root\") pod \"node-exporter-jzdvv\" (UID: \"776dc5e7-889d-43ce-a675-bfc52276aebb\") " pod="openshift-monitoring/node-exporter-jzdvv"
Sep 06 19:15:43.389875 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:15:43.389784    2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 06 19:15:43.389875 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:15:43.389833    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/776dc5e7-889d-43ce-a675-bfc52276aebb-node-exporter-tls podName:776dc5e7-889d-43ce-a675-bfc52276aebb nodeName:}" failed. No retries permitted until 2026-09-06 19:15:43.889816234 +0000 UTC m=+290.130701558 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/776dc5e7-889d-43ce-a675-bfc52276aebb-node-exporter-tls") pod "node-exporter-jzdvv" (UID: "776dc5e7-889d-43ce-a675-bfc52276aebb") : secret "node-exporter-tls" not found
Sep 06 19:15:43.389875 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:43.389834    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/776dc5e7-889d-43ce-a675-bfc52276aebb-node-exporter-wtmp\") pod \"node-exporter-jzdvv\" (UID: \"776dc5e7-889d-43ce-a675-bfc52276aebb\") " pod="openshift-monitoring/node-exporter-jzdvv"
Sep 06 19:15:43.390095 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:43.390049    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/776dc5e7-889d-43ce-a675-bfc52276aebb-node-exporter-textfile\") pod \"node-exporter-jzdvv\" (UID: \"776dc5e7-889d-43ce-a675-bfc52276aebb\") " pod="openshift-monitoring/node-exporter-jzdvv"
Sep 06 19:15:43.390167 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:43.390152    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/776dc5e7-889d-43ce-a675-bfc52276aebb-metrics-client-ca\") pod \"node-exporter-jzdvv\" (UID: \"776dc5e7-889d-43ce-a675-bfc52276aebb\") " pod="openshift-monitoring/node-exporter-jzdvv"
Sep 06 19:15:43.390200 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:43.390153    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/776dc5e7-889d-43ce-a675-bfc52276aebb-node-exporter-accelerators-collector-config\") pod \"node-exporter-jzdvv\" (UID: \"776dc5e7-889d-43ce-a675-bfc52276aebb\") " pod="openshift-monitoring/node-exporter-jzdvv"
Sep 06 19:15:43.391825 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:43.391802    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/776dc5e7-889d-43ce-a675-bfc52276aebb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jzdvv\" (UID: \"776dc5e7-889d-43ce-a675-bfc52276aebb\") " pod="openshift-monitoring/node-exporter-jzdvv"
Sep 06 19:15:43.397047 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:43.397026    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlmsl\" (UniqueName: \"kubernetes.io/projected/776dc5e7-889d-43ce-a675-bfc52276aebb-kube-api-access-nlmsl\") pod \"node-exporter-jzdvv\" (UID: \"776dc5e7-889d-43ce-a675-bfc52276aebb\") " pod="openshift-monitoring/node-exporter-jzdvv"
Sep 06 19:15:43.892613 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:43.892566    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/776dc5e7-889d-43ce-a675-bfc52276aebb-node-exporter-tls\") pod \"node-exporter-jzdvv\" (UID: \"776dc5e7-889d-43ce-a675-bfc52276aebb\") " pod="openshift-monitoring/node-exporter-jzdvv"
Sep 06 19:15:43.894718 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:43.894700    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/776dc5e7-889d-43ce-a675-bfc52276aebb-node-exporter-tls\") pod \"node-exporter-jzdvv\" (UID: \"776dc5e7-889d-43ce-a675-bfc52276aebb\") " pod="openshift-monitoring/node-exporter-jzdvv"
Sep 06 19:15:44.028188 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:44.028161    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jzdvv"
Sep 06 19:15:44.038995 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:15:44.038953    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod776dc5e7_889d_43ce_a675_bfc52276aebb.slice/crio-b985c1bbfd3404c0685d29891100d3fafa6a0389333acc97134a5648c9d62e6f WatchSource:0}: Error finding container b985c1bbfd3404c0685d29891100d3fafa6a0389333acc97134a5648c9d62e6f: Status 404 returned error can't find the container with id b985c1bbfd3404c0685d29891100d3fafa6a0389333acc97134a5648c9d62e6f
Sep 06 19:15:44.436563 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:44.436526    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jzdvv" event={"ID":"776dc5e7-889d-43ce-a675-bfc52276aebb","Type":"ContainerStarted","Data":"b985c1bbfd3404c0685d29891100d3fafa6a0389333acc97134a5648c9d62e6f"}
Sep 06 19:15:45.440878 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:45.440804    2577 generic.go:356] "Generic (PLEG): container finished" podID="776dc5e7-889d-43ce-a675-bfc52276aebb" containerID="3a604ef52856fa287291a5eb547eda8839d83f5e992918c1b901995bb91c7fa1" exitCode=0
Sep 06 19:15:45.441246 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:45.440886    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jzdvv" event={"ID":"776dc5e7-889d-43ce-a675-bfc52276aebb","Type":"ContainerDied","Data":"3a604ef52856fa287291a5eb547eda8839d83f5e992918c1b901995bb91c7fa1"}
Sep 06 19:15:46.448076 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:46.448038    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jzdvv" event={"ID":"776dc5e7-889d-43ce-a675-bfc52276aebb","Type":"ContainerStarted","Data":"5d733f20dfd2fe62a8ee882ef20a058b74e7ab08e780987bdec9bebb0d8b1fe2"}
Sep 06 19:15:46.448419 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:46.448090    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jzdvv" event={"ID":"776dc5e7-889d-43ce-a675-bfc52276aebb","Type":"ContainerStarted","Data":"aecec81dc7b7c85a3626adfb16217d30baee3a4d3d28c9855383f24f9a345379"}
Sep 06 19:15:46.464428 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:46.464387    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jzdvv" podStartSLOduration=2.459790722 podStartE2EDuration="3.464372692s" totalImagesPullingTime="946.328616ms" totalInitContainerRuntime="58.253354ms" isStatefulPod=true podCreationTimestamp="2026-09-06 19:15:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:15:46.464178114 +0000 UTC m=+292.705063475" watchObservedRunningTime="2026-09-06 19:15:46.464372692 +0000 UTC m=+292.705258032"
Sep 06 19:15:47.385857 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:15:47.385819    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-vzktl" podUID="2f48c221-e457-4c65-b433-902fa3a75f09"
Sep 06 19:15:49.450759 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:49.450724    2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74d4ddf68d-vfcgt"
Sep 06 19:15:49.451118 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:49.450996    2577 scope.go:117] "RemoveContainer" containerID="3ea61e9d5d280a0b0e56c3c8dcdba7be2b5d68bef05617bb14b2b5f89bf74ead"
Sep 06 19:15:49.451157 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:15:49.451113    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-74d4ddf68d-vfcgt_open-cluster-management-agent-addon(e3ab0344-ff86-4036-9813-69eddfa00b55)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74d4ddf68d-vfcgt" podUID="e3ab0344-ff86-4036-9813-69eddfa00b55"
Sep 06 19:15:49.473417 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:49.473390    2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cb66cd76-46xk5"
Sep 06 19:15:49.473719 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:49.473705    2577 scope.go:117] "RemoveContainer" containerID="f138df599365582cc568f8b96f0a93da3a65292b629f853b97518ba6bbf95c58"
Sep 06 19:15:49.473863 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:15:49.473845    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-64cb66cd76-46xk5_open-cluster-management-agent-addon(a29c8bfe-e1d3-45eb-9665-f7770cad94f3)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cb66cd76-46xk5" podUID="a29c8bfe-e1d3-45eb-9665-f7770cad94f3"
Sep 06 19:15:52.053170 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:52.053131    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cb66cd76-46xk5"
Sep 06 19:15:52.053637 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:52.053547    2577 scope.go:117] "RemoveContainer" containerID="f138df599365582cc568f8b96f0a93da3a65292b629f853b97518ba6bbf95c58"
Sep 06 19:15:52.435036 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:52.434968    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2s46l"
Sep 06 19:15:52.468312 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:52.468276    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cb66cd76-46xk5" event={"ID":"a29c8bfe-e1d3-45eb-9665-f7770cad94f3","Type":"ContainerStarted","Data":"51e96c964f5c89c95651f6bab56d41051ff60d6f895678bc3117c7f1976afbdc"}
Sep 06 19:15:52.468587 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:52.468565    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cb66cd76-46xk5"
Sep 06 19:15:52.469854 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:52.469832    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cb66cd76-46xk5"
Sep 06 19:15:54.181030 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:54.181006    2577 kubelet.go:1648] "Image garbage collection succeeded"
Sep 06 19:15:59.382241 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:59.382209    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzktl"
Sep 06 19:15:59.396396 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:59.396368    2577 patch_prober.go:28] interesting pod/image-registry-6964544647-pbxn2 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 06 19:15:59.396538 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:15:59.396428    2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6964544647-pbxn2" podUID="bdd70125-96a1-41de-a36d-edec1a41e56b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 06 19:16:01.115596 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:16:01.115564    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6964544647-pbxn2"]
Sep 06 19:16:01.119542 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:16:01.119515    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6964544647-pbxn2"
Sep 06 19:16:03.382367 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:16:03.382340    2577 scope.go:117] "RemoveContainer" containerID="3ea61e9d5d280a0b0e56c3c8dcdba7be2b5d68bef05617bb14b2b5f89bf74ead"
Sep 06 19:16:03.502022 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:16:03.501984    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74d4ddf68d-vfcgt" event={"ID":"e3ab0344-ff86-4036-9813-69eddfa00b55","Type":"ContainerStarted","Data":"80b18697f161ed41665fb4a73da574dd2619cf6163a9c2b3d995a7fbbb18cce1"}
Sep 06 19:16:26.133625 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:16:26.133584    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6964544647-pbxn2" podUID="bdd70125-96a1-41de-a36d-edec1a41e56b" containerName="registry" containerID="cri-o://bdf801ae70209fbaa9859e3c07b8609276c9caf5f5d072b9b1ea9b0d1f000867" gracePeriod=30
Sep 06 19:16:26.369093 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:16:26.369071    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6964544647-pbxn2"
Sep 06 19:16:26.374655 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:16:26.374636    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fd2r7\" (UniqueName: \"kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-kube-api-access-fd2r7\") pod \"bdd70125-96a1-41de-a36d-edec1a41e56b\" (UID: \"bdd70125-96a1-41de-a36d-edec1a41e56b\") "
Sep 06 19:16:26.374719 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:16:26.374667    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bdd70125-96a1-41de-a36d-edec1a41e56b-installation-pull-secrets\") pod \"bdd70125-96a1-41de-a36d-edec1a41e56b\" (UID: \"bdd70125-96a1-41de-a36d-edec1a41e56b\") "
Sep 06 19:16:26.374719 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:16:26.374694    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bdd70125-96a1-41de-a36d-edec1a41e56b-ca-trust-extracted\") pod \"bdd70125-96a1-41de-a36d-edec1a41e56b\" (UID: \"bdd70125-96a1-41de-a36d-edec1a41e56b\") "
Sep 06 19:16:26.374719 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:16:26.374716    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-bound-sa-token\") pod \"bdd70125-96a1-41de-a36d-edec1a41e56b\" (UID: \"bdd70125-96a1-41de-a36d-edec1a41e56b\") "
Sep 06 19:16:26.374865 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:16:26.374745    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bdd70125-96a1-41de-a36d-edec1a41e56b-registry-certificates\") pod \"bdd70125-96a1-41de-a36d-edec1a41e56b\" (UID: \"bdd70125-96a1-41de-a36d-edec1a41e56b\") "
Sep 06 19:16:26.374865 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:16:26.374777    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-registry-tls\") pod \"bdd70125-96a1-41de-a36d-edec1a41e56b\" (UID: \"bdd70125-96a1-41de-a36d-edec1a41e56b\") "
Sep 06 19:16:26.374865 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:16:26.374797    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bdd70125-96a1-41de-a36d-edec1a41e56b-image-registry-private-configuration\") pod \"bdd70125-96a1-41de-a36d-edec1a41e56b\" (UID: \"bdd70125-96a1-41de-a36d-edec1a41e56b\") "
Sep 06 19:16:26.374865 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:16:26.374828    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bdd70125-96a1-41de-a36d-edec1a41e56b-trusted-ca\") pod \"bdd70125-96a1-41de-a36d-edec1a41e56b\" (UID: \"bdd70125-96a1-41de-a36d-edec1a41e56b\") "
Sep 06 19:16:26.375207 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:16:26.375154    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdd70125-96a1-41de-a36d-edec1a41e56b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "bdd70125-96a1-41de-a36d-edec1a41e56b" (UID: "bdd70125-96a1-41de-a36d-edec1a41e56b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:16:26.375395 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:16:26.375339    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdd70125-96a1-41de-a36d-edec1a41e56b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "bdd70125-96a1-41de-a36d-edec1a41e56b" (UID: "bdd70125-96a1-41de-a36d-edec1a41e56b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:16:26.377349 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:16:26.377323    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdd70125-96a1-41de-a36d-edec1a41e56b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "bdd70125-96a1-41de-a36d-edec1a41e56b" (UID: "bdd70125-96a1-41de-a36d-edec1a41e56b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:16:26.377529 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:16:26.377403    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdd70125-96a1-41de-a36d-edec1a41e56b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "bdd70125-96a1-41de-a36d-edec1a41e56b" (UID: "bdd70125-96a1-41de-a36d-edec1a41e56b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:16:26.377529 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:16:26.377520    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-kube-api-access-fd2r7" (OuterVolumeSpecName: "kube-api-access-fd2r7") pod "bdd70125-96a1-41de-a36d-edec1a41e56b" (UID: "bdd70125-96a1-41de-a36d-edec1a41e56b"). InnerVolumeSpecName "kube-api-access-fd2r7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:16:26.377691 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:16:26.377664    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "bdd70125-96a1-41de-a36d-edec1a41e56b" (UID: "bdd70125-96a1-41de-a36d-edec1a41e56b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:16:26.377778 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:16:26.377730    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "bdd70125-96a1-41de-a36d-edec1a41e56b" (UID: "bdd70125-96a1-41de-a36d-edec1a41e56b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:16:26.383772 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:16:26.383721    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdd70125-96a1-41de-a36d-edec1a41e56b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "bdd70125-96a1-41de-a36d-edec1a41e56b" (UID: "bdd70125-96a1-41de-a36d-edec1a41e56b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 19:16:26.475486 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:16:26.475448    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fd2r7\" (UniqueName: \"kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-kube-api-access-fd2r7\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:16:26.475486 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:16:26.475486    2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bdd70125-96a1-41de-a36d-edec1a41e56b-installation-pull-secrets\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:16:26.475634 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:16:26.475496    2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bdd70125-96a1-41de-a36d-edec1a41e56b-ca-trust-extracted\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:16:26.475634 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:16:26.475505    2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-bound-sa-token\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:16:26.475634 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:16:26.475513    2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bdd70125-96a1-41de-a36d-edec1a41e56b-registry-certificates\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:16:26.475634 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:16:26.475523    2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bdd70125-96a1-41de-a36d-edec1a41e56b-registry-tls\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:16:26.475634 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:16:26.475530    2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bdd70125-96a1-41de-a36d-edec1a41e56b-image-registry-private-configuration\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:16:26.475634 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:16:26.475539    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bdd70125-96a1-41de-a36d-edec1a41e56b-trusted-ca\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:16:26.574361 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:16:26.574328    2577 generic.go:356] "Generic (PLEG): container finished" podID="bdd70125-96a1-41de-a36d-edec1a41e56b" containerID="bdf801ae70209fbaa9859e3c07b8609276c9caf5f5d072b9b1ea9b0d1f000867" exitCode=0
Sep 06 19:16:26.574458 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:16:26.574389    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6964544647-pbxn2"
Sep 06 19:16:26.574458 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:16:26.574406    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6964544647-pbxn2" event={"ID":"bdd70125-96a1-41de-a36d-edec1a41e56b","Type":"ContainerDied","Data":"bdf801ae70209fbaa9859e3c07b8609276c9caf5f5d072b9b1ea9b0d1f000867"}
Sep 06 19:16:26.574562 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:16:26.574494    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6964544647-pbxn2" event={"ID":"bdd70125-96a1-41de-a36d-edec1a41e56b","Type":"ContainerDied","Data":"3b86dfb685b89ce6b88859b3c0f7a12f0fcf41b1d3264b569b7421fdebcc757c"}
Sep 06 19:16:26.574562 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:16:26.574522    2577 scope.go:117] "RemoveContainer" containerID="bdf801ae70209fbaa9859e3c07b8609276c9caf5f5d072b9b1ea9b0d1f000867"
Sep 06 19:16:26.582063 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:16:26.582048    2577 scope.go:117] "RemoveContainer" containerID="bdf801ae70209fbaa9859e3c07b8609276c9caf5f5d072b9b1ea9b0d1f000867"
Sep 06 19:16:26.582324 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:16:26.582303    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdf801ae70209fbaa9859e3c07b8609276c9caf5f5d072b9b1ea9b0d1f000867\": container with ID starting with bdf801ae70209fbaa9859e3c07b8609276c9caf5f5d072b9b1ea9b0d1f000867 not found: ID does not exist" containerID="bdf801ae70209fbaa9859e3c07b8609276c9caf5f5d072b9b1ea9b0d1f000867"
Sep 06 19:16:26.582364 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:16:26.582331    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdf801ae70209fbaa9859e3c07b8609276c9caf5f5d072b9b1ea9b0d1f000867"} err="failed to get container status \"bdf801ae70209fbaa9859e3c07b8609276c9caf5f5d072b9b1ea9b0d1f000867\": rpc error: code = NotFound desc = could not find container \"bdf801ae70209fbaa9859e3c07b8609276c9caf5f5d072b9b1ea9b0d1f000867\": container with ID starting with bdf801ae70209fbaa9859e3c07b8609276c9caf5f5d072b9b1ea9b0d1f000867 not found: ID does not exist"
Sep 06 19:16:26.588296 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:16:26.588271    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6964544647-pbxn2"]
Sep 06 19:16:26.591570 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:16:26.591548    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6964544647-pbxn2"]
Sep 06 19:16:28.385814 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:16:28.385782    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdd70125-96a1-41de-a36d-edec1a41e56b" path="/var/lib/kubelet/pods/bdd70125-96a1-41de-a36d-edec1a41e56b/volumes"
Sep 06 19:17:08.168159 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:17:08.168096    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f48c221-e457-4c65-b433-902fa3a75f09-metrics-certs\") pod \"network-metrics-daemon-vzktl\" (UID: \"2f48c221-e457-4c65-b433-902fa3a75f09\") " pod="openshift-multus/network-metrics-daemon-vzktl"
Sep 06 19:17:08.170341 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:17:08.170318    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f48c221-e457-4c65-b433-902fa3a75f09-metrics-certs\") pod \"network-metrics-daemon-vzktl\" (UID: \"2f48c221-e457-4c65-b433-902fa3a75f09\") " pod="openshift-multus/network-metrics-daemon-vzktl"
Sep 06 19:17:08.384847 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:17:08.384816    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6p7v7\""
Sep 06 19:17:08.393512 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:17:08.393481    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzktl"
Sep 06 19:17:08.660575 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:17:08.660551    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vzktl"]
Sep 06 19:17:08.663098 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:17:08.663069    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f48c221_e457_4c65_b433_902fa3a75f09.slice/crio-843ac0918ec5ddc5920adcf68a40b8e96675823d090c80795173f314ce8b4db7 WatchSource:0}: Error finding container 843ac0918ec5ddc5920adcf68a40b8e96675823d090c80795173f314ce8b4db7: Status 404 returned error can't find the container with id 843ac0918ec5ddc5920adcf68a40b8e96675823d090c80795173f314ce8b4db7
Sep 06 19:17:08.665076 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:17:08.665062    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 19:17:08.705395 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:17:08.705312    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vzktl" event={"ID":"2f48c221-e457-4c65-b433-902fa3a75f09","Type":"ContainerStarted","Data":"843ac0918ec5ddc5920adcf68a40b8e96675823d090c80795173f314ce8b4db7"}
Sep 06 19:17:10.714772 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:17:10.714729    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vzktl" event={"ID":"2f48c221-e457-4c65-b433-902fa3a75f09","Type":"ContainerStarted","Data":"0e76284af446fdf229f8cc711bec2de2049e649fe1fa22d8447b6b0df4e0b940"}
Sep 06 19:17:10.715145 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:17:10.714796    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vzktl" event={"ID":"2f48c221-e457-4c65-b433-902fa3a75f09","Type":"ContainerStarted","Data":"f12771145bbeeccff6eca1be613fcc65865f886005239d928e3465c5e5c73e97"}
Sep 06 19:17:10.728553 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:17:10.728504    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vzktl" podStartSLOduration=374.728684051 podStartE2EDuration="6m15.728487782s" totalImagesPullingTime="999.803731ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:10:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:17:10.727620414 +0000 UTC m=+376.968505774" watchObservedRunningTime="2026-09-06 19:17:10.728487782 +0000 UTC m=+376.969373126"
Sep 06 19:20:06.265462 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:06.265384    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-plpqv"]
Sep 06 19:20:06.265964 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:06.265649    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdd70125-96a1-41de-a36d-edec1a41e56b" containerName="registry"
Sep 06 19:20:06.265964 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:06.265661    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdd70125-96a1-41de-a36d-edec1a41e56b" containerName="registry"
Sep 06 19:20:06.265964 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:06.265708    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdd70125-96a1-41de-a36d-edec1a41e56b" containerName="registry"
Sep 06 19:20:06.268369 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:06.268348    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-plpqv"
Sep 06 19:20:06.270282 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:06.270262    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 06 19:20:06.270866 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:06.270845    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 06 19:20:06.270963 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:06.270845    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-k9vjs\""
Sep 06 19:20:06.277592 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:06.277570    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-plpqv"]
Sep 06 19:20:06.411015 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:06.410983    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zwjw\" (UniqueName: \"kubernetes.io/projected/5cb6cb48-3c2d-4ed7-96fe-f33e60751e6e-kube-api-access-5zwjw\") pod \"cert-manager-55b4d954d5-plpqv\" (UID: \"5cb6cb48-3c2d-4ed7-96fe-f33e60751e6e\") " pod="cert-manager/cert-manager-55b4d954d5-plpqv"
Sep 06 19:20:06.411015 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:06.411017    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5cb6cb48-3c2d-4ed7-96fe-f33e60751e6e-bound-sa-token\") pod \"cert-manager-55b4d954d5-plpqv\" (UID: \"5cb6cb48-3c2d-4ed7-96fe-f33e60751e6e\") " pod="cert-manager/cert-manager-55b4d954d5-plpqv"
Sep 06 19:20:06.511848 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:06.511813    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zwjw\" (UniqueName: \"kubernetes.io/projected/5cb6cb48-3c2d-4ed7-96fe-f33e60751e6e-kube-api-access-5zwjw\") pod \"cert-manager-55b4d954d5-plpqv\" (UID: \"5cb6cb48-3c2d-4ed7-96fe-f33e60751e6e\") " pod="cert-manager/cert-manager-55b4d954d5-plpqv"
Sep 06 19:20:06.511981 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:06.511855    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5cb6cb48-3c2d-4ed7-96fe-f33e60751e6e-bound-sa-token\") pod \"cert-manager-55b4d954d5-plpqv\" (UID: \"5cb6cb48-3c2d-4ed7-96fe-f33e60751e6e\") " pod="cert-manager/cert-manager-55b4d954d5-plpqv"
Sep 06 19:20:06.518994 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:06.518935    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zwjw\" (UniqueName: \"kubernetes.io/projected/5cb6cb48-3c2d-4ed7-96fe-f33e60751e6e-kube-api-access-5zwjw\") pod \"cert-manager-55b4d954d5-plpqv\" (UID: \"5cb6cb48-3c2d-4ed7-96fe-f33e60751e6e\") " pod="cert-manager/cert-manager-55b4d954d5-plpqv"
Sep 06 19:20:06.518994 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:06.518950    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5cb6cb48-3c2d-4ed7-96fe-f33e60751e6e-bound-sa-token\") pod \"cert-manager-55b4d954d5-plpqv\" (UID: \"5cb6cb48-3c2d-4ed7-96fe-f33e60751e6e\") " pod="cert-manager/cert-manager-55b4d954d5-plpqv"
Sep 06 19:20:06.578098 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:06.578066    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-plpqv"
Sep 06 19:20:06.846604 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:06.846520    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-plpqv"]
Sep 06 19:20:06.850020 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:20:06.849992    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5cb6cb48_3c2d_4ed7_96fe_f33e60751e6e.slice/crio-4b2f37bbee1d449e68be805934abea56ad88e608837c9a890712642fbc9d7a64 WatchSource:0}: Error finding container 4b2f37bbee1d449e68be805934abea56ad88e608837c9a890712642fbc9d7a64: Status 404 returned error can't find the container with id 4b2f37bbee1d449e68be805934abea56ad88e608837c9a890712642fbc9d7a64
Sep 06 19:20:07.277914 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:07.277881    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-plpqv" event={"ID":"5cb6cb48-3c2d-4ed7-96fe-f33e60751e6e","Type":"ContainerStarted","Data":"4b2f37bbee1d449e68be805934abea56ad88e608837c9a890712642fbc9d7a64"}
Sep 06 19:20:10.291387 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:10.291347    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-plpqv" event={"ID":"5cb6cb48-3c2d-4ed7-96fe-f33e60751e6e","Type":"ContainerStarted","Data":"0ea37fbccc59ac7d3ee2cd5274fa361043c7dfca569ed6e68573ea2d70a05ac1"}
Sep 06 19:20:10.306784 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:10.306727    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-plpqv" podStartSLOduration=1.234622064 podStartE2EDuration="4.3067075s" totalImagesPullingTime="3.072085436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:20:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:20:10.306233248 +0000 UTC m=+556.547118593" watchObservedRunningTime="2026-09-06 19:20:10.3067075 +0000 UTC m=+556.547592846"
Sep 06 19:20:11.048860 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:11.048825    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68l9q"]
Sep 06 19:20:11.052009 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:11.051994    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68l9q"
Sep 06 19:20:11.055390 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:11.055373    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 06 19:20:11.056131 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:11.056114    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-h69zm\""
Sep 06 19:20:11.056182 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:11.056114    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 06 19:20:11.065710 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:11.065687    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68l9q"]
Sep 06 19:20:11.149665 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:11.149627    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l4k9\" (UniqueName: \"kubernetes.io/projected/082bf3f2-7c45-46f5-80a1-119de026a898-kube-api-access-5l4k9\") pod \"openshift-lws-operator-fd8ccff4c-68l9q\" (UID: \"082bf3f2-7c45-46f5-80a1-119de026a898\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68l9q"
Sep 06 19:20:11.149853 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:11.149682    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/082bf3f2-7c45-46f5-80a1-119de026a898-tmp\") pod \"openshift-lws-operator-fd8ccff4c-68l9q\" (UID: \"082bf3f2-7c45-46f5-80a1-119de026a898\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68l9q"
Sep 06 19:20:11.250442 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:11.250395    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l4k9\" (UniqueName: \"kubernetes.io/projected/082bf3f2-7c45-46f5-80a1-119de026a898-kube-api-access-5l4k9\") pod \"openshift-lws-operator-fd8ccff4c-68l9q\" (UID: \"082bf3f2-7c45-46f5-80a1-119de026a898\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68l9q"
Sep 06 19:20:11.250604 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:11.250460    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/082bf3f2-7c45-46f5-80a1-119de026a898-tmp\") pod \"openshift-lws-operator-fd8ccff4c-68l9q\" (UID: \"082bf3f2-7c45-46f5-80a1-119de026a898\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68l9q"
Sep 06 19:20:11.250810 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:11.250792    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/082bf3f2-7c45-46f5-80a1-119de026a898-tmp\") pod \"openshift-lws-operator-fd8ccff4c-68l9q\" (UID: \"082bf3f2-7c45-46f5-80a1-119de026a898\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68l9q"
Sep 06 19:20:11.258047 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:11.258026    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l4k9\" (UniqueName: \"kubernetes.io/projected/082bf3f2-7c45-46f5-80a1-119de026a898-kube-api-access-5l4k9\") pod \"openshift-lws-operator-fd8ccff4c-68l9q\" (UID: \"082bf3f2-7c45-46f5-80a1-119de026a898\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68l9q"
Sep 06 19:20:11.360846 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:11.360775    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68l9q"
Sep 06 19:20:11.627229 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:11.627153    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68l9q"]
Sep 06 19:20:11.630579 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:20:11.630557    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod082bf3f2_7c45_46f5_80a1_119de026a898.slice/crio-5dfc4f412d60ea9273869724ae17a6d406e55a618572918295ebbf0722087dd0 WatchSource:0}: Error finding container 5dfc4f412d60ea9273869724ae17a6d406e55a618572918295ebbf0722087dd0: Status 404 returned error can't find the container with id 5dfc4f412d60ea9273869724ae17a6d406e55a618572918295ebbf0722087dd0
Sep 06 19:20:12.301543 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:12.301503    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68l9q" event={"ID":"082bf3f2-7c45-46f5-80a1-119de026a898","Type":"ContainerStarted","Data":"5dfc4f412d60ea9273869724ae17a6d406e55a618572918295ebbf0722087dd0"}
Sep 06 19:20:14.310937 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:14.310854    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68l9q" event={"ID":"082bf3f2-7c45-46f5-80a1-119de026a898","Type":"ContainerStarted","Data":"7edd88fd0d3453dddd6fafcd4d6f35ae676285e2efc137a884438f2cd8e3a284"}
Sep 06 19:20:14.328951 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:14.328887    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68l9q" podStartSLOduration=0.959621575 podStartE2EDuration="3.328869031s" totalImagesPullingTime="2.369247456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:20:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:20:14.328072276 +0000 UTC m=+560.568957622" watchObservedRunningTime="2026-09-06 19:20:14.328869031 +0000 UTC m=+560.569754379"
Sep 06 19:20:34.587100 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:34.587064    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d4b9b44b9-5rtds"]
Sep 06 19:20:34.590126 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:34.590110    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d4b9b44b9-5rtds"
Sep 06 19:20:34.595405 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:34.595377    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 06 19:20:34.595570 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:34.595410    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 06 19:20:34.595570 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:34.595410    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-b4hv4\""
Sep 06 19:20:34.595570 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:34.595558    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 06 19:20:34.595740 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:34.595605    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 06 19:20:34.607814 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:34.607792    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d4b9b44b9-5rtds"]
Sep 06 19:20:34.711878 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:34.711850    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04e26f01-a4d2-41f8-809f-0ede64e569ab-tmp\") pod \"opendatahub-operator-controller-manager-d4b9b44b9-5rtds\" (UID: \"04e26f01-a4d2-41f8-809f-0ede64e569ab\") " pod="opendatahub/opendatahub-operator-controller-manager-d4b9b44b9-5rtds"
Sep 06 19:20:34.712002 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:34.711895    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04e26f01-a4d2-41f8-809f-0ede64e569ab-webhook-cert\") pod \"opendatahub-operator-controller-manager-d4b9b44b9-5rtds\" (UID: \"04e26f01-a4d2-41f8-809f-0ede64e569ab\") " pod="opendatahub/opendatahub-operator-controller-manager-d4b9b44b9-5rtds"
Sep 06 19:20:34.712002 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:34.711918    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/04e26f01-a4d2-41f8-809f-0ede64e569ab-manifests\") pod \"opendatahub-operator-controller-manager-d4b9b44b9-5rtds\" (UID: \"04e26f01-a4d2-41f8-809f-0ede64e569ab\") " pod="opendatahub/opendatahub-operator-controller-manager-d4b9b44b9-5rtds"
Sep 06 19:20:34.712002 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:34.711968    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/04e26f01-a4d2-41f8-809f-0ede64e569ab-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d4b9b44b9-5rtds\" (UID: \"04e26f01-a4d2-41f8-809f-0ede64e569ab\") " pod="opendatahub/opendatahub-operator-controller-manager-d4b9b44b9-5rtds"
Sep 06 19:20:34.712108 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:34.712013    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2nl7\" (UniqueName: \"kubernetes.io/projected/04e26f01-a4d2-41f8-809f-0ede64e569ab-kube-api-access-z2nl7\") pod \"opendatahub-operator-controller-manager-d4b9b44b9-5rtds\" (UID: \"04e26f01-a4d2-41f8-809f-0ede64e569ab\") " pod="opendatahub/opendatahub-operator-controller-manager-d4b9b44b9-5rtds"
Sep 06 19:20:34.813210 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:34.813183    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04e26f01-a4d2-41f8-809f-0ede64e569ab-webhook-cert\") pod \"opendatahub-operator-controller-manager-d4b9b44b9-5rtds\" (UID: \"04e26f01-a4d2-41f8-809f-0ede64e569ab\") " pod="opendatahub/opendatahub-operator-controller-manager-d4b9b44b9-5rtds"
Sep 06 19:20:34.813277 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:34.813219    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/04e26f01-a4d2-41f8-809f-0ede64e569ab-manifests\") pod \"opendatahub-operator-controller-manager-d4b9b44b9-5rtds\" (UID: \"04e26f01-a4d2-41f8-809f-0ede64e569ab\") " pod="opendatahub/opendatahub-operator-controller-manager-d4b9b44b9-5rtds"
Sep 06 19:20:34.813277 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:34.813242    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/04e26f01-a4d2-41f8-809f-0ede64e569ab-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d4b9b44b9-5rtds\" (UID: \"04e26f01-a4d2-41f8-809f-0ede64e569ab\") " pod="opendatahub/opendatahub-operator-controller-manager-d4b9b44b9-5rtds"
Sep 06 19:20:34.813277 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:34.813271    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2nl7\" (UniqueName: \"kubernetes.io/projected/04e26f01-a4d2-41f8-809f-0ede64e569ab-kube-api-access-z2nl7\") pod \"opendatahub-operator-controller-manager-d4b9b44b9-5rtds\" (UID: \"04e26f01-a4d2-41f8-809f-0ede64e569ab\") " pod="opendatahub/opendatahub-operator-controller-manager-d4b9b44b9-5rtds"
Sep 06 19:20:34.813394 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:34.813320    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04e26f01-a4d2-41f8-809f-0ede64e569ab-tmp\") pod \"opendatahub-operator-controller-manager-d4b9b44b9-5rtds\" (UID: \"04e26f01-a4d2-41f8-809f-0ede64e569ab\") " pod="opendatahub/opendatahub-operator-controller-manager-d4b9b44b9-5rtds"
Sep 06 19:20:34.813616 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:34.813593    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/04e26f01-a4d2-41f8-809f-0ede64e569ab-manifests\") pod \"opendatahub-operator-controller-manager-d4b9b44b9-5rtds\" (UID: \"04e26f01-a4d2-41f8-809f-0ede64e569ab\") " pod="opendatahub/opendatahub-operator-controller-manager-d4b9b44b9-5rtds"
Sep 06 19:20:34.815456 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:34.815428    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04e26f01-a4d2-41f8-809f-0ede64e569ab-tmp\") pod \"opendatahub-operator-controller-manager-d4b9b44b9-5rtds\" (UID: \"04e26f01-a4d2-41f8-809f-0ede64e569ab\") " pod="opendatahub/opendatahub-operator-controller-manager-d4b9b44b9-5rtds"
Sep 06 19:20:34.815725 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:34.815704    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04e26f01-a4d2-41f8-809f-0ede64e569ab-webhook-cert\") pod \"opendatahub-operator-controller-manager-d4b9b44b9-5rtds\" (UID: \"04e26f01-a4d2-41f8-809f-0ede64e569ab\") " pod="opendatahub/opendatahub-operator-controller-manager-d4b9b44b9-5rtds"
Sep 06 19:20:34.815792 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:34.815709    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/04e26f01-a4d2-41f8-809f-0ede64e569ab-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d4b9b44b9-5rtds\" (UID: \"04e26f01-a4d2-41f8-809f-0ede64e569ab\") " pod="opendatahub/opendatahub-operator-controller-manager-d4b9b44b9-5rtds"
Sep 06 19:20:34.820797 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:34.820773    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2nl7\" (UniqueName: \"kubernetes.io/projected/04e26f01-a4d2-41f8-809f-0ede64e569ab-kube-api-access-z2nl7\") pod \"opendatahub-operator-controller-manager-d4b9b44b9-5rtds\" (UID: \"04e26f01-a4d2-41f8-809f-0ede64e569ab\") " pod="opendatahub/opendatahub-operator-controller-manager-d4b9b44b9-5rtds"
Sep 06 19:20:34.903273 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:34.903214    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d4b9b44b9-5rtds"
Sep 06 19:20:35.179800 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:35.179711    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d4b9b44b9-5rtds"]
Sep 06 19:20:35.183121 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:20:35.183093    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04e26f01_a4d2_41f8_809f_0ede64e569ab.slice/crio-c4302d70e5fe3793f52ad07acd1ec9290f8afcdadedced0e7e109049c633b28b WatchSource:0}: Error finding container c4302d70e5fe3793f52ad07acd1ec9290f8afcdadedced0e7e109049c633b28b: Status 404 returned error can't find the container with id c4302d70e5fe3793f52ad07acd1ec9290f8afcdadedced0e7e109049c633b28b
Sep 06 19:20:35.381486 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:35.381436    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d4b9b44b9-5rtds" event={"ID":"04e26f01-a4d2-41f8-809f-0ede64e569ab","Type":"ContainerStarted","Data":"c4302d70e5fe3793f52ad07acd1ec9290f8afcdadedced0e7e109049c633b28b"}
Sep 06 19:20:38.396152 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:38.396072    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d4b9b44b9-5rtds" event={"ID":"04e26f01-a4d2-41f8-809f-0ede64e569ab","Type":"ContainerStarted","Data":"e0efc2e28d1acb9eda55a33812ba3578d54a155f9d8366491501f245143cdcf0"}
Sep 06 19:20:39.401488 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:39.401381    2577 generic.go:356] "Generic (PLEG): container finished" podID="04e26f01-a4d2-41f8-809f-0ede64e569ab" containerID="e0efc2e28d1acb9eda55a33812ba3578d54a155f9d8366491501f245143cdcf0" exitCode=0
Sep 06 19:20:39.401927 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:39.401461    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d4b9b44b9-5rtds" event={"ID":"04e26f01-a4d2-41f8-809f-0ede64e569ab","Type":"ContainerDied","Data":"e0efc2e28d1acb9eda55a33812ba3578d54a155f9d8366491501f245143cdcf0"}
Sep 06 19:20:40.408940 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:40.408900    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d4b9b44b9-5rtds" event={"ID":"04e26f01-a4d2-41f8-809f-0ede64e569ab","Type":"ContainerStarted","Data":"cc30b1c1eee678ac2980156581943dacd56be3184989dde61e20947b09fb94f9"}
Sep 06 19:20:40.409329 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:40.409156    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d4b9b44b9-5rtds"
Sep 06 19:20:40.429989 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:40.429935    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d4b9b44b9-5rtds" podStartSLOduration=2.2657892139999998 podStartE2EDuration="6.429915673s" totalImagesPullingTime="3.152126657s" totalInitContainerRuntime="1.011999802s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:20:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:20:40.429075314 +0000 UTC m=+586.669960691" watchObservedRunningTime="2026-09-06 19:20:40.429915673 +0000 UTC m=+586.670801019"
Sep 06 19:20:51.416900 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:51.416871    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d4b9b44b9-5rtds"
Sep 06 19:20:54.448627 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:54.448591    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-8b7764445-9nj2h"]
Sep 06 19:20:54.453303 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:54.453283    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8b7764445-9nj2h"
Sep 06 19:20:54.455899 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:54.455867    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 06 19:20:54.456026 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:54.455921    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 06 19:20:54.456708 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:54.456663    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 06 19:20:54.456708 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:54.456695    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-b7pgb\""
Sep 06 19:20:54.456928 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:54.456908    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 06 19:20:54.478553 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:54.477631    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8b7764445-9nj2h"]
Sep 06 19:20:54.549200 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:54.549166    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49454096-8bb7-4173-a3b9-5582f678e39d-tls-certs\") pod \"kube-auth-proxy-8b7764445-9nj2h\" (UID: \"49454096-8bb7-4173-a3b9-5582f678e39d\") " pod="openshift-ingress/kube-auth-proxy-8b7764445-9nj2h"
Sep 06 19:20:54.549368 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:54.549209    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49454096-8bb7-4173-a3b9-5582f678e39d-tmp\") pod \"kube-auth-proxy-8b7764445-9nj2h\" (UID: \"49454096-8bb7-4173-a3b9-5582f678e39d\") " pod="openshift-ingress/kube-auth-proxy-8b7764445-9nj2h"
Sep 06 19:20:54.549368 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:54.549248    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4lqz\" (UniqueName: \"kubernetes.io/projected/49454096-8bb7-4173-a3b9-5582f678e39d-kube-api-access-s4lqz\") pod \"kube-auth-proxy-8b7764445-9nj2h\" (UID: \"49454096-8bb7-4173-a3b9-5582f678e39d\") " pod="openshift-ingress/kube-auth-proxy-8b7764445-9nj2h"
Sep 06 19:20:54.650014 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:54.649974    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4lqz\" (UniqueName: \"kubernetes.io/projected/49454096-8bb7-4173-a3b9-5582f678e39d-kube-api-access-s4lqz\") pod \"kube-auth-proxy-8b7764445-9nj2h\" (UID: \"49454096-8bb7-4173-a3b9-5582f678e39d\") " pod="openshift-ingress/kube-auth-proxy-8b7764445-9nj2h"
Sep 06 19:20:54.650181 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:54.650058    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49454096-8bb7-4173-a3b9-5582f678e39d-tls-certs\") pod \"kube-auth-proxy-8b7764445-9nj2h\" (UID: \"49454096-8bb7-4173-a3b9-5582f678e39d\") " pod="openshift-ingress/kube-auth-proxy-8b7764445-9nj2h"
Sep 06 19:20:54.650181 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:54.650099    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49454096-8bb7-4173-a3b9-5582f678e39d-tmp\") pod \"kube-auth-proxy-8b7764445-9nj2h\" (UID: \"49454096-8bb7-4173-a3b9-5582f678e39d\") " pod="openshift-ingress/kube-auth-proxy-8b7764445-9nj2h"
Sep 06 19:20:54.652216 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:54.652192    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49454096-8bb7-4173-a3b9-5582f678e39d-tmp\") pod \"kube-auth-proxy-8b7764445-9nj2h\" (UID: \"49454096-8bb7-4173-a3b9-5582f678e39d\") " pod="openshift-ingress/kube-auth-proxy-8b7764445-9nj2h"
Sep 06 19:20:54.652315 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:54.652301    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49454096-8bb7-4173-a3b9-5582f678e39d-tls-certs\") pod \"kube-auth-proxy-8b7764445-9nj2h\" (UID: \"49454096-8bb7-4173-a3b9-5582f678e39d\") " pod="openshift-ingress/kube-auth-proxy-8b7764445-9nj2h"
Sep 06 19:20:54.658236 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:54.658210    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4lqz\" (UniqueName: \"kubernetes.io/projected/49454096-8bb7-4173-a3b9-5582f678e39d-kube-api-access-s4lqz\") pod \"kube-auth-proxy-8b7764445-9nj2h\" (UID: \"49454096-8bb7-4173-a3b9-5582f678e39d\") " pod="openshift-ingress/kube-auth-proxy-8b7764445-9nj2h"
Sep 06 19:20:54.762608 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:54.762566    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8b7764445-9nj2h"
Sep 06 19:20:55.047972 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:55.047889    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8b7764445-9nj2h"]
Sep 06 19:20:55.051878 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:20:55.051851    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49454096_8bb7_4173_a3b9_5582f678e39d.slice/crio-bc61e0ae3e177f80ad130a0d295d0584f5b8ae1615d2d5e050efcc4fbd6c57d8 WatchSource:0}: Error finding container bc61e0ae3e177f80ad130a0d295d0584f5b8ae1615d2d5e050efcc4fbd6c57d8: Status 404 returned error can't find the container with id bc61e0ae3e177f80ad130a0d295d0584f5b8ae1615d2d5e050efcc4fbd6c57d8
Sep 06 19:20:55.463654 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:55.463567    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8b7764445-9nj2h" event={"ID":"49454096-8bb7-4173-a3b9-5582f678e39d","Type":"ContainerStarted","Data":"bc61e0ae3e177f80ad130a0d295d0584f5b8ae1615d2d5e050efcc4fbd6c57d8"}
Sep 06 19:20:58.479190 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:58.479160    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8b7764445-9nj2h" event={"ID":"49454096-8bb7-4173-a3b9-5582f678e39d","Type":"ContainerStarted","Data":"a860684043dbd69662c29e6c6e572f65a41aa7e20ace653682abc561538b72ac"}
Sep 06 19:20:58.494154 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:20:58.494108    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-8b7764445-9nj2h" podStartSLOduration=1.368605467 podStartE2EDuration="4.494092803s" totalImagesPullingTime="3.125487336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:20:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:20:58.492819115 +0000 UTC m=+604.733704511" watchObservedRunningTime="2026-09-06 19:20:58.494092803 +0000 UTC m=+604.734978148"
Sep 06 19:21:04.943303 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:04.943270    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xk8l9"]
Sep 06 19:21:04.946482 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:04.946450    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-xk8l9"
Sep 06 19:21:04.949013 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:04.948989    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 06 19:21:04.949227 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:04.949084    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-dtb29\""
Sep 06 19:21:04.957133 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:04.957108    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xk8l9"]
Sep 06 19:21:05.025773 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:05.025741    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pn2q\" (UniqueName: \"kubernetes.io/projected/fb5f0c02-5fac-4f5e-9310-73d4b6bb66ef-kube-api-access-7pn2q\") pod \"odh-model-controller-7998c67dc4-xk8l9\" (UID: \"fb5f0c02-5fac-4f5e-9310-73d4b6bb66ef\") " pod="opendatahub/odh-model-controller-7998c67dc4-xk8l9"
Sep 06 19:21:05.025929 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:05.025784    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb5f0c02-5fac-4f5e-9310-73d4b6bb66ef-cert\") pod \"odh-model-controller-7998c67dc4-xk8l9\" (UID: \"fb5f0c02-5fac-4f5e-9310-73d4b6bb66ef\") " pod="opendatahub/odh-model-controller-7998c67dc4-xk8l9"
Sep 06 19:21:05.126408 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:05.126370    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pn2q\" (UniqueName: \"kubernetes.io/projected/fb5f0c02-5fac-4f5e-9310-73d4b6bb66ef-kube-api-access-7pn2q\") pod \"odh-model-controller-7998c67dc4-xk8l9\" (UID: \"fb5f0c02-5fac-4f5e-9310-73d4b6bb66ef\") " pod="opendatahub/odh-model-controller-7998c67dc4-xk8l9"
Sep 06 19:21:05.126408 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:05.126415    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb5f0c02-5fac-4f5e-9310-73d4b6bb66ef-cert\") pod \"odh-model-controller-7998c67dc4-xk8l9\" (UID: \"fb5f0c02-5fac-4f5e-9310-73d4b6bb66ef\") " pod="opendatahub/odh-model-controller-7998c67dc4-xk8l9"
Sep 06 19:21:05.126672 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:21:05.126534    2577 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 06 19:21:05.126672 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:21:05.126602    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb5f0c02-5fac-4f5e-9310-73d4b6bb66ef-cert podName:fb5f0c02-5fac-4f5e-9310-73d4b6bb66ef nodeName:}" failed. No retries permitted until 2026-09-06 19:21:05.626582148 +0000 UTC m=+611.867467488 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fb5f0c02-5fac-4f5e-9310-73d4b6bb66ef-cert") pod "odh-model-controller-7998c67dc4-xk8l9" (UID: "fb5f0c02-5fac-4f5e-9310-73d4b6bb66ef") : secret "odh-model-controller-webhook-cert" not found
Sep 06 19:21:05.136141 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:05.136107    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pn2q\" (UniqueName: \"kubernetes.io/projected/fb5f0c02-5fac-4f5e-9310-73d4b6bb66ef-kube-api-access-7pn2q\") pod \"odh-model-controller-7998c67dc4-xk8l9\" (UID: \"fb5f0c02-5fac-4f5e-9310-73d4b6bb66ef\") " pod="opendatahub/odh-model-controller-7998c67dc4-xk8l9"
Sep 06 19:21:05.253920 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:05.253887    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zkjwv"]
Sep 06 19:21:05.257078 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:05.257058    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-zkjwv"
Sep 06 19:21:05.259125 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:05.259104    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 06 19:21:05.267405 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:05.267384    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zkjwv"]
Sep 06 19:21:05.328293 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:05.328259    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s995\" (UniqueName: \"kubernetes.io/projected/47c657a4-8136-42ff-a024-bc21630a0039-kube-api-access-8s995\") pod \"model-serving-api-54d89bd5fc-zkjwv\" (UID: \"47c657a4-8136-42ff-a024-bc21630a0039\") " pod="opendatahub/model-serving-api-54d89bd5fc-zkjwv"
Sep 06 19:21:05.328462 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:05.328329    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47c657a4-8136-42ff-a024-bc21630a0039-tls-certs\") pod \"model-serving-api-54d89bd5fc-zkjwv\" (UID: \"47c657a4-8136-42ff-a024-bc21630a0039\") " pod="opendatahub/model-serving-api-54d89bd5fc-zkjwv"
Sep 06 19:21:05.429431 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:05.429393    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s995\" (UniqueName: \"kubernetes.io/projected/47c657a4-8136-42ff-a024-bc21630a0039-kube-api-access-8s995\") pod \"model-serving-api-54d89bd5fc-zkjwv\" (UID: \"47c657a4-8136-42ff-a024-bc21630a0039\") " pod="opendatahub/model-serving-api-54d89bd5fc-zkjwv"
Sep 06 19:21:05.429619 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:05.429451    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47c657a4-8136-42ff-a024-bc21630a0039-tls-certs\") pod \"model-serving-api-54d89bd5fc-zkjwv\" (UID: \"47c657a4-8136-42ff-a024-bc21630a0039\") " pod="opendatahub/model-serving-api-54d89bd5fc-zkjwv"
Sep 06 19:21:05.429619 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:21:05.429573    2577 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 06 19:21:05.429737 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:21:05.429633    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47c657a4-8136-42ff-a024-bc21630a0039-tls-certs podName:47c657a4-8136-42ff-a024-bc21630a0039 nodeName:}" failed. No retries permitted until 2026-09-06 19:21:05.92961609 +0000 UTC m=+612.170501413 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/47c657a4-8136-42ff-a024-bc21630a0039-tls-certs") pod "model-serving-api-54d89bd5fc-zkjwv" (UID: "47c657a4-8136-42ff-a024-bc21630a0039") : secret "model-serving-api-tls" not found
Sep 06 19:21:05.437812 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:05.437785    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s995\" (UniqueName: \"kubernetes.io/projected/47c657a4-8136-42ff-a024-bc21630a0039-kube-api-access-8s995\") pod \"model-serving-api-54d89bd5fc-zkjwv\" (UID: \"47c657a4-8136-42ff-a024-bc21630a0039\") " pod="opendatahub/model-serving-api-54d89bd5fc-zkjwv"
Sep 06 19:21:05.631622 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:05.631539    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb5f0c02-5fac-4f5e-9310-73d4b6bb66ef-cert\") pod \"odh-model-controller-7998c67dc4-xk8l9\" (UID: \"fb5f0c02-5fac-4f5e-9310-73d4b6bb66ef\") " pod="opendatahub/odh-model-controller-7998c67dc4-xk8l9"
Sep 06 19:21:05.634028 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:05.634000    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb5f0c02-5fac-4f5e-9310-73d4b6bb66ef-cert\") pod \"odh-model-controller-7998c67dc4-xk8l9\" (UID: \"fb5f0c02-5fac-4f5e-9310-73d4b6bb66ef\") " pod="opendatahub/odh-model-controller-7998c67dc4-xk8l9"
Sep 06 19:21:05.860046 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:05.860010    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-xk8l9"
Sep 06 19:21:05.934130 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:05.934031    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47c657a4-8136-42ff-a024-bc21630a0039-tls-certs\") pod \"model-serving-api-54d89bd5fc-zkjwv\" (UID: \"47c657a4-8136-42ff-a024-bc21630a0039\") " pod="opendatahub/model-serving-api-54d89bd5fc-zkjwv"
Sep 06 19:21:05.936662 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:05.936637    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47c657a4-8136-42ff-a024-bc21630a0039-tls-certs\") pod \"model-serving-api-54d89bd5fc-zkjwv\" (UID: \"47c657a4-8136-42ff-a024-bc21630a0039\") " pod="opendatahub/model-serving-api-54d89bd5fc-zkjwv"
Sep 06 19:21:06.128328 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:06.128295    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xk8l9"]
Sep 06 19:21:06.131685 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:21:06.131658    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb5f0c02_5fac_4f5e_9310_73d4b6bb66ef.slice/crio-72542aca53885e22ca24500c6a8ef95c50de45b20ce0253d3ae4f7009aaa9798 WatchSource:0}: Error finding container 72542aca53885e22ca24500c6a8ef95c50de45b20ce0253d3ae4f7009aaa9798: Status 404 returned error can't find the container with id 72542aca53885e22ca24500c6a8ef95c50de45b20ce0253d3ae4f7009aaa9798
Sep 06 19:21:06.167561 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:06.167491    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-zkjwv"
Sep 06 19:21:06.440268 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:06.440189    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zkjwv"]
Sep 06 19:21:06.443983 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:21:06.443956    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47c657a4_8136_42ff_a024_bc21630a0039.slice/crio-5ef1853714ab41c8869b496fef85754df0850c848e79c0b20cf84883d06ffbc4 WatchSource:0}: Error finding container 5ef1853714ab41c8869b496fef85754df0850c848e79c0b20cf84883d06ffbc4: Status 404 returned error can't find the container with id 5ef1853714ab41c8869b496fef85754df0850c848e79c0b20cf84883d06ffbc4
Sep 06 19:21:06.509904 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:06.509865    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-zkjwv" event={"ID":"47c657a4-8136-42ff-a024-bc21630a0039","Type":"ContainerStarted","Data":"5ef1853714ab41c8869b496fef85754df0850c848e79c0b20cf84883d06ffbc4"}
Sep 06 19:21:06.511200 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:06.511175    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-xk8l9" event={"ID":"fb5f0c02-5fac-4f5e-9310-73d4b6bb66ef","Type":"ContainerStarted","Data":"72542aca53885e22ca24500c6a8ef95c50de45b20ce0253d3ae4f7009aaa9798"}
Sep 06 19:21:09.529380 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:09.529342    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-zkjwv" event={"ID":"47c657a4-8136-42ff-a024-bc21630a0039","Type":"ContainerStarted","Data":"13203960388a9883b5e0df2a1a9696c82dc359f44cd2bc85e8902246637964ed"}
Sep 06 19:21:09.529859 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:09.529443    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-zkjwv"
Sep 06 19:21:09.531485 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:09.531436    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-xk8l9" event={"ID":"fb5f0c02-5fac-4f5e-9310-73d4b6bb66ef","Type":"ContainerStarted","Data":"c4b217e0414aa86cc55c595397ca4dccad50502e5346b449d1da52dbf593077c"}
Sep 06 19:21:09.531610 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:09.531500    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-xk8l9"
Sep 06 19:21:09.546293 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:09.546253    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-zkjwv" podStartSLOduration=1.630090214 podStartE2EDuration="4.546241282s" totalImagesPullingTime="2.916151068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:21:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:21:09.544789349 +0000 UTC m=+615.785674693" watchObservedRunningTime="2026-09-06 19:21:09.546241282 +0000 UTC m=+615.787126619"
Sep 06 19:21:09.566646 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:09.563035    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-xk8l9" podStartSLOduration=2.3310631 podStartE2EDuration="5.563010997s" totalImagesPullingTime="3.231947897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:21:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:21:09.56113722 +0000 UTC m=+615.802022567" watchObservedRunningTime="2026-09-06 19:21:09.563010997 +0000 UTC m=+615.803896343"
Sep 06 19:21:12.240676 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:12.240643    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-mqwhm"]
Sep 06 19:21:12.244298 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:12.244273    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mqwhm"
Sep 06 19:21:12.246709 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:12.246680    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 06 19:21:12.246840 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:12.246712    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 06 19:21:12.246840 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:12.246796    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-msdgd\""
Sep 06 19:21:12.246840 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:12.246688    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 06 19:21:12.247035 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:12.247022    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 06 19:21:12.256083 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:12.256057    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-mqwhm"]
Sep 06 19:21:12.387963 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:12.387929    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7c2e77a-f483-4c54-8594-b94209788dde-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-mqwhm\" (UID: \"c7c2e77a-f483-4c54-8594-b94209788dde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mqwhm"
Sep 06 19:21:12.388122 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:12.387970    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c7c2e77a-f483-4c54-8594-b94209788dde-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-mqwhm\" (UID: \"c7c2e77a-f483-4c54-8594-b94209788dde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mqwhm"
Sep 06 19:21:12.388122 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:12.387988    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c7c2e77a-f483-4c54-8594-b94209788dde-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-mqwhm\" (UID: \"c7c2e77a-f483-4c54-8594-b94209788dde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mqwhm"
Sep 06 19:21:12.388122 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:12.388064    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7jwb\" (UniqueName: \"kubernetes.io/projected/c7c2e77a-f483-4c54-8594-b94209788dde-kube-api-access-v7jwb\") pod \"istiod-openshift-gateway-5677ccb49b-mqwhm\" (UID: \"c7c2e77a-f483-4c54-8594-b94209788dde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mqwhm"
Sep 06 19:21:12.388122 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:12.388108    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7c2e77a-f483-4c54-8594-b94209788dde-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-mqwhm\" (UID: \"c7c2e77a-f483-4c54-8594-b94209788dde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mqwhm"
Sep 06 19:21:12.388305 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:12.388154    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c7c2e77a-f483-4c54-8594-b94209788dde-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-mqwhm\" (UID: \"c7c2e77a-f483-4c54-8594-b94209788dde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mqwhm"
Sep 06 19:21:12.388305 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:12.388194    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c7c2e77a-f483-4c54-8594-b94209788dde-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-mqwhm\" (UID: \"c7c2e77a-f483-4c54-8594-b94209788dde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mqwhm"
Sep 06 19:21:12.489540 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:12.489508    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7c2e77a-f483-4c54-8594-b94209788dde-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-mqwhm\" (UID: \"c7c2e77a-f483-4c54-8594-b94209788dde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mqwhm"
Sep 06 19:21:12.489540 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:12.489542    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c7c2e77a-f483-4c54-8594-b94209788dde-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-mqwhm\" (UID: \"c7c2e77a-f483-4c54-8594-b94209788dde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mqwhm"
Sep 06 19:21:12.489754 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:12.489564    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c7c2e77a-f483-4c54-8594-b94209788dde-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-mqwhm\" (UID: \"c7c2e77a-f483-4c54-8594-b94209788dde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mqwhm"
Sep 06 19:21:12.489754 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:12.489584    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7c2e77a-f483-4c54-8594-b94209788dde-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-mqwhm\" (UID: \"c7c2e77a-f483-4c54-8594-b94209788dde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mqwhm"
Sep 06 19:21:12.489754 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:12.489608    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c7c2e77a-f483-4c54-8594-b94209788dde-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-mqwhm\" (UID: \"c7c2e77a-f483-4c54-8594-b94209788dde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mqwhm"
Sep 06 19:21:12.489754 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:12.489735    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c7c2e77a-f483-4c54-8594-b94209788dde-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-mqwhm\" (UID: \"c7c2e77a-f483-4c54-8594-b94209788dde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mqwhm"
Sep 06 19:21:12.489932 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:12.489815    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7jwb\" (UniqueName: \"kubernetes.io/projected/c7c2e77a-f483-4c54-8594-b94209788dde-kube-api-access-v7jwb\") pod \"istiod-openshift-gateway-5677ccb49b-mqwhm\" (UID: \"c7c2e77a-f483-4c54-8594-b94209788dde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mqwhm"
Sep 06 19:21:12.490428 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:12.490404    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c7c2e77a-f483-4c54-8594-b94209788dde-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-mqwhm\" (UID: \"c7c2e77a-f483-4c54-8594-b94209788dde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mqwhm"
Sep 06 19:21:12.492178 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:12.492125    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c7c2e77a-f483-4c54-8594-b94209788dde-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-mqwhm\" (UID: \"c7c2e77a-f483-4c54-8594-b94209788dde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mqwhm"
Sep 06 19:21:12.492178 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:12.492135    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c7c2e77a-f483-4c54-8594-b94209788dde-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-mqwhm\" (UID: \"c7c2e77a-f483-4c54-8594-b94209788dde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mqwhm"
Sep 06 19:21:12.492313 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:12.492264    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7c2e77a-f483-4c54-8594-b94209788dde-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-mqwhm\" (UID: \"c7c2e77a-f483-4c54-8594-b94209788dde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mqwhm"
Sep 06 19:21:12.492353 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:12.492329    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c7c2e77a-f483-4c54-8594-b94209788dde-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-mqwhm\" (UID: \"c7c2e77a-f483-4c54-8594-b94209788dde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mqwhm"
Sep 06 19:21:12.506455 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:12.506432    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7jwb\" (UniqueName: \"kubernetes.io/projected/c7c2e77a-f483-4c54-8594-b94209788dde-kube-api-access-v7jwb\") pod \"istiod-openshift-gateway-5677ccb49b-mqwhm\" (UID: \"c7c2e77a-f483-4c54-8594-b94209788dde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mqwhm"
Sep 06 19:21:12.508009 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:12.507987    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7c2e77a-f483-4c54-8594-b94209788dde-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-mqwhm\" (UID: \"c7c2e77a-f483-4c54-8594-b94209788dde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mqwhm"
Sep 06 19:21:12.554609 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:12.554590    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mqwhm"
Sep 06 19:21:12.852522 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:12.852481    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-mqwhm"]
Sep 06 19:21:12.855058 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:21:12.855034    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7c2e77a_f483_4c54_8594_b94209788dde.slice/crio-542425a60afc1ee4f11aeabd05d1c2e15a71317245daeca4bf50261c4c7ea3e1 WatchSource:0}: Error finding container 542425a60afc1ee4f11aeabd05d1c2e15a71317245daeca4bf50261c4c7ea3e1: Status 404 returned error can't find the container with id 542425a60afc1ee4f11aeabd05d1c2e15a71317245daeca4bf50261c4c7ea3e1
Sep 06 19:21:13.549109 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:13.549073    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mqwhm" event={"ID":"c7c2e77a-f483-4c54-8594-b94209788dde","Type":"ContainerStarted","Data":"542425a60afc1ee4f11aeabd05d1c2e15a71317245daeca4bf50261c4c7ea3e1"}
Sep 06 19:21:17.650221 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:17.650181    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 06 19:21:17.650456 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:17.650251    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 06 19:21:18.570853 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:18.570812    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mqwhm" event={"ID":"c7c2e77a-f483-4c54-8594-b94209788dde","Type":"ContainerStarted","Data":"65b50d5f48a032b36d22c12ae5ba3375d3452153207ff18980b2c6f188985313"}
Sep 06 19:21:18.571038 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:18.570997    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mqwhm"
Sep 06 19:21:18.572594 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:18.572572    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mqwhm"
Sep 06 19:21:18.589588 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:18.589543    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mqwhm" podStartSLOduration=1.796655436 podStartE2EDuration="6.589529809s" totalImagesPullingTime="4.792874373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:21:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:21:18.587719291 +0000 UTC m=+624.828604639" watchObservedRunningTime="2026-09-06 19:21:18.589529809 +0000 UTC m=+624.830415155"
Sep 06 19:21:20.538038 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:20.538010    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-xk8l9"
Sep 06 19:21:20.539972 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:21:20.539950    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-zkjwv"
Sep 06 19:22:24.558757 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:24.558724    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zg5zv"]
Sep 06 19:22:24.561810 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:24.561787    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zg5zv"
Sep 06 19:22:24.564577 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:24.564554    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 06 19:22:24.564713 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:24.564597    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-24r28\""
Sep 06 19:22:24.565166 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:24.565150    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 06 19:22:24.574058 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:24.574039    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zg5zv"]
Sep 06 19:22:24.632062 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:24.632036    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5hrj\" (UniqueName: \"kubernetes.io/projected/70bc7b08-4549-4554-a4c7-2749ebf66c26-kube-api-access-h5hrj\") pod \"kuadrant-operator-controller-manager-58fc56757c-zg5zv\" (UID: \"70bc7b08-4549-4554-a4c7-2749ebf66c26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zg5zv"
Sep 06 19:22:24.632191 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:24.632070    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/70bc7b08-4549-4554-a4c7-2749ebf66c26-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-zg5zv\" (UID: \"70bc7b08-4549-4554-a4c7-2749ebf66c26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zg5zv"
Sep 06 19:22:24.733333 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:24.733298    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5hrj\" (UniqueName: \"kubernetes.io/projected/70bc7b08-4549-4554-a4c7-2749ebf66c26-kube-api-access-h5hrj\") pod \"kuadrant-operator-controller-manager-58fc56757c-zg5zv\" (UID: \"70bc7b08-4549-4554-a4c7-2749ebf66c26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zg5zv"
Sep 06 19:22:24.733487 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:24.733345    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/70bc7b08-4549-4554-a4c7-2749ebf66c26-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-zg5zv\" (UID: \"70bc7b08-4549-4554-a4c7-2749ebf66c26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zg5zv"
Sep 06 19:22:24.733774 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:24.733755    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/70bc7b08-4549-4554-a4c7-2749ebf66c26-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-zg5zv\" (UID: \"70bc7b08-4549-4554-a4c7-2749ebf66c26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zg5zv"
Sep 06 19:22:24.756298 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:24.756275    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5hrj\" (UniqueName: \"kubernetes.io/projected/70bc7b08-4549-4554-a4c7-2749ebf66c26-kube-api-access-h5hrj\") pod \"kuadrant-operator-controller-manager-58fc56757c-zg5zv\" (UID: \"70bc7b08-4549-4554-a4c7-2749ebf66c26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zg5zv"
Sep 06 19:22:24.871654 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:24.871560    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zg5zv"
Sep 06 19:22:25.148350 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:25.148242    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zg5zv"]
Sep 06 19:22:25.152767 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:22:25.152735    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70bc7b08_4549_4554_a4c7_2749ebf66c26.slice/crio-30ee306fae56ff4c254d211d13b378345551e04fd435bd0fb946f8cec25ee83f WatchSource:0}: Error finding container 30ee306fae56ff4c254d211d13b378345551e04fd435bd0fb946f8cec25ee83f: Status 404 returned error can't find the container with id 30ee306fae56ff4c254d211d13b378345551e04fd435bd0fb946f8cec25ee83f
Sep 06 19:22:25.156086 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:25.156065    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 19:22:25.839293 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:25.839259    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zg5zv" event={"ID":"70bc7b08-4549-4554-a4c7-2749ebf66c26","Type":"ContainerStarted","Data":"30ee306fae56ff4c254d211d13b378345551e04fd435bd0fb946f8cec25ee83f"}
Sep 06 19:22:29.859045 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:29.859009    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zg5zv" event={"ID":"70bc7b08-4549-4554-a4c7-2749ebf66c26","Type":"ContainerStarted","Data":"f2a9ff1c190930567f6dae8ba9d4d11108ec5a6ccbe0b06b9b65e9ff68931e33"}
Sep 06 19:22:29.859404 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:29.859076    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zg5zv"
Sep 06 19:22:29.878295 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:29.878247    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zg5zv" podStartSLOduration=2.050201918 podStartE2EDuration="5.878230879s" totalImagesPullingTime="3.828028961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:22:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:22:29.876230124 +0000 UTC m=+696.117115468" watchObservedRunningTime="2026-09-06 19:22:29.878230879 +0000 UTC m=+696.119116223"
Sep 06 19:22:40.865402 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:40.865372    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zg5zv"
Sep 06 19:22:41.894529 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:41.894494    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-55hlg"]
Sep 06 19:22:41.897860 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:41.897833    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-55hlg"
Sep 06 19:22:41.920797 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:41.920759    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-55hlg"]
Sep 06 19:22:42.059801 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:42.059769    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-55hlg\" (UID: \"0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-55hlg"
Sep 06 19:22:42.059981 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:42.059815    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7g4w\" (UniqueName: \"kubernetes.io/projected/0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262-kube-api-access-b7g4w\") pod \"kuadrant-operator-controller-manager-96db98c47-55hlg\" (UID: \"0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-55hlg"
Sep 06 19:22:42.160704 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:42.160640    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-55hlg\" (UID: \"0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-55hlg"
Sep 06 19:22:42.160704 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:42.160674    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7g4w\" (UniqueName: \"kubernetes.io/projected/0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262-kube-api-access-b7g4w\") pod \"kuadrant-operator-controller-manager-96db98c47-55hlg\" (UID: \"0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-55hlg"
Sep 06 19:22:42.161025 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:42.161006    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-55hlg\" (UID: \"0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-55hlg"
Sep 06 19:22:42.168657 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:42.168631    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7g4w\" (UniqueName: \"kubernetes.io/projected/0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262-kube-api-access-b7g4w\") pod \"kuadrant-operator-controller-manager-96db98c47-55hlg\" (UID: \"0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-55hlg"
Sep 06 19:22:42.207511 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:42.207486    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-55hlg"
Sep 06 19:22:42.480809 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:42.480788    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-55hlg"]
Sep 06 19:22:42.483809 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:22:42.483781    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cd33a1e_6bf8_4cdc_b0d9_f51eb16f1262.slice/crio-0d1219c8a64b6f84ce3c196bbfcaa7493f3cd186a87eb59a1436a97980f705d0 WatchSource:0}: Error finding container 0d1219c8a64b6f84ce3c196bbfcaa7493f3cd186a87eb59a1436a97980f705d0: Status 404 returned error can't find the container with id 0d1219c8a64b6f84ce3c196bbfcaa7493f3cd186a87eb59a1436a97980f705d0
Sep 06 19:22:42.892977 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:42.892891    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zg5zv"]
Sep 06 19:22:42.893281 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:42.893144    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zg5zv" podUID="70bc7b08-4549-4554-a4c7-2749ebf66c26" containerName="manager" containerID="cri-o://f2a9ff1c190930567f6dae8ba9d4d11108ec5a6ccbe0b06b9b65e9ff68931e33" gracePeriod=2
Sep 06 19:22:42.904301 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:42.904270    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zg5zv"]
Sep 06 19:22:42.918594 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:42.918557    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sc79h"]
Sep 06 19:22:42.919172 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:42.918927    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70bc7b08-4549-4554-a4c7-2749ebf66c26" containerName="manager"
Sep 06 19:22:42.919172 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:42.918950    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="70bc7b08-4549-4554-a4c7-2749ebf66c26" containerName="manager"
Sep 06 19:22:42.919172 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:42.919041    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="70bc7b08-4549-4554-a4c7-2749ebf66c26" containerName="manager"
Sep 06 19:22:42.922128 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:42.922110    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-55hlg"]
Sep 06 19:22:42.922224 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:42.922148    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-55hlg"
Sep 06 19:22:42.922224 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:42.922172    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-55hlg" event={"ID":"0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262","Type":"ContainerStarted","Data":"8f3d1c5a4afb4db52992d9aecd92ada506ca9b742bd7998e1f1353571f5d72f6"}
Sep 06 19:22:42.922224 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:42.922198    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-55hlg" event={"ID":"0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262","Type":"ContainerStarted","Data":"0d1219c8a64b6f84ce3c196bbfcaa7493f3cd186a87eb59a1436a97980f705d0"}
Sep 06 19:22:42.922364 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:42.922231    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sc79h"
Sep 06 19:22:42.923250 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:22:42.923224    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-zg5zv\" is forbidden: User \"system:node:ip-10-0-135-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-37.ec2.internal' and this object" podUID="70bc7b08-4549-4554-a4c7-2749ebf66c26" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zg5zv"
Sep 06 19:22:42.929768 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:42.929748    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-55hlg"]
Sep 06 19:22:42.933946 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:42.933926    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sc79h"]
Sep 06 19:22:42.934324 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:22:42.934280    2577 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-09-06T19:22:42Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"200m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://8f3d1c5a4afb4db52992d9aecd92ada506ca9b742bd7998e1f1353571f5d72f6\\\",\\\"image\\\":\\\"registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:8c2d9a84169e86454e4fb3df6f4846c5c5495d19b01137b6e78e113161981e47\\\",\\\"imageID\\\":\\\"registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:3c2960333b4e980e8f34e9089e26f8d62ec6fbbfcd89f29e3577ad4244d663a6\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"manager\\\",\\\"ready\\\":false,\\\"resources\\\":{\\\"limits\\\":{\\\"cpu\\\":\\\"200m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"requests\\\":{\\\"cpu\\\":\\\"200m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-06T19:22:42Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000680000],\\\"uid\\\":1000680000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp/kuadrant\\\",\\\"name\\\":\\\"extensions-socket-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-b7g4w\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"10.132.0.22\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"10.132.0.22\\\"}]}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-96db98c47-55hlg\": pods \"kuadrant-operator-controller-manager-96db98c47-55hlg\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-55hlg"
Sep 06 19:22:42.936298 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:22:42.936266    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-55hlg\" is forbidden: User \"system:node:ip-10-0-135-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-37.ec2.internal' and this object" podUID="0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-55hlg"
Sep 06 19:22:42.938190 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:22:42.937982    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-zg5zv\" is forbidden: User \"system:node:ip-10-0-135-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-37.ec2.internal' and this object" podUID="70bc7b08-4549-4554-a4c7-2749ebf66c26" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zg5zv"
Sep 06 19:22:42.945283 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:42.945261    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ctk7t"]
Sep 06 19:22:42.945538 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:42.945523    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262" containerName="manager"
Sep 06 19:22:42.945538 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:42.945538    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262" containerName="manager"
Sep 06 19:22:42.945664 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:42.945598    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262" containerName="manager"
Sep 06 19:22:42.948542 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:42.948525    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ctk7t"
Sep 06 19:22:42.966073 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:42.966051    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ctk7t"]
Sep 06 19:22:42.992611 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:22:42.992536    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-55hlg\" is forbidden: User \"system:node:ip-10-0-135-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-37.ec2.internal' and this object" podUID="0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-55hlg"
Sep 06 19:22:42.994411 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:22:42.994380    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-zg5zv\" is forbidden: User \"system:node:ip-10-0-135-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-37.ec2.internal' and this object" podUID="70bc7b08-4549-4554-a4c7-2749ebf66c26" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zg5zv"
Sep 06 19:22:43.069974 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:43.069944    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7739f7f9-c5f8-48da-8ecf-cc8eeed03969-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-ctk7t\" (UID: \"7739f7f9-c5f8-48da-8ecf-cc8eeed03969\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ctk7t"
Sep 06 19:22:43.070086 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:43.069989    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq6wm\" (UniqueName: \"kubernetes.io/projected/d5b4b5b5-7921-402a-9a43-4bdd1f109a4c-kube-api-access-mq6wm\") pod \"kuadrant-operator-controller-manager-58fc56757c-sc79h\" (UID: \"d5b4b5b5-7921-402a-9a43-4bdd1f109a4c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sc79h"
Sep 06 19:22:43.070086 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:43.070042    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwmqs\" (UniqueName: \"kubernetes.io/projected/7739f7f9-c5f8-48da-8ecf-cc8eeed03969-kube-api-access-mwmqs\") pod \"kuadrant-operator-controller-manager-96db98c47-ctk7t\" (UID: \"7739f7f9-c5f8-48da-8ecf-cc8eeed03969\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ctk7t"
Sep 06 19:22:43.070153 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:43.070093    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5b4b5b5-7921-402a-9a43-4bdd1f109a4c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-sc79h\" (UID: \"d5b4b5b5-7921-402a-9a43-4bdd1f109a4c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sc79h"
Sep 06 19:22:43.112797 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:43.112773    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zg5zv"
Sep 06 19:22:43.114775 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:22:43.114748    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-55hlg\" is forbidden: User \"system:node:ip-10-0-135-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-37.ec2.internal' and this object" podUID="0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-55hlg"
Sep 06 19:22:43.116386 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:22:43.116361    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-zg5zv\" is forbidden: User \"system:node:ip-10-0-135-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-37.ec2.internal' and this object" podUID="70bc7b08-4549-4554-a4c7-2749ebf66c26" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zg5zv"
Sep 06 19:22:43.170920 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:43.170869    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5b4b5b5-7921-402a-9a43-4bdd1f109a4c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-sc79h\" (UID: \"d5b4b5b5-7921-402a-9a43-4bdd1f109a4c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sc79h"
Sep 06 19:22:43.171011 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:43.170926    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7739f7f9-c5f8-48da-8ecf-cc8eeed03969-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-ctk7t\" (UID: \"7739f7f9-c5f8-48da-8ecf-cc8eeed03969\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ctk7t"
Sep 06 19:22:43.171011 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:43.170959    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq6wm\" (UniqueName: \"kubernetes.io/projected/d5b4b5b5-7921-402a-9a43-4bdd1f109a4c-kube-api-access-mq6wm\") pod \"kuadrant-operator-controller-manager-58fc56757c-sc79h\" (UID: \"d5b4b5b5-7921-402a-9a43-4bdd1f109a4c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sc79h"
Sep 06 19:22:43.171011 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:43.170987    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwmqs\" (UniqueName: \"kubernetes.io/projected/7739f7f9-c5f8-48da-8ecf-cc8eeed03969-kube-api-access-mwmqs\") pod \"kuadrant-operator-controller-manager-96db98c47-ctk7t\" (UID: \"7739f7f9-c5f8-48da-8ecf-cc8eeed03969\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ctk7t"
Sep 06 19:22:43.171264 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:43.171245    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5b4b5b5-7921-402a-9a43-4bdd1f109a4c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-sc79h\" (UID: \"d5b4b5b5-7921-402a-9a43-4bdd1f109a4c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sc79h"
Sep 06 19:22:43.171319 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:43.171264    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7739f7f9-c5f8-48da-8ecf-cc8eeed03969-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-ctk7t\" (UID: \"7739f7f9-c5f8-48da-8ecf-cc8eeed03969\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ctk7t"
Sep 06 19:22:43.180614 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:43.180589    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwmqs\" (UniqueName: \"kubernetes.io/projected/7739f7f9-c5f8-48da-8ecf-cc8eeed03969-kube-api-access-mwmqs\") pod \"kuadrant-operator-controller-manager-96db98c47-ctk7t\" (UID: \"7739f7f9-c5f8-48da-8ecf-cc8eeed03969\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ctk7t"
Sep 06 19:22:43.180828 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:43.180807    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq6wm\" (UniqueName: \"kubernetes.io/projected/d5b4b5b5-7921-402a-9a43-4bdd1f109a4c-kube-api-access-mq6wm\") pod \"kuadrant-operator-controller-manager-58fc56757c-sc79h\" (UID: \"d5b4b5b5-7921-402a-9a43-4bdd1f109a4c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sc79h"
Sep 06 19:22:43.258206 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:43.258176    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sc79h"
Sep 06 19:22:43.265142 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:43.265126    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ctk7t"
Sep 06 19:22:43.272287 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:43.272257    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5hrj\" (UniqueName: \"kubernetes.io/projected/70bc7b08-4549-4554-a4c7-2749ebf66c26-kube-api-access-h5hrj\") pod \"70bc7b08-4549-4554-a4c7-2749ebf66c26\" (UID: \"70bc7b08-4549-4554-a4c7-2749ebf66c26\") "
Sep 06 19:22:43.272376 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:43.272310    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/70bc7b08-4549-4554-a4c7-2749ebf66c26-extensions-socket-volume\") pod \"70bc7b08-4549-4554-a4c7-2749ebf66c26\" (UID: \"70bc7b08-4549-4554-a4c7-2749ebf66c26\") "
Sep 06 19:22:43.272887 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:43.272859    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70bc7b08-4549-4554-a4c7-2749ebf66c26-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "70bc7b08-4549-4554-a4c7-2749ebf66c26" (UID: "70bc7b08-4549-4554-a4c7-2749ebf66c26"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 19:22:43.274318 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:43.274283    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70bc7b08-4549-4554-a4c7-2749ebf66c26-kube-api-access-h5hrj" (OuterVolumeSpecName: "kube-api-access-h5hrj") pod "70bc7b08-4549-4554-a4c7-2749ebf66c26" (UID: "70bc7b08-4549-4554-a4c7-2749ebf66c26"). InnerVolumeSpecName "kube-api-access-h5hrj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:22:43.372958 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:43.372923    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5hrj\" (UniqueName: \"kubernetes.io/projected/70bc7b08-4549-4554-a4c7-2749ebf66c26-kube-api-access-h5hrj\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:22:43.372958 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:43.372955    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/70bc7b08-4549-4554-a4c7-2749ebf66c26-extensions-socket-volume\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:22:43.552300 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:43.552271    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sc79h"]
Sep 06 19:22:43.555518 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:22:43.555495    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5b4b5b5_7921_402a_9a43_4bdd1f109a4c.slice/crio-e77823bed009e3965ea4898bf0c89643a123f9657816cdb6bce55673a404d337 WatchSource:0}: Error finding container e77823bed009e3965ea4898bf0c89643a123f9657816cdb6bce55673a404d337: Status 404 returned error can't find the container with id e77823bed009e3965ea4898bf0c89643a123f9657816cdb6bce55673a404d337
Sep 06 19:22:43.562580 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:22:43.562556    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7739f7f9_c5f8_48da_8ecf_cc8eeed03969.slice/crio-2703794317b9dfd2c81d442736e49a5d16cdc2ec6f01cd21d26aa726de702fd0 WatchSource:0}: Error finding container 2703794317b9dfd2c81d442736e49a5d16cdc2ec6f01cd21d26aa726de702fd0: Status 404 returned error can't find the container with id 2703794317b9dfd2c81d442736e49a5d16cdc2ec6f01cd21d26aa726de702fd0
Sep 06 19:22:43.565380 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:43.565361    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ctk7t"]
Sep 06 19:22:43.927208 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:43.927122    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sc79h" event={"ID":"d5b4b5b5-7921-402a-9a43-4bdd1f109a4c","Type":"ContainerStarted","Data":"261a0e2029c6a11800b28957619828c8f9f3adbb56cf882ba7061b6fce51f368"}
Sep 06 19:22:43.927208 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:43.927186    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sc79h" event={"ID":"d5b4b5b5-7921-402a-9a43-4bdd1f109a4c","Type":"ContainerStarted","Data":"e77823bed009e3965ea4898bf0c89643a123f9657816cdb6bce55673a404d337"}
Sep 06 19:22:43.927651 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:43.927313    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sc79h"
Sep 06 19:22:43.928562 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:43.928538    2577 generic.go:356] "Generic (PLEG): container finished" podID="70bc7b08-4549-4554-a4c7-2749ebf66c26" containerID="f2a9ff1c190930567f6dae8ba9d4d11108ec5a6ccbe0b06b9b65e9ff68931e33" exitCode=0
Sep 06 19:22:43.928649 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:43.928579    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zg5zv"
Sep 06 19:22:43.928649 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:43.928629    2577 scope.go:117] "RemoveContainer" containerID="f2a9ff1c190930567f6dae8ba9d4d11108ec5a6ccbe0b06b9b65e9ff68931e33"
Sep 06 19:22:43.929026 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:22:43.929004    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-55hlg\" is forbidden: User \"system:node:ip-10-0-135-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-37.ec2.internal' and this object" podUID="0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-55hlg"
Sep 06 19:22:43.930449 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:43.930424    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ctk7t" event={"ID":"7739f7f9-c5f8-48da-8ecf-cc8eeed03969","Type":"ContainerStarted","Data":"86bd629244795083fb75b9e4c240404b135c821f0e0276574725c5f153801838"}
Sep 06 19:22:43.930565 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:43.930484    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ctk7t" event={"ID":"7739f7f9-c5f8-48da-8ecf-cc8eeed03969","Type":"ContainerStarted","Data":"2703794317b9dfd2c81d442736e49a5d16cdc2ec6f01cd21d26aa726de702fd0"}
Sep 06 19:22:43.930565 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:43.930541    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-55hlg" podUID="0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262" containerName="manager" containerID="cri-o://8f3d1c5a4afb4db52992d9aecd92ada506ca9b742bd7998e1f1353571f5d72f6" gracePeriod=2
Sep 06 19:22:43.930685 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:22:43.930647    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-zg5zv\" is forbidden: User \"system:node:ip-10-0-135-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-37.ec2.internal' and this object" podUID="70bc7b08-4549-4554-a4c7-2749ebf66c26" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zg5zv"
Sep 06 19:22:43.937590 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:43.937496    2577 scope.go:117] "RemoveContainer" containerID="f2a9ff1c190930567f6dae8ba9d4d11108ec5a6ccbe0b06b9b65e9ff68931e33"
Sep 06 19:22:43.937910 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:22:43.937866    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2a9ff1c190930567f6dae8ba9d4d11108ec5a6ccbe0b06b9b65e9ff68931e33\": container with ID starting with f2a9ff1c190930567f6dae8ba9d4d11108ec5a6ccbe0b06b9b65e9ff68931e33 not found: ID does not exist" containerID="f2a9ff1c190930567f6dae8ba9d4d11108ec5a6ccbe0b06b9b65e9ff68931e33"
Sep 06 19:22:43.937910 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:43.937894    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2a9ff1c190930567f6dae8ba9d4d11108ec5a6ccbe0b06b9b65e9ff68931e33"} err="failed to get container status \"f2a9ff1c190930567f6dae8ba9d4d11108ec5a6ccbe0b06b9b65e9ff68931e33\": rpc error: code = NotFound desc = could not find container \"f2a9ff1c190930567f6dae8ba9d4d11108ec5a6ccbe0b06b9b65e9ff68931e33\": container with ID starting with f2a9ff1c190930567f6dae8ba9d4d11108ec5a6ccbe0b06b9b65e9ff68931e33 not found: ID does not exist"
Sep 06 19:22:43.953054 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:43.953014    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sc79h" podStartSLOduration=1.95297692 podStartE2EDuration="1.95297692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:22:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:22:43.952033158 +0000 UTC m=+710.192918503" watchObservedRunningTime="2026-09-06 19:22:43.95297692 +0000 UTC m=+710.193862261"
Sep 06 19:22:43.970758 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:43.970717    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ctk7t" podStartSLOduration=1.970705085 podStartE2EDuration="1.970705085s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:22:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:22:43.96934993 +0000 UTC m=+710.210235302" watchObservedRunningTime="2026-09-06 19:22:43.970705085 +0000 UTC m=+710.211590430"
Sep 06 19:22:43.971142 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:22:43.971118    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-55hlg\" is forbidden: User \"system:node:ip-10-0-135-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-37.ec2.internal' and this object" podUID="0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-55hlg"
Sep 06 19:22:43.972795 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:22:43.972776    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-zg5zv\" is forbidden: User \"system:node:ip-10-0-135-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-37.ec2.internal' and this object" podUID="70bc7b08-4549-4554-a4c7-2749ebf66c26" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zg5zv"
Sep 06 19:22:44.152683 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:44.152658    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-55hlg"
Sep 06 19:22:44.154640 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:22:44.154614    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-55hlg\" is forbidden: User \"system:node:ip-10-0-135-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-37.ec2.internal' and this object" podUID="0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-55hlg"
Sep 06 19:22:44.156156 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:22:44.156134    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-zg5zv\" is forbidden: User \"system:node:ip-10-0-135-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-37.ec2.internal' and this object" podUID="70bc7b08-4549-4554-a4c7-2749ebf66c26" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zg5zv"
Sep 06 19:22:44.280652 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:44.280626    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7g4w\" (UniqueName: \"kubernetes.io/projected/0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262-kube-api-access-b7g4w\") pod \"0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262\" (UID: \"0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262\") "
Sep 06 19:22:44.280818 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:44.280748    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262-extensions-socket-volume\") pod \"0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262\" (UID: \"0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262\") "
Sep 06 19:22:44.281103 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:44.281075    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262" (UID: "0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 19:22:44.282635 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:44.282612    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262-kube-api-access-b7g4w" (OuterVolumeSpecName: "kube-api-access-b7g4w") pod "0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262" (UID: "0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262"). InnerVolumeSpecName "kube-api-access-b7g4w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:22:44.381577 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:44.381546    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262-extensions-socket-volume\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:22:44.381577 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:44.381571    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7g4w\" (UniqueName: \"kubernetes.io/projected/0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262-kube-api-access-b7g4w\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:22:44.384908 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:22:44.384877    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-zg5zv\" is forbidden: User \"system:node:ip-10-0-135-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-37.ec2.internal' and this object" podUID="70bc7b08-4549-4554-a4c7-2749ebf66c26" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zg5zv"
Sep 06 19:22:44.386578 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:22:44.386551    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-55hlg\" is forbidden: User \"system:node:ip-10-0-135-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-37.ec2.internal' and this object" podUID="0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-55hlg"
Sep 06 19:22:44.387128 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:44.387108    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262" path="/var/lib/kubelet/pods/0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262/volumes"
Sep 06 19:22:44.387452 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:44.387440    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70bc7b08-4549-4554-a4c7-2749ebf66c26" path="/var/lib/kubelet/pods/70bc7b08-4549-4554-a4c7-2749ebf66c26/volumes"
Sep 06 19:22:44.937229 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:44.937194    2577 generic.go:356] "Generic (PLEG): container finished" podID="0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262" containerID="8f3d1c5a4afb4db52992d9aecd92ada506ca9b742bd7998e1f1353571f5d72f6" exitCode=0
Sep 06 19:22:44.937703 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:44.937244    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-55hlg"
Sep 06 19:22:44.937703 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:44.937290    2577 scope.go:117] "RemoveContainer" containerID="8f3d1c5a4afb4db52992d9aecd92ada506ca9b742bd7998e1f1353571f5d72f6"
Sep 06 19:22:44.937703 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:44.937558    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ctk7t"
Sep 06 19:22:44.941998 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:22:44.941973    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-55hlg\" is forbidden: User \"system:node:ip-10-0-135-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-37.ec2.internal' and this object" podUID="0cd33a1e-6bf8-4cdc-b0d9-f51eb16f1262" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-55hlg"
Sep 06 19:22:44.945083 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:44.945061    2577 scope.go:117] "RemoveContainer" containerID="8f3d1c5a4afb4db52992d9aecd92ada506ca9b742bd7998e1f1353571f5d72f6"
Sep 06 19:22:44.945346 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:22:44.945328    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f3d1c5a4afb4db52992d9aecd92ada506ca9b742bd7998e1f1353571f5d72f6\": container with ID starting with 8f3d1c5a4afb4db52992d9aecd92ada506ca9b742bd7998e1f1353571f5d72f6 not found: ID does not exist" containerID="8f3d1c5a4afb4db52992d9aecd92ada506ca9b742bd7998e1f1353571f5d72f6"
Sep 06 19:22:44.945415 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:44.945356    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f3d1c5a4afb4db52992d9aecd92ada506ca9b742bd7998e1f1353571f5d72f6"} err="failed to get container status \"8f3d1c5a4afb4db52992d9aecd92ada506ca9b742bd7998e1f1353571f5d72f6\": rpc error: code = NotFound desc = could not find container \"8f3d1c5a4afb4db52992d9aecd92ada506ca9b742bd7998e1f1353571f5d72f6\": container with ID starting with 8f3d1c5a4afb4db52992d9aecd92ada506ca9b742bd7998e1f1353571f5d72f6 not found: ID does not exist"
Sep 06 19:22:54.939445 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:54.939417    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sc79h"
Sep 06 19:22:55.945067 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:55.945034    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ctk7t"
Sep 06 19:22:56.006546 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:56.006504    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sc79h"]
Sep 06 19:22:56.006747 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:56.006703    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sc79h" podUID="d5b4b5b5-7921-402a-9a43-4bdd1f109a4c" containerName="manager" containerID="cri-o://261a0e2029c6a11800b28957619828c8f9f3adbb56cf882ba7061b6fce51f368" gracePeriod=10
Sep 06 19:22:56.250786 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:56.250761    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sc79h"
Sep 06 19:22:56.325217 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:56.325190    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-67qx5"]
Sep 06 19:22:56.325506 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:56.325493    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5b4b5b5-7921-402a-9a43-4bdd1f109a4c" containerName="manager"
Sep 06 19:22:56.325566 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:56.325508    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5b4b5b5-7921-402a-9a43-4bdd1f109a4c" containerName="manager"
Sep 06 19:22:56.325600 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:56.325573    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5b4b5b5-7921-402a-9a43-4bdd1f109a4c" containerName="manager"
Sep 06 19:22:56.328210 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:56.328195    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-67qx5"
Sep 06 19:22:56.354349 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:56.354325    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-67qx5"]
Sep 06 19:22:56.367991 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:56.367970    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5b4b5b5-7921-402a-9a43-4bdd1f109a4c-extensions-socket-volume\") pod \"d5b4b5b5-7921-402a-9a43-4bdd1f109a4c\" (UID: \"d5b4b5b5-7921-402a-9a43-4bdd1f109a4c\") "
Sep 06 19:22:56.368095 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:56.368017    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mq6wm\" (UniqueName: \"kubernetes.io/projected/d5b4b5b5-7921-402a-9a43-4bdd1f109a4c-kube-api-access-mq6wm\") pod \"d5b4b5b5-7921-402a-9a43-4bdd1f109a4c\" (UID: \"d5b4b5b5-7921-402a-9a43-4bdd1f109a4c\") "
Sep 06 19:22:56.368338 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:56.368311    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5b4b5b5-7921-402a-9a43-4bdd1f109a4c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d5b4b5b5-7921-402a-9a43-4bdd1f109a4c" (UID: "d5b4b5b5-7921-402a-9a43-4bdd1f109a4c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 19:22:56.369881 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:56.369861    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5b4b5b5-7921-402a-9a43-4bdd1f109a4c-kube-api-access-mq6wm" (OuterVolumeSpecName: "kube-api-access-mq6wm") pod "d5b4b5b5-7921-402a-9a43-4bdd1f109a4c" (UID: "d5b4b5b5-7921-402a-9a43-4bdd1f109a4c"). InnerVolumeSpecName "kube-api-access-mq6wm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:22:56.469220 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:56.469165    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d011eef-95b0-4d00-85ea-12b43a8b3236-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-67qx5\" (UID: \"6d011eef-95b0-4d00-85ea-12b43a8b3236\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-67qx5"
Sep 06 19:22:56.469220 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:56.469206    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvltn\" (UniqueName: \"kubernetes.io/projected/6d011eef-95b0-4d00-85ea-12b43a8b3236-kube-api-access-kvltn\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-67qx5\" (UID: \"6d011eef-95b0-4d00-85ea-12b43a8b3236\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-67qx5"
Sep 06 19:22:56.469355 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:56.469242    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5b4b5b5-7921-402a-9a43-4bdd1f109a4c-extensions-socket-volume\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:22:56.469355 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:56.469257    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mq6wm\" (UniqueName: \"kubernetes.io/projected/d5b4b5b5-7921-402a-9a43-4bdd1f109a4c-kube-api-access-mq6wm\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:22:56.570162 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:56.570131    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d011eef-95b0-4d00-85ea-12b43a8b3236-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-67qx5\" (UID: \"6d011eef-95b0-4d00-85ea-12b43a8b3236\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-67qx5"
Sep 06 19:22:56.570273 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:56.570181    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvltn\" (UniqueName: \"kubernetes.io/projected/6d011eef-95b0-4d00-85ea-12b43a8b3236-kube-api-access-kvltn\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-67qx5\" (UID: \"6d011eef-95b0-4d00-85ea-12b43a8b3236\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-67qx5"
Sep 06 19:22:56.570525 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:56.570505    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d011eef-95b0-4d00-85ea-12b43a8b3236-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-67qx5\" (UID: \"6d011eef-95b0-4d00-85ea-12b43a8b3236\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-67qx5"
Sep 06 19:22:56.578199 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:56.578175    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvltn\" (UniqueName: \"kubernetes.io/projected/6d011eef-95b0-4d00-85ea-12b43a8b3236-kube-api-access-kvltn\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-67qx5\" (UID: \"6d011eef-95b0-4d00-85ea-12b43a8b3236\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-67qx5"
Sep 06 19:22:56.638000 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:56.637978    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-67qx5"
Sep 06 19:22:56.913645 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:56.913609    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-67qx5"]
Sep 06 19:22:56.916424 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:22:56.916397    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d011eef_95b0_4d00_85ea_12b43a8b3236.slice/crio-f33d4a9d445b284c46b6431c0f8ae955c310b47a372e17164995413b904f871a WatchSource:0}: Error finding container f33d4a9d445b284c46b6431c0f8ae955c310b47a372e17164995413b904f871a: Status 404 returned error can't find the container with id f33d4a9d445b284c46b6431c0f8ae955c310b47a372e17164995413b904f871a
Sep 06 19:22:56.990486 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:56.990437    2577 generic.go:356] "Generic (PLEG): container finished" podID="d5b4b5b5-7921-402a-9a43-4bdd1f109a4c" containerID="261a0e2029c6a11800b28957619828c8f9f3adbb56cf882ba7061b6fce51f368" exitCode=0
Sep 06 19:22:56.990831 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:56.990494    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sc79h"
Sep 06 19:22:56.990831 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:56.990508    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sc79h" event={"ID":"d5b4b5b5-7921-402a-9a43-4bdd1f109a4c","Type":"ContainerDied","Data":"261a0e2029c6a11800b28957619828c8f9f3adbb56cf882ba7061b6fce51f368"}
Sep 06 19:22:56.990831 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:56.990576    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sc79h" event={"ID":"d5b4b5b5-7921-402a-9a43-4bdd1f109a4c","Type":"ContainerDied","Data":"e77823bed009e3965ea4898bf0c89643a123f9657816cdb6bce55673a404d337"}
Sep 06 19:22:56.990831 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:56.990611    2577 scope.go:117] "RemoveContainer" containerID="261a0e2029c6a11800b28957619828c8f9f3adbb56cf882ba7061b6fce51f368"
Sep 06 19:22:56.992280 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:56.992252    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-67qx5" event={"ID":"6d011eef-95b0-4d00-85ea-12b43a8b3236","Type":"ContainerStarted","Data":"1e9906c07e9338c6d5b911050a1e216286c3b8253eb3426fe7b03feb2b0f6031"}
Sep 06 19:22:56.992377 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:56.992304    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-67qx5" event={"ID":"6d011eef-95b0-4d00-85ea-12b43a8b3236","Type":"ContainerStarted","Data":"f33d4a9d445b284c46b6431c0f8ae955c310b47a372e17164995413b904f871a"}
Sep 06 19:22:56.992611 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:56.992591    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-67qx5"
Sep 06 19:22:56.998259 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:56.998242    2577 scope.go:117] "RemoveContainer" containerID="261a0e2029c6a11800b28957619828c8f9f3adbb56cf882ba7061b6fce51f368"
Sep 06 19:22:56.998559 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:22:56.998541    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"261a0e2029c6a11800b28957619828c8f9f3adbb56cf882ba7061b6fce51f368\": container with ID starting with 261a0e2029c6a11800b28957619828c8f9f3adbb56cf882ba7061b6fce51f368 not found: ID does not exist" containerID="261a0e2029c6a11800b28957619828c8f9f3adbb56cf882ba7061b6fce51f368"
Sep 06 19:22:56.998659 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:56.998565    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"261a0e2029c6a11800b28957619828c8f9f3adbb56cf882ba7061b6fce51f368"} err="failed to get container status \"261a0e2029c6a11800b28957619828c8f9f3adbb56cf882ba7061b6fce51f368\": rpc error: code = NotFound desc = could not find container \"261a0e2029c6a11800b28957619828c8f9f3adbb56cf882ba7061b6fce51f368\": container with ID starting with 261a0e2029c6a11800b28957619828c8f9f3adbb56cf882ba7061b6fce51f368 not found: ID does not exist"
Sep 06 19:22:57.005414 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:57.005394    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sc79h"]
Sep 06 19:22:57.010794 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:57.010775    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sc79h"]
Sep 06 19:22:57.025006 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:57.024961    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-67qx5" podStartSLOduration=1.024946018 podStartE2EDuration="1.024946018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:22:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:22:57.024565928 +0000 UTC m=+723.265451299" watchObservedRunningTime="2026-09-06 19:22:57.024946018 +0000 UTC m=+723.265831363"
Sep 06 19:22:58.390771 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:22:58.390734    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5b4b5b5-7921-402a-9a43-4bdd1f109a4c" path="/var/lib/kubelet/pods/d5b4b5b5-7921-402a-9a43-4bdd1f109a4c/volumes"
Sep 06 19:23:08.000229 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:08.000196    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-67qx5"
Sep 06 19:23:08.048108 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:08.048073    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ctk7t"]
Sep 06 19:23:08.048307 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:08.048281    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ctk7t" podUID="7739f7f9-c5f8-48da-8ecf-cc8eeed03969" containerName="manager" containerID="cri-o://86bd629244795083fb75b9e4c240404b135c821f0e0276574725c5f153801838" gracePeriod=10
Sep 06 19:23:08.291265 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:08.291242    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ctk7t"
Sep 06 19:23:08.353171 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:08.353135    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7739f7f9-c5f8-48da-8ecf-cc8eeed03969-extensions-socket-volume\") pod \"7739f7f9-c5f8-48da-8ecf-cc8eeed03969\" (UID: \"7739f7f9-c5f8-48da-8ecf-cc8eeed03969\") "
Sep 06 19:23:08.353320 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:08.353223    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwmqs\" (UniqueName: \"kubernetes.io/projected/7739f7f9-c5f8-48da-8ecf-cc8eeed03969-kube-api-access-mwmqs\") pod \"7739f7f9-c5f8-48da-8ecf-cc8eeed03969\" (UID: \"7739f7f9-c5f8-48da-8ecf-cc8eeed03969\") "
Sep 06 19:23:08.353531 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:08.353506    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7739f7f9-c5f8-48da-8ecf-cc8eeed03969-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7739f7f9-c5f8-48da-8ecf-cc8eeed03969" (UID: "7739f7f9-c5f8-48da-8ecf-cc8eeed03969"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 19:23:08.355210 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:08.355189    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7739f7f9-c5f8-48da-8ecf-cc8eeed03969-kube-api-access-mwmqs" (OuterVolumeSpecName: "kube-api-access-mwmqs") pod "7739f7f9-c5f8-48da-8ecf-cc8eeed03969" (UID: "7739f7f9-c5f8-48da-8ecf-cc8eeed03969"). InnerVolumeSpecName "kube-api-access-mwmqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:23:08.454342 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:08.454304    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwmqs\" (UniqueName: \"kubernetes.io/projected/7739f7f9-c5f8-48da-8ecf-cc8eeed03969-kube-api-access-mwmqs\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:23:08.454342 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:08.454336    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7739f7f9-c5f8-48da-8ecf-cc8eeed03969-extensions-socket-volume\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:23:09.046830 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:09.046794    2577 generic.go:356] "Generic (PLEG): container finished" podID="7739f7f9-c5f8-48da-8ecf-cc8eeed03969" containerID="86bd629244795083fb75b9e4c240404b135c821f0e0276574725c5f153801838" exitCode=0
Sep 06 19:23:09.046830 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:09.046830    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ctk7t" event={"ID":"7739f7f9-c5f8-48da-8ecf-cc8eeed03969","Type":"ContainerDied","Data":"86bd629244795083fb75b9e4c240404b135c821f0e0276574725c5f153801838"}
Sep 06 19:23:09.047425 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:09.046843    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ctk7t"
Sep 06 19:23:09.047425 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:09.046868    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ctk7t" event={"ID":"7739f7f9-c5f8-48da-8ecf-cc8eeed03969","Type":"ContainerDied","Data":"2703794317b9dfd2c81d442736e49a5d16cdc2ec6f01cd21d26aa726de702fd0"}
Sep 06 19:23:09.047425 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:09.046891    2577 scope.go:117] "RemoveContainer" containerID="86bd629244795083fb75b9e4c240404b135c821f0e0276574725c5f153801838"
Sep 06 19:23:09.055424 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:09.055234    2577 scope.go:117] "RemoveContainer" containerID="86bd629244795083fb75b9e4c240404b135c821f0e0276574725c5f153801838"
Sep 06 19:23:09.055567 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:23:09.055547    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86bd629244795083fb75b9e4c240404b135c821f0e0276574725c5f153801838\": container with ID starting with 86bd629244795083fb75b9e4c240404b135c821f0e0276574725c5f153801838 not found: ID does not exist" containerID="86bd629244795083fb75b9e4c240404b135c821f0e0276574725c5f153801838"
Sep 06 19:23:09.055639 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:09.055575    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86bd629244795083fb75b9e4c240404b135c821f0e0276574725c5f153801838"} err="failed to get container status \"86bd629244795083fb75b9e4c240404b135c821f0e0276574725c5f153801838\": rpc error: code = NotFound desc = could not find container \"86bd629244795083fb75b9e4c240404b135c821f0e0276574725c5f153801838\": container with ID starting with 86bd629244795083fb75b9e4c240404b135c821f0e0276574725c5f153801838 not found: ID does not exist"
Sep 06 19:23:09.062803 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:09.062780    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ctk7t"]
Sep 06 19:23:09.070381 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:09.070082    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ctk7t"]
Sep 06 19:23:10.386944 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:10.386911    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7739f7f9-c5f8-48da-8ecf-cc8eeed03969" path="/var/lib/kubelet/pods/7739f7f9-c5f8-48da-8ecf-cc8eeed03969/volumes"
Sep 06 19:23:25.148218 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:25.148183    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-xw7f5"]
Sep 06 19:23:25.148644 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:25.148450    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7739f7f9-c5f8-48da-8ecf-cc8eeed03969" containerName="manager"
Sep 06 19:23:25.148644 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:25.148462    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7739f7f9-c5f8-48da-8ecf-cc8eeed03969" containerName="manager"
Sep 06 19:23:25.148644 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:25.148552    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7739f7f9-c5f8-48da-8ecf-cc8eeed03969" containerName="manager"
Sep 06 19:23:25.151320 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:25.151300    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-xw7f5"
Sep 06 19:23:25.153489 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:25.153457    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-px5nx\""
Sep 06 19:23:25.153673 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:25.153657    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 06 19:23:25.160708 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:25.160685    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-xw7f5"]
Sep 06 19:23:25.176567 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:25.176541    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0c1d0a24-dd87-4405-a599-a923f3656e18-config-file\") pod \"limitador-limitador-859c4d96d6-xw7f5\" (UID: \"0c1d0a24-dd87-4405-a599-a923f3656e18\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-xw7f5"
Sep 06 19:23:25.176680 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:25.176593    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmfl2\" (UniqueName: \"kubernetes.io/projected/0c1d0a24-dd87-4405-a599-a923f3656e18-kube-api-access-mmfl2\") pod \"limitador-limitador-859c4d96d6-xw7f5\" (UID: \"0c1d0a24-dd87-4405-a599-a923f3656e18\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-xw7f5"
Sep 06 19:23:25.245701 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:25.245668    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-xw7f5"]
Sep 06 19:23:25.277524 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:25.277490    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0c1d0a24-dd87-4405-a599-a923f3656e18-config-file\") pod \"limitador-limitador-859c4d96d6-xw7f5\" (UID: \"0c1d0a24-dd87-4405-a599-a923f3656e18\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-xw7f5"
Sep 06 19:23:25.277702 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:25.277549    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmfl2\" (UniqueName: \"kubernetes.io/projected/0c1d0a24-dd87-4405-a599-a923f3656e18-kube-api-access-mmfl2\") pod \"limitador-limitador-859c4d96d6-xw7f5\" (UID: \"0c1d0a24-dd87-4405-a599-a923f3656e18\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-xw7f5"
Sep 06 19:23:25.278197 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:25.278177    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0c1d0a24-dd87-4405-a599-a923f3656e18-config-file\") pod \"limitador-limitador-859c4d96d6-xw7f5\" (UID: \"0c1d0a24-dd87-4405-a599-a923f3656e18\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-xw7f5"
Sep 06 19:23:25.284617 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:25.284589    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmfl2\" (UniqueName: \"kubernetes.io/projected/0c1d0a24-dd87-4405-a599-a923f3656e18-kube-api-access-mmfl2\") pod \"limitador-limitador-859c4d96d6-xw7f5\" (UID: \"0c1d0a24-dd87-4405-a599-a923f3656e18\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-xw7f5"
Sep 06 19:23:25.461650 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:25.461563    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-xw7f5"
Sep 06 19:23:25.730996 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:25.730962    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-xw7f5"]
Sep 06 19:23:25.734057 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:23:25.734029    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c1d0a24_dd87_4405_a599_a923f3656e18.slice/crio-eac7fb61529abcd2ee0ef8b3b9ec1c8374ffceb9f2388adc7e277675f3f41ed3 WatchSource:0}: Error finding container eac7fb61529abcd2ee0ef8b3b9ec1c8374ffceb9f2388adc7e277675f3f41ed3: Status 404 returned error can't find the container with id eac7fb61529abcd2ee0ef8b3b9ec1c8374ffceb9f2388adc7e277675f3f41ed3
Sep 06 19:23:26.125222 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:26.125141    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-xw7f5" event={"ID":"0c1d0a24-dd87-4405-a599-a923f3656e18","Type":"ContainerStarted","Data":"eac7fb61529abcd2ee0ef8b3b9ec1c8374ffceb9f2388adc7e277675f3f41ed3"}
Sep 06 19:23:28.135241 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:28.135201    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-xw7f5" event={"ID":"0c1d0a24-dd87-4405-a599-a923f3656e18","Type":"ContainerStarted","Data":"4d06d7e725e0af3fecda01e37d3720313c6e13f25a719678a647acd6f8cdab30"}
Sep 06 19:23:28.135694 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:28.135315    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-xw7f5"
Sep 06 19:23:28.150553 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:28.150508    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-859c4d96d6-xw7f5" podStartSLOduration=1.784804805 podStartE2EDuration="3.150495396s" totalImagesPullingTime="1.365690591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:23:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:23:28.149210111 +0000 UTC m=+754.390095476" watchObservedRunningTime="2026-09-06 19:23:28.150495396 +0000 UTC m=+754.391380732"
Sep 06 19:23:39.141153 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:39.141118    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-xw7f5"
Sep 06 19:23:40.394209 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:40.394178    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-xw7f5"]
Sep 06 19:23:40.394621 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:40.394360    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-859c4d96d6-xw7f5" podUID="0c1d0a24-dd87-4405-a599-a923f3656e18" containerName="limitador" containerID="cri-o://4d06d7e725e0af3fecda01e37d3720313c6e13f25a719678a647acd6f8cdab30" gracePeriod=30
Sep 06 19:23:40.933716 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:40.933689    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-xw7f5"
Sep 06 19:23:40.998969 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:40.998933    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmfl2\" (UniqueName: \"kubernetes.io/projected/0c1d0a24-dd87-4405-a599-a923f3656e18-kube-api-access-mmfl2\") pod \"0c1d0a24-dd87-4405-a599-a923f3656e18\" (UID: \"0c1d0a24-dd87-4405-a599-a923f3656e18\") "
Sep 06 19:23:40.999144 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:40.999069    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0c1d0a24-dd87-4405-a599-a923f3656e18-config-file\") pod \"0c1d0a24-dd87-4405-a599-a923f3656e18\" (UID: \"0c1d0a24-dd87-4405-a599-a923f3656e18\") "
Sep 06 19:23:40.999407 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:40.999383    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c1d0a24-dd87-4405-a599-a923f3656e18-config-file" (OuterVolumeSpecName: "config-file") pod "0c1d0a24-dd87-4405-a599-a923f3656e18" (UID: "0c1d0a24-dd87-4405-a599-a923f3656e18"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:23:41.001035 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:41.001008    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c1d0a24-dd87-4405-a599-a923f3656e18-kube-api-access-mmfl2" (OuterVolumeSpecName: "kube-api-access-mmfl2") pod "0c1d0a24-dd87-4405-a599-a923f3656e18" (UID: "0c1d0a24-dd87-4405-a599-a923f3656e18"). InnerVolumeSpecName "kube-api-access-mmfl2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:23:41.099844 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:41.099795    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmfl2\" (UniqueName: \"kubernetes.io/projected/0c1d0a24-dd87-4405-a599-a923f3656e18-kube-api-access-mmfl2\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:23:41.099844 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:41.099838    2577 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0c1d0a24-dd87-4405-a599-a923f3656e18-config-file\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:23:41.188195 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:41.188160    2577 generic.go:356] "Generic (PLEG): container finished" podID="0c1d0a24-dd87-4405-a599-a923f3656e18" containerID="4d06d7e725e0af3fecda01e37d3720313c6e13f25a719678a647acd6f8cdab30" exitCode=0
Sep 06 19:23:41.188195 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:41.188198    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-xw7f5" event={"ID":"0c1d0a24-dd87-4405-a599-a923f3656e18","Type":"ContainerDied","Data":"4d06d7e725e0af3fecda01e37d3720313c6e13f25a719678a647acd6f8cdab30"}
Sep 06 19:23:41.188410 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:41.188205    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-xw7f5"
Sep 06 19:23:41.188410 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:41.188238    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-xw7f5" event={"ID":"0c1d0a24-dd87-4405-a599-a923f3656e18","Type":"ContainerDied","Data":"eac7fb61529abcd2ee0ef8b3b9ec1c8374ffceb9f2388adc7e277675f3f41ed3"}
Sep 06 19:23:41.188410 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:41.188259    2577 scope.go:117] "RemoveContainer" containerID="4d06d7e725e0af3fecda01e37d3720313c6e13f25a719678a647acd6f8cdab30"
Sep 06 19:23:41.196303 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:41.196286    2577 scope.go:117] "RemoveContainer" containerID="4d06d7e725e0af3fecda01e37d3720313c6e13f25a719678a647acd6f8cdab30"
Sep 06 19:23:41.196615 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:23:41.196592    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d06d7e725e0af3fecda01e37d3720313c6e13f25a719678a647acd6f8cdab30\": container with ID starting with 4d06d7e725e0af3fecda01e37d3720313c6e13f25a719678a647acd6f8cdab30 not found: ID does not exist" containerID="4d06d7e725e0af3fecda01e37d3720313c6e13f25a719678a647acd6f8cdab30"
Sep 06 19:23:41.196679 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:41.196627    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d06d7e725e0af3fecda01e37d3720313c6e13f25a719678a647acd6f8cdab30"} err="failed to get container status \"4d06d7e725e0af3fecda01e37d3720313c6e13f25a719678a647acd6f8cdab30\": rpc error: code = NotFound desc = could not find container \"4d06d7e725e0af3fecda01e37d3720313c6e13f25a719678a647acd6f8cdab30\": container with ID starting with 4d06d7e725e0af3fecda01e37d3720313c6e13f25a719678a647acd6f8cdab30 not found: ID does not exist"
Sep 06 19:23:41.206831 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:41.206809    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-xw7f5"]
Sep 06 19:23:41.211146 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:41.211125    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-xw7f5"]
Sep 06 19:23:42.390851 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:42.390820    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c1d0a24-dd87-4405-a599-a923f3656e18" path="/var/lib/kubelet/pods/0c1d0a24-dd87-4405-a599-a923f3656e18/volumes"
Sep 06 19:23:46.166520 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:46.166484    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6vbks"]
Sep 06 19:23:46.166883 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:46.166799    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c1d0a24-dd87-4405-a599-a923f3656e18" containerName="limitador"
Sep 06 19:23:46.166883 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:46.166811    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c1d0a24-dd87-4405-a599-a923f3656e18" containerName="limitador"
Sep 06 19:23:46.166883 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:46.166856    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c1d0a24-dd87-4405-a599-a923f3656e18" containerName="limitador"
Sep 06 19:23:46.171350 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:46.171326    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6vbks"
Sep 06 19:23:46.173428 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:46.173403    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 06 19:23:46.173571 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:46.173425    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 06 19:23:46.173571 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:46.173433    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 06 19:23:46.173970 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:46.173955    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-2p7xh\""
Sep 06 19:23:46.177512 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:46.177457    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6vbks"]
Sep 06 19:23:46.239673 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:46.239642    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25qdv\" (UniqueName: \"kubernetes.io/projected/9ff6d901-a29c-4a79-9c8c-8d8d0dd02a81-kube-api-access-25qdv\") pod \"postgres-69fb4594cf-6vbks\" (UID: \"9ff6d901-a29c-4a79-9c8c-8d8d0dd02a81\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6vbks"
Sep 06 19:23:46.239825 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:46.239693    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9ff6d901-a29c-4a79-9c8c-8d8d0dd02a81-data\") pod \"postgres-69fb4594cf-6vbks\" (UID: \"9ff6d901-a29c-4a79-9c8c-8d8d0dd02a81\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6vbks"
Sep 06 19:23:46.340068 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:46.340031    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9ff6d901-a29c-4a79-9c8c-8d8d0dd02a81-data\") pod \"postgres-69fb4594cf-6vbks\" (UID: \"9ff6d901-a29c-4a79-9c8c-8d8d0dd02a81\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6vbks"
Sep 06 19:23:46.340225 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:46.340089    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25qdv\" (UniqueName: \"kubernetes.io/projected/9ff6d901-a29c-4a79-9c8c-8d8d0dd02a81-kube-api-access-25qdv\") pod \"postgres-69fb4594cf-6vbks\" (UID: \"9ff6d901-a29c-4a79-9c8c-8d8d0dd02a81\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6vbks"
Sep 06 19:23:46.340409 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:46.340390    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9ff6d901-a29c-4a79-9c8c-8d8d0dd02a81-data\") pod \"postgres-69fb4594cf-6vbks\" (UID: \"9ff6d901-a29c-4a79-9c8c-8d8d0dd02a81\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6vbks"
Sep 06 19:23:46.347899 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:46.347874    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25qdv\" (UniqueName: \"kubernetes.io/projected/9ff6d901-a29c-4a79-9c8c-8d8d0dd02a81-kube-api-access-25qdv\") pod \"postgres-69fb4594cf-6vbks\" (UID: \"9ff6d901-a29c-4a79-9c8c-8d8d0dd02a81\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6vbks"
Sep 06 19:23:46.483574 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:46.483552    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6vbks"
Sep 06 19:23:46.757020 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:46.756998    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6vbks"]
Sep 06 19:23:46.759127 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:23:46.759103    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ff6d901_a29c_4a79_9c8c_8d8d0dd02a81.slice/crio-9450e4ce73bf323fcb8fcbc1762f432cc457c3bf0b92c3a60918a2d3b6d7e6cd WatchSource:0}: Error finding container 9450e4ce73bf323fcb8fcbc1762f432cc457c3bf0b92c3a60918a2d3b6d7e6cd: Status 404 returned error can't find the container with id 9450e4ce73bf323fcb8fcbc1762f432cc457c3bf0b92c3a60918a2d3b6d7e6cd
Sep 06 19:23:47.216218 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:47.216136    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6vbks" event={"ID":"9ff6d901-a29c-4a79-9c8c-8d8d0dd02a81","Type":"ContainerStarted","Data":"9450e4ce73bf323fcb8fcbc1762f432cc457c3bf0b92c3a60918a2d3b6d7e6cd"}
Sep 06 19:23:52.245315 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:52.245281    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6vbks" event={"ID":"9ff6d901-a29c-4a79-9c8c-8d8d0dd02a81","Type":"ContainerStarted","Data":"d663c0dc58e8508dd454854e44210aed99479b999d77cb59c7ff950e6d80e40b"}
Sep 06 19:23:52.245686 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:52.245416    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6vbks"
Sep 06 19:23:52.258187 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:52.258140    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6vbks" podStartSLOduration=1.452285323 podStartE2EDuration="6.258123664s" totalImagesPullingTime="4.805838341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:23:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:23:52.25765329 +0000 UTC m=+778.498538657" watchObservedRunningTime="2026-09-06 19:23:52.258123664 +0000 UTC m=+778.499009011"
Sep 06 19:23:58.278444 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:23:58.278415    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6vbks"
Sep 06 19:24:05.189225 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:05.189189    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-699b755fc9-jx6pf"]
Sep 06 19:24:05.214176 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:05.214134    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-699b755fc9-jx6pf"]
Sep 06 19:24:05.214352 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:05.214258    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-699b755fc9-jx6pf"
Sep 06 19:24:05.216575 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:05.216552    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 06 19:24:05.216689 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:05.216552    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 06 19:24:05.216689 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:05.216552    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 06 19:24:05.217254 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:05.217236    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-dtb87\""
Sep 06 19:24:05.360748 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:05.360718    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5694bddd64-8pgvf"]
Sep 06 19:24:05.363984 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:05.363963    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5694bddd64-8pgvf"
Sep 06 19:24:05.371795 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:05.371764    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5694bddd64-8pgvf"]
Sep 06 19:24:05.391249 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:05.391228    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1cf29e4-8c40-4a8b-ad76-a122db52a40f-webhook-cert\") pod \"maas-controller-699b755fc9-jx6pf\" (UID: \"e1cf29e4-8c40-4a8b-ad76-a122db52a40f\") " pod="opendatahub/maas-controller-699b755fc9-jx6pf"
Sep 06 19:24:05.391365 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:05.391259    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9vlx\" (UniqueName: \"kubernetes.io/projected/e1cf29e4-8c40-4a8b-ad76-a122db52a40f-kube-api-access-t9vlx\") pod \"maas-controller-699b755fc9-jx6pf\" (UID: \"e1cf29e4-8c40-4a8b-ad76-a122db52a40f\") " pod="opendatahub/maas-controller-699b755fc9-jx6pf"
Sep 06 19:24:05.391365 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:05.391291    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1cf29e4-8c40-4a8b-ad76-a122db52a40f-metrics-certs\") pod \"maas-controller-699b755fc9-jx6pf\" (UID: \"e1cf29e4-8c40-4a8b-ad76-a122db52a40f\") " pod="opendatahub/maas-controller-699b755fc9-jx6pf"
Sep 06 19:24:05.492677 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:05.492653    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhfc8\" (UniqueName: \"kubernetes.io/projected/0208413f-9c83-4967-9ab8-b27890b4a489-kube-api-access-lhfc8\") pod \"maas-controller-5694bddd64-8pgvf\" (UID: \"0208413f-9c83-4967-9ab8-b27890b4a489\") " pod="opendatahub/maas-controller-5694bddd64-8pgvf"
Sep 06 19:24:05.492814 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:05.492689    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1cf29e4-8c40-4a8b-ad76-a122db52a40f-webhook-cert\") pod \"maas-controller-699b755fc9-jx6pf\" (UID: \"e1cf29e4-8c40-4a8b-ad76-a122db52a40f\") " pod="opendatahub/maas-controller-699b755fc9-jx6pf"
Sep 06 19:24:05.492814 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:05.492708    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9vlx\" (UniqueName: \"kubernetes.io/projected/e1cf29e4-8c40-4a8b-ad76-a122db52a40f-kube-api-access-t9vlx\") pod \"maas-controller-699b755fc9-jx6pf\" (UID: \"e1cf29e4-8c40-4a8b-ad76-a122db52a40f\") " pod="opendatahub/maas-controller-699b755fc9-jx6pf"
Sep 06 19:24:05.492814 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:05.492782    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1cf29e4-8c40-4a8b-ad76-a122db52a40f-metrics-certs\") pod \"maas-controller-699b755fc9-jx6pf\" (UID: \"e1cf29e4-8c40-4a8b-ad76-a122db52a40f\") " pod="opendatahub/maas-controller-699b755fc9-jx6pf"
Sep 06 19:24:05.492980 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:05.492835    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0208413f-9c83-4967-9ab8-b27890b4a489-webhook-cert\") pod \"maas-controller-5694bddd64-8pgvf\" (UID: \"0208413f-9c83-4967-9ab8-b27890b4a489\") " pod="opendatahub/maas-controller-5694bddd64-8pgvf"
Sep 06 19:24:05.492980 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:05.492869    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0208413f-9c83-4967-9ab8-b27890b4a489-metrics-certs\") pod \"maas-controller-5694bddd64-8pgvf\" (UID: \"0208413f-9c83-4967-9ab8-b27890b4a489\") " pod="opendatahub/maas-controller-5694bddd64-8pgvf"
Sep 06 19:24:05.495102 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:05.495080    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1cf29e4-8c40-4a8b-ad76-a122db52a40f-metrics-certs\") pod \"maas-controller-699b755fc9-jx6pf\" (UID: \"e1cf29e4-8c40-4a8b-ad76-a122db52a40f\") " pod="opendatahub/maas-controller-699b755fc9-jx6pf"
Sep 06 19:24:05.495197 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:05.495109    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1cf29e4-8c40-4a8b-ad76-a122db52a40f-webhook-cert\") pod \"maas-controller-699b755fc9-jx6pf\" (UID: \"e1cf29e4-8c40-4a8b-ad76-a122db52a40f\") " pod="opendatahub/maas-controller-699b755fc9-jx6pf"
Sep 06 19:24:05.499743 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:05.499721    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9vlx\" (UniqueName: \"kubernetes.io/projected/e1cf29e4-8c40-4a8b-ad76-a122db52a40f-kube-api-access-t9vlx\") pod \"maas-controller-699b755fc9-jx6pf\" (UID: \"e1cf29e4-8c40-4a8b-ad76-a122db52a40f\") " pod="opendatahub/maas-controller-699b755fc9-jx6pf"
Sep 06 19:24:05.524543 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:05.524520    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-699b755fc9-jx6pf"
Sep 06 19:24:05.593653 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:05.593599    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0208413f-9c83-4967-9ab8-b27890b4a489-webhook-cert\") pod \"maas-controller-5694bddd64-8pgvf\" (UID: \"0208413f-9c83-4967-9ab8-b27890b4a489\") " pod="opendatahub/maas-controller-5694bddd64-8pgvf"
Sep 06 19:24:05.593653 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:05.593643    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0208413f-9c83-4967-9ab8-b27890b4a489-metrics-certs\") pod \"maas-controller-5694bddd64-8pgvf\" (UID: \"0208413f-9c83-4967-9ab8-b27890b4a489\") " pod="opendatahub/maas-controller-5694bddd64-8pgvf"
Sep 06 19:24:05.593881 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:05.593695    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhfc8\" (UniqueName: \"kubernetes.io/projected/0208413f-9c83-4967-9ab8-b27890b4a489-kube-api-access-lhfc8\") pod \"maas-controller-5694bddd64-8pgvf\" (UID: \"0208413f-9c83-4967-9ab8-b27890b4a489\") " pod="opendatahub/maas-controller-5694bddd64-8pgvf"
Sep 06 19:24:05.596129 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:05.596103    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0208413f-9c83-4967-9ab8-b27890b4a489-metrics-certs\") pod \"maas-controller-5694bddd64-8pgvf\" (UID: \"0208413f-9c83-4967-9ab8-b27890b4a489\") " pod="opendatahub/maas-controller-5694bddd64-8pgvf"
Sep 06 19:24:05.596584 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:05.596560    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0208413f-9c83-4967-9ab8-b27890b4a489-webhook-cert\") pod \"maas-controller-5694bddd64-8pgvf\" (UID: \"0208413f-9c83-4967-9ab8-b27890b4a489\") " pod="opendatahub/maas-controller-5694bddd64-8pgvf"
Sep 06 19:24:05.601279 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:05.601255    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhfc8\" (UniqueName: \"kubernetes.io/projected/0208413f-9c83-4967-9ab8-b27890b4a489-kube-api-access-lhfc8\") pod \"maas-controller-5694bddd64-8pgvf\" (UID: \"0208413f-9c83-4967-9ab8-b27890b4a489\") " pod="opendatahub/maas-controller-5694bddd64-8pgvf"
Sep 06 19:24:05.675104 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:05.675072    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5694bddd64-8pgvf"
Sep 06 19:24:05.790969 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:05.790906    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-699b755fc9-jx6pf"]
Sep 06 19:24:05.792995 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:24:05.792966    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1cf29e4_8c40_4a8b_ad76_a122db52a40f.slice/crio-b6bc4917a69e88e7573275dc01d953c2d9eaa694a4e4e7175287f7829a8cc795 WatchSource:0}: Error finding container b6bc4917a69e88e7573275dc01d953c2d9eaa694a4e4e7175287f7829a8cc795: Status 404 returned error can't find the container with id b6bc4917a69e88e7573275dc01d953c2d9eaa694a4e4e7175287f7829a8cc795
Sep 06 19:24:05.949060 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:05.948855    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5694bddd64-8pgvf"]
Sep 06 19:24:05.951652 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:24:05.951620    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0208413f_9c83_4967_9ab8_b27890b4a489.slice/crio-3dd5e88d88b81b951e6f5438fbbbe71480467760a1dc7becf48057e1e77b9aea WatchSource:0}: Error finding container 3dd5e88d88b81b951e6f5438fbbbe71480467760a1dc7becf48057e1e77b9aea: Status 404 returned error can't find the container with id 3dd5e88d88b81b951e6f5438fbbbe71480467760a1dc7becf48057e1e77b9aea
Sep 06 19:24:06.310197 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:06.310156    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5694bddd64-8pgvf" event={"ID":"0208413f-9c83-4967-9ab8-b27890b4a489","Type":"ContainerStarted","Data":"3dd5e88d88b81b951e6f5438fbbbe71480467760a1dc7becf48057e1e77b9aea"}
Sep 06 19:24:06.311621 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:06.311587    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-699b755fc9-jx6pf" event={"ID":"e1cf29e4-8c40-4a8b-ad76-a122db52a40f","Type":"ContainerStarted","Data":"b6bc4917a69e88e7573275dc01d953c2d9eaa694a4e4e7175287f7829a8cc795"}
Sep 06 19:24:09.326884 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:09.326842    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-699b755fc9-jx6pf" event={"ID":"e1cf29e4-8c40-4a8b-ad76-a122db52a40f","Type":"ContainerStarted","Data":"c6eb2031d948cc59e9d65d11f65ea4f2018ff61e9466e2a9e8f3e15ac982b522"}
Sep 06 19:24:09.327337 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:09.326912    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-699b755fc9-jx6pf"
Sep 06 19:24:09.328298 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:09.328273    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5694bddd64-8pgvf" event={"ID":"0208413f-9c83-4967-9ab8-b27890b4a489","Type":"ContainerStarted","Data":"0f8e089627ac239c66b1c49b840d0537bb58627f0040864fedee698ecf8fb7b1"}
Sep 06 19:24:09.328413 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:09.328398    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5694bddd64-8pgvf"
Sep 06 19:24:09.344208 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:09.344161    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-699b755fc9-jx6pf" podStartSLOduration=1.794792835 podStartE2EDuration="4.344147883s" totalImagesPullingTime="2.549355048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:24:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:24:09.342860067 +0000 UTC m=+795.583745412" watchObservedRunningTime="2026-09-06 19:24:09.344147883 +0000 UTC m=+795.585033253"
Sep 06 19:24:09.360605 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:09.360562    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5694bddd64-8pgvf" podStartSLOduration=1.9604339469999998 podStartE2EDuration="4.360549544s" totalImagesPullingTime="2.400115597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:24:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:24:09.358534358 +0000 UTC m=+795.599419724" watchObservedRunningTime="2026-09-06 19:24:09.360549544 +0000 UTC m=+795.601434888"
Sep 06 19:24:20.334879 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:20.334803    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5694bddd64-8pgvf"
Sep 06 19:24:20.335213 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:20.335191    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-699b755fc9-jx6pf"
Sep 06 19:24:20.392741 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:20.392696    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-699b755fc9-jx6pf"]
Sep 06 19:24:20.393062 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:20.393026    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-699b755fc9-jx6pf" podUID="e1cf29e4-8c40-4a8b-ad76-a122db52a40f" containerName="manager" containerID="cri-o://c6eb2031d948cc59e9d65d11f65ea4f2018ff61e9466e2a9e8f3e15ac982b522" gracePeriod=30
Sep 06 19:24:20.627704 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:20.627678    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-699b755fc9-jx6pf"
Sep 06 19:24:20.712633 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:20.712605    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9vlx\" (UniqueName: \"kubernetes.io/projected/e1cf29e4-8c40-4a8b-ad76-a122db52a40f-kube-api-access-t9vlx\") pod \"e1cf29e4-8c40-4a8b-ad76-a122db52a40f\" (UID: \"e1cf29e4-8c40-4a8b-ad76-a122db52a40f\") "
Sep 06 19:24:20.712752 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:20.712691    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1cf29e4-8c40-4a8b-ad76-a122db52a40f-webhook-cert\") pod \"e1cf29e4-8c40-4a8b-ad76-a122db52a40f\" (UID: \"e1cf29e4-8c40-4a8b-ad76-a122db52a40f\") "
Sep 06 19:24:20.712752 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:20.712714    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1cf29e4-8c40-4a8b-ad76-a122db52a40f-metrics-certs\") pod \"e1cf29e4-8c40-4a8b-ad76-a122db52a40f\" (UID: \"e1cf29e4-8c40-4a8b-ad76-a122db52a40f\") "
Sep 06 19:24:20.714757 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:20.714727    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1cf29e4-8c40-4a8b-ad76-a122db52a40f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e1cf29e4-8c40-4a8b-ad76-a122db52a40f" (UID: "e1cf29e4-8c40-4a8b-ad76-a122db52a40f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:24:20.714757 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:20.714754    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1cf29e4-8c40-4a8b-ad76-a122db52a40f-kube-api-access-t9vlx" (OuterVolumeSpecName: "kube-api-access-t9vlx") pod "e1cf29e4-8c40-4a8b-ad76-a122db52a40f" (UID: "e1cf29e4-8c40-4a8b-ad76-a122db52a40f"). InnerVolumeSpecName "kube-api-access-t9vlx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:24:20.714889 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:20.714763    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1cf29e4-8c40-4a8b-ad76-a122db52a40f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e1cf29e4-8c40-4a8b-ad76-a122db52a40f" (UID: "e1cf29e4-8c40-4a8b-ad76-a122db52a40f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:24:20.813122 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:20.813099    2577 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1cf29e4-8c40-4a8b-ad76-a122db52a40f-webhook-cert\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:24:20.813122 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:20.813122    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1cf29e4-8c40-4a8b-ad76-a122db52a40f-metrics-certs\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:24:20.813255 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:20.813131    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9vlx\" (UniqueName: \"kubernetes.io/projected/e1cf29e4-8c40-4a8b-ad76-a122db52a40f-kube-api-access-t9vlx\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:24:21.380099 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:21.380061    2577 generic.go:356] "Generic (PLEG): container finished" podID="e1cf29e4-8c40-4a8b-ad76-a122db52a40f" containerID="c6eb2031d948cc59e9d65d11f65ea4f2018ff61e9466e2a9e8f3e15ac982b522" exitCode=0
Sep 06 19:24:21.380495 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:21.380110    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-699b755fc9-jx6pf"
Sep 06 19:24:21.380495 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:21.380147    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-699b755fc9-jx6pf" event={"ID":"e1cf29e4-8c40-4a8b-ad76-a122db52a40f","Type":"ContainerDied","Data":"c6eb2031d948cc59e9d65d11f65ea4f2018ff61e9466e2a9e8f3e15ac982b522"}
Sep 06 19:24:21.380495 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:21.380202    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-699b755fc9-jx6pf" event={"ID":"e1cf29e4-8c40-4a8b-ad76-a122db52a40f","Type":"ContainerDied","Data":"b6bc4917a69e88e7573275dc01d953c2d9eaa694a4e4e7175287f7829a8cc795"}
Sep 06 19:24:21.380495 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:21.380223    2577 scope.go:117] "RemoveContainer" containerID="c6eb2031d948cc59e9d65d11f65ea4f2018ff61e9466e2a9e8f3e15ac982b522"
Sep 06 19:24:21.388340 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:21.388316    2577 scope.go:117] "RemoveContainer" containerID="c6eb2031d948cc59e9d65d11f65ea4f2018ff61e9466e2a9e8f3e15ac982b522"
Sep 06 19:24:21.388601 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:24:21.388580    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6eb2031d948cc59e9d65d11f65ea4f2018ff61e9466e2a9e8f3e15ac982b522\": container with ID starting with c6eb2031d948cc59e9d65d11f65ea4f2018ff61e9466e2a9e8f3e15ac982b522 not found: ID does not exist" containerID="c6eb2031d948cc59e9d65d11f65ea4f2018ff61e9466e2a9e8f3e15ac982b522"
Sep 06 19:24:21.388656 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:21.388611    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6eb2031d948cc59e9d65d11f65ea4f2018ff61e9466e2a9e8f3e15ac982b522"} err="failed to get container status \"c6eb2031d948cc59e9d65d11f65ea4f2018ff61e9466e2a9e8f3e15ac982b522\": rpc error: code = NotFound desc = could not find container \"c6eb2031d948cc59e9d65d11f65ea4f2018ff61e9466e2a9e8f3e15ac982b522\": container with ID starting with c6eb2031d948cc59e9d65d11f65ea4f2018ff61e9466e2a9e8f3e15ac982b522 not found: ID does not exist"
Sep 06 19:24:21.398607 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:21.398588    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-699b755fc9-jx6pf"]
Sep 06 19:24:21.402197 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:21.402178    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-699b755fc9-jx6pf"]
Sep 06 19:24:22.387449 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:22.387415    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1cf29e4-8c40-4a8b-ad76-a122db52a40f" path="/var/lib/kubelet/pods/e1cf29e4-8c40-4a8b-ad76-a122db52a40f/volumes"
Sep 06 19:24:40.116995 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.116964    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5cb9864d77-hn8w5"]
Sep 06 19:24:40.117428 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.117300    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1cf29e4-8c40-4a8b-ad76-a122db52a40f" containerName="manager"
Sep 06 19:24:40.117428 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.117311    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1cf29e4-8c40-4a8b-ad76-a122db52a40f" containerName="manager"
Sep 06 19:24:40.117428 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.117359    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1cf29e4-8c40-4a8b-ad76-a122db52a40f" containerName="manager"
Sep 06 19:24:40.121322 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.121303    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5cb9864d77-hn8w5"
Sep 06 19:24:40.123414 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.123393    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 06 19:24:40.123520 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.123397    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 06 19:24:40.123520 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.123451    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-gfj4k\""
Sep 06 19:24:40.130601 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.130580    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5cb9864d77-hn8w5"]
Sep 06 19:24:40.142091 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.142069    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ba11fbc-47b8-4789-9268-15956a082e56-maas-api-tls\") pod \"maas-api-5cb9864d77-hn8w5\" (UID: \"5ba11fbc-47b8-4789-9268-15956a082e56\") " pod="odh-ai-gateway-infra/maas-api-5cb9864d77-hn8w5"
Sep 06 19:24:40.142186 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.142103    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ba11fbc-47b8-4789-9268-15956a082e56-openshift-service-ca\") pod \"maas-api-5cb9864d77-hn8w5\" (UID: \"5ba11fbc-47b8-4789-9268-15956a082e56\") " pod="odh-ai-gateway-infra/maas-api-5cb9864d77-hn8w5"
Sep 06 19:24:40.142186 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.142158    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5d2g\" (UniqueName: \"kubernetes.io/projected/5ba11fbc-47b8-4789-9268-15956a082e56-kube-api-access-l5d2g\") pod \"maas-api-5cb9864d77-hn8w5\" (UID: \"5ba11fbc-47b8-4789-9268-15956a082e56\") " pod="odh-ai-gateway-infra/maas-api-5cb9864d77-hn8w5"
Sep 06 19:24:40.142186 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.142178    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ba11fbc-47b8-4789-9268-15956a082e56-metrics-certs\") pod \"maas-api-5cb9864d77-hn8w5\" (UID: \"5ba11fbc-47b8-4789-9268-15956a082e56\") " pod="odh-ai-gateway-infra/maas-api-5cb9864d77-hn8w5"
Sep 06 19:24:40.242546 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.242513    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ba11fbc-47b8-4789-9268-15956a082e56-openshift-service-ca\") pod \"maas-api-5cb9864d77-hn8w5\" (UID: \"5ba11fbc-47b8-4789-9268-15956a082e56\") " pod="odh-ai-gateway-infra/maas-api-5cb9864d77-hn8w5"
Sep 06 19:24:40.242696 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.242572    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5d2g\" (UniqueName: \"kubernetes.io/projected/5ba11fbc-47b8-4789-9268-15956a082e56-kube-api-access-l5d2g\") pod \"maas-api-5cb9864d77-hn8w5\" (UID: \"5ba11fbc-47b8-4789-9268-15956a082e56\") " pod="odh-ai-gateway-infra/maas-api-5cb9864d77-hn8w5"
Sep 06 19:24:40.242696 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.242606    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ba11fbc-47b8-4789-9268-15956a082e56-metrics-certs\") pod \"maas-api-5cb9864d77-hn8w5\" (UID: \"5ba11fbc-47b8-4789-9268-15956a082e56\") " pod="odh-ai-gateway-infra/maas-api-5cb9864d77-hn8w5"
Sep 06 19:24:40.242696 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.242660    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ba11fbc-47b8-4789-9268-15956a082e56-maas-api-tls\") pod \"maas-api-5cb9864d77-hn8w5\" (UID: \"5ba11fbc-47b8-4789-9268-15956a082e56\") " pod="odh-ai-gateway-infra/maas-api-5cb9864d77-hn8w5"
Sep 06 19:24:40.242801 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:24:40.242748    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Sep 06 19:24:40.242834 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:24:40.242809    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ba11fbc-47b8-4789-9268-15956a082e56-maas-api-tls podName:5ba11fbc-47b8-4789-9268-15956a082e56 nodeName:}" failed. No retries permitted until 2026-09-06 19:24:40.74278932 +0000 UTC m=+826.983674662 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5ba11fbc-47b8-4789-9268-15956a082e56-maas-api-tls") pod "maas-api-5cb9864d77-hn8w5" (UID: "5ba11fbc-47b8-4789-9268-15956a082e56") : secret "maas-api-serving-cert" not found
Sep 06 19:24:40.243415 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.243396    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ba11fbc-47b8-4789-9268-15956a082e56-openshift-service-ca\") pod \"maas-api-5cb9864d77-hn8w5\" (UID: \"5ba11fbc-47b8-4789-9268-15956a082e56\") " pod="odh-ai-gateway-infra/maas-api-5cb9864d77-hn8w5"
Sep 06 19:24:40.245712 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.245689    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ba11fbc-47b8-4789-9268-15956a082e56-metrics-certs\") pod \"maas-api-5cb9864d77-hn8w5\" (UID: \"5ba11fbc-47b8-4789-9268-15956a082e56\") " pod="odh-ai-gateway-infra/maas-api-5cb9864d77-hn8w5"
Sep 06 19:24:40.256420 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.256399    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5d2g\" (UniqueName: \"kubernetes.io/projected/5ba11fbc-47b8-4789-9268-15956a082e56-kube-api-access-l5d2g\") pod \"maas-api-5cb9864d77-hn8w5\" (UID: \"5ba11fbc-47b8-4789-9268-15956a082e56\") " pod="odh-ai-gateway-infra/maas-api-5cb9864d77-hn8w5"
Sep 06 19:24:40.736709 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.736672    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-65s68"]
Sep 06 19:24:40.740090 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.740072    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-65s68"
Sep 06 19:24:40.742362 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.742332    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 06 19:24:40.742462 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.742367    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-mv7g9\""
Sep 06 19:24:40.746786 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.746747    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ba11fbc-47b8-4789-9268-15956a082e56-maas-api-tls\") pod \"maas-api-5cb9864d77-hn8w5\" (UID: \"5ba11fbc-47b8-4789-9268-15956a082e56\") " pod="odh-ai-gateway-infra/maas-api-5cb9864d77-hn8w5"
Sep 06 19:24:40.749212 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.749162    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ba11fbc-47b8-4789-9268-15956a082e56-maas-api-tls\") pod \"maas-api-5cb9864d77-hn8w5\" (UID: \"5ba11fbc-47b8-4789-9268-15956a082e56\") " pod="odh-ai-gateway-infra/maas-api-5cb9864d77-hn8w5"
Sep 06 19:24:40.751201 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.751179    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-65s68"]
Sep 06 19:24:40.766783 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.766761    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-gwhhc"]
Sep 06 19:24:40.769854 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.769838    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-gwhhc"
Sep 06 19:24:40.777505 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.777459    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-gwhhc"]
Sep 06 19:24:40.847408 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.847371    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0824d78-036b-4941-951b-70d428790bbd-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-65s68\" (UID: \"f0824d78-036b-4941-951b-70d428790bbd\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-65s68"
Sep 06 19:24:40.847570 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.847438    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnz8q\" (UniqueName: \"kubernetes.io/projected/5c4cec7e-5502-46d8-a4e3-6bb673b455e5-kube-api-access-dnz8q\") pod \"payload-processing-5b54b7fbb7-gwhhc\" (UID: \"5c4cec7e-5502-46d8-a4e3-6bb673b455e5\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-gwhhc"
Sep 06 19:24:40.847570 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.847537    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c4cec7e-5502-46d8-a4e3-6bb673b455e5-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-gwhhc\" (UID: \"5c4cec7e-5502-46d8-a4e3-6bb673b455e5\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-gwhhc"
Sep 06 19:24:40.847686 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.847580    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8g9q\" (UniqueName: \"kubernetes.io/projected/f0824d78-036b-4941-951b-70d428790bbd-kube-api-access-z8g9q\") pod \"payload-pre-processing-59fbc47bf8-65s68\" (UID: \"f0824d78-036b-4941-951b-70d428790bbd\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-65s68"
Sep 06 19:24:40.948620 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.948591    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c4cec7e-5502-46d8-a4e3-6bb673b455e5-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-gwhhc\" (UID: \"5c4cec7e-5502-46d8-a4e3-6bb673b455e5\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-gwhhc"
Sep 06 19:24:40.948778 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.948634    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8g9q\" (UniqueName: \"kubernetes.io/projected/f0824d78-036b-4941-951b-70d428790bbd-kube-api-access-z8g9q\") pod \"payload-pre-processing-59fbc47bf8-65s68\" (UID: \"f0824d78-036b-4941-951b-70d428790bbd\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-65s68"
Sep 06 19:24:40.948849 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.948767    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0824d78-036b-4941-951b-70d428790bbd-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-65s68\" (UID: \"f0824d78-036b-4941-951b-70d428790bbd\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-65s68"
Sep 06 19:24:40.948904 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.948864    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnz8q\" (UniqueName: \"kubernetes.io/projected/5c4cec7e-5502-46d8-a4e3-6bb673b455e5-kube-api-access-dnz8q\") pod \"payload-processing-5b54b7fbb7-gwhhc\" (UID: \"5c4cec7e-5502-46d8-a4e3-6bb673b455e5\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-gwhhc"
Sep 06 19:24:40.949489 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.949452    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c4cec7e-5502-46d8-a4e3-6bb673b455e5-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-gwhhc\" (UID: \"5c4cec7e-5502-46d8-a4e3-6bb673b455e5\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-gwhhc"
Sep 06 19:24:40.949577 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.949563    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0824d78-036b-4941-951b-70d428790bbd-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-65s68\" (UID: \"f0824d78-036b-4941-951b-70d428790bbd\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-65s68"
Sep 06 19:24:40.956270 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.956249    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8g9q\" (UniqueName: \"kubernetes.io/projected/f0824d78-036b-4941-951b-70d428790bbd-kube-api-access-z8g9q\") pod \"payload-pre-processing-59fbc47bf8-65s68\" (UID: \"f0824d78-036b-4941-951b-70d428790bbd\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-65s68"
Sep 06 19:24:40.956873 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:40.956852    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnz8q\" (UniqueName: \"kubernetes.io/projected/5c4cec7e-5502-46d8-a4e3-6bb673b455e5-kube-api-access-dnz8q\") pod \"payload-processing-5b54b7fbb7-gwhhc\" (UID: \"5c4cec7e-5502-46d8-a4e3-6bb673b455e5\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-gwhhc"
Sep 06 19:24:41.032878 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:41.032822    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5cb9864d77-hn8w5"
Sep 06 19:24:41.051699 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:41.051676    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-65s68"
Sep 06 19:24:41.081965 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:41.081302    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-gwhhc"
Sep 06 19:24:41.304982 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:41.304958    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5cb9864d77-hn8w5"]
Sep 06 19:24:41.307951 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:24:41.307914    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ba11fbc_47b8_4789_9268_15956a082e56.slice/crio-42ccbe86c06c514fb4ccd5272c7b357f8b8ede67fccee5cb4933de0e98e0fdcb WatchSource:0}: Error finding container 42ccbe86c06c514fb4ccd5272c7b357f8b8ede67fccee5cb4933de0e98e0fdcb: Status 404 returned error can't find the container with id 42ccbe86c06c514fb4ccd5272c7b357f8b8ede67fccee5cb4933de0e98e0fdcb
Sep 06 19:24:41.329702 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:41.329680    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-65s68"]
Sep 06 19:24:41.331833 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:24:41.331806    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0824d78_036b_4941_951b_70d428790bbd.slice/crio-37f0fcdfa504f0728d16cecdf5322271f86d6e3101b7f5487ec16f937e73b33c WatchSource:0}: Error finding container 37f0fcdfa504f0728d16cecdf5322271f86d6e3101b7f5487ec16f937e73b33c: Status 404 returned error can't find the container with id 37f0fcdfa504f0728d16cecdf5322271f86d6e3101b7f5487ec16f937e73b33c
Sep 06 19:24:41.363227 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:41.363207    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-gwhhc"]
Sep 06 19:24:41.365594 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:24:41.365563    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c4cec7e_5502_46d8_a4e3_6bb673b455e5.slice/crio-eb5d7d920e7d5513fca79f725f478e7c3ca3485b1fc69dd559db994e14f9cbfe WatchSource:0}: Error finding container eb5d7d920e7d5513fca79f725f478e7c3ca3485b1fc69dd559db994e14f9cbfe: Status 404 returned error can't find the container with id eb5d7d920e7d5513fca79f725f478e7c3ca3485b1fc69dd559db994e14f9cbfe
Sep 06 19:24:41.464351 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:41.464317    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-gwhhc" event={"ID":"5c4cec7e-5502-46d8-a4e3-6bb673b455e5","Type":"ContainerStarted","Data":"eb5d7d920e7d5513fca79f725f478e7c3ca3485b1fc69dd559db994e14f9cbfe"}
Sep 06 19:24:41.465605 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:41.465581    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-65s68" event={"ID":"f0824d78-036b-4941-951b-70d428790bbd","Type":"ContainerStarted","Data":"37f0fcdfa504f0728d16cecdf5322271f86d6e3101b7f5487ec16f937e73b33c"}
Sep 06 19:24:41.466677 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:41.466656    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5cb9864d77-hn8w5" event={"ID":"5ba11fbc-47b8-4789-9268-15956a082e56","Type":"ContainerStarted","Data":"42ccbe86c06c514fb4ccd5272c7b357f8b8ede67fccee5cb4933de0e98e0fdcb"}
Sep 06 19:24:44.489902 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:44.489863    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-gwhhc" event={"ID":"5c4cec7e-5502-46d8-a4e3-6bb673b455e5","Type":"ContainerStarted","Data":"a44be8adc66f09e45bf9c6ee06b477f53d6d828b171459667e7420bb114d6890"}
Sep 06 19:24:44.490366 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:44.489965    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-gwhhc"
Sep 06 19:24:44.491440 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:44.491418    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-65s68" event={"ID":"f0824d78-036b-4941-951b-70d428790bbd","Type":"ContainerStarted","Data":"b7f15cfae82023b2be625f14812aa2d028290ce68845f9fbb04086142fad56c6"}
Sep 06 19:24:44.491534 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:44.491520    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-65s68"
Sep 06 19:24:44.492995 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:44.492972    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5cb9864d77-hn8w5" event={"ID":"5ba11fbc-47b8-4789-9268-15956a082e56","Type":"ContainerStarted","Data":"5e07fc3d1d1b4f9cf66cadd81677638b71600c1c3fee7597ff317b60e39f3a98"}
Sep 06 19:24:44.493113 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:44.493050    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5cb9864d77-hn8w5"
Sep 06 19:24:44.505588 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:44.505543    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-gwhhc" podStartSLOduration=2.236503803 podStartE2EDuration="4.505528411s" totalImagesPullingTime="2.269024608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:24:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:24:44.505115662 +0000 UTC m=+830.746001035" watchObservedRunningTime="2026-09-06 19:24:44.505528411 +0000 UTC m=+830.746413757"
Sep 06 19:24:44.522830 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:44.522786    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5cb9864d77-hn8w5" podStartSLOduration=2.204494051 podStartE2EDuration="4.522771347s" totalImagesPullingTime="2.318277296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:24:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:24:44.520640669 +0000 UTC m=+830.761526038" watchObservedRunningTime="2026-09-06 19:24:44.522771347 +0000 UTC m=+830.763656693"
Sep 06 19:24:44.537445 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:44.537393    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-65s68" podStartSLOduration=2.242848494 podStartE2EDuration="4.537378502s" totalImagesPullingTime="2.294530008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:24:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:24:44.535624241 +0000 UTC m=+830.776509609" watchObservedRunningTime="2026-09-06 19:24:44.537378502 +0000 UTC m=+830.778263852"
Sep 06 19:24:50.503701 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:50.503668    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5cb9864d77-hn8w5"
Sep 06 19:24:55.500622 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:55.500593    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-65s68"
Sep 06 19:24:55.501032 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:24:55.500740    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-gwhhc"
Sep 06 19:25:11.235528 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:11.235449    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-rhxrh"]
Sep 06 19:25:11.240186 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:11.240162    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rhxrh"
Sep 06 19:25:11.242159 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:11.242136    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 06 19:25:11.242535 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:11.242517    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 06 19:25:11.243043 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:11.243022    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-84kjj\""
Sep 06 19:25:11.243146 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:11.243048    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 06 19:25:11.249998 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:11.249975    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-rhxrh"]
Sep 06 19:25:11.375209 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:11.375178    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68e274a0-ef23-4653-aa71-97001b099f9a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rhxrh\" (UID: \"68e274a0-ef23-4653-aa71-97001b099f9a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rhxrh"
Sep 06 19:25:11.375209 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:11.375213    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68e274a0-ef23-4653-aa71-97001b099f9a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rhxrh\" (UID: \"68e274a0-ef23-4653-aa71-97001b099f9a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rhxrh"
Sep 06 19:25:11.375416 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:11.375239    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68e274a0-ef23-4653-aa71-97001b099f9a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rhxrh\" (UID: \"68e274a0-ef23-4653-aa71-97001b099f9a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rhxrh"
Sep 06 19:25:11.375416 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:11.375318    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68e274a0-ef23-4653-aa71-97001b099f9a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rhxrh\" (UID: \"68e274a0-ef23-4653-aa71-97001b099f9a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rhxrh"
Sep 06 19:25:11.375416 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:11.375347    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z76kc\" (UniqueName: \"kubernetes.io/projected/68e274a0-ef23-4653-aa71-97001b099f9a-kube-api-access-z76kc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rhxrh\" (UID: \"68e274a0-ef23-4653-aa71-97001b099f9a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rhxrh"
Sep 06 19:25:11.375416 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:11.375395    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68e274a0-ef23-4653-aa71-97001b099f9a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rhxrh\" (UID: \"68e274a0-ef23-4653-aa71-97001b099f9a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rhxrh"
Sep 06 19:25:11.476515 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:11.476485    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68e274a0-ef23-4653-aa71-97001b099f9a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rhxrh\" (UID: \"68e274a0-ef23-4653-aa71-97001b099f9a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rhxrh"
Sep 06 19:25:11.476661 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:11.476548    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68e274a0-ef23-4653-aa71-97001b099f9a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rhxrh\" (UID: \"68e274a0-ef23-4653-aa71-97001b099f9a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rhxrh"
Sep 06 19:25:11.476661 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:11.476569    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68e274a0-ef23-4653-aa71-97001b099f9a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rhxrh\" (UID: \"68e274a0-ef23-4653-aa71-97001b099f9a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rhxrh"
Sep 06 19:25:11.476661 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:11.476607    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68e274a0-ef23-4653-aa71-97001b099f9a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rhxrh\" (UID: \"68e274a0-ef23-4653-aa71-97001b099f9a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rhxrh"
Sep 06 19:25:11.476661 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:11.476634    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z76kc\" (UniqueName: \"kubernetes.io/projected/68e274a0-ef23-4653-aa71-97001b099f9a-kube-api-access-z76kc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rhxrh\" (UID: \"68e274a0-ef23-4653-aa71-97001b099f9a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rhxrh"
Sep 06 19:25:11.476875 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:11.476674    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68e274a0-ef23-4653-aa71-97001b099f9a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rhxrh\" (UID: \"68e274a0-ef23-4653-aa71-97001b099f9a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rhxrh"
Sep 06 19:25:11.477009 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:11.476988    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68e274a0-ef23-4653-aa71-97001b099f9a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rhxrh\" (UID: \"68e274a0-ef23-4653-aa71-97001b099f9a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rhxrh"
Sep 06 19:25:11.477070 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:11.477019    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68e274a0-ef23-4653-aa71-97001b099f9a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rhxrh\" (UID: \"68e274a0-ef23-4653-aa71-97001b099f9a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rhxrh"
Sep 06 19:25:11.477133 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:11.477116    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68e274a0-ef23-4653-aa71-97001b099f9a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rhxrh\" (UID: \"68e274a0-ef23-4653-aa71-97001b099f9a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rhxrh"
Sep 06 19:25:11.478912 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:11.478882    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68e274a0-ef23-4653-aa71-97001b099f9a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rhxrh\" (UID: \"68e274a0-ef23-4653-aa71-97001b099f9a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rhxrh"
Sep 06 19:25:11.479146 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:11.479129    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68e274a0-ef23-4653-aa71-97001b099f9a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rhxrh\" (UID: \"68e274a0-ef23-4653-aa71-97001b099f9a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rhxrh"
Sep 06 19:25:11.483604 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:11.483584    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z76kc\" (UniqueName: \"kubernetes.io/projected/68e274a0-ef23-4653-aa71-97001b099f9a-kube-api-access-z76kc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rhxrh\" (UID: \"68e274a0-ef23-4653-aa71-97001b099f9a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rhxrh"
Sep 06 19:25:11.551273 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:11.551220    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rhxrh"
Sep 06 19:25:11.820412 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:11.820388    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-rhxrh"]
Sep 06 19:25:11.822435 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:25:11.822408    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68e274a0_ef23_4653_aa71_97001b099f9a.slice/crio-7fe537352914782ef1f7cab24c00f8a478a6cc260980450d6cab81c840fd3c78 WatchSource:0}: Error finding container 7fe537352914782ef1f7cab24c00f8a478a6cc260980450d6cab81c840fd3c78: Status 404 returned error can't find the container with id 7fe537352914782ef1f7cab24c00f8a478a6cc260980450d6cab81c840fd3c78
Sep 06 19:25:12.618008 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:12.617967    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rhxrh" event={"ID":"68e274a0-ef23-4653-aa71-97001b099f9a","Type":"ContainerStarted","Data":"7fe537352914782ef1f7cab24c00f8a478a6cc260980450d6cab81c840fd3c78"}
Sep 06 19:25:13.623288 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:13.623255    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rhxrh" event={"ID":"68e274a0-ef23-4653-aa71-97001b099f9a","Type":"ContainerStarted","Data":"7d1aa5f527c9a2ff00cea27e3755c1b65d8adbc4b13e10d7e0aea93e9fbd6827"}
Sep 06 19:25:13.638827 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:13.638777    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rhxrh" podStartSLOduration=1.68210492 podStartE2EDuration="2.638761981s" totalImagesPullingTime="956.657061ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:25:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:25:13.637094838 +0000 UTC m=+859.877980180" watchObservedRunningTime="2026-09-06 19:25:13.638761981 +0000 UTC m=+859.879647324"
Sep 06 19:25:21.551532 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:21.551497    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rhxrh"
Sep 06 19:25:21.551981 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:21.551578    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rhxrh"
Sep 06 19:25:21.563720 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:21.563698    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rhxrh"
Sep 06 19:25:21.665273 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:21.665249    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rhxrh"
Sep 06 19:25:27.540838 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:27.540798    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-fgfpj"]
Sep 06 19:25:27.544490 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:27.544455    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fgfpj"
Sep 06 19:25:27.546591 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:27.546568    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 06 19:25:27.554077 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:27.554055    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-fgfpj"]
Sep 06 19:25:27.704313 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:27.704278    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20057929-47b7-43ac-ac46-08a0eafb78a0-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fgfpj\" (UID: \"20057929-47b7-43ac-ac46-08a0eafb78a0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fgfpj"
Sep 06 19:25:27.704313 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:27.704314    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9skdh\" (UniqueName: \"kubernetes.io/projected/20057929-47b7-43ac-ac46-08a0eafb78a0-kube-api-access-9skdh\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fgfpj\" (UID: \"20057929-47b7-43ac-ac46-08a0eafb78a0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fgfpj"
Sep 06 19:25:27.704510 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:27.704345    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20057929-47b7-43ac-ac46-08a0eafb78a0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fgfpj\" (UID: \"20057929-47b7-43ac-ac46-08a0eafb78a0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fgfpj"
Sep 06 19:25:27.704510 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:27.704421    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20057929-47b7-43ac-ac46-08a0eafb78a0-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fgfpj\" (UID: \"20057929-47b7-43ac-ac46-08a0eafb78a0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fgfpj"
Sep 06 19:25:27.704510 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:27.704450    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20057929-47b7-43ac-ac46-08a0eafb78a0-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fgfpj\" (UID: \"20057929-47b7-43ac-ac46-08a0eafb78a0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fgfpj"
Sep 06 19:25:27.704510 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:27.704488    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20057929-47b7-43ac-ac46-08a0eafb78a0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fgfpj\" (UID: \"20057929-47b7-43ac-ac46-08a0eafb78a0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fgfpj"
Sep 06 19:25:27.805109 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:27.805030    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20057929-47b7-43ac-ac46-08a0eafb78a0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fgfpj\" (UID: \"20057929-47b7-43ac-ac46-08a0eafb78a0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fgfpj"
Sep 06 19:25:27.805109 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:27.805068    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20057929-47b7-43ac-ac46-08a0eafb78a0-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fgfpj\" (UID: \"20057929-47b7-43ac-ac46-08a0eafb78a0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fgfpj"
Sep 06 19:25:27.805109 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:27.805099    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20057929-47b7-43ac-ac46-08a0eafb78a0-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fgfpj\" (UID: \"20057929-47b7-43ac-ac46-08a0eafb78a0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fgfpj"
Sep 06 19:25:27.805342 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:27.805114    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20057929-47b7-43ac-ac46-08a0eafb78a0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fgfpj\" (UID: \"20057929-47b7-43ac-ac46-08a0eafb78a0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fgfpj"
Sep 06 19:25:27.805342 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:27.805153    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20057929-47b7-43ac-ac46-08a0eafb78a0-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fgfpj\" (UID: \"20057929-47b7-43ac-ac46-08a0eafb78a0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fgfpj"
Sep 06 19:25:27.805342 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:27.805168    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9skdh\" (UniqueName: \"kubernetes.io/projected/20057929-47b7-43ac-ac46-08a0eafb78a0-kube-api-access-9skdh\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fgfpj\" (UID: \"20057929-47b7-43ac-ac46-08a0eafb78a0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fgfpj"
Sep 06 19:25:27.805539 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:27.805513    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20057929-47b7-43ac-ac46-08a0eafb78a0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fgfpj\" (UID: \"20057929-47b7-43ac-ac46-08a0eafb78a0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fgfpj"
Sep 06 19:25:27.805616 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:27.805525    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20057929-47b7-43ac-ac46-08a0eafb78a0-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fgfpj\" (UID: \"20057929-47b7-43ac-ac46-08a0eafb78a0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fgfpj"
Sep 06 19:25:27.805616 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:27.805605    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20057929-47b7-43ac-ac46-08a0eafb78a0-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fgfpj\" (UID: \"20057929-47b7-43ac-ac46-08a0eafb78a0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fgfpj"
Sep 06 19:25:27.807274 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:27.807247    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20057929-47b7-43ac-ac46-08a0eafb78a0-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fgfpj\" (UID: \"20057929-47b7-43ac-ac46-08a0eafb78a0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fgfpj"
Sep 06 19:25:27.807554 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:27.807536    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20057929-47b7-43ac-ac46-08a0eafb78a0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fgfpj\" (UID: \"20057929-47b7-43ac-ac46-08a0eafb78a0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fgfpj"
Sep 06 19:25:27.812939 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:27.812921    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9skdh\" (UniqueName: \"kubernetes.io/projected/20057929-47b7-43ac-ac46-08a0eafb78a0-kube-api-access-9skdh\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fgfpj\" (UID: \"20057929-47b7-43ac-ac46-08a0eafb78a0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fgfpj"
Sep 06 19:25:27.856047 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:27.856024    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fgfpj"
Sep 06 19:25:28.123736 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:28.123711    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-fgfpj"]
Sep 06 19:25:28.125697 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:25:28.125658    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20057929_47b7_43ac_ac46_08a0eafb78a0.slice/crio-570f95ccdc637a42cd510808a387856ead026377a1c27fc223d6cef1264426e5 WatchSource:0}: Error finding container 570f95ccdc637a42cd510808a387856ead026377a1c27fc223d6cef1264426e5: Status 404 returned error can't find the container with id 570f95ccdc637a42cd510808a387856ead026377a1c27fc223d6cef1264426e5
Sep 06 19:25:28.690562 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:28.690526    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fgfpj" event={"ID":"20057929-47b7-43ac-ac46-08a0eafb78a0","Type":"ContainerStarted","Data":"3a9555c18f060b4f560377816dda2a98f9c72bec3f6719cf5bf5130715cebb37"}
Sep 06 19:25:28.690910 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:28.690584    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fgfpj" event={"ID":"20057929-47b7-43ac-ac46-08a0eafb78a0","Type":"ContainerStarted","Data":"570f95ccdc637a42cd510808a387856ead026377a1c27fc223d6cef1264426e5"}
Sep 06 19:25:28.708924 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:28.708874    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fgfpj" podStartSLOduration=1.5231780449999999 podStartE2EDuration="1.708859419s" totalImagesPullingTime="185.681374ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:25:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:25:28.707380904 +0000 UTC m=+874.948266258" watchObservedRunningTime="2026-09-06 19:25:28.708859419 +0000 UTC m=+874.949744774"
Sep 06 19:25:37.856616 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:37.856577    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fgfpj"
Sep 06 19:25:37.856991 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:37.856640    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fgfpj"
Sep 06 19:25:37.868763 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:37.868738    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fgfpj"
Sep 06 19:25:38.745235 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:38.745205    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fgfpj"
Sep 06 19:25:51.545056 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:51.544983    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-n4r92"]
Sep 06 19:25:51.548357 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:51.548336    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4r92"
Sep 06 19:25:51.550402 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:51.550383    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 06 19:25:51.558310 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:51.558285    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-n4r92"]
Sep 06 19:25:51.590189 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:51.590167    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b70594a-29fd-483e-978f-89fd9e594c76-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n4r92\" (UID: \"3b70594a-29fd-483e-978f-89fd9e594c76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4r92"
Sep 06 19:25:51.590297 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:51.590203    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b70594a-29fd-483e-978f-89fd9e594c76-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n4r92\" (UID: \"3b70594a-29fd-483e-978f-89fd9e594c76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4r92"
Sep 06 19:25:51.590297 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:51.590228    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b70594a-29fd-483e-978f-89fd9e594c76-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n4r92\" (UID: \"3b70594a-29fd-483e-978f-89fd9e594c76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4r92"
Sep 06 19:25:51.590413 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:51.590344    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7zjp\" (UniqueName: \"kubernetes.io/projected/3b70594a-29fd-483e-978f-89fd9e594c76-kube-api-access-c7zjp\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n4r92\" (UID: \"3b70594a-29fd-483e-978f-89fd9e594c76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4r92"
Sep 06 19:25:51.590413 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:51.590387    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b70594a-29fd-483e-978f-89fd9e594c76-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n4r92\" (UID: \"3b70594a-29fd-483e-978f-89fd9e594c76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4r92"
Sep 06 19:25:51.590534 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:51.590415    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b70594a-29fd-483e-978f-89fd9e594c76-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n4r92\" (UID: \"3b70594a-29fd-483e-978f-89fd9e594c76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4r92"
Sep 06 19:25:51.691500 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:51.691451    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b70594a-29fd-483e-978f-89fd9e594c76-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n4r92\" (UID: \"3b70594a-29fd-483e-978f-89fd9e594c76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4r92"
Sep 06 19:25:51.691617 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:51.691515    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b70594a-29fd-483e-978f-89fd9e594c76-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n4r92\" (UID: \"3b70594a-29fd-483e-978f-89fd9e594c76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4r92"
Sep 06 19:25:51.691617 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:51.691533    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b70594a-29fd-483e-978f-89fd9e594c76-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n4r92\" (UID: \"3b70594a-29fd-483e-978f-89fd9e594c76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4r92"
Sep 06 19:25:51.691617 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:51.691571    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7zjp\" (UniqueName: \"kubernetes.io/projected/3b70594a-29fd-483e-978f-89fd9e594c76-kube-api-access-c7zjp\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n4r92\" (UID: \"3b70594a-29fd-483e-978f-89fd9e594c76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4r92"
Sep 06 19:25:51.691617 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:51.691591    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b70594a-29fd-483e-978f-89fd9e594c76-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n4r92\" (UID: \"3b70594a-29fd-483e-978f-89fd9e594c76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4r92"
Sep 06 19:25:51.691617 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:51.691606    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b70594a-29fd-483e-978f-89fd9e594c76-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n4r92\" (UID: \"3b70594a-29fd-483e-978f-89fd9e594c76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4r92"
Sep 06 19:25:51.691920 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:51.691881    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b70594a-29fd-483e-978f-89fd9e594c76-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n4r92\" (UID: \"3b70594a-29fd-483e-978f-89fd9e594c76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4r92"
Sep 06 19:25:51.692001 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:51.691981    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b70594a-29fd-483e-978f-89fd9e594c76-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n4r92\" (UID: \"3b70594a-29fd-483e-978f-89fd9e594c76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4r92"
Sep 06 19:25:51.692042 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:51.692013    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b70594a-29fd-483e-978f-89fd9e594c76-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n4r92\" (UID: \"3b70594a-29fd-483e-978f-89fd9e594c76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4r92"
Sep 06 19:25:51.693724 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:51.693704    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b70594a-29fd-483e-978f-89fd9e594c76-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n4r92\" (UID: \"3b70594a-29fd-483e-978f-89fd9e594c76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4r92"
Sep 06 19:25:51.694062 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:51.694042    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b70594a-29fd-483e-978f-89fd9e594c76-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n4r92\" (UID: \"3b70594a-29fd-483e-978f-89fd9e594c76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4r92"
Sep 06 19:25:51.699194 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:51.699170    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7zjp\" (UniqueName: \"kubernetes.io/projected/3b70594a-29fd-483e-978f-89fd9e594c76-kube-api-access-c7zjp\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n4r92\" (UID: \"3b70594a-29fd-483e-978f-89fd9e594c76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4r92"
Sep 06 19:25:51.877298 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:51.877226    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4r92"
Sep 06 19:25:52.143606 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:52.143508    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-n4r92"]
Sep 06 19:25:52.146382 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:25:52.146353    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b70594a_29fd_483e_978f_89fd9e594c76.slice/crio-bda2cbbfc53040d9e2ffffc37afdd9da4cef2aec4cd59e7ce22ff4fd31d5c24d WatchSource:0}: Error finding container bda2cbbfc53040d9e2ffffc37afdd9da4cef2aec4cd59e7ce22ff4fd31d5c24d: Status 404 returned error can't find the container with id bda2cbbfc53040d9e2ffffc37afdd9da4cef2aec4cd59e7ce22ff4fd31d5c24d
Sep 06 19:25:52.803699 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:52.803669    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4r92" event={"ID":"3b70594a-29fd-483e-978f-89fd9e594c76","Type":"ContainerStarted","Data":"e32ce8f8ae5a2faaf5c79c04e43b4b713cc2e751189c6cf2544db0eead6747a7"}
Sep 06 19:25:52.804213 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:52.803727    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4r92" event={"ID":"3b70594a-29fd-483e-978f-89fd9e594c76","Type":"ContainerStarted","Data":"bda2cbbfc53040d9e2ffffc37afdd9da4cef2aec4cd59e7ce22ff4fd31d5c24d"}
Sep 06 19:25:52.818674 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:25:52.818627    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4r92" podStartSLOduration=1.6056409459999998 podStartE2EDuration="1.818611557s" totalImagesPullingTime="212.970611ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:25:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:25:52.818080941 +0000 UTC m=+899.058966304" watchObservedRunningTime="2026-09-06 19:25:52.818611557 +0000 UTC m=+899.059496900"
Sep 06 19:26:01.878348 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:26:01.878307    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4r92"
Sep 06 19:26:01.878738 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:26:01.878377    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4r92"
Sep 06 19:26:01.890701 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:26:01.890680    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4r92"
Sep 06 19:26:02.855418 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:26:02.855383    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4r92"
Sep 06 19:27:30.835619 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:30.835538    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6"]
Sep 06 19:27:30.839251 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:30.839223    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6"
Sep 06 19:27:30.841382 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:30.841360    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-5307a7-serving-cert\""
Sep 06 19:27:30.851104 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:30.851083    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6"]
Sep 06 19:27:30.912791 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:30.912760    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kcz6\" (UniqueName: \"kubernetes.io/projected/0b53dd4e-dbdd-4646-a60d-25f46489b1a0-kube-api-access-4kcz6\") pod \"maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6\" (UID: \"0b53dd4e-dbdd-4646-a60d-25f46489b1a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6"
Sep 06 19:27:30.912917 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:30.912800    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b53dd4e-dbdd-4646-a60d-25f46489b1a0-metrics-certs\") pod \"maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6\" (UID: \"0b53dd4e-dbdd-4646-a60d-25f46489b1a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6"
Sep 06 19:27:30.912917 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:30.912867    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b53dd4e-dbdd-4646-a60d-25f46489b1a0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6\" (UID: \"0b53dd4e-dbdd-4646-a60d-25f46489b1a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6"
Sep 06 19:27:30.912917 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:30.912899    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b53dd4e-dbdd-4646-a60d-25f46489b1a0-maas-api-tls\") pod \"maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6\" (UID: \"0b53dd4e-dbdd-4646-a60d-25f46489b1a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6"
Sep 06 19:27:31.013656 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:31.013625    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kcz6\" (UniqueName: \"kubernetes.io/projected/0b53dd4e-dbdd-4646-a60d-25f46489b1a0-kube-api-access-4kcz6\") pod \"maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6\" (UID: \"0b53dd4e-dbdd-4646-a60d-25f46489b1a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6"
Sep 06 19:27:31.013788 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:31.013661    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b53dd4e-dbdd-4646-a60d-25f46489b1a0-metrics-certs\") pod \"maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6\" (UID: \"0b53dd4e-dbdd-4646-a60d-25f46489b1a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6"
Sep 06 19:27:31.013788 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:31.013703    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b53dd4e-dbdd-4646-a60d-25f46489b1a0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6\" (UID: \"0b53dd4e-dbdd-4646-a60d-25f46489b1a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6"
Sep 06 19:27:31.013788 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:31.013737    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b53dd4e-dbdd-4646-a60d-25f46489b1a0-maas-api-tls\") pod \"maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6\" (UID: \"0b53dd4e-dbdd-4646-a60d-25f46489b1a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6"
Sep 06 19:27:31.014393 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:31.014369    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b53dd4e-dbdd-4646-a60d-25f46489b1a0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6\" (UID: \"0b53dd4e-dbdd-4646-a60d-25f46489b1a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6"
Sep 06 19:27:31.016165 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:31.016143    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b53dd4e-dbdd-4646-a60d-25f46489b1a0-metrics-certs\") pod \"maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6\" (UID: \"0b53dd4e-dbdd-4646-a60d-25f46489b1a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6"
Sep 06 19:27:31.016280 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:31.016199    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b53dd4e-dbdd-4646-a60d-25f46489b1a0-maas-api-tls\") pod \"maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6\" (UID: \"0b53dd4e-dbdd-4646-a60d-25f46489b1a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6"
Sep 06 19:27:31.022251 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:31.022228    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kcz6\" (UniqueName: \"kubernetes.io/projected/0b53dd4e-dbdd-4646-a60d-25f46489b1a0-kube-api-access-4kcz6\") pod \"maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6\" (UID: \"0b53dd4e-dbdd-4646-a60d-25f46489b1a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6"
Sep 06 19:27:31.152208 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:31.152126    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6"
Sep 06 19:27:31.407628 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:31.407563    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-5307a7-7d47f6d98b-qzpmk"]
Sep 06 19:27:31.412255 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:31.412233    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5307a7-7d47f6d98b-qzpmk"
Sep 06 19:27:31.414335 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:31.414315    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-5307a7-dockercfg-2ksnh\""
Sep 06 19:27:31.414438 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:31.414318    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-5307a7\""
Sep 06 19:27:31.421460 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:31.421438    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-5307a7-7d47f6d98b-qzpmk"]
Sep 06 19:27:31.424827 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:31.424811    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6"]
Sep 06 19:27:31.427357 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:27:31.427333    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b53dd4e_dbdd_4646_a60d_25f46489b1a0.slice/crio-73c9e9b83b804874ff63d60602d67983a522f71a104d86166cd7c678d0713c01 WatchSource:0}: Error finding container 73c9e9b83b804874ff63d60602d67983a522f71a104d86166cd7c678d0713c01: Status 404 returned error can't find the container with id 73c9e9b83b804874ff63d60602d67983a522f71a104d86166cd7c678d0713c01
Sep 06 19:27:31.429172 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:31.429155    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 19:27:31.519308 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:31.519262    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6acd97b8-bdd5-4919-a7e5-2fdc7ac0552f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-5307a7-7d47f6d98b-qzpmk\" (UID: \"6acd97b8-bdd5-4919-a7e5-2fdc7ac0552f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5307a7-7d47f6d98b-qzpmk"
Sep 06 19:27:31.519308 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:31.519313    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhpxd\" (UniqueName: \"kubernetes.io/projected/6acd97b8-bdd5-4919-a7e5-2fdc7ac0552f-kube-api-access-mhpxd\") pod \"payload-pre-processing-e2e-inf-a-5307a7-7d47f6d98b-qzpmk\" (UID: \"6acd97b8-bdd5-4919-a7e5-2fdc7ac0552f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5307a7-7d47f6d98b-qzpmk"
Sep 06 19:27:31.620139 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:31.620106    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6acd97b8-bdd5-4919-a7e5-2fdc7ac0552f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-5307a7-7d47f6d98b-qzpmk\" (UID: \"6acd97b8-bdd5-4919-a7e5-2fdc7ac0552f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5307a7-7d47f6d98b-qzpmk"
Sep 06 19:27:31.620294 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:31.620150    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhpxd\" (UniqueName: \"kubernetes.io/projected/6acd97b8-bdd5-4919-a7e5-2fdc7ac0552f-kube-api-access-mhpxd\") pod \"payload-pre-processing-e2e-inf-a-5307a7-7d47f6d98b-qzpmk\" (UID: \"6acd97b8-bdd5-4919-a7e5-2fdc7ac0552f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5307a7-7d47f6d98b-qzpmk"
Sep 06 19:27:31.620874 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:31.620850    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6acd97b8-bdd5-4919-a7e5-2fdc7ac0552f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-5307a7-7d47f6d98b-qzpmk\" (UID: \"6acd97b8-bdd5-4919-a7e5-2fdc7ac0552f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5307a7-7d47f6d98b-qzpmk"
Sep 06 19:27:31.627550 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:31.627519    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhpxd\" (UniqueName: \"kubernetes.io/projected/6acd97b8-bdd5-4919-a7e5-2fdc7ac0552f-kube-api-access-mhpxd\") pod \"payload-pre-processing-e2e-inf-a-5307a7-7d47f6d98b-qzpmk\" (UID: \"6acd97b8-bdd5-4919-a7e5-2fdc7ac0552f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5307a7-7d47f6d98b-qzpmk"
Sep 06 19:27:31.724007 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:31.723942    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5307a7-7d47f6d98b-qzpmk"
Sep 06 19:27:31.989900 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:31.989870    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-5307a7-7d47f6d98b-qzpmk"]
Sep 06 19:27:31.993603 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:27:31.993574    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6acd97b8_bdd5_4919_a7e5_2fdc7ac0552f.slice/crio-a8fd3d1749ed7ae213c36d508f9a7abc140992c8a23181a611a4bdfe98470eef WatchSource:0}: Error finding container a8fd3d1749ed7ae213c36d508f9a7abc140992c8a23181a611a4bdfe98470eef: Status 404 returned error can't find the container with id a8fd3d1749ed7ae213c36d508f9a7abc140992c8a23181a611a4bdfe98470eef
Sep 06 19:27:32.243268 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:32.243183    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6" event={"ID":"0b53dd4e-dbdd-4646-a60d-25f46489b1a0","Type":"ContainerStarted","Data":"bbff8d922d4722fc4e0d65ad3b87723f86a69e8f4adf65a43db9a363bbcd0afc"}
Sep 06 19:27:32.243268 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:32.243243    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6" event={"ID":"0b53dd4e-dbdd-4646-a60d-25f46489b1a0","Type":"ContainerStarted","Data":"73c9e9b83b804874ff63d60602d67983a522f71a104d86166cd7c678d0713c01"}
Sep 06 19:27:32.243461 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:32.243272    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6"
Sep 06 19:27:32.244869 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:32.244845    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5307a7-7d47f6d98b-qzpmk" event={"ID":"6acd97b8-bdd5-4919-a7e5-2fdc7ac0552f","Type":"ContainerStarted","Data":"625463a3b9376a2453595a519e91b3ee9f3e0e6bf61058a1c59d122d45067db3"}
Sep 06 19:27:32.244981 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:32.244885    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5307a7-7d47f6d98b-qzpmk" event={"ID":"6acd97b8-bdd5-4919-a7e5-2fdc7ac0552f","Type":"ContainerStarted","Data":"a8fd3d1749ed7ae213c36d508f9a7abc140992c8a23181a611a4bdfe98470eef"}
Sep 06 19:27:32.244981 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:32.244928    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5307a7-7d47f6d98b-qzpmk"
Sep 06 19:27:32.258850 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:32.258808    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6" podStartSLOduration=1.834343182 podStartE2EDuration="2.258794615s" totalImagesPullingTime="424.451433ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:27:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:27:32.25765357 +0000 UTC m=+998.498538948" watchObservedRunningTime="2026-09-06 19:27:32.258794615 +0000 UTC m=+998.499679958"
Sep 06 19:27:32.271505 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:32.271431    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5307a7-7d47f6d98b-qzpmk" podStartSLOduration=1.271414891 podStartE2EDuration="1.271414891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:27:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:27:32.270897081 +0000 UTC m=+998.511782423" watchObservedRunningTime="2026-09-06 19:27:32.271414891 +0000 UTC m=+998.512300236"
Sep 06 19:27:38.245961 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:38.245920    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0281bd63-76864649cb-tfhsd"]
Sep 06 19:27:38.249973 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:38.249898    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0281bd63-76864649cb-tfhsd"
Sep 06 19:27:38.252359 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:38.252339    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-0281bd63-serving-cert\""
Sep 06 19:27:38.257816 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:38.257792    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6"
Sep 06 19:27:38.260125 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:38.260098    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0281bd63-76864649cb-tfhsd"]
Sep 06 19:27:38.274947 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:38.274922    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdjb2\" (UniqueName: \"kubernetes.io/projected/1e1675f0-2153-485d-bb57-5ed879ee4055-kube-api-access-pdjb2\") pod \"maas-api-e2e-ait-0281bd63-76864649cb-tfhsd\" (UID: \"1e1675f0-2153-485d-bb57-5ed879ee4055\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0281bd63-76864649cb-tfhsd"
Sep 06 19:27:38.275063 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:38.274966    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e1675f0-2153-485d-bb57-5ed879ee4055-maas-api-tls\") pod \"maas-api-e2e-ait-0281bd63-76864649cb-tfhsd\" (UID: \"1e1675f0-2153-485d-bb57-5ed879ee4055\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0281bd63-76864649cb-tfhsd"
Sep 06 19:27:38.275063 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:38.275003    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e1675f0-2153-485d-bb57-5ed879ee4055-metrics-certs\") pod \"maas-api-e2e-ait-0281bd63-76864649cb-tfhsd\" (UID: \"1e1675f0-2153-485d-bb57-5ed879ee4055\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0281bd63-76864649cb-tfhsd"
Sep 06 19:27:38.275063 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:38.275042    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e1675f0-2153-485d-bb57-5ed879ee4055-openshift-service-ca\") pod \"maas-api-e2e-ait-0281bd63-76864649cb-tfhsd\" (UID: \"1e1675f0-2153-485d-bb57-5ed879ee4055\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0281bd63-76864649cb-tfhsd"
Sep 06 19:27:38.376338 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:38.376303    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdjb2\" (UniqueName: \"kubernetes.io/projected/1e1675f0-2153-485d-bb57-5ed879ee4055-kube-api-access-pdjb2\") pod \"maas-api-e2e-ait-0281bd63-76864649cb-tfhsd\" (UID: \"1e1675f0-2153-485d-bb57-5ed879ee4055\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0281bd63-76864649cb-tfhsd"
Sep 06 19:27:38.376338 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:38.376340    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e1675f0-2153-485d-bb57-5ed879ee4055-maas-api-tls\") pod \"maas-api-e2e-ait-0281bd63-76864649cb-tfhsd\" (UID: \"1e1675f0-2153-485d-bb57-5ed879ee4055\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0281bd63-76864649cb-tfhsd"
Sep 06 19:27:38.376586 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:38.376499    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e1675f0-2153-485d-bb57-5ed879ee4055-metrics-certs\") pod \"maas-api-e2e-ait-0281bd63-76864649cb-tfhsd\" (UID: \"1e1675f0-2153-485d-bb57-5ed879ee4055\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0281bd63-76864649cb-tfhsd"
Sep 06 19:27:38.376586 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:38.376526    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e1675f0-2153-485d-bb57-5ed879ee4055-openshift-service-ca\") pod \"maas-api-e2e-ait-0281bd63-76864649cb-tfhsd\" (UID: \"1e1675f0-2153-485d-bb57-5ed879ee4055\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0281bd63-76864649cb-tfhsd"
Sep 06 19:27:38.377151 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:38.377117    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e1675f0-2153-485d-bb57-5ed879ee4055-openshift-service-ca\") pod \"maas-api-e2e-ait-0281bd63-76864649cb-tfhsd\" (UID: \"1e1675f0-2153-485d-bb57-5ed879ee4055\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0281bd63-76864649cb-tfhsd"
Sep 06 19:27:38.378821 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:38.378790    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e1675f0-2153-485d-bb57-5ed879ee4055-maas-api-tls\") pod \"maas-api-e2e-ait-0281bd63-76864649cb-tfhsd\" (UID: \"1e1675f0-2153-485d-bb57-5ed879ee4055\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0281bd63-76864649cb-tfhsd"
Sep 06 19:27:38.378917 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:38.378836    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e1675f0-2153-485d-bb57-5ed879ee4055-metrics-certs\") pod \"maas-api-e2e-ait-0281bd63-76864649cb-tfhsd\" (UID: \"1e1675f0-2153-485d-bb57-5ed879ee4055\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0281bd63-76864649cb-tfhsd"
Sep 06 19:27:38.385192 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:38.385170    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdjb2\" (UniqueName: \"kubernetes.io/projected/1e1675f0-2153-485d-bb57-5ed879ee4055-kube-api-access-pdjb2\") pod \"maas-api-e2e-ait-0281bd63-76864649cb-tfhsd\" (UID: \"1e1675f0-2153-485d-bb57-5ed879ee4055\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0281bd63-76864649cb-tfhsd"
Sep 06 19:27:38.565938 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:38.565862    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0281bd63-76864649cb-tfhsd"
Sep 06 19:27:38.846812 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:38.846787    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0281bd63-76864649cb-tfhsd"]
Sep 06 19:27:38.848876 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:27:38.848847    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e1675f0_2153_485d_bb57_5ed879ee4055.slice/crio-4b36f625bcbbe44af68f8a6f130c2ce8079697aa1cd587a358364b4930feab80 WatchSource:0}: Error finding container 4b36f625bcbbe44af68f8a6f130c2ce8079697aa1cd587a358364b4930feab80: Status 404 returned error can't find the container with id 4b36f625bcbbe44af68f8a6f130c2ce8079697aa1cd587a358364b4930feab80
Sep 06 19:27:38.888428 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:38.888402    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0281bd63-97b5c4699-9n9cq"]
Sep 06 19:27:38.892884 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:38.892862    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0281bd63-97b5c4699-9n9cq"
Sep 06 19:27:38.894925 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:38.894897    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-0281bd63-dockercfg-fkfz9\""
Sep 06 19:27:38.895035 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:38.894901    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-0281bd63\""
Sep 06 19:27:38.903230 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:38.903204    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0281bd63-97b5c4699-9n9cq"]
Sep 06 19:27:38.981824 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:38.981788    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a294ed9-2099-44b2-b873-0ad37e6b4960-plugins-config-volume\") pod \"payload-processing-e2e-ait-0281bd63-97b5c4699-9n9cq\" (UID: \"3a294ed9-2099-44b2-b873-0ad37e6b4960\") " pod="openshift-ingress/payload-processing-e2e-ait-0281bd63-97b5c4699-9n9cq"
Sep 06 19:27:38.981952 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:38.981843    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-897jp\" (UniqueName: \"kubernetes.io/projected/3a294ed9-2099-44b2-b873-0ad37e6b4960-kube-api-access-897jp\") pod \"payload-processing-e2e-ait-0281bd63-97b5c4699-9n9cq\" (UID: \"3a294ed9-2099-44b2-b873-0ad37e6b4960\") " pod="openshift-ingress/payload-processing-e2e-ait-0281bd63-97b5c4699-9n9cq"
Sep 06 19:27:39.082277 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:39.082243    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a294ed9-2099-44b2-b873-0ad37e6b4960-plugins-config-volume\") pod \"payload-processing-e2e-ait-0281bd63-97b5c4699-9n9cq\" (UID: \"3a294ed9-2099-44b2-b873-0ad37e6b4960\") " pod="openshift-ingress/payload-processing-e2e-ait-0281bd63-97b5c4699-9n9cq"
Sep 06 19:27:39.082449 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:39.082287    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-897jp\" (UniqueName: \"kubernetes.io/projected/3a294ed9-2099-44b2-b873-0ad37e6b4960-kube-api-access-897jp\") pod \"payload-processing-e2e-ait-0281bd63-97b5c4699-9n9cq\" (UID: \"3a294ed9-2099-44b2-b873-0ad37e6b4960\") " pod="openshift-ingress/payload-processing-e2e-ait-0281bd63-97b5c4699-9n9cq"
Sep 06 19:27:39.082975 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:39.082951    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a294ed9-2099-44b2-b873-0ad37e6b4960-plugins-config-volume\") pod \"payload-processing-e2e-ait-0281bd63-97b5c4699-9n9cq\" (UID: \"3a294ed9-2099-44b2-b873-0ad37e6b4960\") " pod="openshift-ingress/payload-processing-e2e-ait-0281bd63-97b5c4699-9n9cq"
Sep 06 19:27:39.090351 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:39.090330    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-897jp\" (UniqueName: \"kubernetes.io/projected/3a294ed9-2099-44b2-b873-0ad37e6b4960-kube-api-access-897jp\") pod \"payload-processing-e2e-ait-0281bd63-97b5c4699-9n9cq\" (UID: \"3a294ed9-2099-44b2-b873-0ad37e6b4960\") " pod="openshift-ingress/payload-processing-e2e-ait-0281bd63-97b5c4699-9n9cq"
Sep 06 19:27:39.204372 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:39.204304    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0281bd63-97b5c4699-9n9cq"
Sep 06 19:27:39.283414 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:39.283363    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0281bd63-76864649cb-tfhsd" event={"ID":"1e1675f0-2153-485d-bb57-5ed879ee4055","Type":"ContainerStarted","Data":"7b90af1d8495283b1201c9b480b87ec03aaf3a4900d290a940f0c42fd6e4ec49"}
Sep 06 19:27:39.283812 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:39.283443    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0281bd63-76864649cb-tfhsd"
Sep 06 19:27:39.283812 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:39.283492    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0281bd63-76864649cb-tfhsd" event={"ID":"1e1675f0-2153-485d-bb57-5ed879ee4055","Type":"ContainerStarted","Data":"4b36f625bcbbe44af68f8a6f130c2ce8079697aa1cd587a358364b4930feab80"}
Sep 06 19:27:39.299381 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:39.299325    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0281bd63-76864649cb-tfhsd" podStartSLOduration=0.936423714 podStartE2EDuration="1.299303861s" totalImagesPullingTime="362.880147ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:27:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:27:39.298159779 +0000 UTC m=+1005.539045147" watchObservedRunningTime="2026-09-06 19:27:39.299303861 +0000 UTC m=+1005.540189205"
Sep 06 19:27:39.483144 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:39.483110    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0281bd63-97b5c4699-9n9cq"]
Sep 06 19:27:39.485155 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:27:39.485130    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a294ed9_2099_44b2_b873_0ad37e6b4960.slice/crio-3494ec571eb6cf0080818f82a6b8085a87aa8156335ac9b7869c1f01c778735c WatchSource:0}: Error finding container 3494ec571eb6cf0080818f82a6b8085a87aa8156335ac9b7869c1f01c778735c: Status 404 returned error can't find the container with id 3494ec571eb6cf0080818f82a6b8085a87aa8156335ac9b7869c1f01c778735c
Sep 06 19:27:40.290021 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:40.289980    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0281bd63-97b5c4699-9n9cq" event={"ID":"3a294ed9-2099-44b2-b873-0ad37e6b4960","Type":"ContainerStarted","Data":"43595e8c3c8ee2024732762a097a6b8246bf7bd3b5e4cf5537d44980ea95e5c6"}
Sep 06 19:27:40.290438 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:40.290050    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0281bd63-97b5c4699-9n9cq" event={"ID":"3a294ed9-2099-44b2-b873-0ad37e6b4960","Type":"ContainerStarted","Data":"3494ec571eb6cf0080818f82a6b8085a87aa8156335ac9b7869c1f01c778735c"}
Sep 06 19:27:40.331158 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:40.331118    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-0281bd63-97b5c4699-9n9cq" podStartSLOduration=2.331104223 podStartE2EDuration="2.331104223s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:27:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:27:40.330050427 +0000 UTC m=+1006.570935790" watchObservedRunningTime="2026-09-06 19:27:40.331104223 +0000 UTC m=+1006.571989612"
Sep 06 19:27:40.727604 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:40.727571    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-21b01e-59c9c8777d-xl52s"]
Sep 06 19:27:40.731363 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:40.731338    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-21b01e-59c9c8777d-xl52s"
Sep 06 19:27:40.733567 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:40.733545    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-21b01e-serving-cert\""
Sep 06 19:27:40.742582 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:40.742558    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-21b01e-59c9c8777d-xl52s"]
Sep 06 19:27:40.800974 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:40.800947    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41a781a5-f26b-4e5d-a812-26fcd3bde055-metrics-certs\") pod \"maas-api-e2e-autores-21b01e-59c9c8777d-xl52s\" (UID: \"41a781a5-f26b-4e5d-a812-26fcd3bde055\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-21b01e-59c9c8777d-xl52s"
Sep 06 19:27:40.801127 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:40.801007    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41a781a5-f26b-4e5d-a812-26fcd3bde055-maas-api-tls\") pod \"maas-api-e2e-autores-21b01e-59c9c8777d-xl52s\" (UID: \"41a781a5-f26b-4e5d-a812-26fcd3bde055\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-21b01e-59c9c8777d-xl52s"
Sep 06 19:27:40.801210 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:40.801130    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41a781a5-f26b-4e5d-a812-26fcd3bde055-openshift-service-ca\") pod \"maas-api-e2e-autores-21b01e-59c9c8777d-xl52s\" (UID: \"41a781a5-f26b-4e5d-a812-26fcd3bde055\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-21b01e-59c9c8777d-xl52s"
Sep 06 19:27:40.801210 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:40.801155    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lm92\" (UniqueName: \"kubernetes.io/projected/41a781a5-f26b-4e5d-a812-26fcd3bde055-kube-api-access-2lm92\") pod \"maas-api-e2e-autores-21b01e-59c9c8777d-xl52s\" (UID: \"41a781a5-f26b-4e5d-a812-26fcd3bde055\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-21b01e-59c9c8777d-xl52s"
Sep 06 19:27:40.902371 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:40.902339    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41a781a5-f26b-4e5d-a812-26fcd3bde055-maas-api-tls\") pod \"maas-api-e2e-autores-21b01e-59c9c8777d-xl52s\" (UID: \"41a781a5-f26b-4e5d-a812-26fcd3bde055\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-21b01e-59c9c8777d-xl52s"
Sep 06 19:27:40.902525 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:40.902437    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41a781a5-f26b-4e5d-a812-26fcd3bde055-openshift-service-ca\") pod \"maas-api-e2e-autores-21b01e-59c9c8777d-xl52s\" (UID: \"41a781a5-f26b-4e5d-a812-26fcd3bde055\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-21b01e-59c9c8777d-xl52s"
Sep 06 19:27:40.902525 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:40.902482    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lm92\" (UniqueName: \"kubernetes.io/projected/41a781a5-f26b-4e5d-a812-26fcd3bde055-kube-api-access-2lm92\") pod \"maas-api-e2e-autores-21b01e-59c9c8777d-xl52s\" (UID: \"41a781a5-f26b-4e5d-a812-26fcd3bde055\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-21b01e-59c9c8777d-xl52s"
Sep 06 19:27:40.902525 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:27:40.902494    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-21b01e-serving-cert: secret "maas-api-e2e-autores-21b01e-serving-cert" not found
Sep 06 19:27:40.902525 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:40.902520    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41a781a5-f26b-4e5d-a812-26fcd3bde055-metrics-certs\") pod \"maas-api-e2e-autores-21b01e-59c9c8777d-xl52s\" (UID: \"41a781a5-f26b-4e5d-a812-26fcd3bde055\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-21b01e-59c9c8777d-xl52s"
Sep 06 19:27:40.902741 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:27:40.902553    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41a781a5-f26b-4e5d-a812-26fcd3bde055-maas-api-tls podName:41a781a5-f26b-4e5d-a812-26fcd3bde055 nodeName:}" failed. No retries permitted until 2026-09-06 19:27:41.402535334 +0000 UTC m=+1007.643420657 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/41a781a5-f26b-4e5d-a812-26fcd3bde055-maas-api-tls") pod "maas-api-e2e-autores-21b01e-59c9c8777d-xl52s" (UID: "41a781a5-f26b-4e5d-a812-26fcd3bde055") : secret "maas-api-e2e-autores-21b01e-serving-cert" not found
Sep 06 19:27:40.903116 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:40.903091    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41a781a5-f26b-4e5d-a812-26fcd3bde055-openshift-service-ca\") pod \"maas-api-e2e-autores-21b01e-59c9c8777d-xl52s\" (UID: \"41a781a5-f26b-4e5d-a812-26fcd3bde055\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-21b01e-59c9c8777d-xl52s"
Sep 06 19:27:40.905017 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:40.904997    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41a781a5-f26b-4e5d-a812-26fcd3bde055-metrics-certs\") pod \"maas-api-e2e-autores-21b01e-59c9c8777d-xl52s\" (UID: \"41a781a5-f26b-4e5d-a812-26fcd3bde055\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-21b01e-59c9c8777d-xl52s"
Sep 06 19:27:40.910148 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:40.910127    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lm92\" (UniqueName: \"kubernetes.io/projected/41a781a5-f26b-4e5d-a812-26fcd3bde055-kube-api-access-2lm92\") pod \"maas-api-e2e-autores-21b01e-59c9c8777d-xl52s\" (UID: \"41a781a5-f26b-4e5d-a812-26fcd3bde055\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-21b01e-59c9c8777d-xl52s"
Sep 06 19:27:41.295136 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:41.295099    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-0281bd63-97b5c4699-9n9cq"
Sep 06 19:27:41.407101 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:41.407065    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41a781a5-f26b-4e5d-a812-26fcd3bde055-maas-api-tls\") pod \"maas-api-e2e-autores-21b01e-59c9c8777d-xl52s\" (UID: \"41a781a5-f26b-4e5d-a812-26fcd3bde055\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-21b01e-59c9c8777d-xl52s"
Sep 06 19:27:41.409506 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:41.409462    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41a781a5-f26b-4e5d-a812-26fcd3bde055-maas-api-tls\") pod \"maas-api-e2e-autores-21b01e-59c9c8777d-xl52s\" (UID: \"41a781a5-f26b-4e5d-a812-26fcd3bde055\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-21b01e-59c9c8777d-xl52s"
Sep 06 19:27:41.643976 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:41.643879    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-21b01e-59c9c8777d-xl52s"
Sep 06 19:27:41.913382 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:41.913311    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-21b01e-59c9c8777d-xl52s"]
Sep 06 19:27:41.916204 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:27:41.916180    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41a781a5_f26b_4e5d_a812_26fcd3bde055.slice/crio-edb165d5af86fd3049c375b2111897858e22a304ef91a6001fc6404e082948b0 WatchSource:0}: Error finding container edb165d5af86fd3049c375b2111897858e22a304ef91a6001fc6404e082948b0: Status 404 returned error can't find the container with id edb165d5af86fd3049c375b2111897858e22a304ef91a6001fc6404e082948b0
Sep 06 19:27:42.301295 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:42.301220    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-21b01e-59c9c8777d-xl52s" event={"ID":"41a781a5-f26b-4e5d-a812-26fcd3bde055","Type":"ContainerStarted","Data":"cd96c9f8e4763f5bd3d55cdf354fa4674a28d3b28b9c767c37599819e806aac1"}
Sep 06 19:27:42.301674 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:42.301302    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-21b01e-59c9c8777d-xl52s" event={"ID":"41a781a5-f26b-4e5d-a812-26fcd3bde055","Type":"ContainerStarted","Data":"edb165d5af86fd3049c375b2111897858e22a304ef91a6001fc6404e082948b0"}
Sep 06 19:27:42.301674 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:42.301586    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-21b01e-59c9c8777d-xl52s"
Sep 06 19:27:42.318414 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:42.318369    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-21b01e-59c9c8777d-xl52s" podStartSLOduration=2.016129446 podStartE2EDuration="2.318352527s" totalImagesPullingTime="302.223081ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:27:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:27:42.315972092 +0000 UTC m=+1008.556857457" watchObservedRunningTime="2026-09-06 19:27:42.318352527 +0000 UTC m=+1008.559237868"
Sep 06 19:27:43.251670 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:43.251636    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5307a7-7d47f6d98b-qzpmk"
Sep 06 19:27:45.296826 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:45.296792    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0281bd63-76864649cb-tfhsd"
Sep 06 19:27:48.312249 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:48.312222    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-21b01e-59c9c8777d-xl52s"
Sep 06 19:27:52.304077 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:27:52.304045    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-0281bd63-97b5c4699-9n9cq"
Sep 06 19:28:18.986269 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:18.986234    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0281bd63-76864649cb-tfhsd"]
Sep 06 19:28:18.986819 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:18.986453    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0281bd63-76864649cb-tfhsd" podUID="1e1675f0-2153-485d-bb57-5ed879ee4055" containerName="maas-api" containerID="cri-o://7b90af1d8495283b1201c9b480b87ec03aaf3a4900d290a940f0c42fd6e4ec49" gracePeriod=30
Sep 06 19:28:19.041224 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:19.041194    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0281bd63-97b5c4699-9n9cq"]
Sep 06 19:28:19.041442 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:19.041415    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-0281bd63-97b5c4699-9n9cq" podUID="3a294ed9-2099-44b2-b873-0ad37e6b4960" containerName="payload-processing" containerID="cri-o://43595e8c3c8ee2024732762a097a6b8246bf7bd3b5e4cf5537d44980ea95e5c6" gracePeriod=30
Sep 06 19:28:19.282389 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:19.282362    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0281bd63-76864649cb-tfhsd"
Sep 06 19:28:19.321961 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:19.321933    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0281bd63-97b5c4699-9n9cq"
Sep 06 19:28:19.324722 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:19.324697    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a294ed9-2099-44b2-b873-0ad37e6b4960-plugins-config-volume\") pod \"3a294ed9-2099-44b2-b873-0ad37e6b4960\" (UID: \"3a294ed9-2099-44b2-b873-0ad37e6b4960\") "
Sep 06 19:28:19.324850 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:19.324746    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-897jp\" (UniqueName: \"kubernetes.io/projected/3a294ed9-2099-44b2-b873-0ad37e6b4960-kube-api-access-897jp\") pod \"3a294ed9-2099-44b2-b873-0ad37e6b4960\" (UID: \"3a294ed9-2099-44b2-b873-0ad37e6b4960\") "
Sep 06 19:28:19.325321 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:19.325292    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a294ed9-2099-44b2-b873-0ad37e6b4960-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3a294ed9-2099-44b2-b873-0ad37e6b4960" (UID: "3a294ed9-2099-44b2-b873-0ad37e6b4960"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:28:19.328036 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:19.328006    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a294ed9-2099-44b2-b873-0ad37e6b4960-kube-api-access-897jp" (OuterVolumeSpecName: "kube-api-access-897jp") pod "3a294ed9-2099-44b2-b873-0ad37e6b4960" (UID: "3a294ed9-2099-44b2-b873-0ad37e6b4960"). InnerVolumeSpecName "kube-api-access-897jp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:28:19.425541 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:19.425513    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e1675f0-2153-485d-bb57-5ed879ee4055-maas-api-tls\") pod \"1e1675f0-2153-485d-bb57-5ed879ee4055\" (UID: \"1e1675f0-2153-485d-bb57-5ed879ee4055\") "
Sep 06 19:28:19.425541 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:19.425541    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e1675f0-2153-485d-bb57-5ed879ee4055-metrics-certs\") pod \"1e1675f0-2153-485d-bb57-5ed879ee4055\" (UID: \"1e1675f0-2153-485d-bb57-5ed879ee4055\") "
Sep 06 19:28:19.425768 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:19.425617    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdjb2\" (UniqueName: \"kubernetes.io/projected/1e1675f0-2153-485d-bb57-5ed879ee4055-kube-api-access-pdjb2\") pod \"1e1675f0-2153-485d-bb57-5ed879ee4055\" (UID: \"1e1675f0-2153-485d-bb57-5ed879ee4055\") "
Sep 06 19:28:19.425768 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:19.425647    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e1675f0-2153-485d-bb57-5ed879ee4055-openshift-service-ca\") pod \"1e1675f0-2153-485d-bb57-5ed879ee4055\" (UID: \"1e1675f0-2153-485d-bb57-5ed879ee4055\") "
Sep 06 19:28:19.426147 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:19.425934    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a294ed9-2099-44b2-b873-0ad37e6b4960-plugins-config-volume\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:28:19.426147 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:19.425956    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-897jp\" (UniqueName: \"kubernetes.io/projected/3a294ed9-2099-44b2-b873-0ad37e6b4960-kube-api-access-897jp\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:28:19.426147 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:19.426017    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e1675f0-2153-485d-bb57-5ed879ee4055-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1e1675f0-2153-485d-bb57-5ed879ee4055" (UID: "1e1675f0-2153-485d-bb57-5ed879ee4055"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:28:19.427954 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:19.427927    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e1675f0-2153-485d-bb57-5ed879ee4055-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1e1675f0-2153-485d-bb57-5ed879ee4055" (UID: "1e1675f0-2153-485d-bb57-5ed879ee4055"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:28:19.428087 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:19.427969    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e1675f0-2153-485d-bb57-5ed879ee4055-kube-api-access-pdjb2" (OuterVolumeSpecName: "kube-api-access-pdjb2") pod "1e1675f0-2153-485d-bb57-5ed879ee4055" (UID: "1e1675f0-2153-485d-bb57-5ed879ee4055"). InnerVolumeSpecName "kube-api-access-pdjb2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:28:19.428087 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:19.427999    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e1675f0-2153-485d-bb57-5ed879ee4055-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1e1675f0-2153-485d-bb57-5ed879ee4055" (UID: "1e1675f0-2153-485d-bb57-5ed879ee4055"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:28:19.473907 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:19.473877    2577 generic.go:356] "Generic (PLEG): container finished" podID="1e1675f0-2153-485d-bb57-5ed879ee4055" containerID="7b90af1d8495283b1201c9b480b87ec03aaf3a4900d290a940f0c42fd6e4ec49" exitCode=0
Sep 06 19:28:19.474007 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:19.473921    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0281bd63-76864649cb-tfhsd"
Sep 06 19:28:19.474007 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:19.473959    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0281bd63-76864649cb-tfhsd" event={"ID":"1e1675f0-2153-485d-bb57-5ed879ee4055","Type":"ContainerDied","Data":"7b90af1d8495283b1201c9b480b87ec03aaf3a4900d290a940f0c42fd6e4ec49"}
Sep 06 19:28:19.474102 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:19.474004    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0281bd63-76864649cb-tfhsd" event={"ID":"1e1675f0-2153-485d-bb57-5ed879ee4055","Type":"ContainerDied","Data":"4b36f625bcbbe44af68f8a6f130c2ce8079697aa1cd587a358364b4930feab80"}
Sep 06 19:28:19.474102 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:19.474036    2577 scope.go:117] "RemoveContainer" containerID="7b90af1d8495283b1201c9b480b87ec03aaf3a4900d290a940f0c42fd6e4ec49"
Sep 06 19:28:19.475249 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:19.475230    2577 generic.go:356] "Generic (PLEG): container finished" podID="3a294ed9-2099-44b2-b873-0ad37e6b4960" containerID="43595e8c3c8ee2024732762a097a6b8246bf7bd3b5e4cf5537d44980ea95e5c6" exitCode=0
Sep 06 19:28:19.475335 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:19.475271    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0281bd63-97b5c4699-9n9cq"
Sep 06 19:28:19.475335 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:19.475307    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0281bd63-97b5c4699-9n9cq" event={"ID":"3a294ed9-2099-44b2-b873-0ad37e6b4960","Type":"ContainerDied","Data":"43595e8c3c8ee2024732762a097a6b8246bf7bd3b5e4cf5537d44980ea95e5c6"}
Sep 06 19:28:19.475402 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:19.475350    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0281bd63-97b5c4699-9n9cq" event={"ID":"3a294ed9-2099-44b2-b873-0ad37e6b4960","Type":"ContainerDied","Data":"3494ec571eb6cf0080818f82a6b8085a87aa8156335ac9b7869c1f01c778735c"}
Sep 06 19:28:19.483757 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:19.483739    2577 scope.go:117] "RemoveContainer" containerID="7b90af1d8495283b1201c9b480b87ec03aaf3a4900d290a940f0c42fd6e4ec49"
Sep 06 19:28:19.484318 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:28:19.484165    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b90af1d8495283b1201c9b480b87ec03aaf3a4900d290a940f0c42fd6e4ec49\": container with ID starting with 7b90af1d8495283b1201c9b480b87ec03aaf3a4900d290a940f0c42fd6e4ec49 not found: ID does not exist" containerID="7b90af1d8495283b1201c9b480b87ec03aaf3a4900d290a940f0c42fd6e4ec49"
Sep 06 19:28:19.484318 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:19.484203    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b90af1d8495283b1201c9b480b87ec03aaf3a4900d290a940f0c42fd6e4ec49"} err="failed to get container status \"7b90af1d8495283b1201c9b480b87ec03aaf3a4900d290a940f0c42fd6e4ec49\": rpc error: code = NotFound desc = could not find container \"7b90af1d8495283b1201c9b480b87ec03aaf3a4900d290a940f0c42fd6e4ec49\": container with ID starting with 7b90af1d8495283b1201c9b480b87ec03aaf3a4900d290a940f0c42fd6e4ec49 not found: ID does not exist"
Sep 06 19:28:19.484318 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:19.484235    2577 scope.go:117] "RemoveContainer" containerID="43595e8c3c8ee2024732762a097a6b8246bf7bd3b5e4cf5537d44980ea95e5c6"
Sep 06 19:28:19.491691 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:19.491677    2577 scope.go:117] "RemoveContainer" containerID="43595e8c3c8ee2024732762a097a6b8246bf7bd3b5e4cf5537d44980ea95e5c6"
Sep 06 19:28:19.491992 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:28:19.491974    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43595e8c3c8ee2024732762a097a6b8246bf7bd3b5e4cf5537d44980ea95e5c6\": container with ID starting with 43595e8c3c8ee2024732762a097a6b8246bf7bd3b5e4cf5537d44980ea95e5c6 not found: ID does not exist" containerID="43595e8c3c8ee2024732762a097a6b8246bf7bd3b5e4cf5537d44980ea95e5c6"
Sep 06 19:28:19.492046 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:19.491999    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43595e8c3c8ee2024732762a097a6b8246bf7bd3b5e4cf5537d44980ea95e5c6"} err="failed to get container status \"43595e8c3c8ee2024732762a097a6b8246bf7bd3b5e4cf5537d44980ea95e5c6\": rpc error: code = NotFound desc = could not find container \"43595e8c3c8ee2024732762a097a6b8246bf7bd3b5e4cf5537d44980ea95e5c6\": container with ID starting with 43595e8c3c8ee2024732762a097a6b8246bf7bd3b5e4cf5537d44980ea95e5c6 not found: ID does not exist"
Sep 06 19:28:19.499850 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:19.499797    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0281bd63-76864649cb-tfhsd"]
Sep 06 19:28:19.503177 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:19.503158    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0281bd63-76864649cb-tfhsd"]
Sep 06 19:28:19.511225 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:19.511206    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0281bd63-97b5c4699-9n9cq"]
Sep 06 19:28:19.515273 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:19.515253    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0281bd63-97b5c4699-9n9cq"]
Sep 06 19:28:19.526286 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:19.526268    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e1675f0-2153-485d-bb57-5ed879ee4055-maas-api-tls\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:28:19.526286 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:19.526287    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e1675f0-2153-485d-bb57-5ed879ee4055-metrics-certs\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:28:19.526399 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:19.526296    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdjb2\" (UniqueName: \"kubernetes.io/projected/1e1675f0-2153-485d-bb57-5ed879ee4055-kube-api-access-pdjb2\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:28:19.526399 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:19.526305    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e1675f0-2153-485d-bb57-5ed879ee4055-openshift-service-ca\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:28:20.388125 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:20.388038    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e1675f0-2153-485d-bb57-5ed879ee4055" path="/var/lib/kubelet/pods/1e1675f0-2153-485d-bb57-5ed879ee4055/volumes"
Sep 06 19:28:20.388602 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:20.388581    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a294ed9-2099-44b2-b873-0ad37e6b4960" path="/var/lib/kubelet/pods/3a294ed9-2099-44b2-b873-0ad37e6b4960/volumes"
Sep 06 19:28:22.866917 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:22.866888    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh"]
Sep 06 19:28:22.867365 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:22.867232    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e1675f0-2153-485d-bb57-5ed879ee4055" containerName="maas-api"
Sep 06 19:28:22.867365 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:22.867242    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e1675f0-2153-485d-bb57-5ed879ee4055" containerName="maas-api"
Sep 06 19:28:22.867365 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:22.867256    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a294ed9-2099-44b2-b873-0ad37e6b4960" containerName="payload-processing"
Sep 06 19:28:22.867365 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:22.867262    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a294ed9-2099-44b2-b873-0ad37e6b4960" containerName="payload-processing"
Sep 06 19:28:22.867365 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:22.867317    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a294ed9-2099-44b2-b873-0ad37e6b4960" containerName="payload-processing"
Sep 06 19:28:22.867365 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:22.867328    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e1675f0-2153-485d-bb57-5ed879ee4055" containerName="maas-api"
Sep 06 19:28:22.870255 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:22.870227    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh"
Sep 06 19:28:22.872339 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:22.872318    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-053eb1b8-serving-cert\""
Sep 06 19:28:22.880184 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:22.880162    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh"]
Sep 06 19:28:22.950025 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:22.949997    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d25dbf56-adc8-42c7-8169-0224fd930792-maas-api-tls\") pod \"maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh\" (UID: \"d25dbf56-adc8-42c7-8169-0224fd930792\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh"
Sep 06 19:28:22.950025 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:22.950028    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d25dbf56-adc8-42c7-8169-0224fd930792-metrics-certs\") pod \"maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh\" (UID: \"d25dbf56-adc8-42c7-8169-0224fd930792\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh"
Sep 06 19:28:22.950207 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:22.950052    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d25dbf56-adc8-42c7-8169-0224fd930792-openshift-service-ca\") pod \"maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh\" (UID: \"d25dbf56-adc8-42c7-8169-0224fd930792\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh"
Sep 06 19:28:22.950207 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:22.950151    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hvjs\" (UniqueName: \"kubernetes.io/projected/d25dbf56-adc8-42c7-8169-0224fd930792-kube-api-access-2hvjs\") pod \"maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh\" (UID: \"d25dbf56-adc8-42c7-8169-0224fd930792\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh"
Sep 06 19:28:23.051250 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:23.051214    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d25dbf56-adc8-42c7-8169-0224fd930792-maas-api-tls\") pod \"maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh\" (UID: \"d25dbf56-adc8-42c7-8169-0224fd930792\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh"
Sep 06 19:28:23.051250 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:23.051247    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d25dbf56-adc8-42c7-8169-0224fd930792-metrics-certs\") pod \"maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh\" (UID: \"d25dbf56-adc8-42c7-8169-0224fd930792\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh"
Sep 06 19:28:23.051499 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:23.051273    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d25dbf56-adc8-42c7-8169-0224fd930792-openshift-service-ca\") pod \"maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh\" (UID: \"d25dbf56-adc8-42c7-8169-0224fd930792\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh"
Sep 06 19:28:23.051499 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:23.051309    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hvjs\" (UniqueName: \"kubernetes.io/projected/d25dbf56-adc8-42c7-8169-0224fd930792-kube-api-access-2hvjs\") pod \"maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh\" (UID: \"d25dbf56-adc8-42c7-8169-0224fd930792\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh"
Sep 06 19:28:23.052033 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:23.052003    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d25dbf56-adc8-42c7-8169-0224fd930792-openshift-service-ca\") pod \"maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh\" (UID: \"d25dbf56-adc8-42c7-8169-0224fd930792\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh"
Sep 06 19:28:23.053606 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:23.053585    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d25dbf56-adc8-42c7-8169-0224fd930792-maas-api-tls\") pod \"maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh\" (UID: \"d25dbf56-adc8-42c7-8169-0224fd930792\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh"
Sep 06 19:28:23.053761 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:23.053739    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d25dbf56-adc8-42c7-8169-0224fd930792-metrics-certs\") pod \"maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh\" (UID: \"d25dbf56-adc8-42c7-8169-0224fd930792\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh"
Sep 06 19:28:23.059074 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:23.059048    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hvjs\" (UniqueName: \"kubernetes.io/projected/d25dbf56-adc8-42c7-8169-0224fd930792-kube-api-access-2hvjs\") pod \"maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh\" (UID: \"d25dbf56-adc8-42c7-8169-0224fd930792\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh"
Sep 06 19:28:23.182352 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:23.182286    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh"
Sep 06 19:28:23.456576 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:23.456552    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh"]
Sep 06 19:28:23.459387 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:28:23.459359    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd25dbf56_adc8_42c7_8169_0224fd930792.slice/crio-8faba63a35da2361417060c6392128206d48b618c474ada79ccdac662c35afcc WatchSource:0}: Error finding container 8faba63a35da2361417060c6392128206d48b618c474ada79ccdac662c35afcc: Status 404 returned error can't find the container with id 8faba63a35da2361417060c6392128206d48b618c474ada79ccdac662c35afcc
Sep 06 19:28:23.497819 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:23.497791    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh" event={"ID":"d25dbf56-adc8-42c7-8169-0224fd930792","Type":"ContainerStarted","Data":"8faba63a35da2361417060c6392128206d48b618c474ada79ccdac662c35afcc"}
Sep 06 19:28:23.505293 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:23.505261    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-053eb1b8-d6b859698-xbvzz"]
Sep 06 19:28:23.509772 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:23.509753    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-053eb1b8-d6b859698-xbvzz"
Sep 06 19:28:23.511885 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:23.511866    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-053eb1b8\""
Sep 06 19:28:23.511974 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:23.511868    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-053eb1b8-dockercfg-l5cnj\""
Sep 06 19:28:23.520030 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:23.519997    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-053eb1b8-d6b859698-xbvzz"]
Sep 06 19:28:23.555725 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:23.555695    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wld9j\" (UniqueName: \"kubernetes.io/projected/217ce446-41eb-4fe0-a206-3996af8af54d-kube-api-access-wld9j\") pod \"payload-pre-processing-e2e-migrate-053eb1b8-d6b859698-xbvzz\" (UID: \"217ce446-41eb-4fe0-a206-3996af8af54d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-053eb1b8-d6b859698-xbvzz"
Sep 06 19:28:23.555845 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:23.555749    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/217ce446-41eb-4fe0-a206-3996af8af54d-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-053eb1b8-d6b859698-xbvzz\" (UID: \"217ce446-41eb-4fe0-a206-3996af8af54d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-053eb1b8-d6b859698-xbvzz"
Sep 06 19:28:23.656425 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:23.656395    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/217ce446-41eb-4fe0-a206-3996af8af54d-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-053eb1b8-d6b859698-xbvzz\" (UID: \"217ce446-41eb-4fe0-a206-3996af8af54d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-053eb1b8-d6b859698-xbvzz"
Sep 06 19:28:23.656624 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:23.656457    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wld9j\" (UniqueName: \"kubernetes.io/projected/217ce446-41eb-4fe0-a206-3996af8af54d-kube-api-access-wld9j\") pod \"payload-pre-processing-e2e-migrate-053eb1b8-d6b859698-xbvzz\" (UID: \"217ce446-41eb-4fe0-a206-3996af8af54d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-053eb1b8-d6b859698-xbvzz"
Sep 06 19:28:23.657088 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:23.657066    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/217ce446-41eb-4fe0-a206-3996af8af54d-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-053eb1b8-d6b859698-xbvzz\" (UID: \"217ce446-41eb-4fe0-a206-3996af8af54d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-053eb1b8-d6b859698-xbvzz"
Sep 06 19:28:23.664274 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:23.664245    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wld9j\" (UniqueName: \"kubernetes.io/projected/217ce446-41eb-4fe0-a206-3996af8af54d-kube-api-access-wld9j\") pod \"payload-pre-processing-e2e-migrate-053eb1b8-d6b859698-xbvzz\" (UID: \"217ce446-41eb-4fe0-a206-3996af8af54d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-053eb1b8-d6b859698-xbvzz"
Sep 06 19:28:23.822301 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:23.822277    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-053eb1b8-d6b859698-xbvzz"
Sep 06 19:28:24.091450 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:24.091377    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-053eb1b8-d6b859698-xbvzz"]
Sep 06 19:28:24.094865 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:28:24.094838    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod217ce446_41eb_4fe0_a206_3996af8af54d.slice/crio-d37838677503f2acad88405675dab01a0d39c50bc52be09e64972c668972bff0 WatchSource:0}: Error finding container d37838677503f2acad88405675dab01a0d39c50bc52be09e64972c668972bff0: Status 404 returned error can't find the container with id d37838677503f2acad88405675dab01a0d39c50bc52be09e64972c668972bff0
Sep 06 19:28:24.505238 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:24.505203    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh" event={"ID":"d25dbf56-adc8-42c7-8169-0224fd930792","Type":"ContainerStarted","Data":"9a5527dc389b0124ec8120dfa9c38f49d714c5d503b2f13753e66f51414a00f0"}
Sep 06 19:28:24.505407 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:24.505349    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh"
Sep 06 19:28:24.507018 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:24.506982    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-053eb1b8-d6b859698-xbvzz" event={"ID":"217ce446-41eb-4fe0-a206-3996af8af54d","Type":"ContainerStarted","Data":"91f2f52fed179fc90152ce638eace148ade796f8816fa4e83937e48cef521c69"}
Sep 06 19:28:24.507125 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:24.507038    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-053eb1b8-d6b859698-xbvzz" event={"ID":"217ce446-41eb-4fe0-a206-3996af8af54d","Type":"ContainerStarted","Data":"d37838677503f2acad88405675dab01a0d39c50bc52be09e64972c668972bff0"}
Sep 06 19:28:24.507125 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:24.507069    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-053eb1b8-d6b859698-xbvzz"
Sep 06 19:28:24.525725 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:24.525682    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh" podStartSLOduration=2.241034824 podStartE2EDuration="2.525668944s" totalImagesPullingTime="284.63412ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:28:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:28:24.523640364 +0000 UTC m=+1050.764525731" watchObservedRunningTime="2026-09-06 19:28:24.525668944 +0000 UTC m=+1050.766554326"
Sep 06 19:28:24.543838 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:24.543790    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-053eb1b8-d6b859698-xbvzz" podStartSLOduration=1.54378028 podStartE2EDuration="1.54378028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:28:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:28:24.542175423 +0000 UTC m=+1050.783060789" watchObservedRunningTime="2026-09-06 19:28:24.54378028 +0000 UTC m=+1050.784665624"
Sep 06 19:28:30.517067 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:30.517039    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh"
Sep 06 19:28:35.513550 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:35.513519    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-053eb1b8-d6b859698-xbvzz"
Sep 06 19:28:54.150010 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.149931    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh"]
Sep 06 19:28:54.150885 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.150829    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh" podUID="d25dbf56-adc8-42c7-8169-0224fd930792" containerName="maas-api" containerID="cri-o://9a5527dc389b0124ec8120dfa9c38f49d714c5d503b2f13753e66f51414a00f0" gracePeriod=30
Sep 06 19:28:54.206087 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.206058    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-053eb1b8-d6b859698-xbvzz"]
Sep 06 19:28:54.206346 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.206300    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-053eb1b8-d6b859698-xbvzz" podUID="217ce446-41eb-4fe0-a206-3996af8af54d" containerName="payload-pre-processing" containerID="cri-o://91f2f52fed179fc90152ce638eace148ade796f8816fa4e83937e48cef521c69" gracePeriod=30
Sep 06 19:28:54.492316 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.492287    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh"
Sep 06 19:28:54.533094 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.533066    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-053eb1b8-d6b859698-xbvzz"
Sep 06 19:28:54.593226 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.593199    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/217ce446-41eb-4fe0-a206-3996af8af54d-plugins-config-volume\") pod \"217ce446-41eb-4fe0-a206-3996af8af54d\" (UID: \"217ce446-41eb-4fe0-a206-3996af8af54d\") "
Sep 06 19:28:54.593376 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.593265    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d25dbf56-adc8-42c7-8169-0224fd930792-metrics-certs\") pod \"d25dbf56-adc8-42c7-8169-0224fd930792\" (UID: \"d25dbf56-adc8-42c7-8169-0224fd930792\") "
Sep 06 19:28:54.593376 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.593292    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d25dbf56-adc8-42c7-8169-0224fd930792-maas-api-tls\") pod \"d25dbf56-adc8-42c7-8169-0224fd930792\" (UID: \"d25dbf56-adc8-42c7-8169-0224fd930792\") "
Sep 06 19:28:54.593376 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.593315    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d25dbf56-adc8-42c7-8169-0224fd930792-openshift-service-ca\") pod \"d25dbf56-adc8-42c7-8169-0224fd930792\" (UID: \"d25dbf56-adc8-42c7-8169-0224fd930792\") "
Sep 06 19:28:54.593376 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.593347    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hvjs\" (UniqueName: \"kubernetes.io/projected/d25dbf56-adc8-42c7-8169-0224fd930792-kube-api-access-2hvjs\") pod \"d25dbf56-adc8-42c7-8169-0224fd930792\" (UID: \"d25dbf56-adc8-42c7-8169-0224fd930792\") "
Sep 06 19:28:54.593680 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.593382    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wld9j\" (UniqueName: \"kubernetes.io/projected/217ce446-41eb-4fe0-a206-3996af8af54d-kube-api-access-wld9j\") pod \"217ce446-41eb-4fe0-a206-3996af8af54d\" (UID: \"217ce446-41eb-4fe0-a206-3996af8af54d\") "
Sep 06 19:28:54.593680 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.593620    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/217ce446-41eb-4fe0-a206-3996af8af54d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "217ce446-41eb-4fe0-a206-3996af8af54d" (UID: "217ce446-41eb-4fe0-a206-3996af8af54d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:28:54.593784 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.593738    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d25dbf56-adc8-42c7-8169-0224fd930792-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d25dbf56-adc8-42c7-8169-0224fd930792" (UID: "d25dbf56-adc8-42c7-8169-0224fd930792"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:28:54.596053 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.596024    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d25dbf56-adc8-42c7-8169-0224fd930792-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d25dbf56-adc8-42c7-8169-0224fd930792" (UID: "d25dbf56-adc8-42c7-8169-0224fd930792"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:28:54.596153 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.596041    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d25dbf56-adc8-42c7-8169-0224fd930792-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d25dbf56-adc8-42c7-8169-0224fd930792" (UID: "d25dbf56-adc8-42c7-8169-0224fd930792"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:28:54.596153 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.596114    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/217ce446-41eb-4fe0-a206-3996af8af54d-kube-api-access-wld9j" (OuterVolumeSpecName: "kube-api-access-wld9j") pod "217ce446-41eb-4fe0-a206-3996af8af54d" (UID: "217ce446-41eb-4fe0-a206-3996af8af54d"). InnerVolumeSpecName "kube-api-access-wld9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:28:54.596153 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.596139    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d25dbf56-adc8-42c7-8169-0224fd930792-kube-api-access-2hvjs" (OuterVolumeSpecName: "kube-api-access-2hvjs") pod "d25dbf56-adc8-42c7-8169-0224fd930792" (UID: "d25dbf56-adc8-42c7-8169-0224fd930792"). InnerVolumeSpecName "kube-api-access-2hvjs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:28:54.654016 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.653979    2577 generic.go:356] "Generic (PLEG): container finished" podID="217ce446-41eb-4fe0-a206-3996af8af54d" containerID="91f2f52fed179fc90152ce638eace148ade796f8816fa4e83937e48cef521c69" exitCode=0
Sep 06 19:28:54.654170 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.654046    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-053eb1b8-d6b859698-xbvzz"
Sep 06 19:28:54.654170 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.654072    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-053eb1b8-d6b859698-xbvzz" event={"ID":"217ce446-41eb-4fe0-a206-3996af8af54d","Type":"ContainerDied","Data":"91f2f52fed179fc90152ce638eace148ade796f8816fa4e83937e48cef521c69"}
Sep 06 19:28:54.654170 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.654164    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-053eb1b8-d6b859698-xbvzz" event={"ID":"217ce446-41eb-4fe0-a206-3996af8af54d","Type":"ContainerDied","Data":"d37838677503f2acad88405675dab01a0d39c50bc52be09e64972c668972bff0"}
Sep 06 19:28:54.654331 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.654195    2577 scope.go:117] "RemoveContainer" containerID="91f2f52fed179fc90152ce638eace148ade796f8816fa4e83937e48cef521c69"
Sep 06 19:28:54.656343 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.656303    2577 generic.go:356] "Generic (PLEG): container finished" podID="d25dbf56-adc8-42c7-8169-0224fd930792" containerID="9a5527dc389b0124ec8120dfa9c38f49d714c5d503b2f13753e66f51414a00f0" exitCode=0
Sep 06 19:28:54.656443 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.656373    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh"
Sep 06 19:28:54.656546 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.656514    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh" event={"ID":"d25dbf56-adc8-42c7-8169-0224fd930792","Type":"ContainerDied","Data":"9a5527dc389b0124ec8120dfa9c38f49d714c5d503b2f13753e66f51414a00f0"}
Sep 06 19:28:54.656752 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.656625    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh" event={"ID":"d25dbf56-adc8-42c7-8169-0224fd930792","Type":"ContainerDied","Data":"8faba63a35da2361417060c6392128206d48b618c474ada79ccdac662c35afcc"}
Sep 06 19:28:54.664949 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.664932    2577 scope.go:117] "RemoveContainer" containerID="91f2f52fed179fc90152ce638eace148ade796f8816fa4e83937e48cef521c69"
Sep 06 19:28:54.665217 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:28:54.665199    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91f2f52fed179fc90152ce638eace148ade796f8816fa4e83937e48cef521c69\": container with ID starting with 91f2f52fed179fc90152ce638eace148ade796f8816fa4e83937e48cef521c69 not found: ID does not exist" containerID="91f2f52fed179fc90152ce638eace148ade796f8816fa4e83937e48cef521c69"
Sep 06 19:28:54.665286 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.665224    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91f2f52fed179fc90152ce638eace148ade796f8816fa4e83937e48cef521c69"} err="failed to get container status \"91f2f52fed179fc90152ce638eace148ade796f8816fa4e83937e48cef521c69\": rpc error: code = NotFound desc = could not find container \"91f2f52fed179fc90152ce638eace148ade796f8816fa4e83937e48cef521c69\": container with ID starting with 91f2f52fed179fc90152ce638eace148ade796f8816fa4e83937e48cef521c69 not found: ID does not exist"
Sep 06 19:28:54.665286 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.665240    2577 scope.go:117] "RemoveContainer" containerID="9a5527dc389b0124ec8120dfa9c38f49d714c5d503b2f13753e66f51414a00f0"
Sep 06 19:28:54.672912 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.672897    2577 scope.go:117] "RemoveContainer" containerID="9a5527dc389b0124ec8120dfa9c38f49d714c5d503b2f13753e66f51414a00f0"
Sep 06 19:28:54.673135 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:28:54.673117    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a5527dc389b0124ec8120dfa9c38f49d714c5d503b2f13753e66f51414a00f0\": container with ID starting with 9a5527dc389b0124ec8120dfa9c38f49d714c5d503b2f13753e66f51414a00f0 not found: ID does not exist" containerID="9a5527dc389b0124ec8120dfa9c38f49d714c5d503b2f13753e66f51414a00f0"
Sep 06 19:28:54.673196 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.673145    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a5527dc389b0124ec8120dfa9c38f49d714c5d503b2f13753e66f51414a00f0"} err="failed to get container status \"9a5527dc389b0124ec8120dfa9c38f49d714c5d503b2f13753e66f51414a00f0\": rpc error: code = NotFound desc = could not find container \"9a5527dc389b0124ec8120dfa9c38f49d714c5d503b2f13753e66f51414a00f0\": container with ID starting with 9a5527dc389b0124ec8120dfa9c38f49d714c5d503b2f13753e66f51414a00f0 not found: ID does not exist"
Sep 06 19:28:54.675928 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.675905    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-053eb1b8-d6b859698-xbvzz"]
Sep 06 19:28:54.681132 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.681110    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-053eb1b8-d6b859698-xbvzz"]
Sep 06 19:28:54.688616 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.688595    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh"]
Sep 06 19:28:54.693938 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.693911    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-053eb1b8-94f77f75c-7plfh"]
Sep 06 19:28:54.694296 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.694279    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hvjs\" (UniqueName: \"kubernetes.io/projected/d25dbf56-adc8-42c7-8169-0224fd930792-kube-api-access-2hvjs\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:28:54.694359 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.694300    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wld9j\" (UniqueName: \"kubernetes.io/projected/217ce446-41eb-4fe0-a206-3996af8af54d-kube-api-access-wld9j\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:28:54.694359 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.694311    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/217ce446-41eb-4fe0-a206-3996af8af54d-plugins-config-volume\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:28:54.694359 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.694319    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d25dbf56-adc8-42c7-8169-0224fd930792-metrics-certs\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:28:54.694359 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.694327    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d25dbf56-adc8-42c7-8169-0224fd930792-maas-api-tls\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:28:54.694359 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:54.694335    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d25dbf56-adc8-42c7-8169-0224fd930792-openshift-service-ca\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:28:56.388398 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:56.388366    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="217ce446-41eb-4fe0-a206-3996af8af54d" path="/var/lib/kubelet/pods/217ce446-41eb-4fe0-a206-3996af8af54d/volumes"
Sep 06 19:28:56.388873 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:56.388853    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d25dbf56-adc8-42c7-8169-0224fd930792" path="/var/lib/kubelet/pods/d25dbf56-adc8-42c7-8169-0224fd930792/volumes"
Sep 06 19:28:58.949764 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:58.949730    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7"]
Sep 06 19:28:58.950256 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:58.950240    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="217ce446-41eb-4fe0-a206-3996af8af54d" containerName="payload-pre-processing"
Sep 06 19:28:58.950298 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:58.950259    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="217ce446-41eb-4fe0-a206-3996af8af54d" containerName="payload-pre-processing"
Sep 06 19:28:58.950298 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:58.950288    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d25dbf56-adc8-42c7-8169-0224fd930792" containerName="maas-api"
Sep 06 19:28:58.950363 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:58.950297    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d25dbf56-adc8-42c7-8169-0224fd930792" containerName="maas-api"
Sep 06 19:28:58.950394 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:58.950382    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="217ce446-41eb-4fe0-a206-3996af8af54d" containerName="payload-pre-processing"
Sep 06 19:28:58.950424 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:58.950398    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d25dbf56-adc8-42c7-8169-0224fd930792" containerName="maas-api"
Sep 06 19:28:58.955326 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:58.955305    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7"
Sep 06 19:28:58.957807 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:58.957783    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-69e43c3f-serving-cert\""
Sep 06 19:28:58.960599 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:58.960577    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7"]
Sep 06 19:28:59.031460 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:59.031430    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqnpd\" (UniqueName: \"kubernetes.io/projected/ac1cd248-8fae-4345-8bb6-5019e88178b5-kube-api-access-zqnpd\") pod \"maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7\" (UID: \"ac1cd248-8fae-4345-8bb6-5019e88178b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7"
Sep 06 19:28:59.031611 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:59.031499    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac1cd248-8fae-4345-8bb6-5019e88178b5-metrics-certs\") pod \"maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7\" (UID: \"ac1cd248-8fae-4345-8bb6-5019e88178b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7"
Sep 06 19:28:59.031611 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:59.031600    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac1cd248-8fae-4345-8bb6-5019e88178b5-maas-api-tls\") pod \"maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7\" (UID: \"ac1cd248-8fae-4345-8bb6-5019e88178b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7"
Sep 06 19:28:59.031735 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:59.031648    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac1cd248-8fae-4345-8bb6-5019e88178b5-openshift-service-ca\") pod \"maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7\" (UID: \"ac1cd248-8fae-4345-8bb6-5019e88178b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7"
Sep 06 19:28:59.132277 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:59.132244    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac1cd248-8fae-4345-8bb6-5019e88178b5-metrics-certs\") pod \"maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7\" (UID: \"ac1cd248-8fae-4345-8bb6-5019e88178b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7"
Sep 06 19:28:59.132415 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:59.132297    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac1cd248-8fae-4345-8bb6-5019e88178b5-maas-api-tls\") pod \"maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7\" (UID: \"ac1cd248-8fae-4345-8bb6-5019e88178b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7"
Sep 06 19:28:59.132415 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:59.132323    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac1cd248-8fae-4345-8bb6-5019e88178b5-openshift-service-ca\") pod \"maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7\" (UID: \"ac1cd248-8fae-4345-8bb6-5019e88178b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7"
Sep 06 19:28:59.132415 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:59.132345    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqnpd\" (UniqueName: \"kubernetes.io/projected/ac1cd248-8fae-4345-8bb6-5019e88178b5-kube-api-access-zqnpd\") pod \"maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7\" (UID: \"ac1cd248-8fae-4345-8bb6-5019e88178b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7"
Sep 06 19:28:59.132594 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:28:59.132442    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-69e43c3f-serving-cert: secret "maas-api-e2e-ait-69e43c3f-serving-cert" not found
Sep 06 19:28:59.132594 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:28:59.132528    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac1cd248-8fae-4345-8bb6-5019e88178b5-maas-api-tls podName:ac1cd248-8fae-4345-8bb6-5019e88178b5 nodeName:}" failed. No retries permitted until 2026-09-06 19:28:59.632511191 +0000 UTC m=+1085.873396515 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ac1cd248-8fae-4345-8bb6-5019e88178b5-maas-api-tls") pod "maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7" (UID: "ac1cd248-8fae-4345-8bb6-5019e88178b5") : secret "maas-api-e2e-ait-69e43c3f-serving-cert" not found
Sep 06 19:28:59.132951 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:59.132932    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac1cd248-8fae-4345-8bb6-5019e88178b5-openshift-service-ca\") pod \"maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7\" (UID: \"ac1cd248-8fae-4345-8bb6-5019e88178b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7"
Sep 06 19:28:59.134575 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:59.134553    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac1cd248-8fae-4345-8bb6-5019e88178b5-metrics-certs\") pod \"maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7\" (UID: \"ac1cd248-8fae-4345-8bb6-5019e88178b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7"
Sep 06 19:28:59.142314 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:59.142289    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqnpd\" (UniqueName: \"kubernetes.io/projected/ac1cd248-8fae-4345-8bb6-5019e88178b5-kube-api-access-zqnpd\") pod \"maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7\" (UID: \"ac1cd248-8fae-4345-8bb6-5019e88178b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7"
Sep 06 19:28:59.628381 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:59.628346    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-69e43c3f-75c584ddf4-pjqhq"]
Sep 06 19:28:59.632034 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:59.632018    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-69e43c3f-75c584ddf4-pjqhq"
Sep 06 19:28:59.634111 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:59.634094    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-69e43c3f\""
Sep 06 19:28:59.634231 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:59.634211    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-69e43c3f-dockercfg-xzgfk\""
Sep 06 19:28:59.637002 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:59.636984    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac1cd248-8fae-4345-8bb6-5019e88178b5-maas-api-tls\") pod \"maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7\" (UID: \"ac1cd248-8fae-4345-8bb6-5019e88178b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7"
Sep 06 19:28:59.639284 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:59.639223    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac1cd248-8fae-4345-8bb6-5019e88178b5-maas-api-tls\") pod \"maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7\" (UID: \"ac1cd248-8fae-4345-8bb6-5019e88178b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7"
Sep 06 19:28:59.645630 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:59.645610    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-69e43c3f-75c584ddf4-pjqhq"]
Sep 06 19:28:59.654622 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:59.654602    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-69e43c3f-797574968f-jf74f"]
Sep 06 19:28:59.657780 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:59.657766    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-69e43c3f-797574968f-jf74f"
Sep 06 19:28:59.667711 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:59.667693    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-69e43c3f-797574968f-jf74f"]
Sep 06 19:28:59.737682 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:59.737651    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khv95\" (UniqueName: \"kubernetes.io/projected/0d784d4c-2c75-4fef-82f8-77a0ea762335-kube-api-access-khv95\") pod \"payload-pre-processing-e2e-ait-69e43c3f-75c584ddf4-pjqhq\" (UID: \"0d784d4c-2c75-4fef-82f8-77a0ea762335\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-69e43c3f-75c584ddf4-pjqhq"
Sep 06 19:28:59.737844 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:59.737701    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d784d4c-2c75-4fef-82f8-77a0ea762335-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-69e43c3f-75c584ddf4-pjqhq\" (UID: \"0d784d4c-2c75-4fef-82f8-77a0ea762335\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-69e43c3f-75c584ddf4-pjqhq"
Sep 06 19:28:59.737844 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:59.737757    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5wdr\" (UniqueName: \"kubernetes.io/projected/c69e55d8-a4a5-44c2-afaa-07568377f8a5-kube-api-access-r5wdr\") pod \"payload-processing-e2e-ait-69e43c3f-797574968f-jf74f\" (UID: \"c69e55d8-a4a5-44c2-afaa-07568377f8a5\") " pod="openshift-ingress/payload-processing-e2e-ait-69e43c3f-797574968f-jf74f"
Sep 06 19:28:59.737844 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:59.737837    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c69e55d8-a4a5-44c2-afaa-07568377f8a5-plugins-config-volume\") pod \"payload-processing-e2e-ait-69e43c3f-797574968f-jf74f\" (UID: \"c69e55d8-a4a5-44c2-afaa-07568377f8a5\") " pod="openshift-ingress/payload-processing-e2e-ait-69e43c3f-797574968f-jf74f"
Sep 06 19:28:59.838954 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:59.838918    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khv95\" (UniqueName: \"kubernetes.io/projected/0d784d4c-2c75-4fef-82f8-77a0ea762335-kube-api-access-khv95\") pod \"payload-pre-processing-e2e-ait-69e43c3f-75c584ddf4-pjqhq\" (UID: \"0d784d4c-2c75-4fef-82f8-77a0ea762335\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-69e43c3f-75c584ddf4-pjqhq"
Sep 06 19:28:59.839102 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:59.838964    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d784d4c-2c75-4fef-82f8-77a0ea762335-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-69e43c3f-75c584ddf4-pjqhq\" (UID: \"0d784d4c-2c75-4fef-82f8-77a0ea762335\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-69e43c3f-75c584ddf4-pjqhq"
Sep 06 19:28:59.839102 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:59.838980    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5wdr\" (UniqueName: \"kubernetes.io/projected/c69e55d8-a4a5-44c2-afaa-07568377f8a5-kube-api-access-r5wdr\") pod \"payload-processing-e2e-ait-69e43c3f-797574968f-jf74f\" (UID: \"c69e55d8-a4a5-44c2-afaa-07568377f8a5\") " pod="openshift-ingress/payload-processing-e2e-ait-69e43c3f-797574968f-jf74f"
Sep 06 19:28:59.839102 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:59.839020    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c69e55d8-a4a5-44c2-afaa-07568377f8a5-plugins-config-volume\") pod \"payload-processing-e2e-ait-69e43c3f-797574968f-jf74f\" (UID: \"c69e55d8-a4a5-44c2-afaa-07568377f8a5\") " pod="openshift-ingress/payload-processing-e2e-ait-69e43c3f-797574968f-jf74f"
Sep 06 19:28:59.839744 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:59.839724    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c69e55d8-a4a5-44c2-afaa-07568377f8a5-plugins-config-volume\") pod \"payload-processing-e2e-ait-69e43c3f-797574968f-jf74f\" (UID: \"c69e55d8-a4a5-44c2-afaa-07568377f8a5\") " pod="openshift-ingress/payload-processing-e2e-ait-69e43c3f-797574968f-jf74f"
Sep 06 19:28:59.839789 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:59.839726    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d784d4c-2c75-4fef-82f8-77a0ea762335-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-69e43c3f-75c584ddf4-pjqhq\" (UID: \"0d784d4c-2c75-4fef-82f8-77a0ea762335\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-69e43c3f-75c584ddf4-pjqhq"
Sep 06 19:28:59.846271 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:59.846241    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khv95\" (UniqueName: \"kubernetes.io/projected/0d784d4c-2c75-4fef-82f8-77a0ea762335-kube-api-access-khv95\") pod \"payload-pre-processing-e2e-ait-69e43c3f-75c584ddf4-pjqhq\" (UID: \"0d784d4c-2c75-4fef-82f8-77a0ea762335\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-69e43c3f-75c584ddf4-pjqhq"
Sep 06 19:28:59.846555 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:59.846535    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5wdr\" (UniqueName: \"kubernetes.io/projected/c69e55d8-a4a5-44c2-afaa-07568377f8a5-kube-api-access-r5wdr\") pod \"payload-processing-e2e-ait-69e43c3f-797574968f-jf74f\" (UID: \"c69e55d8-a4a5-44c2-afaa-07568377f8a5\") " pod="openshift-ingress/payload-processing-e2e-ait-69e43c3f-797574968f-jf74f"
Sep 06 19:28:59.868394 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:59.868376    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7"
Sep 06 19:28:59.951612 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:59.951582    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-69e43c3f-75c584ddf4-pjqhq"
Sep 06 19:28:59.968744 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:28:59.968716    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-69e43c3f-797574968f-jf74f"
Sep 06 19:29:00.135524 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:00.135502    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7"]
Sep 06 19:29:00.137622 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:29:00.137600    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac1cd248_8fae_4345_8bb6_5019e88178b5.slice/crio-5bd5f69c88dba3e7c90ea3c4b2b4ba0e139e876405075fded7803cff84e3f070 WatchSource:0}: Error finding container 5bd5f69c88dba3e7c90ea3c4b2b4ba0e139e876405075fded7803cff84e3f070: Status 404 returned error can't find the container with id 5bd5f69c88dba3e7c90ea3c4b2b4ba0e139e876405075fded7803cff84e3f070
Sep 06 19:29:00.220770 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:00.220732    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-69e43c3f-75c584ddf4-pjqhq"]
Sep 06 19:29:00.222981 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:29:00.222950    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d784d4c_2c75_4fef_82f8_77a0ea762335.slice/crio-e539203d40733757a6bf8af22cbc228d8e84c5c9bf18cf72daeae1a07ccfa5b6 WatchSource:0}: Error finding container e539203d40733757a6bf8af22cbc228d8e84c5c9bf18cf72daeae1a07ccfa5b6: Status 404 returned error can't find the container with id e539203d40733757a6bf8af22cbc228d8e84c5c9bf18cf72daeae1a07ccfa5b6
Sep 06 19:29:00.242062 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:00.242032    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-69e43c3f-797574968f-jf74f"]
Sep 06 19:29:00.246263 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:29:00.246227    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc69e55d8_a4a5_44c2_afaa_07568377f8a5.slice/crio-1c4b724deb1846b2193556fea766c6c41747f3462deabcd19e748a7c0bbf13dd WatchSource:0}: Error finding container 1c4b724deb1846b2193556fea766c6c41747f3462deabcd19e748a7c0bbf13dd: Status 404 returned error can't find the container with id 1c4b724deb1846b2193556fea766c6c41747f3462deabcd19e748a7c0bbf13dd
Sep 06 19:29:00.689606 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:00.689568    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-69e43c3f-75c584ddf4-pjqhq" event={"ID":"0d784d4c-2c75-4fef-82f8-77a0ea762335","Type":"ContainerStarted","Data":"29ce645b41ff16dc101e94d6cf6e53994a270d206e5ce81935518c5036be7760"}
Sep 06 19:29:00.689773 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:00.689628    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-69e43c3f-75c584ddf4-pjqhq" event={"ID":"0d784d4c-2c75-4fef-82f8-77a0ea762335","Type":"ContainerStarted","Data":"e539203d40733757a6bf8af22cbc228d8e84c5c9bf18cf72daeae1a07ccfa5b6"}
Sep 06 19:29:00.689773 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:00.689720    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-69e43c3f-75c584ddf4-pjqhq"
Sep 06 19:29:00.691179 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:00.691157    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-69e43c3f-797574968f-jf74f" event={"ID":"c69e55d8-a4a5-44c2-afaa-07568377f8a5","Type":"ContainerStarted","Data":"077caf7e0f860858ffa2585beabd3e76cef7ecf512faa104052c2540010c261b"}
Sep 06 19:29:00.691287 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:00.691196    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-69e43c3f-797574968f-jf74f" event={"ID":"c69e55d8-a4a5-44c2-afaa-07568377f8a5","Type":"ContainerStarted","Data":"1c4b724deb1846b2193556fea766c6c41747f3462deabcd19e748a7c0bbf13dd"}
Sep 06 19:29:00.691287 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:00.691236    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-69e43c3f-797574968f-jf74f"
Sep 06 19:29:00.692876 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:00.692839    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7" event={"ID":"ac1cd248-8fae-4345-8bb6-5019e88178b5","Type":"ContainerStarted","Data":"94ca418daf1142e73ce1642d0528d9ac897326075b0a4a4410ff0c4b57fda2a0"}
Sep 06 19:29:00.692974 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:00.692884    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7" event={"ID":"ac1cd248-8fae-4345-8bb6-5019e88178b5","Type":"ContainerStarted","Data":"5bd5f69c88dba3e7c90ea3c4b2b4ba0e139e876405075fded7803cff84e3f070"}
Sep 06 19:29:00.692974 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:00.692910    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7"
Sep 06 19:29:00.705912 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:00.705833    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-69e43c3f-75c584ddf4-pjqhq" podStartSLOduration=1.705821177 podStartE2EDuration="1.705821177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:28:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:29:00.703584244 +0000 UTC m=+1086.944469612" watchObservedRunningTime="2026-09-06 19:29:00.705821177 +0000 UTC m=+1086.946706520"
Sep 06 19:29:00.719947 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:00.719901    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7" podStartSLOduration=2.410731345 podStartE2EDuration="2.719884689s" totalImagesPullingTime="309.153344ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:28:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:29:00.71734171 +0000 UTC m=+1086.958227066" watchObservedRunningTime="2026-09-06 19:29:00.719884689 +0000 UTC m=+1086.960770034"
Sep 06 19:29:00.732534 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:00.732501    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-69e43c3f-797574968f-jf74f" podStartSLOduration=1.732490391 podStartE2EDuration="1.732490391s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:28:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:29:00.731020017 +0000 UTC m=+1086.971905387" watchObservedRunningTime="2026-09-06 19:29:00.732490391 +0000 UTC m=+1086.973375735"
Sep 06 19:29:06.704120 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:06.704093    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7"
Sep 06 19:29:11.700102 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:11.700066    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-69e43c3f-75c584ddf4-pjqhq"
Sep 06 19:29:11.700521 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:11.700338    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-69e43c3f-797574968f-jf74f"
Sep 06 19:29:29.219788 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.219748    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7"]
Sep 06 19:29:29.220291 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.220000    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7" podUID="ac1cd248-8fae-4345-8bb6-5019e88178b5" containerName="maas-api" containerID="cri-o://94ca418daf1142e73ce1642d0528d9ac897326075b0a4a4410ff0c4b57fda2a0" gracePeriod=30
Sep 06 19:29:29.265103 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.265069    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-69e43c3f-797574968f-jf74f"]
Sep 06 19:29:29.265334 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.265307    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-69e43c3f-797574968f-jf74f" podUID="c69e55d8-a4a5-44c2-afaa-07568377f8a5" containerName="payload-processing" containerID="cri-o://077caf7e0f860858ffa2585beabd3e76cef7ecf512faa104052c2540010c261b" gracePeriod=30
Sep 06 19:29:29.270998 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.270972    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-69e43c3f-75c584ddf4-pjqhq"]
Sep 06 19:29:29.271211 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.271177    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-69e43c3f-75c584ddf4-pjqhq" podUID="0d784d4c-2c75-4fef-82f8-77a0ea762335" containerName="payload-pre-processing" containerID="cri-o://29ce645b41ff16dc101e94d6cf6e53994a270d206e5ce81935518c5036be7760" gracePeriod=30
Sep 06 19:29:29.543370 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.543339    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-69e43c3f-797574968f-jf74f"
Sep 06 19:29:29.558371 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.558346    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7"
Sep 06 19:29:29.564210 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.564178    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-69e43c3f-75c584ddf4-pjqhq"
Sep 06 19:29:29.677233 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.677202    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d784d4c-2c75-4fef-82f8-77a0ea762335-plugins-config-volume\") pod \"0d784d4c-2c75-4fef-82f8-77a0ea762335\" (UID: \"0d784d4c-2c75-4fef-82f8-77a0ea762335\") "
Sep 06 19:29:29.677389 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.677247    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c69e55d8-a4a5-44c2-afaa-07568377f8a5-plugins-config-volume\") pod \"c69e55d8-a4a5-44c2-afaa-07568377f8a5\" (UID: \"c69e55d8-a4a5-44c2-afaa-07568377f8a5\") "
Sep 06 19:29:29.677389 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.677274    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac1cd248-8fae-4345-8bb6-5019e88178b5-maas-api-tls\") pod \"ac1cd248-8fae-4345-8bb6-5019e88178b5\" (UID: \"ac1cd248-8fae-4345-8bb6-5019e88178b5\") "
Sep 06 19:29:29.677389 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.677338    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqnpd\" (UniqueName: \"kubernetes.io/projected/ac1cd248-8fae-4345-8bb6-5019e88178b5-kube-api-access-zqnpd\") pod \"ac1cd248-8fae-4345-8bb6-5019e88178b5\" (UID: \"ac1cd248-8fae-4345-8bb6-5019e88178b5\") "
Sep 06 19:29:29.677389 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.677366    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac1cd248-8fae-4345-8bb6-5019e88178b5-metrics-certs\") pod \"ac1cd248-8fae-4345-8bb6-5019e88178b5\" (UID: \"ac1cd248-8fae-4345-8bb6-5019e88178b5\") "
Sep 06 19:29:29.677628 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.677392    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac1cd248-8fae-4345-8bb6-5019e88178b5-openshift-service-ca\") pod \"ac1cd248-8fae-4345-8bb6-5019e88178b5\" (UID: \"ac1cd248-8fae-4345-8bb6-5019e88178b5\") "
Sep 06 19:29:29.677628 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.677432    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khv95\" (UniqueName: \"kubernetes.io/projected/0d784d4c-2c75-4fef-82f8-77a0ea762335-kube-api-access-khv95\") pod \"0d784d4c-2c75-4fef-82f8-77a0ea762335\" (UID: \"0d784d4c-2c75-4fef-82f8-77a0ea762335\") "
Sep 06 19:29:29.677628 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.677522    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5wdr\" (UniqueName: \"kubernetes.io/projected/c69e55d8-a4a5-44c2-afaa-07568377f8a5-kube-api-access-r5wdr\") pod \"c69e55d8-a4a5-44c2-afaa-07568377f8a5\" (UID: \"c69e55d8-a4a5-44c2-afaa-07568377f8a5\") "
Sep 06 19:29:29.677765 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.677635    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d784d4c-2c75-4fef-82f8-77a0ea762335-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0d784d4c-2c75-4fef-82f8-77a0ea762335" (UID: "0d784d4c-2c75-4fef-82f8-77a0ea762335"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:29:29.677765 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.677661    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c69e55d8-a4a5-44c2-afaa-07568377f8a5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c69e55d8-a4a5-44c2-afaa-07568377f8a5" (UID: "c69e55d8-a4a5-44c2-afaa-07568377f8a5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:29:29.677860 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.677817    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d784d4c-2c75-4fef-82f8-77a0ea762335-plugins-config-volume\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:29:29.677860 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.677822    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac1cd248-8fae-4345-8bb6-5019e88178b5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ac1cd248-8fae-4345-8bb6-5019e88178b5" (UID: "ac1cd248-8fae-4345-8bb6-5019e88178b5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:29:29.677860 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.677834    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c69e55d8-a4a5-44c2-afaa-07568377f8a5-plugins-config-volume\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:29:29.679448 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.679421    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac1cd248-8fae-4345-8bb6-5019e88178b5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ac1cd248-8fae-4345-8bb6-5019e88178b5" (UID: "ac1cd248-8fae-4345-8bb6-5019e88178b5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:29:29.679592 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.679564    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d784d4c-2c75-4fef-82f8-77a0ea762335-kube-api-access-khv95" (OuterVolumeSpecName: "kube-api-access-khv95") pod "0d784d4c-2c75-4fef-82f8-77a0ea762335" (UID: "0d784d4c-2c75-4fef-82f8-77a0ea762335"). InnerVolumeSpecName "kube-api-access-khv95". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:29:29.679638 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.679597    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c69e55d8-a4a5-44c2-afaa-07568377f8a5-kube-api-access-r5wdr" (OuterVolumeSpecName: "kube-api-access-r5wdr") pod "c69e55d8-a4a5-44c2-afaa-07568377f8a5" (UID: "c69e55d8-a4a5-44c2-afaa-07568377f8a5"). InnerVolumeSpecName "kube-api-access-r5wdr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:29:29.679839 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.679811    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac1cd248-8fae-4345-8bb6-5019e88178b5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ac1cd248-8fae-4345-8bb6-5019e88178b5" (UID: "ac1cd248-8fae-4345-8bb6-5019e88178b5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:29:29.679839 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.679826    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac1cd248-8fae-4345-8bb6-5019e88178b5-kube-api-access-zqnpd" (OuterVolumeSpecName: "kube-api-access-zqnpd") pod "ac1cd248-8fae-4345-8bb6-5019e88178b5" (UID: "ac1cd248-8fae-4345-8bb6-5019e88178b5"). InnerVolumeSpecName "kube-api-access-zqnpd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:29:29.779030 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.778975    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khv95\" (UniqueName: \"kubernetes.io/projected/0d784d4c-2c75-4fef-82f8-77a0ea762335-kube-api-access-khv95\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:29:29.779030 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.778995    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5wdr\" (UniqueName: \"kubernetes.io/projected/c69e55d8-a4a5-44c2-afaa-07568377f8a5-kube-api-access-r5wdr\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:29:29.779030 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.779004    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac1cd248-8fae-4345-8bb6-5019e88178b5-maas-api-tls\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:29:29.779030 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.779013    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqnpd\" (UniqueName: \"kubernetes.io/projected/ac1cd248-8fae-4345-8bb6-5019e88178b5-kube-api-access-zqnpd\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:29:29.779030 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.779021    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac1cd248-8fae-4345-8bb6-5019e88178b5-metrics-certs\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:29:29.779030 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.779029    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac1cd248-8fae-4345-8bb6-5019e88178b5-openshift-service-ca\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:29:29.839569 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.839540    2577 generic.go:356] "Generic (PLEG): container finished" podID="ac1cd248-8fae-4345-8bb6-5019e88178b5" containerID="94ca418daf1142e73ce1642d0528d9ac897326075b0a4a4410ff0c4b57fda2a0" exitCode=0
Sep 06 19:29:29.839676 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.839582    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7"
Sep 06 19:29:29.839676 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.839618    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7" event={"ID":"ac1cd248-8fae-4345-8bb6-5019e88178b5","Type":"ContainerDied","Data":"94ca418daf1142e73ce1642d0528d9ac897326075b0a4a4410ff0c4b57fda2a0"}
Sep 06 19:29:29.839676 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.839663    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7" event={"ID":"ac1cd248-8fae-4345-8bb6-5019e88178b5","Type":"ContainerDied","Data":"5bd5f69c88dba3e7c90ea3c4b2b4ba0e139e876405075fded7803cff84e3f070"}
Sep 06 19:29:29.839819 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.839684    2577 scope.go:117] "RemoveContainer" containerID="94ca418daf1142e73ce1642d0528d9ac897326075b0a4a4410ff0c4b57fda2a0"
Sep 06 19:29:29.840982 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.840960    2577 generic.go:356] "Generic (PLEG): container finished" podID="0d784d4c-2c75-4fef-82f8-77a0ea762335" containerID="29ce645b41ff16dc101e94d6cf6e53994a270d206e5ce81935518c5036be7760" exitCode=0
Sep 06 19:29:29.841066 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.840983    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-69e43c3f-75c584ddf4-pjqhq" event={"ID":"0d784d4c-2c75-4fef-82f8-77a0ea762335","Type":"ContainerDied","Data":"29ce645b41ff16dc101e94d6cf6e53994a270d206e5ce81935518c5036be7760"}
Sep 06 19:29:29.841066 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.841006    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-69e43c3f-75c584ddf4-pjqhq"
Sep 06 19:29:29.841066 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.841022    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-69e43c3f-75c584ddf4-pjqhq" event={"ID":"0d784d4c-2c75-4fef-82f8-77a0ea762335","Type":"ContainerDied","Data":"e539203d40733757a6bf8af22cbc228d8e84c5c9bf18cf72daeae1a07ccfa5b6"}
Sep 06 19:29:29.842551 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.842509    2577 generic.go:356] "Generic (PLEG): container finished" podID="c69e55d8-a4a5-44c2-afaa-07568377f8a5" containerID="077caf7e0f860858ffa2585beabd3e76cef7ecf512faa104052c2540010c261b" exitCode=0
Sep 06 19:29:29.842551 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.842549    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-69e43c3f-797574968f-jf74f"
Sep 06 19:29:29.842707 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.842549    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-69e43c3f-797574968f-jf74f" event={"ID":"c69e55d8-a4a5-44c2-afaa-07568377f8a5","Type":"ContainerDied","Data":"077caf7e0f860858ffa2585beabd3e76cef7ecf512faa104052c2540010c261b"}
Sep 06 19:29:29.842707 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.842662    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-69e43c3f-797574968f-jf74f" event={"ID":"c69e55d8-a4a5-44c2-afaa-07568377f8a5","Type":"ContainerDied","Data":"1c4b724deb1846b2193556fea766c6c41747f3462deabcd19e748a7c0bbf13dd"}
Sep 06 19:29:29.849622 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.849601    2577 scope.go:117] "RemoveContainer" containerID="94ca418daf1142e73ce1642d0528d9ac897326075b0a4a4410ff0c4b57fda2a0"
Sep 06 19:29:29.849862 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:29:29.849842    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94ca418daf1142e73ce1642d0528d9ac897326075b0a4a4410ff0c4b57fda2a0\": container with ID starting with 94ca418daf1142e73ce1642d0528d9ac897326075b0a4a4410ff0c4b57fda2a0 not found: ID does not exist" containerID="94ca418daf1142e73ce1642d0528d9ac897326075b0a4a4410ff0c4b57fda2a0"
Sep 06 19:29:29.849938 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.849866    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94ca418daf1142e73ce1642d0528d9ac897326075b0a4a4410ff0c4b57fda2a0"} err="failed to get container status \"94ca418daf1142e73ce1642d0528d9ac897326075b0a4a4410ff0c4b57fda2a0\": rpc error: code = NotFound desc = could not find container \"94ca418daf1142e73ce1642d0528d9ac897326075b0a4a4410ff0c4b57fda2a0\": container with ID starting with 94ca418daf1142e73ce1642d0528d9ac897326075b0a4a4410ff0c4b57fda2a0 not found: ID does not exist"
Sep 06 19:29:29.849938 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.849881    2577 scope.go:117] "RemoveContainer" containerID="29ce645b41ff16dc101e94d6cf6e53994a270d206e5ce81935518c5036be7760"
Sep 06 19:29:29.857853 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.857835    2577 scope.go:117] "RemoveContainer" containerID="29ce645b41ff16dc101e94d6cf6e53994a270d206e5ce81935518c5036be7760"
Sep 06 19:29:29.858113 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:29:29.858095    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29ce645b41ff16dc101e94d6cf6e53994a270d206e5ce81935518c5036be7760\": container with ID starting with 29ce645b41ff16dc101e94d6cf6e53994a270d206e5ce81935518c5036be7760 not found: ID does not exist" containerID="29ce645b41ff16dc101e94d6cf6e53994a270d206e5ce81935518c5036be7760"
Sep 06 19:29:29.858157 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.858120    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29ce645b41ff16dc101e94d6cf6e53994a270d206e5ce81935518c5036be7760"} err="failed to get container status \"29ce645b41ff16dc101e94d6cf6e53994a270d206e5ce81935518c5036be7760\": rpc error: code = NotFound desc = could not find container \"29ce645b41ff16dc101e94d6cf6e53994a270d206e5ce81935518c5036be7760\": container with ID starting with 29ce645b41ff16dc101e94d6cf6e53994a270d206e5ce81935518c5036be7760 not found: ID does not exist"
Sep 06 19:29:29.858157 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.858136    2577 scope.go:117] "RemoveContainer" containerID="077caf7e0f860858ffa2585beabd3e76cef7ecf512faa104052c2540010c261b"
Sep 06 19:29:29.861308 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.861289    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7"]
Sep 06 19:29:29.864429 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.864409    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-69e43c3f-677594bb6f-54hx7"]
Sep 06 19:29:29.866038 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.866023    2577 scope.go:117] "RemoveContainer" containerID="077caf7e0f860858ffa2585beabd3e76cef7ecf512faa104052c2540010c261b"
Sep 06 19:29:29.866279 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:29:29.866263    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"077caf7e0f860858ffa2585beabd3e76cef7ecf512faa104052c2540010c261b\": container with ID starting with 077caf7e0f860858ffa2585beabd3e76cef7ecf512faa104052c2540010c261b not found: ID does not exist" containerID="077caf7e0f860858ffa2585beabd3e76cef7ecf512faa104052c2540010c261b"
Sep 06 19:29:29.866339 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.866288    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"077caf7e0f860858ffa2585beabd3e76cef7ecf512faa104052c2540010c261b"} err="failed to get container status \"077caf7e0f860858ffa2585beabd3e76cef7ecf512faa104052c2540010c261b\": rpc error: code = NotFound desc = could not find container \"077caf7e0f860858ffa2585beabd3e76cef7ecf512faa104052c2540010c261b\": container with ID starting with 077caf7e0f860858ffa2585beabd3e76cef7ecf512faa104052c2540010c261b not found: ID does not exist"
Sep 06 19:29:29.873116 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.873097    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-69e43c3f-797574968f-jf74f"]
Sep 06 19:29:29.876988 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.876967    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-69e43c3f-797574968f-jf74f"]
Sep 06 19:29:29.885176 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.885156    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-69e43c3f-75c584ddf4-pjqhq"]
Sep 06 19:29:29.887223 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:29.887203    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-69e43c3f-75c584ddf4-pjqhq"]
Sep 06 19:29:30.387582 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:30.387553    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d784d4c-2c75-4fef-82f8-77a0ea762335" path="/var/lib/kubelet/pods/0d784d4c-2c75-4fef-82f8-77a0ea762335/volumes"
Sep 06 19:29:30.387939 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:30.387926    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac1cd248-8fae-4345-8bb6-5019e88178b5" path="/var/lib/kubelet/pods/ac1cd248-8fae-4345-8bb6-5019e88178b5/volumes"
Sep 06 19:29:30.388227 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:30.388215    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c69e55d8-a4a5-44c2-afaa-07568377f8a5" path="/var/lib/kubelet/pods/c69e55d8-a4a5-44c2-afaa-07568377f8a5/volumes"
Sep 06 19:29:35.164570 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:35.164536    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-119d0999-64797f84d9-lgtxr"]
Sep 06 19:29:35.164932 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:35.164891    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d784d4c-2c75-4fef-82f8-77a0ea762335" containerName="payload-pre-processing"
Sep 06 19:29:35.164932 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:35.164903    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d784d4c-2c75-4fef-82f8-77a0ea762335" containerName="payload-pre-processing"
Sep 06 19:29:35.164932 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:35.164911    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac1cd248-8fae-4345-8bb6-5019e88178b5" containerName="maas-api"
Sep 06 19:29:35.164932 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:35.164916    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac1cd248-8fae-4345-8bb6-5019e88178b5" containerName="maas-api"
Sep 06 19:29:35.165059 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:35.164941    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c69e55d8-a4a5-44c2-afaa-07568377f8a5" containerName="payload-processing"
Sep 06 19:29:35.165059 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:35.164948    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c69e55d8-a4a5-44c2-afaa-07568377f8a5" containerName="payload-processing"
Sep 06 19:29:35.165059 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:35.165018    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c69e55d8-a4a5-44c2-afaa-07568377f8a5" containerName="payload-processing"
Sep 06 19:29:35.165059 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:35.165028    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac1cd248-8fae-4345-8bb6-5019e88178b5" containerName="maas-api"
Sep 06 19:29:35.165059 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:35.165039    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d784d4c-2c75-4fef-82f8-77a0ea762335" containerName="payload-pre-processing"
Sep 06 19:29:35.169731 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:35.169711    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-119d0999-64797f84d9-lgtxr"
Sep 06 19:29:35.171822 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:35.171795    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-119d0999-serving-cert\""
Sep 06 19:29:35.180139 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:35.180106    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-119d0999-64797f84d9-lgtxr"]
Sep 06 19:29:35.319358 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:35.319329    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c369eb5d-2cef-4a9e-a529-29497000dfda-openshift-service-ca\") pod \"maas-api-e2e-derive-119d0999-64797f84d9-lgtxr\" (UID: \"c369eb5d-2cef-4a9e-a529-29497000dfda\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-119d0999-64797f84d9-lgtxr"
Sep 06 19:29:35.319554 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:35.319368    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twlqf\" (UniqueName: \"kubernetes.io/projected/c369eb5d-2cef-4a9e-a529-29497000dfda-kube-api-access-twlqf\") pod \"maas-api-e2e-derive-119d0999-64797f84d9-lgtxr\" (UID: \"c369eb5d-2cef-4a9e-a529-29497000dfda\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-119d0999-64797f84d9-lgtxr"
Sep 06 19:29:35.319554 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:35.319393    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c369eb5d-2cef-4a9e-a529-29497000dfda-maas-api-tls\") pod \"maas-api-e2e-derive-119d0999-64797f84d9-lgtxr\" (UID: \"c369eb5d-2cef-4a9e-a529-29497000dfda\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-119d0999-64797f84d9-lgtxr"
Sep 06 19:29:35.319554 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:35.319504    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c369eb5d-2cef-4a9e-a529-29497000dfda-metrics-certs\") pod \"maas-api-e2e-derive-119d0999-64797f84d9-lgtxr\" (UID: \"c369eb5d-2cef-4a9e-a529-29497000dfda\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-119d0999-64797f84d9-lgtxr"
Sep 06 19:29:35.419985 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:35.419916    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c369eb5d-2cef-4a9e-a529-29497000dfda-metrics-certs\") pod \"maas-api-e2e-derive-119d0999-64797f84d9-lgtxr\" (UID: \"c369eb5d-2cef-4a9e-a529-29497000dfda\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-119d0999-64797f84d9-lgtxr"
Sep 06 19:29:35.419985 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:35.419958    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c369eb5d-2cef-4a9e-a529-29497000dfda-openshift-service-ca\") pod \"maas-api-e2e-derive-119d0999-64797f84d9-lgtxr\" (UID: \"c369eb5d-2cef-4a9e-a529-29497000dfda\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-119d0999-64797f84d9-lgtxr"
Sep 06 19:29:35.419985 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:35.419982    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twlqf\" (UniqueName: \"kubernetes.io/projected/c369eb5d-2cef-4a9e-a529-29497000dfda-kube-api-access-twlqf\") pod \"maas-api-e2e-derive-119d0999-64797f84d9-lgtxr\" (UID: \"c369eb5d-2cef-4a9e-a529-29497000dfda\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-119d0999-64797f84d9-lgtxr"
Sep 06 19:29:35.420217 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:35.420090    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c369eb5d-2cef-4a9e-a529-29497000dfda-maas-api-tls\") pod \"maas-api-e2e-derive-119d0999-64797f84d9-lgtxr\" (UID: \"c369eb5d-2cef-4a9e-a529-29497000dfda\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-119d0999-64797f84d9-lgtxr"
Sep 06 19:29:35.420217 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:29:35.420205    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-119d0999-serving-cert: secret "maas-api-e2e-derive-119d0999-serving-cert" not found
Sep 06 19:29:35.420326 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:29:35.420257    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c369eb5d-2cef-4a9e-a529-29497000dfda-maas-api-tls podName:c369eb5d-2cef-4a9e-a529-29497000dfda nodeName:}" failed. No retries permitted until 2026-09-06 19:29:35.920242873 +0000 UTC m=+1122.161128208 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c369eb5d-2cef-4a9e-a529-29497000dfda-maas-api-tls") pod "maas-api-e2e-derive-119d0999-64797f84d9-lgtxr" (UID: "c369eb5d-2cef-4a9e-a529-29497000dfda") : secret "maas-api-e2e-derive-119d0999-serving-cert" not found
Sep 06 19:29:35.420544 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:35.420526    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c369eb5d-2cef-4a9e-a529-29497000dfda-openshift-service-ca\") pod \"maas-api-e2e-derive-119d0999-64797f84d9-lgtxr\" (UID: \"c369eb5d-2cef-4a9e-a529-29497000dfda\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-119d0999-64797f84d9-lgtxr"
Sep 06 19:29:35.422483 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:35.422447    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c369eb5d-2cef-4a9e-a529-29497000dfda-metrics-certs\") pod \"maas-api-e2e-derive-119d0999-64797f84d9-lgtxr\" (UID: \"c369eb5d-2cef-4a9e-a529-29497000dfda\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-119d0999-64797f84d9-lgtxr"
Sep 06 19:29:35.428015 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:35.427992    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twlqf\" (UniqueName: \"kubernetes.io/projected/c369eb5d-2cef-4a9e-a529-29497000dfda-kube-api-access-twlqf\") pod \"maas-api-e2e-derive-119d0999-64797f84d9-lgtxr\" (UID: \"c369eb5d-2cef-4a9e-a529-29497000dfda\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-119d0999-64797f84d9-lgtxr"
Sep 06 19:29:35.762152 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:35.762123    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-119d0999-56bcdddd46-r6twk"]
Sep 06 19:29:35.765296 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:35.765279    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-119d0999-56bcdddd46-r6twk"
Sep 06 19:29:35.767259 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:35.767235    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-119d0999\""
Sep 06 19:29:35.775094 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:35.775071    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-119d0999-56bcdddd46-r6twk"]
Sep 06 19:29:35.804236 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:35.804210    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-119d0999-77cf556cd5-wvg9b"]
Sep 06 19:29:35.807355 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:35.807340    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-119d0999-77cf556cd5-wvg9b"
Sep 06 19:29:35.812069 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:35.812016    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-119d0999-dockercfg-xjqwt\""
Sep 06 19:29:35.818094 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:35.818075    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-119d0999-77cf556cd5-wvg9b"]
Sep 06 19:29:35.924843 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:35.924810    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/adff35c2-1086-4b1e-9238-00904a6ecc85-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-119d0999-56bcdddd46-r6twk\" (UID: \"adff35c2-1086-4b1e-9238-00904a6ecc85\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-119d0999-56bcdddd46-r6twk"
Sep 06 19:29:35.925014 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:35.924847    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d171643-a91d-48d9-a584-aa74f0590631-plugins-config-volume\") pod \"payload-processing-e2e-derive-119d0999-77cf556cd5-wvg9b\" (UID: \"4d171643-a91d-48d9-a584-aa74f0590631\") " pod="openshift-ingress/payload-processing-e2e-derive-119d0999-77cf556cd5-wvg9b"
Sep 06 19:29:35.925014 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:35.924877    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l5lp\" (UniqueName: \"kubernetes.io/projected/4d171643-a91d-48d9-a584-aa74f0590631-kube-api-access-8l5lp\") pod \"payload-processing-e2e-derive-119d0999-77cf556cd5-wvg9b\" (UID: \"4d171643-a91d-48d9-a584-aa74f0590631\") " pod="openshift-ingress/payload-processing-e2e-derive-119d0999-77cf556cd5-wvg9b"
Sep 06 19:29:35.925014 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:35.924903    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmfdc\" (UniqueName: \"kubernetes.io/projected/adff35c2-1086-4b1e-9238-00904a6ecc85-kube-api-access-nmfdc\") pod \"payload-pre-processing-e2e-derive-119d0999-56bcdddd46-r6twk\" (UID: \"adff35c2-1086-4b1e-9238-00904a6ecc85\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-119d0999-56bcdddd46-r6twk"
Sep 06 19:29:35.925190 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:35.925020    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c369eb5d-2cef-4a9e-a529-29497000dfda-maas-api-tls\") pod \"maas-api-e2e-derive-119d0999-64797f84d9-lgtxr\" (UID: \"c369eb5d-2cef-4a9e-a529-29497000dfda\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-119d0999-64797f84d9-lgtxr"
Sep 06 19:29:35.927647 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:35.927621    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c369eb5d-2cef-4a9e-a529-29497000dfda-maas-api-tls\") pod \"maas-api-e2e-derive-119d0999-64797f84d9-lgtxr\" (UID: \"c369eb5d-2cef-4a9e-a529-29497000dfda\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-119d0999-64797f84d9-lgtxr"
Sep 06 19:29:36.026457 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:36.026385    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/adff35c2-1086-4b1e-9238-00904a6ecc85-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-119d0999-56bcdddd46-r6twk\" (UID: \"adff35c2-1086-4b1e-9238-00904a6ecc85\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-119d0999-56bcdddd46-r6twk"
Sep 06 19:29:36.026457 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:36.026419    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d171643-a91d-48d9-a584-aa74f0590631-plugins-config-volume\") pod \"payload-processing-e2e-derive-119d0999-77cf556cd5-wvg9b\" (UID: \"4d171643-a91d-48d9-a584-aa74f0590631\") " pod="openshift-ingress/payload-processing-e2e-derive-119d0999-77cf556cd5-wvg9b"
Sep 06 19:29:36.026457 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:36.026437    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l5lp\" (UniqueName: \"kubernetes.io/projected/4d171643-a91d-48d9-a584-aa74f0590631-kube-api-access-8l5lp\") pod \"payload-processing-e2e-derive-119d0999-77cf556cd5-wvg9b\" (UID: \"4d171643-a91d-48d9-a584-aa74f0590631\") " pod="openshift-ingress/payload-processing-e2e-derive-119d0999-77cf556cd5-wvg9b"
Sep 06 19:29:36.026716 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:36.026556    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmfdc\" (UniqueName: \"kubernetes.io/projected/adff35c2-1086-4b1e-9238-00904a6ecc85-kube-api-access-nmfdc\") pod \"payload-pre-processing-e2e-derive-119d0999-56bcdddd46-r6twk\" (UID: \"adff35c2-1086-4b1e-9238-00904a6ecc85\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-119d0999-56bcdddd46-r6twk"
Sep 06 19:29:36.027079 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:36.027057    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d171643-a91d-48d9-a584-aa74f0590631-plugins-config-volume\") pod \"payload-processing-e2e-derive-119d0999-77cf556cd5-wvg9b\" (UID: \"4d171643-a91d-48d9-a584-aa74f0590631\") " pod="openshift-ingress/payload-processing-e2e-derive-119d0999-77cf556cd5-wvg9b"
Sep 06 19:29:36.027181 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:36.027163    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/adff35c2-1086-4b1e-9238-00904a6ecc85-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-119d0999-56bcdddd46-r6twk\" (UID: \"adff35c2-1086-4b1e-9238-00904a6ecc85\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-119d0999-56bcdddd46-r6twk"
Sep 06 19:29:36.033909 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:36.033888    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l5lp\" (UniqueName: \"kubernetes.io/projected/4d171643-a91d-48d9-a584-aa74f0590631-kube-api-access-8l5lp\") pod \"payload-processing-e2e-derive-119d0999-77cf556cd5-wvg9b\" (UID: \"4d171643-a91d-48d9-a584-aa74f0590631\") " pod="openshift-ingress/payload-processing-e2e-derive-119d0999-77cf556cd5-wvg9b"
Sep 06 19:29:36.033989 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:36.033895    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmfdc\" (UniqueName: \"kubernetes.io/projected/adff35c2-1086-4b1e-9238-00904a6ecc85-kube-api-access-nmfdc\") pod \"payload-pre-processing-e2e-derive-119d0999-56bcdddd46-r6twk\" (UID: \"adff35c2-1086-4b1e-9238-00904a6ecc85\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-119d0999-56bcdddd46-r6twk"
Sep 06 19:29:36.076416 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:36.076394    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-119d0999-56bcdddd46-r6twk"
Sep 06 19:29:36.080604 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:36.080260    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-119d0999-64797f84d9-lgtxr"
Sep 06 19:29:36.118424 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:36.118391    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-119d0999-77cf556cd5-wvg9b"
Sep 06 19:29:36.349058 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:36.349033    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-119d0999-56bcdddd46-r6twk"]
Sep 06 19:29:36.350883 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:29:36.350851    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadff35c2_1086_4b1e_9238_00904a6ecc85.slice/crio-506983f06be797fe84c36629ee43768930852f12fd207854ee5e40e35236f18e WatchSource:0}: Error finding container 506983f06be797fe84c36629ee43768930852f12fd207854ee5e40e35236f18e: Status 404 returned error can't find the container with id 506983f06be797fe84c36629ee43768930852f12fd207854ee5e40e35236f18e
Sep 06 19:29:36.359272 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:36.359238    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-119d0999-64797f84d9-lgtxr"]
Sep 06 19:29:36.362802 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:29:36.362779    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc369eb5d_2cef_4a9e_a529_29497000dfda.slice/crio-2b6d1966270be4ade868a10848f8c5d0240d604bae97586d5b8211fe0e53b1c5 WatchSource:0}: Error finding container 2b6d1966270be4ade868a10848f8c5d0240d604bae97586d5b8211fe0e53b1c5: Status 404 returned error can't find the container with id 2b6d1966270be4ade868a10848f8c5d0240d604bae97586d5b8211fe0e53b1c5
Sep 06 19:29:36.403632 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:36.403608    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-119d0999-77cf556cd5-wvg9b"]
Sep 06 19:29:36.405828 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:29:36.405787    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d171643_a91d_48d9_a584_aa74f0590631.slice/crio-8dac3cac0549791621b280d0d682e64cb899ef1329bff82942a5e8aaaf5d60d1 WatchSource:0}: Error finding container 8dac3cac0549791621b280d0d682e64cb899ef1329bff82942a5e8aaaf5d60d1: Status 404 returned error can't find the container with id 8dac3cac0549791621b280d0d682e64cb899ef1329bff82942a5e8aaaf5d60d1
Sep 06 19:29:36.879139 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:36.879106    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-119d0999-56bcdddd46-r6twk" event={"ID":"adff35c2-1086-4b1e-9238-00904a6ecc85","Type":"ContainerStarted","Data":"90856f2eb25102669015566289630e85da40d447da2d52633e0b22567bc6db48"}
Sep 06 19:29:36.879298 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:36.879152    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-119d0999-56bcdddd46-r6twk" event={"ID":"adff35c2-1086-4b1e-9238-00904a6ecc85","Type":"ContainerStarted","Data":"506983f06be797fe84c36629ee43768930852f12fd207854ee5e40e35236f18e"}
Sep 06 19:29:36.879298 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:36.879177    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-119d0999-56bcdddd46-r6twk"
Sep 06 19:29:36.880907 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:36.880872    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-119d0999-77cf556cd5-wvg9b" event={"ID":"4d171643-a91d-48d9-a584-aa74f0590631","Type":"ContainerStarted","Data":"efa8ccb91feeebf85f22b2a8220810446a79b283d448889a2d2634a75579bd28"}
Sep 06 19:29:36.881037 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:36.880930    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-119d0999-77cf556cd5-wvg9b" event={"ID":"4d171643-a91d-48d9-a584-aa74f0590631","Type":"ContainerStarted","Data":"8dac3cac0549791621b280d0d682e64cb899ef1329bff82942a5e8aaaf5d60d1"}
Sep 06 19:29:36.881037 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:36.880961    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-119d0999-77cf556cd5-wvg9b"
Sep 06 19:29:36.882530 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:36.882501    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-119d0999-64797f84d9-lgtxr" event={"ID":"c369eb5d-2cef-4a9e-a529-29497000dfda","Type":"ContainerStarted","Data":"7a628ebe84c4f02705a3bd099b6c420c3c6c939d7435e2ba33fa45bb8122e522"}
Sep 06 19:29:36.882626 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:36.882555    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-119d0999-64797f84d9-lgtxr" event={"ID":"c369eb5d-2cef-4a9e-a529-29497000dfda","Type":"ContainerStarted","Data":"2b6d1966270be4ade868a10848f8c5d0240d604bae97586d5b8211fe0e53b1c5"}
Sep 06 19:29:36.882626 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:36.882584    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-119d0999-64797f84d9-lgtxr"
Sep 06 19:29:36.893853 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:36.893805    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-119d0999-56bcdddd46-r6twk" podStartSLOduration=1.8937870509999999 podStartE2EDuration="1.893787051s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:29:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:29:36.892312514 +0000 UTC m=+1123.133197858" watchObservedRunningTime="2026-09-06 19:29:36.893787051 +0000 UTC m=+1123.134672397"
Sep 06 19:29:36.910294 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:36.910254    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-119d0999-64797f84d9-lgtxr" podStartSLOduration=1.579178646 podStartE2EDuration="1.910241837s" totalImagesPullingTime="331.063191ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:29:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:29:36.908062266 +0000 UTC m=+1123.148947635" watchObservedRunningTime="2026-09-06 19:29:36.910241837 +0000 UTC m=+1123.151127207"
Sep 06 19:29:36.923374 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:36.923330    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-119d0999-77cf556cd5-wvg9b" podStartSLOduration=1.92331769 podStartE2EDuration="1.92331769s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:29:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:29:36.921506868 +0000 UTC m=+1123.162392230" watchObservedRunningTime="2026-09-06 19:29:36.92331769 +0000 UTC m=+1123.164203072"
Sep 06 19:29:42.893071 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:42.893039    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-119d0999-64797f84d9-lgtxr"
Sep 06 19:29:47.890275 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:47.890236    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-119d0999-56bcdddd46-r6twk"
Sep 06 19:29:47.890659 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:29:47.890313    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-119d0999-77cf556cd5-wvg9b"
Sep 06 19:30:05.976182 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:05.976144    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-119d0999-64797f84d9-lgtxr"]
Sep 06 19:30:05.976652 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:05.976385    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-119d0999-64797f84d9-lgtxr" podUID="c369eb5d-2cef-4a9e-a529-29497000dfda" containerName="maas-api" containerID="cri-o://7a628ebe84c4f02705a3bd099b6c420c3c6c939d7435e2ba33fa45bb8122e522" gracePeriod=30
Sep 06 19:30:06.031161 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:06.031122    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-119d0999-77cf556cd5-wvg9b"]
Sep 06 19:30:06.031349 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:06.031310    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-119d0999-77cf556cd5-wvg9b" podUID="4d171643-a91d-48d9-a584-aa74f0590631" containerName="payload-processing" containerID="cri-o://efa8ccb91feeebf85f22b2a8220810446a79b283d448889a2d2634a75579bd28" gracePeriod=30
Sep 06 19:30:06.036436 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:06.036411    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-119d0999-56bcdddd46-r6twk"]
Sep 06 19:30:06.036824 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:06.036768    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-119d0999-56bcdddd46-r6twk" podUID="adff35c2-1086-4b1e-9238-00904a6ecc85" containerName="payload-pre-processing" containerID="cri-o://90856f2eb25102669015566289630e85da40d447da2d52633e0b22567bc6db48" gracePeriod=30
Sep 06 19:30:06.294450 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:06.294421    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-119d0999-64797f84d9-lgtxr"
Sep 06 19:30:06.329618 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:06.329590    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-119d0999-77cf556cd5-wvg9b"
Sep 06 19:30:06.359638 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:06.359609    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-119d0999-56bcdddd46-r6twk"
Sep 06 19:30:06.371283 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:06.371255    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twlqf\" (UniqueName: \"kubernetes.io/projected/c369eb5d-2cef-4a9e-a529-29497000dfda-kube-api-access-twlqf\") pod \"c369eb5d-2cef-4a9e-a529-29497000dfda\" (UID: \"c369eb5d-2cef-4a9e-a529-29497000dfda\") "
Sep 06 19:30:06.371422 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:06.371309    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d171643-a91d-48d9-a584-aa74f0590631-plugins-config-volume\") pod \"4d171643-a91d-48d9-a584-aa74f0590631\" (UID: \"4d171643-a91d-48d9-a584-aa74f0590631\") "
Sep 06 19:30:06.371508 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:06.371440    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c369eb5d-2cef-4a9e-a529-29497000dfda-metrics-certs\") pod \"c369eb5d-2cef-4a9e-a529-29497000dfda\" (UID: \"c369eb5d-2cef-4a9e-a529-29497000dfda\") "
Sep 06 19:30:06.371569 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:06.371537    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c369eb5d-2cef-4a9e-a529-29497000dfda-openshift-service-ca\") pod \"c369eb5d-2cef-4a9e-a529-29497000dfda\" (UID: \"c369eb5d-2cef-4a9e-a529-29497000dfda\") "
Sep 06 19:30:06.371622 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:06.371574    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8l5lp\" (UniqueName: \"kubernetes.io/projected/4d171643-a91d-48d9-a584-aa74f0590631-kube-api-access-8l5lp\") pod \"4d171643-a91d-48d9-a584-aa74f0590631\" (UID: \"4d171643-a91d-48d9-a584-aa74f0590631\") "
Sep 06 19:30:06.371622 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:06.371593    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d171643-a91d-48d9-a584-aa74f0590631-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4d171643-a91d-48d9-a584-aa74f0590631" (UID: "4d171643-a91d-48d9-a584-aa74f0590631"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:30:06.371622 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:06.371611    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c369eb5d-2cef-4a9e-a529-29497000dfda-maas-api-tls\") pod \"c369eb5d-2cef-4a9e-a529-29497000dfda\" (UID: \"c369eb5d-2cef-4a9e-a529-29497000dfda\") "
Sep 06 19:30:06.371924 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:06.371867    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d171643-a91d-48d9-a584-aa74f0590631-plugins-config-volume\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:30:06.371924 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:06.371869    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c369eb5d-2cef-4a9e-a529-29497000dfda-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c369eb5d-2cef-4a9e-a529-29497000dfda" (UID: "c369eb5d-2cef-4a9e-a529-29497000dfda"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:30:06.373747 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:06.373721    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c369eb5d-2cef-4a9e-a529-29497000dfda-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c369eb5d-2cef-4a9e-a529-29497000dfda" (UID: "c369eb5d-2cef-4a9e-a529-29497000dfda"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:30:06.373747 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:06.373740    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c369eb5d-2cef-4a9e-a529-29497000dfda-kube-api-access-twlqf" (OuterVolumeSpecName: "kube-api-access-twlqf") pod "c369eb5d-2cef-4a9e-a529-29497000dfda" (UID: "c369eb5d-2cef-4a9e-a529-29497000dfda"). InnerVolumeSpecName "kube-api-access-twlqf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:30:06.373881 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:06.373803    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d171643-a91d-48d9-a584-aa74f0590631-kube-api-access-8l5lp" (OuterVolumeSpecName: "kube-api-access-8l5lp") pod "4d171643-a91d-48d9-a584-aa74f0590631" (UID: "4d171643-a91d-48d9-a584-aa74f0590631"). InnerVolumeSpecName "kube-api-access-8l5lp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:30:06.374026 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:06.374008    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c369eb5d-2cef-4a9e-a529-29497000dfda-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c369eb5d-2cef-4a9e-a529-29497000dfda" (UID: "c369eb5d-2cef-4a9e-a529-29497000dfda"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:30:06.472735 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:06.472708    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmfdc\" (UniqueName: \"kubernetes.io/projected/adff35c2-1086-4b1e-9238-00904a6ecc85-kube-api-access-nmfdc\") pod \"adff35c2-1086-4b1e-9238-00904a6ecc85\" (UID: \"adff35c2-1086-4b1e-9238-00904a6ecc85\") "
Sep 06 19:30:06.472936 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:06.472809    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/adff35c2-1086-4b1e-9238-00904a6ecc85-plugins-config-volume\") pod \"adff35c2-1086-4b1e-9238-00904a6ecc85\" (UID: \"adff35c2-1086-4b1e-9238-00904a6ecc85\") "
Sep 06 19:30:06.473244 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:06.473215    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adff35c2-1086-4b1e-9238-00904a6ecc85-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "adff35c2-1086-4b1e-9238-00904a6ecc85" (UID: "adff35c2-1086-4b1e-9238-00904a6ecc85"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:30:06.473433 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:06.473410    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c369eb5d-2cef-4a9e-a529-29497000dfda-openshift-service-ca\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:30:06.473565 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:06.473435    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8l5lp\" (UniqueName: \"kubernetes.io/projected/4d171643-a91d-48d9-a584-aa74f0590631-kube-api-access-8l5lp\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:30:06.473565 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:06.473449    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c369eb5d-2cef-4a9e-a529-29497000dfda-maas-api-tls\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:30:06.473565 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:06.473463    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twlqf\" (UniqueName: \"kubernetes.io/projected/c369eb5d-2cef-4a9e-a529-29497000dfda-kube-api-access-twlqf\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:30:06.473565 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:06.473506    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c369eb5d-2cef-4a9e-a529-29497000dfda-metrics-certs\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:30:06.474970 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:06.474948    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adff35c2-1086-4b1e-9238-00904a6ecc85-kube-api-access-nmfdc" (OuterVolumeSpecName: "kube-api-access-nmfdc") pod "adff35c2-1086-4b1e-9238-00904a6ecc85" (UID: "adff35c2-1086-4b1e-9238-00904a6ecc85"). InnerVolumeSpecName "kube-api-access-nmfdc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:30:06.574465 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:06.574393    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/adff35c2-1086-4b1e-9238-00904a6ecc85-plugins-config-volume\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:30:06.574465 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:06.574417    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmfdc\" (UniqueName: \"kubernetes.io/projected/adff35c2-1086-4b1e-9238-00904a6ecc85-kube-api-access-nmfdc\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:30:07.028052 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:07.028018    2577 generic.go:356] "Generic (PLEG): container finished" podID="adff35c2-1086-4b1e-9238-00904a6ecc85" containerID="90856f2eb25102669015566289630e85da40d447da2d52633e0b22567bc6db48" exitCode=0
Sep 06 19:30:07.028436 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:07.028074    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-119d0999-56bcdddd46-r6twk"
Sep 06 19:30:07.028436 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:07.028089    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-119d0999-56bcdddd46-r6twk" event={"ID":"adff35c2-1086-4b1e-9238-00904a6ecc85","Type":"ContainerDied","Data":"90856f2eb25102669015566289630e85da40d447da2d52633e0b22567bc6db48"}
Sep 06 19:30:07.028436 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:07.028172    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-119d0999-56bcdddd46-r6twk" event={"ID":"adff35c2-1086-4b1e-9238-00904a6ecc85","Type":"ContainerDied","Data":"506983f06be797fe84c36629ee43768930852f12fd207854ee5e40e35236f18e"}
Sep 06 19:30:07.028436 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:07.028200    2577 scope.go:117] "RemoveContainer" containerID="90856f2eb25102669015566289630e85da40d447da2d52633e0b22567bc6db48"
Sep 06 19:30:07.029522 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:07.029462    2577 generic.go:356] "Generic (PLEG): container finished" podID="4d171643-a91d-48d9-a584-aa74f0590631" containerID="efa8ccb91feeebf85f22b2a8220810446a79b283d448889a2d2634a75579bd28" exitCode=0
Sep 06 19:30:07.029586 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:07.029547    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-119d0999-77cf556cd5-wvg9b" event={"ID":"4d171643-a91d-48d9-a584-aa74f0590631","Type":"ContainerDied","Data":"efa8ccb91feeebf85f22b2a8220810446a79b283d448889a2d2634a75579bd28"}
Sep 06 19:30:07.029633 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:07.029585    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-119d0999-77cf556cd5-wvg9b" event={"ID":"4d171643-a91d-48d9-a584-aa74f0590631","Type":"ContainerDied","Data":"8dac3cac0549791621b280d0d682e64cb899ef1329bff82942a5e8aaaf5d60d1"}
Sep 06 19:30:07.029633 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:07.029551    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-119d0999-77cf556cd5-wvg9b"
Sep 06 19:30:07.031210 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:07.031186    2577 generic.go:356] "Generic (PLEG): container finished" podID="c369eb5d-2cef-4a9e-a529-29497000dfda" containerID="7a628ebe84c4f02705a3bd099b6c420c3c6c939d7435e2ba33fa45bb8122e522" exitCode=0
Sep 06 19:30:07.031331 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:07.031252    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-119d0999-64797f84d9-lgtxr"
Sep 06 19:30:07.031331 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:07.031249    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-119d0999-64797f84d9-lgtxr" event={"ID":"c369eb5d-2cef-4a9e-a529-29497000dfda","Type":"ContainerDied","Data":"7a628ebe84c4f02705a3bd099b6c420c3c6c939d7435e2ba33fa45bb8122e522"}
Sep 06 19:30:07.031331 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:07.031296    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-119d0999-64797f84d9-lgtxr" event={"ID":"c369eb5d-2cef-4a9e-a529-29497000dfda","Type":"ContainerDied","Data":"2b6d1966270be4ade868a10848f8c5d0240d604bae97586d5b8211fe0e53b1c5"}
Sep 06 19:30:07.038109 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:07.038092    2577 scope.go:117] "RemoveContainer" containerID="90856f2eb25102669015566289630e85da40d447da2d52633e0b22567bc6db48"
Sep 06 19:30:07.038355 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:30:07.038338    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90856f2eb25102669015566289630e85da40d447da2d52633e0b22567bc6db48\": container with ID starting with 90856f2eb25102669015566289630e85da40d447da2d52633e0b22567bc6db48 not found: ID does not exist" containerID="90856f2eb25102669015566289630e85da40d447da2d52633e0b22567bc6db48"
Sep 06 19:30:07.038402 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:07.038363    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90856f2eb25102669015566289630e85da40d447da2d52633e0b22567bc6db48"} err="failed to get container status \"90856f2eb25102669015566289630e85da40d447da2d52633e0b22567bc6db48\": rpc error: code = NotFound desc = could not find container \"90856f2eb25102669015566289630e85da40d447da2d52633e0b22567bc6db48\": container with ID starting with 90856f2eb25102669015566289630e85da40d447da2d52633e0b22567bc6db48 not found: ID does not exist"
Sep 06 19:30:07.038402 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:07.038378    2577 scope.go:117] "RemoveContainer" containerID="efa8ccb91feeebf85f22b2a8220810446a79b283d448889a2d2634a75579bd28"
Sep 06 19:30:07.046035 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:07.046015    2577 scope.go:117] "RemoveContainer" containerID="efa8ccb91feeebf85f22b2a8220810446a79b283d448889a2d2634a75579bd28"
Sep 06 19:30:07.046326 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:30:07.046304    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efa8ccb91feeebf85f22b2a8220810446a79b283d448889a2d2634a75579bd28\": container with ID starting with efa8ccb91feeebf85f22b2a8220810446a79b283d448889a2d2634a75579bd28 not found: ID does not exist" containerID="efa8ccb91feeebf85f22b2a8220810446a79b283d448889a2d2634a75579bd28"
Sep 06 19:30:07.046394 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:07.046331    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efa8ccb91feeebf85f22b2a8220810446a79b283d448889a2d2634a75579bd28"} err="failed to get container status \"efa8ccb91feeebf85f22b2a8220810446a79b283d448889a2d2634a75579bd28\": rpc error: code = NotFound desc = could not find container \"efa8ccb91feeebf85f22b2a8220810446a79b283d448889a2d2634a75579bd28\": container with ID starting with efa8ccb91feeebf85f22b2a8220810446a79b283d448889a2d2634a75579bd28 not found: ID does not exist"
Sep 06 19:30:07.046394 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:07.046346    2577 scope.go:117] "RemoveContainer" containerID="7a628ebe84c4f02705a3bd099b6c420c3c6c939d7435e2ba33fa45bb8122e522"
Sep 06 19:30:07.051101 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:07.051081    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-119d0999-64797f84d9-lgtxr"]
Sep 06 19:30:07.054329 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:07.054314    2577 scope.go:117] "RemoveContainer" containerID="7a628ebe84c4f02705a3bd099b6c420c3c6c939d7435e2ba33fa45bb8122e522"
Sep 06 19:30:07.054621 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:30:07.054599    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a628ebe84c4f02705a3bd099b6c420c3c6c939d7435e2ba33fa45bb8122e522\": container with ID starting with 7a628ebe84c4f02705a3bd099b6c420c3c6c939d7435e2ba33fa45bb8122e522 not found: ID does not exist" containerID="7a628ebe84c4f02705a3bd099b6c420c3c6c939d7435e2ba33fa45bb8122e522"
Sep 06 19:30:07.054719 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:07.054624    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a628ebe84c4f02705a3bd099b6c420c3c6c939d7435e2ba33fa45bb8122e522"} err="failed to get container status \"7a628ebe84c4f02705a3bd099b6c420c3c6c939d7435e2ba33fa45bb8122e522\": rpc error: code = NotFound desc = could not find container \"7a628ebe84c4f02705a3bd099b6c420c3c6c939d7435e2ba33fa45bb8122e522\": container with ID starting with 7a628ebe84c4f02705a3bd099b6c420c3c6c939d7435e2ba33fa45bb8122e522 not found: ID does not exist"
Sep 06 19:30:07.057805 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:07.057786    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-119d0999-64797f84d9-lgtxr"]
Sep 06 19:30:07.069453 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:07.069431    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-119d0999-77cf556cd5-wvg9b"]
Sep 06 19:30:07.073298 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:07.073279    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-119d0999-77cf556cd5-wvg9b"]
Sep 06 19:30:07.082884 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:07.082865    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-119d0999-56bcdddd46-r6twk"]
Sep 06 19:30:07.094345 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:07.094323    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-119d0999-56bcdddd46-r6twk"]
Sep 06 19:30:08.387891 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:08.387861    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d171643-a91d-48d9-a584-aa74f0590631" path="/var/lib/kubelet/pods/4d171643-a91d-48d9-a584-aa74f0590631/volumes"
Sep 06 19:30:08.388211 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:08.388194    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adff35c2-1086-4b1e-9238-00904a6ecc85" path="/var/lib/kubelet/pods/adff35c2-1086-4b1e-9238-00904a6ecc85/volumes"
Sep 06 19:30:08.388539 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:08.388525    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c369eb5d-2cef-4a9e-a529-29497000dfda" path="/var/lib/kubelet/pods/c369eb5d-2cef-4a9e-a529-29497000dfda/volumes"
Sep 06 19:30:41.189927 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:41.189894    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-21b01e-59c9c8777d-xl52s"]
Sep 06 19:30:41.190445 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:41.190074    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-21b01e-59c9c8777d-xl52s" podUID="41a781a5-f26b-4e5d-a812-26fcd3bde055" containerName="maas-api" containerID="cri-o://cd96c9f8e4763f5bd3d55cdf354fa4674a28d3b28b9c767c37599819e806aac1" gracePeriod=30
Sep 06 19:30:41.453178 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:41.453114    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-21b01e-59c9c8777d-xl52s"
Sep 06 19:30:41.463974 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:41.463948    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41a781a5-f26b-4e5d-a812-26fcd3bde055-maas-api-tls\") pod \"41a781a5-f26b-4e5d-a812-26fcd3bde055\" (UID: \"41a781a5-f26b-4e5d-a812-26fcd3bde055\") "
Sep 06 19:30:41.464084 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:41.464010    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41a781a5-f26b-4e5d-a812-26fcd3bde055-metrics-certs\") pod \"41a781a5-f26b-4e5d-a812-26fcd3bde055\" (UID: \"41a781a5-f26b-4e5d-a812-26fcd3bde055\") "
Sep 06 19:30:41.464084 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:41.464077    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2lm92\" (UniqueName: \"kubernetes.io/projected/41a781a5-f26b-4e5d-a812-26fcd3bde055-kube-api-access-2lm92\") pod \"41a781a5-f26b-4e5d-a812-26fcd3bde055\" (UID: \"41a781a5-f26b-4e5d-a812-26fcd3bde055\") "
Sep 06 19:30:41.464194 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:41.464133    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41a781a5-f26b-4e5d-a812-26fcd3bde055-openshift-service-ca\") pod \"41a781a5-f26b-4e5d-a812-26fcd3bde055\" (UID: \"41a781a5-f26b-4e5d-a812-26fcd3bde055\") "
Sep 06 19:30:41.464530 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:41.464497    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41a781a5-f26b-4e5d-a812-26fcd3bde055-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "41a781a5-f26b-4e5d-a812-26fcd3bde055" (UID: "41a781a5-f26b-4e5d-a812-26fcd3bde055"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:30:41.465920 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:41.465896    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41a781a5-f26b-4e5d-a812-26fcd3bde055-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "41a781a5-f26b-4e5d-a812-26fcd3bde055" (UID: "41a781a5-f26b-4e5d-a812-26fcd3bde055"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:30:41.466004 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:41.465978    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41a781a5-f26b-4e5d-a812-26fcd3bde055-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "41a781a5-f26b-4e5d-a812-26fcd3bde055" (UID: "41a781a5-f26b-4e5d-a812-26fcd3bde055"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:30:41.466088 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:41.466066    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41a781a5-f26b-4e5d-a812-26fcd3bde055-kube-api-access-2lm92" (OuterVolumeSpecName: "kube-api-access-2lm92") pod "41a781a5-f26b-4e5d-a812-26fcd3bde055" (UID: "41a781a5-f26b-4e5d-a812-26fcd3bde055"). InnerVolumeSpecName "kube-api-access-2lm92". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:30:41.565296 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:41.565266    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2lm92\" (UniqueName: \"kubernetes.io/projected/41a781a5-f26b-4e5d-a812-26fcd3bde055-kube-api-access-2lm92\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:30:41.565296 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:41.565295    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41a781a5-f26b-4e5d-a812-26fcd3bde055-openshift-service-ca\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:30:41.565446 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:41.565305    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41a781a5-f26b-4e5d-a812-26fcd3bde055-maas-api-tls\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:30:41.565446 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:41.565313    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41a781a5-f26b-4e5d-a812-26fcd3bde055-metrics-certs\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:30:42.194088 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:42.194047    2577 generic.go:356] "Generic (PLEG): container finished" podID="41a781a5-f26b-4e5d-a812-26fcd3bde055" containerID="cd96c9f8e4763f5bd3d55cdf354fa4674a28d3b28b9c767c37599819e806aac1" exitCode=0
Sep 06 19:30:42.194088 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:42.194092    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-21b01e-59c9c8777d-xl52s"
Sep 06 19:30:42.194589 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:42.194131    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-21b01e-59c9c8777d-xl52s" event={"ID":"41a781a5-f26b-4e5d-a812-26fcd3bde055","Type":"ContainerDied","Data":"cd96c9f8e4763f5bd3d55cdf354fa4674a28d3b28b9c767c37599819e806aac1"}
Sep 06 19:30:42.194589 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:42.194193    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-21b01e-59c9c8777d-xl52s" event={"ID":"41a781a5-f26b-4e5d-a812-26fcd3bde055","Type":"ContainerDied","Data":"edb165d5af86fd3049c375b2111897858e22a304ef91a6001fc6404e082948b0"}
Sep 06 19:30:42.194589 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:42.194213    2577 scope.go:117] "RemoveContainer" containerID="cd96c9f8e4763f5bd3d55cdf354fa4674a28d3b28b9c767c37599819e806aac1"
Sep 06 19:30:42.204339 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:42.204323    2577 scope.go:117] "RemoveContainer" containerID="cd96c9f8e4763f5bd3d55cdf354fa4674a28d3b28b9c767c37599819e806aac1"
Sep 06 19:30:42.204632 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:30:42.204614    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd96c9f8e4763f5bd3d55cdf354fa4674a28d3b28b9c767c37599819e806aac1\": container with ID starting with cd96c9f8e4763f5bd3d55cdf354fa4674a28d3b28b9c767c37599819e806aac1 not found: ID does not exist" containerID="cd96c9f8e4763f5bd3d55cdf354fa4674a28d3b28b9c767c37599819e806aac1"
Sep 06 19:30:42.204685 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:42.204640    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd96c9f8e4763f5bd3d55cdf354fa4674a28d3b28b9c767c37599819e806aac1"} err="failed to get container status \"cd96c9f8e4763f5bd3d55cdf354fa4674a28d3b28b9c767c37599819e806aac1\": rpc error: code = NotFound desc = could not find container \"cd96c9f8e4763f5bd3d55cdf354fa4674a28d3b28b9c767c37599819e806aac1\": container with ID starting with cd96c9f8e4763f5bd3d55cdf354fa4674a28d3b28b9c767c37599819e806aac1 not found: ID does not exist"
Sep 06 19:30:42.215251 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:42.215228    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-21b01e-59c9c8777d-xl52s"]
Sep 06 19:30:42.218308 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:42.218287    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-21b01e-59c9c8777d-xl52s"]
Sep 06 19:30:42.387542 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:42.387510    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41a781a5-f26b-4e5d-a812-26fcd3bde055" path="/var/lib/kubelet/pods/41a781a5-f26b-4e5d-a812-26fcd3bde055/volumes"
Sep 06 19:30:53.258018 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:53.257979    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-c6813a-69799c6766-7v9cz"]
Sep 06 19:30:53.258599 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:53.258517    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c369eb5d-2cef-4a9e-a529-29497000dfda" containerName="maas-api"
Sep 06 19:30:53.258599 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:53.258536    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c369eb5d-2cef-4a9e-a529-29497000dfda" containerName="maas-api"
Sep 06 19:30:53.258599 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:53.258561    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d171643-a91d-48d9-a584-aa74f0590631" containerName="payload-processing"
Sep 06 19:30:53.258599 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:53.258570    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d171643-a91d-48d9-a584-aa74f0590631" containerName="payload-processing"
Sep 06 19:30:53.258599 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:53.258588    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adff35c2-1086-4b1e-9238-00904a6ecc85" containerName="payload-pre-processing"
Sep 06 19:30:53.258599 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:53.258598    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="adff35c2-1086-4b1e-9238-00904a6ecc85" containerName="payload-pre-processing"
Sep 06 19:30:53.258922 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:53.258612    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41a781a5-f26b-4e5d-a812-26fcd3bde055" containerName="maas-api"
Sep 06 19:30:53.258922 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:53.258620    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="41a781a5-f26b-4e5d-a812-26fcd3bde055" containerName="maas-api"
Sep 06 19:30:53.258922 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:53.258707    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="adff35c2-1086-4b1e-9238-00904a6ecc85" containerName="payload-pre-processing"
Sep 06 19:30:53.258922 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:53.258720    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d171643-a91d-48d9-a584-aa74f0590631" containerName="payload-processing"
Sep 06 19:30:53.258922 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:53.258729    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="41a781a5-f26b-4e5d-a812-26fcd3bde055" containerName="maas-api"
Sep 06 19:30:53.258922 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:53.258740    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c369eb5d-2cef-4a9e-a529-29497000dfda" containerName="maas-api"
Sep 06 19:30:53.262433 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:53.262412    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c6813a-69799c6766-7v9cz"
Sep 06 19:30:53.264380 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:53.264358    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-c6813a-serving-cert\""
Sep 06 19:30:53.270955 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:53.270935    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-c6813a-69799c6766-7v9cz"]
Sep 06 19:30:53.362826 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:53.362796    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72dc6840-8ad9-4673-a406-ec1867bdee59-metrics-certs\") pod \"maas-api-e2e-explicit-c6813a-69799c6766-7v9cz\" (UID: \"72dc6840-8ad9-4673-a406-ec1867bdee59\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c6813a-69799c6766-7v9cz"
Sep 06 19:30:53.362992 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:53.362847    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmkgx\" (UniqueName: \"kubernetes.io/projected/72dc6840-8ad9-4673-a406-ec1867bdee59-kube-api-access-lmkgx\") pod \"maas-api-e2e-explicit-c6813a-69799c6766-7v9cz\" (UID: \"72dc6840-8ad9-4673-a406-ec1867bdee59\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c6813a-69799c6766-7v9cz"
Sep 06 19:30:53.362992 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:53.362936    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72dc6840-8ad9-4673-a406-ec1867bdee59-openshift-service-ca\") pod \"maas-api-e2e-explicit-c6813a-69799c6766-7v9cz\" (UID: \"72dc6840-8ad9-4673-a406-ec1867bdee59\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c6813a-69799c6766-7v9cz"
Sep 06 19:30:53.362992 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:53.362964    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72dc6840-8ad9-4673-a406-ec1867bdee59-maas-api-tls\") pod \"maas-api-e2e-explicit-c6813a-69799c6766-7v9cz\" (UID: \"72dc6840-8ad9-4673-a406-ec1867bdee59\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c6813a-69799c6766-7v9cz"
Sep 06 19:30:53.464164 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:53.464132    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72dc6840-8ad9-4673-a406-ec1867bdee59-metrics-certs\") pod \"maas-api-e2e-explicit-c6813a-69799c6766-7v9cz\" (UID: \"72dc6840-8ad9-4673-a406-ec1867bdee59\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c6813a-69799c6766-7v9cz"
Sep 06 19:30:53.464339 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:53.464190    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmkgx\" (UniqueName: \"kubernetes.io/projected/72dc6840-8ad9-4673-a406-ec1867bdee59-kube-api-access-lmkgx\") pod \"maas-api-e2e-explicit-c6813a-69799c6766-7v9cz\" (UID: \"72dc6840-8ad9-4673-a406-ec1867bdee59\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c6813a-69799c6766-7v9cz"
Sep 06 19:30:53.464339 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:53.464238    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72dc6840-8ad9-4673-a406-ec1867bdee59-openshift-service-ca\") pod \"maas-api-e2e-explicit-c6813a-69799c6766-7v9cz\" (UID: \"72dc6840-8ad9-4673-a406-ec1867bdee59\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c6813a-69799c6766-7v9cz"
Sep 06 19:30:53.464339 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:53.464278    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72dc6840-8ad9-4673-a406-ec1867bdee59-maas-api-tls\") pod \"maas-api-e2e-explicit-c6813a-69799c6766-7v9cz\" (UID: \"72dc6840-8ad9-4673-a406-ec1867bdee59\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c6813a-69799c6766-7v9cz"
Sep 06 19:30:53.464896 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:53.464875    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72dc6840-8ad9-4673-a406-ec1867bdee59-openshift-service-ca\") pod \"maas-api-e2e-explicit-c6813a-69799c6766-7v9cz\" (UID: \"72dc6840-8ad9-4673-a406-ec1867bdee59\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c6813a-69799c6766-7v9cz"
Sep 06 19:30:53.466517 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:53.466489    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72dc6840-8ad9-4673-a406-ec1867bdee59-metrics-certs\") pod \"maas-api-e2e-explicit-c6813a-69799c6766-7v9cz\" (UID: \"72dc6840-8ad9-4673-a406-ec1867bdee59\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c6813a-69799c6766-7v9cz"
Sep 06 19:30:53.466642 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:53.466621    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72dc6840-8ad9-4673-a406-ec1867bdee59-maas-api-tls\") pod \"maas-api-e2e-explicit-c6813a-69799c6766-7v9cz\" (UID: \"72dc6840-8ad9-4673-a406-ec1867bdee59\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c6813a-69799c6766-7v9cz"
Sep 06 19:30:53.471514 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:53.471463    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmkgx\" (UniqueName: \"kubernetes.io/projected/72dc6840-8ad9-4673-a406-ec1867bdee59-kube-api-access-lmkgx\") pod \"maas-api-e2e-explicit-c6813a-69799c6766-7v9cz\" (UID: \"72dc6840-8ad9-4673-a406-ec1867bdee59\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c6813a-69799c6766-7v9cz"
Sep 06 19:30:53.575130 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:53.575062    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c6813a-69799c6766-7v9cz"
Sep 06 19:30:53.846290 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:53.846263    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-c6813a-69799c6766-7v9cz"]
Sep 06 19:30:53.848736 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:30:53.848710    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72dc6840_8ad9_4673_a406_ec1867bdee59.slice/crio-2666ce1bfa9c76cc64df86e3f8840955b46de63eeed076f25a24a9d2f2a42282 WatchSource:0}: Error finding container 2666ce1bfa9c76cc64df86e3f8840955b46de63eeed076f25a24a9d2f2a42282: Status 404 returned error can't find the container with id 2666ce1bfa9c76cc64df86e3f8840955b46de63eeed076f25a24a9d2f2a42282
Sep 06 19:30:53.889282 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:53.889253    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c6813a-86cfd96f45-md4l6"]
Sep 06 19:30:53.893580 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:53.893553    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-c6813a-86cfd96f45-md4l6"
Sep 06 19:30:53.895620 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:53.895594    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-c6813a\""
Sep 06 19:30:53.895725 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:53.895599    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-c6813a-dockercfg-m79dk\""
Sep 06 19:30:53.903196 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:53.903171    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c6813a-86cfd96f45-md4l6"]
Sep 06 19:30:53.968789 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:53.968749    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24779156-e26d-447f-bfd1-a219d134a5bb-plugins-config-volume\") pod \"payload-processing-e2e-explicit-c6813a-86cfd96f45-md4l6\" (UID: \"24779156-e26d-447f-bfd1-a219d134a5bb\") " pod="openshift-ingress/payload-processing-e2e-explicit-c6813a-86cfd96f45-md4l6"
Sep 06 19:30:53.968988 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:53.968806    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srgtf\" (UniqueName: \"kubernetes.io/projected/24779156-e26d-447f-bfd1-a219d134a5bb-kube-api-access-srgtf\") pod \"payload-processing-e2e-explicit-c6813a-86cfd96f45-md4l6\" (UID: \"24779156-e26d-447f-bfd1-a219d134a5bb\") " pod="openshift-ingress/payload-processing-e2e-explicit-c6813a-86cfd96f45-md4l6"
Sep 06 19:30:54.069682 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:54.069645    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24779156-e26d-447f-bfd1-a219d134a5bb-plugins-config-volume\") pod \"payload-processing-e2e-explicit-c6813a-86cfd96f45-md4l6\" (UID: \"24779156-e26d-447f-bfd1-a219d134a5bb\") " pod="openshift-ingress/payload-processing-e2e-explicit-c6813a-86cfd96f45-md4l6"
Sep 06 19:30:54.069682 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:54.069685    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srgtf\" (UniqueName: \"kubernetes.io/projected/24779156-e26d-447f-bfd1-a219d134a5bb-kube-api-access-srgtf\") pod \"payload-processing-e2e-explicit-c6813a-86cfd96f45-md4l6\" (UID: \"24779156-e26d-447f-bfd1-a219d134a5bb\") " pod="openshift-ingress/payload-processing-e2e-explicit-c6813a-86cfd96f45-md4l6"
Sep 06 19:30:54.070344 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:54.070325    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24779156-e26d-447f-bfd1-a219d134a5bb-plugins-config-volume\") pod \"payload-processing-e2e-explicit-c6813a-86cfd96f45-md4l6\" (UID: \"24779156-e26d-447f-bfd1-a219d134a5bb\") " pod="openshift-ingress/payload-processing-e2e-explicit-c6813a-86cfd96f45-md4l6"
Sep 06 19:30:54.076573 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:54.076550    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srgtf\" (UniqueName: \"kubernetes.io/projected/24779156-e26d-447f-bfd1-a219d134a5bb-kube-api-access-srgtf\") pod \"payload-processing-e2e-explicit-c6813a-86cfd96f45-md4l6\" (UID: \"24779156-e26d-447f-bfd1-a219d134a5bb\") " pod="openshift-ingress/payload-processing-e2e-explicit-c6813a-86cfd96f45-md4l6"
Sep 06 19:30:54.207116 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:54.207095    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-c6813a-dockercfg-m79dk\""
Sep 06 19:30:54.215955 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:54.215934    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-c6813a-86cfd96f45-md4l6"
Sep 06 19:30:54.257270 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:54.257235    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c6813a-69799c6766-7v9cz" event={"ID":"72dc6840-8ad9-4673-a406-ec1867bdee59","Type":"ContainerStarted","Data":"da9b2ff1e804b217ff284cfdaf18728297efe382612b8856669346d1afe2bc2c"}
Sep 06 19:30:54.257443 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:54.257296    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c6813a-69799c6766-7v9cz" event={"ID":"72dc6840-8ad9-4673-a406-ec1867bdee59","Type":"ContainerStarted","Data":"2666ce1bfa9c76cc64df86e3f8840955b46de63eeed076f25a24a9d2f2a42282"}
Sep 06 19:30:54.257443 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:54.257326    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c6813a-69799c6766-7v9cz"
Sep 06 19:30:54.273639 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:54.273586    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c6813a-69799c6766-7v9cz" podStartSLOduration=0.974526853 podStartE2EDuration="1.27356522s" totalImagesPullingTime="299.038367ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:30:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:30:54.271510909 +0000 UTC m=+1200.512396277" watchObservedRunningTime="2026-09-06 19:30:54.27356522 +0000 UTC m=+1200.514450567"
Sep 06 19:30:54.489909 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:54.489885    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c6813a-86cfd96f45-md4l6"]
Sep 06 19:30:55.263603 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:55.263561    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-c6813a-86cfd96f45-md4l6" event={"ID":"24779156-e26d-447f-bfd1-a219d134a5bb","Type":"ContainerStarted","Data":"45a269594d46aa2c3ce542807eb06b767599334ebb8c63e8f49ea85068266d35"}
Sep 06 19:30:55.263801 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:55.263649    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-c6813a-86cfd96f45-md4l6" event={"ID":"24779156-e26d-447f-bfd1-a219d134a5bb","Type":"ContainerStarted","Data":"e2d6e4b310c050c810e295faece33ba44cce5c70a1a17ae14941701dd8dc042d"}
Sep 06 19:30:55.263878 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:55.263823    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-c6813a-86cfd96f45-md4l6"
Sep 06 19:30:55.280622 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:30:55.280563    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-c6813a-86cfd96f45-md4l6" podStartSLOduration=2.280546047 podStartE2EDuration="2.280546047s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:30:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:30:55.278403491 +0000 UTC m=+1201.519288869" watchObservedRunningTime="2026-09-06 19:30:55.280546047 +0000 UTC m=+1201.521431393"
Sep 06 19:31:00.269503 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:31:00.269452    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c6813a-69799c6766-7v9cz"
Sep 06 19:31:06.271397 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:31:06.271366    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-c6813a-86cfd96f45-md4l6"
Sep 06 19:31:44.473135 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:31:44.473093    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-032bc360-859d64d986-btklq"]
Sep 06 19:31:44.477294 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:31:44.477272    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-032bc360-859d64d986-btklq"
Sep 06 19:31:44.479589 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:31:44.479570    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-032bc360-serving-cert\""
Sep 06 19:31:44.486680 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:31:44.486239    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-032bc360-859d64d986-btklq"]
Sep 06 19:31:44.495460 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:31:44.495431    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b02b7574-105f-4dba-917d-7f8dee42285d-metrics-certs\") pod \"maas-api-e2e-mt-032bc360-859d64d986-btklq\" (UID: \"b02b7574-105f-4dba-917d-7f8dee42285d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-032bc360-859d64d986-btklq"
Sep 06 19:31:44.495635 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:31:44.495511    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgvjm\" (UniqueName: \"kubernetes.io/projected/b02b7574-105f-4dba-917d-7f8dee42285d-kube-api-access-xgvjm\") pod \"maas-api-e2e-mt-032bc360-859d64d986-btklq\" (UID: \"b02b7574-105f-4dba-917d-7f8dee42285d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-032bc360-859d64d986-btklq"
Sep 06 19:31:44.495635 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:31:44.495610    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b02b7574-105f-4dba-917d-7f8dee42285d-maas-api-tls\") pod \"maas-api-e2e-mt-032bc360-859d64d986-btklq\" (UID: \"b02b7574-105f-4dba-917d-7f8dee42285d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-032bc360-859d64d986-btklq"
Sep 06 19:31:44.495745 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:31:44.495674    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b02b7574-105f-4dba-917d-7f8dee42285d-openshift-service-ca\") pod \"maas-api-e2e-mt-032bc360-859d64d986-btklq\" (UID: \"b02b7574-105f-4dba-917d-7f8dee42285d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-032bc360-859d64d986-btklq"
Sep 06 19:31:44.597083 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:31:44.597046    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b02b7574-105f-4dba-917d-7f8dee42285d-maas-api-tls\") pod \"maas-api-e2e-mt-032bc360-859d64d986-btklq\" (UID: \"b02b7574-105f-4dba-917d-7f8dee42285d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-032bc360-859d64d986-btklq"
Sep 06 19:31:44.597629 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:31:44.597587    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b02b7574-105f-4dba-917d-7f8dee42285d-openshift-service-ca\") pod \"maas-api-e2e-mt-032bc360-859d64d986-btklq\" (UID: \"b02b7574-105f-4dba-917d-7f8dee42285d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-032bc360-859d64d986-btklq"
Sep 06 19:31:44.597875 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:31:44.597848    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b02b7574-105f-4dba-917d-7f8dee42285d-metrics-certs\") pod \"maas-api-e2e-mt-032bc360-859d64d986-btklq\" (UID: \"b02b7574-105f-4dba-917d-7f8dee42285d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-032bc360-859d64d986-btklq"
Sep 06 19:31:44.597997 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:31:44.597912    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgvjm\" (UniqueName: \"kubernetes.io/projected/b02b7574-105f-4dba-917d-7f8dee42285d-kube-api-access-xgvjm\") pod \"maas-api-e2e-mt-032bc360-859d64d986-btklq\" (UID: \"b02b7574-105f-4dba-917d-7f8dee42285d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-032bc360-859d64d986-btklq"
Sep 06 19:31:44.598287 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:31:44.597417    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-032bc360-serving-cert: secret "maas-api-e2e-mt-032bc360-serving-cert" not found
Sep 06 19:31:44.598436 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:31:44.598407    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b02b7574-105f-4dba-917d-7f8dee42285d-openshift-service-ca\") pod \"maas-api-e2e-mt-032bc360-859d64d986-btklq\" (UID: \"b02b7574-105f-4dba-917d-7f8dee42285d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-032bc360-859d64d986-btklq"
Sep 06 19:31:44.598572 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:31:44.598505    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b02b7574-105f-4dba-917d-7f8dee42285d-maas-api-tls podName:b02b7574-105f-4dba-917d-7f8dee42285d nodeName:}" failed. No retries permitted until 2026-09-06 19:31:45.098456375 +0000 UTC m=+1251.339341704 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b02b7574-105f-4dba-917d-7f8dee42285d-maas-api-tls") pod "maas-api-e2e-mt-032bc360-859d64d986-btklq" (UID: "b02b7574-105f-4dba-917d-7f8dee42285d") : secret "maas-api-e2e-mt-032bc360-serving-cert" not found
Sep 06 19:31:44.601062 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:31:44.601041    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b02b7574-105f-4dba-917d-7f8dee42285d-metrics-certs\") pod \"maas-api-e2e-mt-032bc360-859d64d986-btklq\" (UID: \"b02b7574-105f-4dba-917d-7f8dee42285d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-032bc360-859d64d986-btklq"
Sep 06 19:31:44.610055 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:31:44.610032    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgvjm\" (UniqueName: \"kubernetes.io/projected/b02b7574-105f-4dba-917d-7f8dee42285d-kube-api-access-xgvjm\") pod \"maas-api-e2e-mt-032bc360-859d64d986-btklq\" (UID: \"b02b7574-105f-4dba-917d-7f8dee42285d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-032bc360-859d64d986-btklq"
Sep 06 19:31:45.102895 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:31:45.102853    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b02b7574-105f-4dba-917d-7f8dee42285d-maas-api-tls\") pod \"maas-api-e2e-mt-032bc360-859d64d986-btklq\" (UID: \"b02b7574-105f-4dba-917d-7f8dee42285d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-032bc360-859d64d986-btklq"
Sep 06 19:31:45.105433 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:31:45.105400    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b02b7574-105f-4dba-917d-7f8dee42285d-maas-api-tls\") pod \"maas-api-e2e-mt-032bc360-859d64d986-btklq\" (UID: \"b02b7574-105f-4dba-917d-7f8dee42285d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-032bc360-859d64d986-btklq"
Sep 06 19:31:45.391763 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:31:45.391684    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-032bc360-859d64d986-btklq"
Sep 06 19:31:45.666370 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:31:45.666327    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-032bc360-859d64d986-btklq"]
Sep 06 19:31:45.669140 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:31:45.669113    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb02b7574_105f_4dba_917d_7f8dee42285d.slice/crio-a64f9ee4ef1dd5cceffe1e19966a105fea865f69d2fb3c42c0b818ee33dbcb98 WatchSource:0}: Error finding container a64f9ee4ef1dd5cceffe1e19966a105fea865f69d2fb3c42c0b818ee33dbcb98: Status 404 returned error can't find the container with id a64f9ee4ef1dd5cceffe1e19966a105fea865f69d2fb3c42c0b818ee33dbcb98
Sep 06 19:31:46.505319 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:31:46.505287    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-032bc360-859d64d986-btklq" event={"ID":"b02b7574-105f-4dba-917d-7f8dee42285d","Type":"ContainerStarted","Data":"02327f53e0c1b1219dace48dc1bb11f8eb44841f9d29697594a00addb8257999"}
Sep 06 19:31:46.505496 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:31:46.505335    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-032bc360-859d64d986-btklq" event={"ID":"b02b7574-105f-4dba-917d-7f8dee42285d","Type":"ContainerStarted","Data":"a64f9ee4ef1dd5cceffe1e19966a105fea865f69d2fb3c42c0b818ee33dbcb98"}
Sep 06 19:31:46.505496 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:31:46.505399    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-032bc360-859d64d986-btklq"
Sep 06 19:31:46.520966 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:31:46.520923    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-032bc360-859d64d986-btklq" podStartSLOduration=2.110989659 podStartE2EDuration="2.520910613s" totalImagesPullingTime="409.920954ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:31:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:31:46.519477812 +0000 UTC m=+1252.760363159" watchObservedRunningTime="2026-09-06 19:31:46.520910613 +0000 UTC m=+1252.761795958"
Sep 06 19:31:52.516217 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:31:52.516186    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-032bc360-859d64d986-btklq"
Sep 06 19:32:11.654287 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:11.654257    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-c6813a-69799c6766-7v9cz"]
Sep 06 19:32:11.654770 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:11.654461    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c6813a-69799c6766-7v9cz" podUID="72dc6840-8ad9-4673-a406-ec1867bdee59" containerName="maas-api" containerID="cri-o://da9b2ff1e804b217ff284cfdaf18728297efe382612b8856669346d1afe2bc2c" gracePeriod=30
Sep 06 19:32:11.713803 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:11.713767    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c6813a-86cfd96f45-md4l6"]
Sep 06 19:32:11.714068 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:11.714019    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-c6813a-86cfd96f45-md4l6" podUID="24779156-e26d-447f-bfd1-a219d134a5bb" containerName="payload-processing" containerID="cri-o://45a269594d46aa2c3ce542807eb06b767599334ebb8c63e8f49ea85068266d35" gracePeriod=30
Sep 06 19:32:11.968195 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:11.968166    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c6813a-69799c6766-7v9cz"
Sep 06 19:32:11.999460 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:11.999434    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-c6813a-86cfd96f45-md4l6"
Sep 06 19:32:12.039935 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:12.039902    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72dc6840-8ad9-4673-a406-ec1867bdee59-metrics-certs\") pod \"72dc6840-8ad9-4673-a406-ec1867bdee59\" (UID: \"72dc6840-8ad9-4673-a406-ec1867bdee59\") "
Sep 06 19:32:12.040068 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:12.039963    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmkgx\" (UniqueName: \"kubernetes.io/projected/72dc6840-8ad9-4673-a406-ec1867bdee59-kube-api-access-lmkgx\") pod \"72dc6840-8ad9-4673-a406-ec1867bdee59\" (UID: \"72dc6840-8ad9-4673-a406-ec1867bdee59\") "
Sep 06 19:32:12.040068 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:12.039981    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72dc6840-8ad9-4673-a406-ec1867bdee59-maas-api-tls\") pod \"72dc6840-8ad9-4673-a406-ec1867bdee59\" (UID: \"72dc6840-8ad9-4673-a406-ec1867bdee59\") "
Sep 06 19:32:12.040068 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:12.040029    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72dc6840-8ad9-4673-a406-ec1867bdee59-openshift-service-ca\") pod \"72dc6840-8ad9-4673-a406-ec1867bdee59\" (UID: \"72dc6840-8ad9-4673-a406-ec1867bdee59\") "
Sep 06 19:32:12.040452 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:12.040420    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72dc6840-8ad9-4673-a406-ec1867bdee59-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "72dc6840-8ad9-4673-a406-ec1867bdee59" (UID: "72dc6840-8ad9-4673-a406-ec1867bdee59"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:32:12.041936 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:12.041910    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72dc6840-8ad9-4673-a406-ec1867bdee59-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "72dc6840-8ad9-4673-a406-ec1867bdee59" (UID: "72dc6840-8ad9-4673-a406-ec1867bdee59"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:32:12.042069 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:12.042003    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72dc6840-8ad9-4673-a406-ec1867bdee59-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "72dc6840-8ad9-4673-a406-ec1867bdee59" (UID: "72dc6840-8ad9-4673-a406-ec1867bdee59"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:32:12.042145 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:12.042126    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72dc6840-8ad9-4673-a406-ec1867bdee59-kube-api-access-lmkgx" (OuterVolumeSpecName: "kube-api-access-lmkgx") pod "72dc6840-8ad9-4673-a406-ec1867bdee59" (UID: "72dc6840-8ad9-4673-a406-ec1867bdee59"). InnerVolumeSpecName "kube-api-access-lmkgx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:32:12.141225 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:12.141190    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24779156-e26d-447f-bfd1-a219d134a5bb-plugins-config-volume\") pod \"24779156-e26d-447f-bfd1-a219d134a5bb\" (UID: \"24779156-e26d-447f-bfd1-a219d134a5bb\") "
Sep 06 19:32:12.141425 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:12.141292    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srgtf\" (UniqueName: \"kubernetes.io/projected/24779156-e26d-447f-bfd1-a219d134a5bb-kube-api-access-srgtf\") pod \"24779156-e26d-447f-bfd1-a219d134a5bb\" (UID: \"24779156-e26d-447f-bfd1-a219d134a5bb\") "
Sep 06 19:32:12.141503 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:12.141434    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72dc6840-8ad9-4673-a406-ec1867bdee59-metrics-certs\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:32:12.141503 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:12.141445    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmkgx\" (UniqueName: \"kubernetes.io/projected/72dc6840-8ad9-4673-a406-ec1867bdee59-kube-api-access-lmkgx\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:32:12.141503 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:12.141456    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72dc6840-8ad9-4673-a406-ec1867bdee59-maas-api-tls\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:32:12.141503 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:12.141464    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72dc6840-8ad9-4673-a406-ec1867bdee59-openshift-service-ca\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:32:12.141639 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:12.141612    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24779156-e26d-447f-bfd1-a219d134a5bb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "24779156-e26d-447f-bfd1-a219d134a5bb" (UID: "24779156-e26d-447f-bfd1-a219d134a5bb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:32:12.143271 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:12.143245    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24779156-e26d-447f-bfd1-a219d134a5bb-kube-api-access-srgtf" (OuterVolumeSpecName: "kube-api-access-srgtf") pod "24779156-e26d-447f-bfd1-a219d134a5bb" (UID: "24779156-e26d-447f-bfd1-a219d134a5bb"). InnerVolumeSpecName "kube-api-access-srgtf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:32:12.242869 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:12.242831    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srgtf\" (UniqueName: \"kubernetes.io/projected/24779156-e26d-447f-bfd1-a219d134a5bb-kube-api-access-srgtf\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:32:12.242869 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:12.242865    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24779156-e26d-447f-bfd1-a219d134a5bb-plugins-config-volume\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:32:12.629660 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:12.629579    2577 generic.go:356] "Generic (PLEG): container finished" podID="24779156-e26d-447f-bfd1-a219d134a5bb" containerID="45a269594d46aa2c3ce542807eb06b767599334ebb8c63e8f49ea85068266d35" exitCode=0
Sep 06 19:32:12.629660 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:12.629619    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-c6813a-86cfd96f45-md4l6"
Sep 06 19:32:12.629880 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:12.629662    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-c6813a-86cfd96f45-md4l6" event={"ID":"24779156-e26d-447f-bfd1-a219d134a5bb","Type":"ContainerDied","Data":"45a269594d46aa2c3ce542807eb06b767599334ebb8c63e8f49ea85068266d35"}
Sep 06 19:32:12.629880 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:12.629718    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-c6813a-86cfd96f45-md4l6" event={"ID":"24779156-e26d-447f-bfd1-a219d134a5bb","Type":"ContainerDied","Data":"e2d6e4b310c050c810e295faece33ba44cce5c70a1a17ae14941701dd8dc042d"}
Sep 06 19:32:12.629880 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:12.629746    2577 scope.go:117] "RemoveContainer" containerID="45a269594d46aa2c3ce542807eb06b767599334ebb8c63e8f49ea85068266d35"
Sep 06 19:32:12.631089 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:12.631066    2577 generic.go:356] "Generic (PLEG): container finished" podID="72dc6840-8ad9-4673-a406-ec1867bdee59" containerID="da9b2ff1e804b217ff284cfdaf18728297efe382612b8856669346d1afe2bc2c" exitCode=0
Sep 06 19:32:12.631205 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:12.631121    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c6813a-69799c6766-7v9cz"
Sep 06 19:32:12.631205 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:12.631132    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c6813a-69799c6766-7v9cz" event={"ID":"72dc6840-8ad9-4673-a406-ec1867bdee59","Type":"ContainerDied","Data":"da9b2ff1e804b217ff284cfdaf18728297efe382612b8856669346d1afe2bc2c"}
Sep 06 19:32:12.631205 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:12.631164    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c6813a-69799c6766-7v9cz" event={"ID":"72dc6840-8ad9-4673-a406-ec1867bdee59","Type":"ContainerDied","Data":"2666ce1bfa9c76cc64df86e3f8840955b46de63eeed076f25a24a9d2f2a42282"}
Sep 06 19:32:12.640070 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:12.640042    2577 scope.go:117] "RemoveContainer" containerID="45a269594d46aa2c3ce542807eb06b767599334ebb8c63e8f49ea85068266d35"
Sep 06 19:32:12.640355 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:32:12.640337    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45a269594d46aa2c3ce542807eb06b767599334ebb8c63e8f49ea85068266d35\": container with ID starting with 45a269594d46aa2c3ce542807eb06b767599334ebb8c63e8f49ea85068266d35 not found: ID does not exist" containerID="45a269594d46aa2c3ce542807eb06b767599334ebb8c63e8f49ea85068266d35"
Sep 06 19:32:12.640422 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:12.640365    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45a269594d46aa2c3ce542807eb06b767599334ebb8c63e8f49ea85068266d35"} err="failed to get container status \"45a269594d46aa2c3ce542807eb06b767599334ebb8c63e8f49ea85068266d35\": rpc error: code = NotFound desc = could not find container \"45a269594d46aa2c3ce542807eb06b767599334ebb8c63e8f49ea85068266d35\": container with ID starting with 45a269594d46aa2c3ce542807eb06b767599334ebb8c63e8f49ea85068266d35 not found: ID does not exist"
Sep 06 19:32:12.640422 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:12.640384    2577 scope.go:117] "RemoveContainer" containerID="da9b2ff1e804b217ff284cfdaf18728297efe382612b8856669346d1afe2bc2c"
Sep 06 19:32:12.647691 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:12.647669    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-c6813a-69799c6766-7v9cz"]
Sep 06 19:32:12.648245 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:12.648234    2577 scope.go:117] "RemoveContainer" containerID="da9b2ff1e804b217ff284cfdaf18728297efe382612b8856669346d1afe2bc2c"
Sep 06 19:32:12.648528 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:32:12.648509    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da9b2ff1e804b217ff284cfdaf18728297efe382612b8856669346d1afe2bc2c\": container with ID starting with da9b2ff1e804b217ff284cfdaf18728297efe382612b8856669346d1afe2bc2c not found: ID does not exist" containerID="da9b2ff1e804b217ff284cfdaf18728297efe382612b8856669346d1afe2bc2c"
Sep 06 19:32:12.648584 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:12.648534    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da9b2ff1e804b217ff284cfdaf18728297efe382612b8856669346d1afe2bc2c"} err="failed to get container status \"da9b2ff1e804b217ff284cfdaf18728297efe382612b8856669346d1afe2bc2c\": rpc error: code = NotFound desc = could not find container \"da9b2ff1e804b217ff284cfdaf18728297efe382612b8856669346d1afe2bc2c\": container with ID starting with da9b2ff1e804b217ff284cfdaf18728297efe382612b8856669346d1afe2bc2c not found: ID does not exist"
Sep 06 19:32:12.653742 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:12.653720    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-c6813a-69799c6766-7v9cz"]
Sep 06 19:32:12.661743 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:12.661723    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c6813a-86cfd96f45-md4l6"]
Sep 06 19:32:12.665166 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:12.665142    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c6813a-86cfd96f45-md4l6"]
Sep 06 19:32:14.388706 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:14.388673    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24779156-e26d-447f-bfd1-a219d134a5bb" path="/var/lib/kubelet/pods/24779156-e26d-447f-bfd1-a219d134a5bb/volumes"
Sep 06 19:32:14.389079 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:14.389065    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72dc6840-8ad9-4673-a406-ec1867bdee59" path="/var/lib/kubelet/pods/72dc6840-8ad9-4673-a406-ec1867bdee59/volumes"
Sep 06 19:32:25.879103 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:25.879064    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-032bc360-859d64d986-btklq"]
Sep 06 19:32:25.880059 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:25.880024    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-032bc360-859d64d986-btklq" podUID="b02b7574-105f-4dba-917d-7f8dee42285d" containerName="maas-api" containerID="cri-o://02327f53e0c1b1219dace48dc1bb11f8eb44841f9d29697594a00addb8257999" gracePeriod=30
Sep 06 19:32:26.128163 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:26.128140    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-032bc360-859d64d986-btklq"
Sep 06 19:32:26.265664 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:26.265630    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b02b7574-105f-4dba-917d-7f8dee42285d-metrics-certs\") pod \"b02b7574-105f-4dba-917d-7f8dee42285d\" (UID: \"b02b7574-105f-4dba-917d-7f8dee42285d\") "
Sep 06 19:32:26.265852 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:26.265736    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgvjm\" (UniqueName: \"kubernetes.io/projected/b02b7574-105f-4dba-917d-7f8dee42285d-kube-api-access-xgvjm\") pod \"b02b7574-105f-4dba-917d-7f8dee42285d\" (UID: \"b02b7574-105f-4dba-917d-7f8dee42285d\") "
Sep 06 19:32:26.265852 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:26.265780    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b02b7574-105f-4dba-917d-7f8dee42285d-openshift-service-ca\") pod \"b02b7574-105f-4dba-917d-7f8dee42285d\" (UID: \"b02b7574-105f-4dba-917d-7f8dee42285d\") "
Sep 06 19:32:26.265852 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:26.265832    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b02b7574-105f-4dba-917d-7f8dee42285d-maas-api-tls\") pod \"b02b7574-105f-4dba-917d-7f8dee42285d\" (UID: \"b02b7574-105f-4dba-917d-7f8dee42285d\") "
Sep 06 19:32:26.266199 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:26.266166    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b02b7574-105f-4dba-917d-7f8dee42285d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b02b7574-105f-4dba-917d-7f8dee42285d" (UID: "b02b7574-105f-4dba-917d-7f8dee42285d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:32:26.267934 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:26.267908    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b02b7574-105f-4dba-917d-7f8dee42285d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b02b7574-105f-4dba-917d-7f8dee42285d" (UID: "b02b7574-105f-4dba-917d-7f8dee42285d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:32:26.267934 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:26.267917    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b02b7574-105f-4dba-917d-7f8dee42285d-kube-api-access-xgvjm" (OuterVolumeSpecName: "kube-api-access-xgvjm") pod "b02b7574-105f-4dba-917d-7f8dee42285d" (UID: "b02b7574-105f-4dba-917d-7f8dee42285d"). InnerVolumeSpecName "kube-api-access-xgvjm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:32:26.268065 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:26.267986    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b02b7574-105f-4dba-917d-7f8dee42285d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b02b7574-105f-4dba-917d-7f8dee42285d" (UID: "b02b7574-105f-4dba-917d-7f8dee42285d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:32:26.366727 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:26.366698    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgvjm\" (UniqueName: \"kubernetes.io/projected/b02b7574-105f-4dba-917d-7f8dee42285d-kube-api-access-xgvjm\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:32:26.366727 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:26.366723    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b02b7574-105f-4dba-917d-7f8dee42285d-openshift-service-ca\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:32:26.366727 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:26.366733    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b02b7574-105f-4dba-917d-7f8dee42285d-maas-api-tls\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:32:26.366936 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:26.366742    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b02b7574-105f-4dba-917d-7f8dee42285d-metrics-certs\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:32:26.697921 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:26.697828    2577 generic.go:356] "Generic (PLEG): container finished" podID="b02b7574-105f-4dba-917d-7f8dee42285d" containerID="02327f53e0c1b1219dace48dc1bb11f8eb44841f9d29697594a00addb8257999" exitCode=0
Sep 06 19:32:26.697921 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:26.697886    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-032bc360-859d64d986-btklq"
Sep 06 19:32:26.697921 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:26.697911    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-032bc360-859d64d986-btklq" event={"ID":"b02b7574-105f-4dba-917d-7f8dee42285d","Type":"ContainerDied","Data":"02327f53e0c1b1219dace48dc1bb11f8eb44841f9d29697594a00addb8257999"}
Sep 06 19:32:26.698181 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:26.697983    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-032bc360-859d64d986-btklq" event={"ID":"b02b7574-105f-4dba-917d-7f8dee42285d","Type":"ContainerDied","Data":"a64f9ee4ef1dd5cceffe1e19966a105fea865f69d2fb3c42c0b818ee33dbcb98"}
Sep 06 19:32:26.698181 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:26.698007    2577 scope.go:117] "RemoveContainer" containerID="02327f53e0c1b1219dace48dc1bb11f8eb44841f9d29697594a00addb8257999"
Sep 06 19:32:26.706830 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:26.706816    2577 scope.go:117] "RemoveContainer" containerID="02327f53e0c1b1219dace48dc1bb11f8eb44841f9d29697594a00addb8257999"
Sep 06 19:32:26.707091 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:32:26.707074    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02327f53e0c1b1219dace48dc1bb11f8eb44841f9d29697594a00addb8257999\": container with ID starting with 02327f53e0c1b1219dace48dc1bb11f8eb44841f9d29697594a00addb8257999 not found: ID does not exist" containerID="02327f53e0c1b1219dace48dc1bb11f8eb44841f9d29697594a00addb8257999"
Sep 06 19:32:26.707160 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:26.707098    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02327f53e0c1b1219dace48dc1bb11f8eb44841f9d29697594a00addb8257999"} err="failed to get container status \"02327f53e0c1b1219dace48dc1bb11f8eb44841f9d29697594a00addb8257999\": rpc error: code = NotFound desc = could not find container \"02327f53e0c1b1219dace48dc1bb11f8eb44841f9d29697594a00addb8257999\": container with ID starting with 02327f53e0c1b1219dace48dc1bb11f8eb44841f9d29697594a00addb8257999 not found: ID does not exist"
Sep 06 19:32:26.713259 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:26.713239    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-032bc360-859d64d986-btklq"]
Sep 06 19:32:26.716739 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:26.716718    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-032bc360-859d64d986-btklq"]
Sep 06 19:32:28.387647 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:28.387615    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b02b7574-105f-4dba-917d-7f8dee42285d" path="/var/lib/kubelet/pods/b02b7574-105f-4dba-917d-7f8dee42285d/volumes"
Sep 06 19:32:49.948023 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:49.947989    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz"]
Sep 06 19:32:49.948460 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:49.948319    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b02b7574-105f-4dba-917d-7f8dee42285d" containerName="maas-api"
Sep 06 19:32:49.948460 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:49.948330    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b02b7574-105f-4dba-917d-7f8dee42285d" containerName="maas-api"
Sep 06 19:32:49.948460 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:49.948343    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72dc6840-8ad9-4673-a406-ec1867bdee59" containerName="maas-api"
Sep 06 19:32:49.948460 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:49.948348    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="72dc6840-8ad9-4673-a406-ec1867bdee59" containerName="maas-api"
Sep 06 19:32:49.948460 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:49.948358    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24779156-e26d-447f-bfd1-a219d134a5bb" containerName="payload-processing"
Sep 06 19:32:49.948460 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:49.948363    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="24779156-e26d-447f-bfd1-a219d134a5bb" containerName="payload-processing"
Sep 06 19:32:49.948460 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:49.948417    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="72dc6840-8ad9-4673-a406-ec1867bdee59" containerName="maas-api"
Sep 06 19:32:49.948460 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:49.948423    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="24779156-e26d-447f-bfd1-a219d134a5bb" containerName="payload-processing"
Sep 06 19:32:49.948460 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:49.948432    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b02b7574-105f-4dba-917d-7f8dee42285d" containerName="maas-api"
Sep 06 19:32:49.952818 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:49.952796    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz"
Sep 06 19:32:49.954688 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:49.954666    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-cf729a-serving-cert\""
Sep 06 19:32:49.962340 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:49.962314    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz"]
Sep 06 19:32:50.062567 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:50.062535    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b4b8a67-d6e3-4870-acef-183aac8448f9-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz\" (UID: \"8b4b8a67-d6e3-4870-acef-183aac8448f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz"
Sep 06 19:32:50.062567 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:50.062582    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjvfk\" (UniqueName: \"kubernetes.io/projected/8b4b8a67-d6e3-4870-acef-183aac8448f9-kube-api-access-rjvfk\") pod \"maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz\" (UID: \"8b4b8a67-d6e3-4870-acef-183aac8448f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz"
Sep 06 19:32:50.062811 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:50.062731    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b4b8a67-d6e3-4870-acef-183aac8448f9-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz\" (UID: \"8b4b8a67-d6e3-4870-acef-183aac8448f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz"
Sep 06 19:32:50.062888 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:50.062868    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b4b8a67-d6e3-4870-acef-183aac8448f9-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz\" (UID: \"8b4b8a67-d6e3-4870-acef-183aac8448f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz"
Sep 06 19:32:50.164208 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:50.164172    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b4b8a67-d6e3-4870-acef-183aac8448f9-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz\" (UID: \"8b4b8a67-d6e3-4870-acef-183aac8448f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz"
Sep 06 19:32:50.164366 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:50.164230    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjvfk\" (UniqueName: \"kubernetes.io/projected/8b4b8a67-d6e3-4870-acef-183aac8448f9-kube-api-access-rjvfk\") pod \"maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz\" (UID: \"8b4b8a67-d6e3-4870-acef-183aac8448f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz"
Sep 06 19:32:50.164366 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:50.164261    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b4b8a67-d6e3-4870-acef-183aac8448f9-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz\" (UID: \"8b4b8a67-d6e3-4870-acef-183aac8448f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz"
Sep 06 19:32:50.164366 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:50.164326    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b4b8a67-d6e3-4870-acef-183aac8448f9-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz\" (UID: \"8b4b8a67-d6e3-4870-acef-183aac8448f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz"
Sep 06 19:32:50.164581 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:32:50.164432    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-cf729a-serving-cert: secret "maas-api-e2e-shared-a-w2-cf729a-serving-cert" not found
Sep 06 19:32:50.164581 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:32:50.164548    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b4b8a67-d6e3-4870-acef-183aac8448f9-maas-api-tls podName:8b4b8a67-d6e3-4870-acef-183aac8448f9 nodeName:}" failed. No retries permitted until 2026-09-06 19:32:50.664526441 +0000 UTC m=+1316.905411778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8b4b8a67-d6e3-4870-acef-183aac8448f9-maas-api-tls") pod "maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz" (UID: "8b4b8a67-d6e3-4870-acef-183aac8448f9") : secret "maas-api-e2e-shared-a-w2-cf729a-serving-cert" not found
Sep 06 19:32:50.164977 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:50.164958    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b4b8a67-d6e3-4870-acef-183aac8448f9-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz\" (UID: \"8b4b8a67-d6e3-4870-acef-183aac8448f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz"
Sep 06 19:32:50.166672 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:50.166653    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b4b8a67-d6e3-4870-acef-183aac8448f9-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz\" (UID: \"8b4b8a67-d6e3-4870-acef-183aac8448f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz"
Sep 06 19:32:50.172056 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:50.172033    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjvfk\" (UniqueName: \"kubernetes.io/projected/8b4b8a67-d6e3-4870-acef-183aac8448f9-kube-api-access-rjvfk\") pod \"maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz\" (UID: \"8b4b8a67-d6e3-4870-acef-183aac8448f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz"
Sep 06 19:32:50.529252 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:50.529204    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cf729a-5d7f68b5f4-kpvkq"]
Sep 06 19:32:50.536398 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:50.536073    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cf729a-5d7f68b5f4-kpvkq"
Sep 06 19:32:50.539072 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:50.539044    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-cf729a\""
Sep 06 19:32:50.540341 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:50.540317    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-cf729a-dockercfg-w89cl\""
Sep 06 19:32:50.544057 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:50.544030    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cf729a-5d7f68b5f4-kpvkq"]
Sep 06 19:32:50.560508 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:50.560483    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-cf729a-5f47779989-mffbw"]
Sep 06 19:32:50.563715 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:50.563698    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-cf729a-5f47779989-mffbw"
Sep 06 19:32:50.567297 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:50.567268    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c09a5888-976c-4d7d-99ef-1f6999df8aa0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-cf729a-5d7f68b5f4-kpvkq\" (UID: \"c09a5888-976c-4d7d-99ef-1f6999df8aa0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cf729a-5d7f68b5f4-kpvkq"
Sep 06 19:32:50.567398 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:50.567382    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d77bc\" (UniqueName: \"kubernetes.io/projected/c09a5888-976c-4d7d-99ef-1f6999df8aa0-kube-api-access-d77bc\") pod \"payload-pre-processing-e2e-shared-a-w2-cf729a-5d7f68b5f4-kpvkq\" (UID: \"c09a5888-976c-4d7d-99ef-1f6999df8aa0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cf729a-5d7f68b5f4-kpvkq"
Sep 06 19:32:50.573837 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:50.573816    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-cf729a-5f47779989-mffbw"]
Sep 06 19:32:50.667763 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:50.667727    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d77bc\" (UniqueName: \"kubernetes.io/projected/c09a5888-976c-4d7d-99ef-1f6999df8aa0-kube-api-access-d77bc\") pod \"payload-pre-processing-e2e-shared-a-w2-cf729a-5d7f68b5f4-kpvkq\" (UID: \"c09a5888-976c-4d7d-99ef-1f6999df8aa0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cf729a-5d7f68b5f4-kpvkq"
Sep 06 19:32:50.667763 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:50.667763    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-br4x7\" (UniqueName: \"kubernetes.io/projected/683fbaba-fa90-4d95-a4a3-689def10d0a3-kube-api-access-br4x7\") pod \"payload-processing-e2e-shared-a-w2-cf729a-5f47779989-mffbw\" (UID: \"683fbaba-fa90-4d95-a4a3-689def10d0a3\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-cf729a-5f47779989-mffbw"
Sep 06 19:32:50.667971 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:50.667812    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c09a5888-976c-4d7d-99ef-1f6999df8aa0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-cf729a-5d7f68b5f4-kpvkq\" (UID: \"c09a5888-976c-4d7d-99ef-1f6999df8aa0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cf729a-5d7f68b5f4-kpvkq"
Sep 06 19:32:50.667971 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:50.667834    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/683fbaba-fa90-4d95-a4a3-689def10d0a3-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-cf729a-5f47779989-mffbw\" (UID: \"683fbaba-fa90-4d95-a4a3-689def10d0a3\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-cf729a-5f47779989-mffbw"
Sep 06 19:32:50.667971 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:50.667862    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b4b8a67-d6e3-4870-acef-183aac8448f9-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz\" (UID: \"8b4b8a67-d6e3-4870-acef-183aac8448f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz"
Sep 06 19:32:50.668487 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:50.668449    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c09a5888-976c-4d7d-99ef-1f6999df8aa0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-cf729a-5d7f68b5f4-kpvkq\" (UID: \"c09a5888-976c-4d7d-99ef-1f6999df8aa0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cf729a-5d7f68b5f4-kpvkq"
Sep 06 19:32:50.670151 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:50.670129    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b4b8a67-d6e3-4870-acef-183aac8448f9-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz\" (UID: \"8b4b8a67-d6e3-4870-acef-183aac8448f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz"
Sep 06 19:32:50.688189 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:50.688157    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d77bc\" (UniqueName: \"kubernetes.io/projected/c09a5888-976c-4d7d-99ef-1f6999df8aa0-kube-api-access-d77bc\") pod \"payload-pre-processing-e2e-shared-a-w2-cf729a-5d7f68b5f4-kpvkq\" (UID: \"c09a5888-976c-4d7d-99ef-1f6999df8aa0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cf729a-5d7f68b5f4-kpvkq"
Sep 06 19:32:50.769201 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:50.769172    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/683fbaba-fa90-4d95-a4a3-689def10d0a3-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-cf729a-5f47779989-mffbw\" (UID: \"683fbaba-fa90-4d95-a4a3-689def10d0a3\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-cf729a-5f47779989-mffbw"
Sep 06 19:32:50.769320 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:50.769233    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-br4x7\" (UniqueName: \"kubernetes.io/projected/683fbaba-fa90-4d95-a4a3-689def10d0a3-kube-api-access-br4x7\") pod \"payload-processing-e2e-shared-a-w2-cf729a-5f47779989-mffbw\" (UID: \"683fbaba-fa90-4d95-a4a3-689def10d0a3\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-cf729a-5f47779989-mffbw"
Sep 06 19:32:50.769826 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:50.769807    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/683fbaba-fa90-4d95-a4a3-689def10d0a3-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-cf729a-5f47779989-mffbw\" (UID: \"683fbaba-fa90-4d95-a4a3-689def10d0a3\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-cf729a-5f47779989-mffbw"
Sep 06 19:32:50.776882 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:50.776859    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-br4x7\" (UniqueName: \"kubernetes.io/projected/683fbaba-fa90-4d95-a4a3-689def10d0a3-kube-api-access-br4x7\") pod \"payload-processing-e2e-shared-a-w2-cf729a-5f47779989-mffbw\" (UID: \"683fbaba-fa90-4d95-a4a3-689def10d0a3\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-cf729a-5f47779989-mffbw"
Sep 06 19:32:50.849488 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:50.849393    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cf729a-5d7f68b5f4-kpvkq"
Sep 06 19:32:50.864315 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:50.864287    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz"
Sep 06 19:32:50.873269 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:50.873245    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-cf729a-5f47779989-mffbw"
Sep 06 19:32:51.126964 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:51.126933    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cf729a-5d7f68b5f4-kpvkq"]
Sep 06 19:32:51.128188 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:32:51.128161    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc09a5888_976c_4d7d_99ef_1f6999df8aa0.slice/crio-b9dfb36f71ea9f6956850b1263a73897e412182f7bf048e33d5dd386ca003d1a WatchSource:0}: Error finding container b9dfb36f71ea9f6956850b1263a73897e412182f7bf048e33d5dd386ca003d1a: Status 404 returned error can't find the container with id b9dfb36f71ea9f6956850b1263a73897e412182f7bf048e33d5dd386ca003d1a
Sep 06 19:32:51.175563 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:51.175385    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-cf729a-5f47779989-mffbw"]
Sep 06 19:32:51.177456 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:51.177435    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz"]
Sep 06 19:32:51.177735 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:32:51.177709    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod683fbaba_fa90_4d95_a4a3_689def10d0a3.slice/crio-1648eb29c232eda53e64cc82a4bb9e2a69bc8da040ca2437309317260ee09fa3 WatchSource:0}: Error finding container 1648eb29c232eda53e64cc82a4bb9e2a69bc8da040ca2437309317260ee09fa3: Status 404 returned error can't find the container with id 1648eb29c232eda53e64cc82a4bb9e2a69bc8da040ca2437309317260ee09fa3
Sep 06 19:32:51.180953 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:32:51.180925    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b4b8a67_d6e3_4870_acef_183aac8448f9.slice/crio-bb870b3c3e5fc81caf1845aeff2b5eb81c73bb2f110d9bcce1f52d2bc2e84e90 WatchSource:0}: Error finding container bb870b3c3e5fc81caf1845aeff2b5eb81c73bb2f110d9bcce1f52d2bc2e84e90: Status 404 returned error can't find the container with id bb870b3c3e5fc81caf1845aeff2b5eb81c73bb2f110d9bcce1f52d2bc2e84e90
Sep 06 19:32:51.182298 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:51.182279    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 19:32:51.821895 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:51.821802    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cf729a-5d7f68b5f4-kpvkq" event={"ID":"c09a5888-976c-4d7d-99ef-1f6999df8aa0","Type":"ContainerStarted","Data":"427465b434f20895074145826c45f6fd39759c7bded367a6b8eafe83e1ed3d0b"}
Sep 06 19:32:51.821895 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:51.821873    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cf729a-5d7f68b5f4-kpvkq" event={"ID":"c09a5888-976c-4d7d-99ef-1f6999df8aa0","Type":"ContainerStarted","Data":"b9dfb36f71ea9f6956850b1263a73897e412182f7bf048e33d5dd386ca003d1a"}
Sep 06 19:32:51.822283 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:51.822206    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cf729a-5d7f68b5f4-kpvkq"
Sep 06 19:32:51.823605 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:51.823578    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz" event={"ID":"8b4b8a67-d6e3-4870-acef-183aac8448f9","Type":"ContainerStarted","Data":"4475d5415499008b8ce6962ef0201b7b7cc4fc078d4d18b9e5051f1426692fdd"}
Sep 06 19:32:51.823685 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:51.823622    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz" event={"ID":"8b4b8a67-d6e3-4870-acef-183aac8448f9","Type":"ContainerStarted","Data":"bb870b3c3e5fc81caf1845aeff2b5eb81c73bb2f110d9bcce1f52d2bc2e84e90"}
Sep 06 19:32:51.823685 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:51.823652    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz"
Sep 06 19:32:51.825336 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:51.825317    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-cf729a-5f47779989-mffbw" event={"ID":"683fbaba-fa90-4d95-a4a3-689def10d0a3","Type":"ContainerStarted","Data":"f926fb27b8ce7552f54c754c9dff3eddff3db37bf27af36804457e8f8c149c97"}
Sep 06 19:32:51.825408 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:51.825352    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-cf729a-5f47779989-mffbw" event={"ID":"683fbaba-fa90-4d95-a4a3-689def10d0a3","Type":"ContainerStarted","Data":"1648eb29c232eda53e64cc82a4bb9e2a69bc8da040ca2437309317260ee09fa3"}
Sep 06 19:32:51.825487 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:51.825448    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-cf729a-5f47779989-mffbw"
Sep 06 19:32:51.836759 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:51.836723    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cf729a-5d7f68b5f4-kpvkq" podStartSLOduration=1.836708259 podStartE2EDuration="1.836708259s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:32:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:32:51.835985122 +0000 UTC m=+1318.076870484" watchObservedRunningTime="2026-09-06 19:32:51.836708259 +0000 UTC m=+1318.077593601"
Sep 06 19:32:51.852685 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:51.852639    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-cf729a-5f47779989-mffbw" podStartSLOduration=1.852624359 podStartE2EDuration="1.852624359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:32:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:32:51.850324366 +0000 UTC m=+1318.091209732" watchObservedRunningTime="2026-09-06 19:32:51.852624359 +0000 UTC m=+1318.093509706"
Sep 06 19:32:51.865829 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:51.865786    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz" podStartSLOduration=2.531071349 podStartE2EDuration="2.865769013s" totalImagesPullingTime="334.697664ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:32:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:32:51.86549372 +0000 UTC m=+1318.106379088" watchObservedRunningTime="2026-09-06 19:32:51.865769013 +0000 UTC m=+1318.106654360"
Sep 06 19:32:57.836122 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:32:57.836091    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz"
Sep 06 19:33:02.833203 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:02.833172    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-cf729a-5f47779989-mffbw"
Sep 06 19:33:02.833621 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:02.833238    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cf729a-5d7f68b5f4-kpvkq"
Sep 06 19:33:03.809176 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:03.809144    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6"]
Sep 06 19:33:03.809378 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:03.809352    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6" podUID="0b53dd4e-dbdd-4646-a60d-25f46489b1a0" containerName="maas-api" containerID="cri-o://bbff8d922d4722fc4e0d65ad3b87723f86a69e8f4adf65a43db9a363bbcd0afc" gracePeriod=30
Sep 06 19:33:03.856753 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:03.856725    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-5307a7-7d47f6d98b-qzpmk"]
Sep 06 19:33:03.857141 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:03.856967    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5307a7-7d47f6d98b-qzpmk" podUID="6acd97b8-bdd5-4919-a7e5-2fdc7ac0552f" containerName="payload-pre-processing" containerID="cri-o://625463a3b9376a2453595a519e91b3ee9f3e0e6bf61058a1c59d122d45067db3" gracePeriod=30
Sep 06 19:33:04.117108 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:04.117071    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6"
Sep 06 19:33:04.137266 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:04.137242    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5307a7-7d47f6d98b-qzpmk"
Sep 06 19:33:04.185889 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:04.185860    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kcz6\" (UniqueName: \"kubernetes.io/projected/0b53dd4e-dbdd-4646-a60d-25f46489b1a0-kube-api-access-4kcz6\") pod \"0b53dd4e-dbdd-4646-a60d-25f46489b1a0\" (UID: \"0b53dd4e-dbdd-4646-a60d-25f46489b1a0\") "
Sep 06 19:33:04.185889 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:04.185895    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b53dd4e-dbdd-4646-a60d-25f46489b1a0-openshift-service-ca\") pod \"0b53dd4e-dbdd-4646-a60d-25f46489b1a0\" (UID: \"0b53dd4e-dbdd-4646-a60d-25f46489b1a0\") "
Sep 06 19:33:04.186144 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:04.185931    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b53dd4e-dbdd-4646-a60d-25f46489b1a0-metrics-certs\") pod \"0b53dd4e-dbdd-4646-a60d-25f46489b1a0\" (UID: \"0b53dd4e-dbdd-4646-a60d-25f46489b1a0\") "
Sep 06 19:33:04.186144 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:04.185966    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b53dd4e-dbdd-4646-a60d-25f46489b1a0-maas-api-tls\") pod \"0b53dd4e-dbdd-4646-a60d-25f46489b1a0\" (UID: \"0b53dd4e-dbdd-4646-a60d-25f46489b1a0\") "
Sep 06 19:33:04.186429 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:04.186399    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b53dd4e-dbdd-4646-a60d-25f46489b1a0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0b53dd4e-dbdd-4646-a60d-25f46489b1a0" (UID: "0b53dd4e-dbdd-4646-a60d-25f46489b1a0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:33:04.187986 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:04.187961    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b53dd4e-dbdd-4646-a60d-25f46489b1a0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0b53dd4e-dbdd-4646-a60d-25f46489b1a0" (UID: "0b53dd4e-dbdd-4646-a60d-25f46489b1a0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:33:04.187986 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:04.187966    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b53dd4e-dbdd-4646-a60d-25f46489b1a0-kube-api-access-4kcz6" (OuterVolumeSpecName: "kube-api-access-4kcz6") pod "0b53dd4e-dbdd-4646-a60d-25f46489b1a0" (UID: "0b53dd4e-dbdd-4646-a60d-25f46489b1a0"). InnerVolumeSpecName "kube-api-access-4kcz6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:33:04.188121 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:04.187997    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b53dd4e-dbdd-4646-a60d-25f46489b1a0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0b53dd4e-dbdd-4646-a60d-25f46489b1a0" (UID: "0b53dd4e-dbdd-4646-a60d-25f46489b1a0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:33:04.287359 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:04.287321    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6acd97b8-bdd5-4919-a7e5-2fdc7ac0552f-plugins-config-volume\") pod \"6acd97b8-bdd5-4919-a7e5-2fdc7ac0552f\" (UID: \"6acd97b8-bdd5-4919-a7e5-2fdc7ac0552f\") "
Sep 06 19:33:04.287544 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:04.287369    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhpxd\" (UniqueName: \"kubernetes.io/projected/6acd97b8-bdd5-4919-a7e5-2fdc7ac0552f-kube-api-access-mhpxd\") pod \"6acd97b8-bdd5-4919-a7e5-2fdc7ac0552f\" (UID: \"6acd97b8-bdd5-4919-a7e5-2fdc7ac0552f\") "
Sep 06 19:33:04.287619 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:04.287606    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b53dd4e-dbdd-4646-a60d-25f46489b1a0-maas-api-tls\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:33:04.287659 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:04.287622    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kcz6\" (UniqueName: \"kubernetes.io/projected/0b53dd4e-dbdd-4646-a60d-25f46489b1a0-kube-api-access-4kcz6\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:33:04.287659 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:04.287633    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b53dd4e-dbdd-4646-a60d-25f46489b1a0-openshift-service-ca\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:33:04.287659 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:04.287642    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b53dd4e-dbdd-4646-a60d-25f46489b1a0-metrics-certs\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:33:04.287757 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:04.287704    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6acd97b8-bdd5-4919-a7e5-2fdc7ac0552f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6acd97b8-bdd5-4919-a7e5-2fdc7ac0552f" (UID: "6acd97b8-bdd5-4919-a7e5-2fdc7ac0552f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:33:04.289412 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:04.289391    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6acd97b8-bdd5-4919-a7e5-2fdc7ac0552f-kube-api-access-mhpxd" (OuterVolumeSpecName: "kube-api-access-mhpxd") pod "6acd97b8-bdd5-4919-a7e5-2fdc7ac0552f" (UID: "6acd97b8-bdd5-4919-a7e5-2fdc7ac0552f"). InnerVolumeSpecName "kube-api-access-mhpxd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:33:04.388337 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:04.388250    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6acd97b8-bdd5-4919-a7e5-2fdc7ac0552f-plugins-config-volume\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:33:04.388337 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:04.388271    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhpxd\" (UniqueName: \"kubernetes.io/projected/6acd97b8-bdd5-4919-a7e5-2fdc7ac0552f-kube-api-access-mhpxd\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:33:04.906569 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:04.906536    2577 generic.go:356] "Generic (PLEG): container finished" podID="0b53dd4e-dbdd-4646-a60d-25f46489b1a0" containerID="bbff8d922d4722fc4e0d65ad3b87723f86a69e8f4adf65a43db9a363bbcd0afc" exitCode=0
Sep 06 19:33:04.906981 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:04.906579    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6"
Sep 06 19:33:04.906981 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:04.906617    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6" event={"ID":"0b53dd4e-dbdd-4646-a60d-25f46489b1a0","Type":"ContainerDied","Data":"bbff8d922d4722fc4e0d65ad3b87723f86a69e8f4adf65a43db9a363bbcd0afc"}
Sep 06 19:33:04.906981 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:04.906704    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6" event={"ID":"0b53dd4e-dbdd-4646-a60d-25f46489b1a0","Type":"ContainerDied","Data":"73c9e9b83b804874ff63d60602d67983a522f71a104d86166cd7c678d0713c01"}
Sep 06 19:33:04.906981 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:04.906734    2577 scope.go:117] "RemoveContainer" containerID="bbff8d922d4722fc4e0d65ad3b87723f86a69e8f4adf65a43db9a363bbcd0afc"
Sep 06 19:33:04.908085 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:04.908039    2577 generic.go:356] "Generic (PLEG): container finished" podID="6acd97b8-bdd5-4919-a7e5-2fdc7ac0552f" containerID="625463a3b9376a2453595a519e91b3ee9f3e0e6bf61058a1c59d122d45067db3" exitCode=0
Sep 06 19:33:04.908152 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:04.908091    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5307a7-7d47f6d98b-qzpmk"
Sep 06 19:33:04.908152 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:04.908124    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5307a7-7d47f6d98b-qzpmk" event={"ID":"6acd97b8-bdd5-4919-a7e5-2fdc7ac0552f","Type":"ContainerDied","Data":"625463a3b9376a2453595a519e91b3ee9f3e0e6bf61058a1c59d122d45067db3"}
Sep 06 19:33:04.908233 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:04.908174    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5307a7-7d47f6d98b-qzpmk" event={"ID":"6acd97b8-bdd5-4919-a7e5-2fdc7ac0552f","Type":"ContainerDied","Data":"a8fd3d1749ed7ae213c36d508f9a7abc140992c8a23181a611a4bdfe98470eef"}
Sep 06 19:33:04.915206 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:04.915176    2577 scope.go:117] "RemoveContainer" containerID="bbff8d922d4722fc4e0d65ad3b87723f86a69e8f4adf65a43db9a363bbcd0afc"
Sep 06 19:33:04.915439 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:33:04.915420    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbff8d922d4722fc4e0d65ad3b87723f86a69e8f4adf65a43db9a363bbcd0afc\": container with ID starting with bbff8d922d4722fc4e0d65ad3b87723f86a69e8f4adf65a43db9a363bbcd0afc not found: ID does not exist" containerID="bbff8d922d4722fc4e0d65ad3b87723f86a69e8f4adf65a43db9a363bbcd0afc"
Sep 06 19:33:04.915533 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:04.915447    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbff8d922d4722fc4e0d65ad3b87723f86a69e8f4adf65a43db9a363bbcd0afc"} err="failed to get container status \"bbff8d922d4722fc4e0d65ad3b87723f86a69e8f4adf65a43db9a363bbcd0afc\": rpc error: code = NotFound desc = could not find container \"bbff8d922d4722fc4e0d65ad3b87723f86a69e8f4adf65a43db9a363bbcd0afc\": container with ID starting with bbff8d922d4722fc4e0d65ad3b87723f86a69e8f4adf65a43db9a363bbcd0afc not found: ID does not exist"
Sep 06 19:33:04.915533 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:04.915463    2577 scope.go:117] "RemoveContainer" containerID="625463a3b9376a2453595a519e91b3ee9f3e0e6bf61058a1c59d122d45067db3"
Sep 06 19:33:04.922816 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:04.922798    2577 scope.go:117] "RemoveContainer" containerID="625463a3b9376a2453595a519e91b3ee9f3e0e6bf61058a1c59d122d45067db3"
Sep 06 19:33:04.923083 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:33:04.923065    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"625463a3b9376a2453595a519e91b3ee9f3e0e6bf61058a1c59d122d45067db3\": container with ID starting with 625463a3b9376a2453595a519e91b3ee9f3e0e6bf61058a1c59d122d45067db3 not found: ID does not exist" containerID="625463a3b9376a2453595a519e91b3ee9f3e0e6bf61058a1c59d122d45067db3"
Sep 06 19:33:04.923148 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:04.923089    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"625463a3b9376a2453595a519e91b3ee9f3e0e6bf61058a1c59d122d45067db3"} err="failed to get container status \"625463a3b9376a2453595a519e91b3ee9f3e0e6bf61058a1c59d122d45067db3\": rpc error: code = NotFound desc = could not find container \"625463a3b9376a2453595a519e91b3ee9f3e0e6bf61058a1c59d122d45067db3\": container with ID starting with 625463a3b9376a2453595a519e91b3ee9f3e0e6bf61058a1c59d122d45067db3 not found: ID does not exist"
Sep 06 19:33:04.923542 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:04.923521    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-5307a7-7d47f6d98b-qzpmk"]
Sep 06 19:33:04.927375 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:04.927355    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-5307a7-7d47f6d98b-qzpmk"]
Sep 06 19:33:04.938072 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:04.938052    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6"]
Sep 06 19:33:04.941601 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:04.941582    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5307a7-66d76f797b-xlvv6"]
Sep 06 19:33:06.387598 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:06.387566    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b53dd4e-dbdd-4646-a60d-25f46489b1a0" path="/var/lib/kubelet/pods/0b53dd4e-dbdd-4646-a60d-25f46489b1a0/volumes"
Sep 06 19:33:06.387978 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:06.387913    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6acd97b8-bdd5-4919-a7e5-2fdc7ac0552f" path="/var/lib/kubelet/pods/6acd97b8-bdd5-4919-a7e5-2fdc7ac0552f/volumes"
Sep 06 19:33:18.874174 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:18.874101    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6bbb53-5fc99d84cd-jw2n5"]
Sep 06 19:33:18.874526 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:18.874499    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6acd97b8-bdd5-4919-a7e5-2fdc7ac0552f" containerName="payload-pre-processing"
Sep 06 19:33:18.874526 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:18.874513    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6acd97b8-bdd5-4919-a7e5-2fdc7ac0552f" containerName="payload-pre-processing"
Sep 06 19:33:18.874608 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:18.874528    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b53dd4e-dbdd-4646-a60d-25f46489b1a0" containerName="maas-api"
Sep 06 19:33:18.874608 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:18.874534    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b53dd4e-dbdd-4646-a60d-25f46489b1a0" containerName="maas-api"
Sep 06 19:33:18.874608 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:18.874596    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b53dd4e-dbdd-4646-a60d-25f46489b1a0" containerName="maas-api"
Sep 06 19:33:18.874608 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:18.874604    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6acd97b8-bdd5-4919-a7e5-2fdc7ac0552f" containerName="payload-pre-processing"
Sep 06 19:33:18.878865 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:18.878849    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6bbb53-5fc99d84cd-jw2n5"
Sep 06 19:33:18.881045 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:18.881021    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-6bbb53\""
Sep 06 19:33:18.881045 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:18.881029    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-6bbb53-dockercfg-xrhxb\""
Sep 06 19:33:18.886279 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:18.886258    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6bbb53-5fc99d84cd-jw2n5"]
Sep 06 19:33:18.924067 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:18.924042    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-6bbb53-74c49dfcf5-gsm5r"]
Sep 06 19:33:18.927125 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:18.927109    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6bbb53-74c49dfcf5-gsm5r"
Sep 06 19:33:18.936835 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:18.936814    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-6bbb53-74c49dfcf5-gsm5r"]
Sep 06 19:33:19.015495 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:19.015449    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqtsg\" (UniqueName: \"kubernetes.io/projected/187b375a-a6eb-4b94-b889-23f14f6a42da-kube-api-access-gqtsg\") pod \"payload-pre-processing-e2e-shared-b-w2-6bbb53-5fc99d84cd-jw2n5\" (UID: \"187b375a-a6eb-4b94-b889-23f14f6a42da\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6bbb53-5fc99d84cd-jw2n5"
Sep 06 19:33:19.015680 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:19.015627    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/187b375a-a6eb-4b94-b889-23f14f6a42da-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-6bbb53-5fc99d84cd-jw2n5\" (UID: \"187b375a-a6eb-4b94-b889-23f14f6a42da\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6bbb53-5fc99d84cd-jw2n5"
Sep 06 19:33:19.116370 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:19.116337    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhkfh\" (UniqueName: \"kubernetes.io/projected/97f6632a-6791-43b5-ba48-258e292e2434-kube-api-access-lhkfh\") pod \"payload-processing-e2e-shared-b-w2-6bbb53-74c49dfcf5-gsm5r\" (UID: \"97f6632a-6791-43b5-ba48-258e292e2434\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6bbb53-74c49dfcf5-gsm5r"
Sep 06 19:33:19.116537 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:19.116386    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqtsg\" (UniqueName: \"kubernetes.io/projected/187b375a-a6eb-4b94-b889-23f14f6a42da-kube-api-access-gqtsg\") pod \"payload-pre-processing-e2e-shared-b-w2-6bbb53-5fc99d84cd-jw2n5\" (UID: \"187b375a-a6eb-4b94-b889-23f14f6a42da\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6bbb53-5fc99d84cd-jw2n5"
Sep 06 19:33:19.116537 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:19.116455    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/187b375a-a6eb-4b94-b889-23f14f6a42da-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-6bbb53-5fc99d84cd-jw2n5\" (UID: \"187b375a-a6eb-4b94-b889-23f14f6a42da\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6bbb53-5fc99d84cd-jw2n5"
Sep 06 19:33:19.116628 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:19.116544    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97f6632a-6791-43b5-ba48-258e292e2434-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-6bbb53-74c49dfcf5-gsm5r\" (UID: \"97f6632a-6791-43b5-ba48-258e292e2434\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6bbb53-74c49dfcf5-gsm5r"
Sep 06 19:33:19.117089 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:19.117071    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/187b375a-a6eb-4b94-b889-23f14f6a42da-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-6bbb53-5fc99d84cd-jw2n5\" (UID: \"187b375a-a6eb-4b94-b889-23f14f6a42da\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6bbb53-5fc99d84cd-jw2n5"
Sep 06 19:33:19.130497 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:19.124148    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqtsg\" (UniqueName: \"kubernetes.io/projected/187b375a-a6eb-4b94-b889-23f14f6a42da-kube-api-access-gqtsg\") pod \"payload-pre-processing-e2e-shared-b-w2-6bbb53-5fc99d84cd-jw2n5\" (UID: \"187b375a-a6eb-4b94-b889-23f14f6a42da\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6bbb53-5fc99d84cd-jw2n5"
Sep 06 19:33:19.189732 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:19.189706    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6bbb53-5fc99d84cd-jw2n5"
Sep 06 19:33:19.217689 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:19.217663    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97f6632a-6791-43b5-ba48-258e292e2434-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-6bbb53-74c49dfcf5-gsm5r\" (UID: \"97f6632a-6791-43b5-ba48-258e292e2434\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6bbb53-74c49dfcf5-gsm5r"
Sep 06 19:33:19.217812 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:19.217727    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhkfh\" (UniqueName: \"kubernetes.io/projected/97f6632a-6791-43b5-ba48-258e292e2434-kube-api-access-lhkfh\") pod \"payload-processing-e2e-shared-b-w2-6bbb53-74c49dfcf5-gsm5r\" (UID: \"97f6632a-6791-43b5-ba48-258e292e2434\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6bbb53-74c49dfcf5-gsm5r"
Sep 06 19:33:19.218620 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:19.218593    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97f6632a-6791-43b5-ba48-258e292e2434-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-6bbb53-74c49dfcf5-gsm5r\" (UID: \"97f6632a-6791-43b5-ba48-258e292e2434\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6bbb53-74c49dfcf5-gsm5r"
Sep 06 19:33:19.229570 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:19.229549    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhkfh\" (UniqueName: \"kubernetes.io/projected/97f6632a-6791-43b5-ba48-258e292e2434-kube-api-access-lhkfh\") pod \"payload-processing-e2e-shared-b-w2-6bbb53-74c49dfcf5-gsm5r\" (UID: \"97f6632a-6791-43b5-ba48-258e292e2434\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6bbb53-74c49dfcf5-gsm5r"
Sep 06 19:33:19.237407 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:19.237343    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6bbb53-74c49dfcf5-gsm5r"
Sep 06 19:33:19.463129 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:19.463103    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6bbb53-5fc99d84cd-jw2n5"]
Sep 06 19:33:19.465105 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:33:19.465077    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod187b375a_a6eb_4b94_b889_23f14f6a42da.slice/crio-28715520e92e59277764c48c3338a6faf0adffca307c69f3af75570bab876f28 WatchSource:0}: Error finding container 28715520e92e59277764c48c3338a6faf0adffca307c69f3af75570bab876f28: Status 404 returned error can't find the container with id 28715520e92e59277764c48c3338a6faf0adffca307c69f3af75570bab876f28
Sep 06 19:33:19.519098 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:19.519000    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-6bbb53-74c49dfcf5-gsm5r"]
Sep 06 19:33:19.521626 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:33:19.521604    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97f6632a_6791_43b5_ba48_258e292e2434.slice/crio-2945f36c6a3d7c414d5c39c4a45372edc88eb86c23543293ab3ba2a81698d088 WatchSource:0}: Error finding container 2945f36c6a3d7c414d5c39c4a45372edc88eb86c23543293ab3ba2a81698d088: Status 404 returned error can't find the container with id 2945f36c6a3d7c414d5c39c4a45372edc88eb86c23543293ab3ba2a81698d088
Sep 06 19:33:19.983601 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:19.983561    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6bbb53-74c49dfcf5-gsm5r" event={"ID":"97f6632a-6791-43b5-ba48-258e292e2434","Type":"ContainerStarted","Data":"88005a6b9105fdccf2f83d256f8ab2911d0f728c5cdc7a27c3b82357e816d7fb"}
Sep 06 19:33:19.984048 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:19.983628    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6bbb53-74c49dfcf5-gsm5r" event={"ID":"97f6632a-6791-43b5-ba48-258e292e2434","Type":"ContainerStarted","Data":"2945f36c6a3d7c414d5c39c4a45372edc88eb86c23543293ab3ba2a81698d088"}
Sep 06 19:33:19.984048 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:19.983654    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6bbb53-74c49dfcf5-gsm5r"
Sep 06 19:33:19.985220 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:19.985193    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6bbb53-5fc99d84cd-jw2n5" event={"ID":"187b375a-a6eb-4b94-b889-23f14f6a42da","Type":"ContainerStarted","Data":"a79447487470ff50f0595ce321a08e3243d3e9190f441475dfc251097f09a8f1"}
Sep 06 19:33:19.985341 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:19.985237    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6bbb53-5fc99d84cd-jw2n5" event={"ID":"187b375a-a6eb-4b94-b889-23f14f6a42da","Type":"ContainerStarted","Data":"28715520e92e59277764c48c3338a6faf0adffca307c69f3af75570bab876f28"}
Sep 06 19:33:19.985341 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:19.985266    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6bbb53-5fc99d84cd-jw2n5"
Sep 06 19:33:19.999381 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:19.999338    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6bbb53-74c49dfcf5-gsm5r" podStartSLOduration=1.999323086 podStartE2EDuration="1.999323086s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:33:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:33:19.99730869 +0000 UTC m=+1346.238194036" watchObservedRunningTime="2026-09-06 19:33:19.999323086 +0000 UTC m=+1346.240208430"
Sep 06 19:33:20.011208 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:20.011157    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6bbb53-5fc99d84cd-jw2n5" podStartSLOduration=2.011139678 podStartE2EDuration="2.011139678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:33:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:33:20.010240558 +0000 UTC m=+1346.251125925" watchObservedRunningTime="2026-09-06 19:33:20.011139678 +0000 UTC m=+1346.252025026"
Sep 06 19:33:30.995814 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:30.995772    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6bbb53-74c49dfcf5-gsm5r"
Sep 06 19:33:30.996426 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:33:30.995892    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6bbb53-5fc99d84cd-jw2n5"
Sep 06 19:34:01.069353 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:01.069314    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-84ba6496-7589f4b89d-9wdtn"]
Sep 06 19:34:01.072258 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:01.072242    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-84ba6496-7589f4b89d-9wdtn"
Sep 06 19:34:01.074482 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:01.074445    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-84ba6496\""
Sep 06 19:34:01.074612 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:01.074509    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-84ba6496-dockercfg-jtj7q\""
Sep 06 19:34:01.082118 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:01.082089    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-84ba6496-7589f4b89d-9wdtn"]
Sep 06 19:34:01.159274 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:01.159245    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54d3733d-be4a-48c1-bb7a-8bd619be36d0-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-84ba6496-7589f4b89d-9wdtn\" (UID: \"54d3733d-be4a-48c1-bb7a-8bd619be36d0\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-84ba6496-7589f4b89d-9wdtn"
Sep 06 19:34:01.159438 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:01.159299    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb8rd\" (UniqueName: \"kubernetes.io/projected/54d3733d-be4a-48c1-bb7a-8bd619be36d0-kube-api-access-hb8rd\") pod \"payload-pre-processing-e2e-mt-84ba6496-7589f4b89d-9wdtn\" (UID: \"54d3733d-be4a-48c1-bb7a-8bd619be36d0\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-84ba6496-7589f4b89d-9wdtn"
Sep 06 19:34:01.260713 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:01.260675    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54d3733d-be4a-48c1-bb7a-8bd619be36d0-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-84ba6496-7589f4b89d-9wdtn\" (UID: \"54d3733d-be4a-48c1-bb7a-8bd619be36d0\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-84ba6496-7589f4b89d-9wdtn"
Sep 06 19:34:01.260895 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:01.260741    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb8rd\" (UniqueName: \"kubernetes.io/projected/54d3733d-be4a-48c1-bb7a-8bd619be36d0-kube-api-access-hb8rd\") pod \"payload-pre-processing-e2e-mt-84ba6496-7589f4b89d-9wdtn\" (UID: \"54d3733d-be4a-48c1-bb7a-8bd619be36d0\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-84ba6496-7589f4b89d-9wdtn"
Sep 06 19:34:01.261600 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:01.261579    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54d3733d-be4a-48c1-bb7a-8bd619be36d0-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-84ba6496-7589f4b89d-9wdtn\" (UID: \"54d3733d-be4a-48c1-bb7a-8bd619be36d0\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-84ba6496-7589f4b89d-9wdtn"
Sep 06 19:34:01.270864 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:01.270836    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb8rd\" (UniqueName: \"kubernetes.io/projected/54d3733d-be4a-48c1-bb7a-8bd619be36d0-kube-api-access-hb8rd\") pod \"payload-pre-processing-e2e-mt-84ba6496-7589f4b89d-9wdtn\" (UID: \"54d3733d-be4a-48c1-bb7a-8bd619be36d0\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-84ba6496-7589f4b89d-9wdtn"
Sep 06 19:34:01.383403 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:01.383328    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-84ba6496-7589f4b89d-9wdtn"
Sep 06 19:34:01.659344 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:01.659263    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-84ba6496-7589f4b89d-9wdtn"]
Sep 06 19:34:01.662596 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:34:01.662565    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54d3733d_be4a_48c1_bb7a_8bd619be36d0.slice/crio-49f5c83f47d0c2e796ff7ee0aa7283b51a7446ab66731795737fb99e5b7dba3b WatchSource:0}: Error finding container 49f5c83f47d0c2e796ff7ee0aa7283b51a7446ab66731795737fb99e5b7dba3b: Status 404 returned error can't find the container with id 49f5c83f47d0c2e796ff7ee0aa7283b51a7446ab66731795737fb99e5b7dba3b
Sep 06 19:34:02.003352 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:02.003310    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-476f98-f6556f69d-99sz8"]
Sep 06 19:34:02.007015 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:02.006990    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-476f98-f6556f69d-99sz8"
Sep 06 19:34:02.009341 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:02.009317    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-476f98-dockercfg-tt6rz\""
Sep 06 19:34:02.009452 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:02.009352    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-476f98\""
Sep 06 19:34:02.018784 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:02.018762    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-476f98-f6556f69d-99sz8"]
Sep 06 19:34:02.037540 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:02.037508    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-476f98-6467cc8b57-smgr8"]
Sep 06 19:34:02.041478 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:02.041448    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-476f98-6467cc8b57-smgr8"
Sep 06 19:34:02.051505 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:02.051479    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-476f98-6467cc8b57-smgr8"]
Sep 06 19:34:02.066681 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:02.066650    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46d7be9d-5bbf-4907-a72b-ba51cbe73842-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-476f98-f6556f69d-99sz8\" (UID: \"46d7be9d-5bbf-4907-a72b-ba51cbe73842\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-476f98-f6556f69d-99sz8"
Sep 06 19:34:02.066833 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:02.066714    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4d92\" (UniqueName: \"kubernetes.io/projected/46d7be9d-5bbf-4907-a72b-ba51cbe73842-kube-api-access-m4d92\") pod \"payload-pre-processing-e2e-shared-b-w3-476f98-f6556f69d-99sz8\" (UID: \"46d7be9d-5bbf-4907-a72b-ba51cbe73842\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-476f98-f6556f69d-99sz8"
Sep 06 19:34:02.167945 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:02.167907    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46d7be9d-5bbf-4907-a72b-ba51cbe73842-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-476f98-f6556f69d-99sz8\" (UID: \"46d7be9d-5bbf-4907-a72b-ba51cbe73842\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-476f98-f6556f69d-99sz8"
Sep 06 19:34:02.168427 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:02.167962    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/caa86d8d-0528-4b26-b34b-039ddbdd9f54-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-476f98-6467cc8b57-smgr8\" (UID: \"caa86d8d-0528-4b26-b34b-039ddbdd9f54\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-476f98-6467cc8b57-smgr8"
Sep 06 19:34:02.168427 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:02.167989    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vzpw\" (UniqueName: \"kubernetes.io/projected/caa86d8d-0528-4b26-b34b-039ddbdd9f54-kube-api-access-5vzpw\") pod \"payload-processing-e2e-shared-b-w3-476f98-6467cc8b57-smgr8\" (UID: \"caa86d8d-0528-4b26-b34b-039ddbdd9f54\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-476f98-6467cc8b57-smgr8"
Sep 06 19:34:02.168427 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:02.168019    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4d92\" (UniqueName: \"kubernetes.io/projected/46d7be9d-5bbf-4907-a72b-ba51cbe73842-kube-api-access-m4d92\") pod \"payload-pre-processing-e2e-shared-b-w3-476f98-f6556f69d-99sz8\" (UID: \"46d7be9d-5bbf-4907-a72b-ba51cbe73842\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-476f98-f6556f69d-99sz8"
Sep 06 19:34:02.168826 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:02.168802    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46d7be9d-5bbf-4907-a72b-ba51cbe73842-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-476f98-f6556f69d-99sz8\" (UID: \"46d7be9d-5bbf-4907-a72b-ba51cbe73842\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-476f98-f6556f69d-99sz8"
Sep 06 19:34:02.174910 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:02.174882    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4d92\" (UniqueName: \"kubernetes.io/projected/46d7be9d-5bbf-4907-a72b-ba51cbe73842-kube-api-access-m4d92\") pod \"payload-pre-processing-e2e-shared-b-w3-476f98-f6556f69d-99sz8\" (UID: \"46d7be9d-5bbf-4907-a72b-ba51cbe73842\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-476f98-f6556f69d-99sz8"
Sep 06 19:34:02.189006 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:02.188971    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-84ba6496-7589f4b89d-9wdtn" event={"ID":"54d3733d-be4a-48c1-bb7a-8bd619be36d0","Type":"ContainerStarted","Data":"4c84496b02cfdacd2013095ab0399ce87557a8b013719405774155f376d3683a"}
Sep 06 19:34:02.189127 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:02.189030    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-84ba6496-7589f4b89d-9wdtn" event={"ID":"54d3733d-be4a-48c1-bb7a-8bd619be36d0","Type":"ContainerStarted","Data":"49f5c83f47d0c2e796ff7ee0aa7283b51a7446ab66731795737fb99e5b7dba3b"}
Sep 06 19:34:02.189199 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:02.189132    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-84ba6496-7589f4b89d-9wdtn"
Sep 06 19:34:02.203205 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:02.203120    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-84ba6496-7589f4b89d-9wdtn" podStartSLOduration=1.203101478 podStartE2EDuration="1.203101478s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:34:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:34:02.202336044 +0000 UTC m=+1388.443221413" watchObservedRunningTime="2026-09-06 19:34:02.203101478 +0000 UTC m=+1388.443986824"
Sep 06 19:34:02.268936 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:02.268835    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/caa86d8d-0528-4b26-b34b-039ddbdd9f54-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-476f98-6467cc8b57-smgr8\" (UID: \"caa86d8d-0528-4b26-b34b-039ddbdd9f54\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-476f98-6467cc8b57-smgr8"
Sep 06 19:34:02.268936 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:02.268900    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vzpw\" (UniqueName: \"kubernetes.io/projected/caa86d8d-0528-4b26-b34b-039ddbdd9f54-kube-api-access-5vzpw\") pod \"payload-processing-e2e-shared-b-w3-476f98-6467cc8b57-smgr8\" (UID: \"caa86d8d-0528-4b26-b34b-039ddbdd9f54\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-476f98-6467cc8b57-smgr8"
Sep 06 19:34:02.269618 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:02.269597    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/caa86d8d-0528-4b26-b34b-039ddbdd9f54-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-476f98-6467cc8b57-smgr8\" (UID: \"caa86d8d-0528-4b26-b34b-039ddbdd9f54\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-476f98-6467cc8b57-smgr8"
Sep 06 19:34:02.276252 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:02.276225    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vzpw\" (UniqueName: \"kubernetes.io/projected/caa86d8d-0528-4b26-b34b-039ddbdd9f54-kube-api-access-5vzpw\") pod \"payload-processing-e2e-shared-b-w3-476f98-6467cc8b57-smgr8\" (UID: \"caa86d8d-0528-4b26-b34b-039ddbdd9f54\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-476f98-6467cc8b57-smgr8"
Sep 06 19:34:02.319273 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:02.319233    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-476f98-f6556f69d-99sz8"
Sep 06 19:34:02.352129 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:02.352095    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-476f98-6467cc8b57-smgr8"
Sep 06 19:34:02.600246 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:02.600221    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-476f98-f6556f69d-99sz8"]
Sep 06 19:34:02.601317 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:34:02.601286    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46d7be9d_5bbf_4907_a72b_ba51cbe73842.slice/crio-2df32d94656093f1ec443303de0a1ff3bf525b942d671e78c9b69dbdae4f06ad WatchSource:0}: Error finding container 2df32d94656093f1ec443303de0a1ff3bf525b942d671e78c9b69dbdae4f06ad: Status 404 returned error can't find the container with id 2df32d94656093f1ec443303de0a1ff3bf525b942d671e78c9b69dbdae4f06ad
Sep 06 19:34:02.640778 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:02.640696    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-476f98-6467cc8b57-smgr8"]
Sep 06 19:34:02.646589 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:34:02.646565    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaa86d8d_0528_4b26_b34b_039ddbdd9f54.slice/crio-ffcd64740b7d54bebac41d13251f565d83a574b1a5e3fcaacc71fa5170ccf449 WatchSource:0}: Error finding container ffcd64740b7d54bebac41d13251f565d83a574b1a5e3fcaacc71fa5170ccf449: Status 404 returned error can't find the container with id ffcd64740b7d54bebac41d13251f565d83a574b1a5e3fcaacc71fa5170ccf449
Sep 06 19:34:03.196605 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:03.196569    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-476f98-6467cc8b57-smgr8" event={"ID":"caa86d8d-0528-4b26-b34b-039ddbdd9f54","Type":"ContainerStarted","Data":"0f539ab847b9f17b6de3353bc7bf176e7ccec379c2bda990362a06ddf6e22f81"}
Sep 06 19:34:03.197152 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:03.197117    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-476f98-6467cc8b57-smgr8" event={"ID":"caa86d8d-0528-4b26-b34b-039ddbdd9f54","Type":"ContainerStarted","Data":"ffcd64740b7d54bebac41d13251f565d83a574b1a5e3fcaacc71fa5170ccf449"}
Sep 06 19:34:03.197264 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:03.197157    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-476f98-6467cc8b57-smgr8"
Sep 06 19:34:03.198381 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:03.198354    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-476f98-f6556f69d-99sz8" event={"ID":"46d7be9d-5bbf-4907-a72b-ba51cbe73842","Type":"ContainerStarted","Data":"127b6cf875f13a5ec395f8bf8c0f0cb804201b1e857df58899dc69c58bf0369a"}
Sep 06 19:34:03.198627 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:03.198603    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-476f98-f6556f69d-99sz8"
Sep 06 19:34:03.198722 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:03.198665    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-476f98-f6556f69d-99sz8" event={"ID":"46d7be9d-5bbf-4907-a72b-ba51cbe73842","Type":"ContainerStarted","Data":"2df32d94656093f1ec443303de0a1ff3bf525b942d671e78c9b69dbdae4f06ad"}
Sep 06 19:34:03.212413 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:03.212360    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-476f98-6467cc8b57-smgr8" podStartSLOduration=1.212340076 podStartE2EDuration="1.212340076s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:34:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:34:03.210853941 +0000 UTC m=+1389.451739318" watchObservedRunningTime="2026-09-06 19:34:03.212340076 +0000 UTC m=+1389.453225422"
Sep 06 19:34:03.228109 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:03.228063    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-476f98-f6556f69d-99sz8" podStartSLOduration=2.228049059 podStartE2EDuration="2.228049059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:34:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:34:03.225550264 +0000 UTC m=+1389.466435634" watchObservedRunningTime="2026-09-06 19:34:03.228049059 +0000 UTC m=+1389.468934403"
Sep 06 19:34:13.201098 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:13.201064    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-84ba6496-7589f4b89d-9wdtn"
Sep 06 19:34:14.207103 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:14.207074    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-476f98-6467cc8b57-smgr8"
Sep 06 19:34:14.207571 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:34:14.207146    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-476f98-f6556f69d-99sz8"
Sep 06 19:35:24.092283 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:35:24.092235    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-84ba6496-7589f4b89d-9wdtn"]
Sep 06 19:35:24.092860 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:35:24.092547    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-84ba6496-7589f4b89d-9wdtn" podUID="54d3733d-be4a-48c1-bb7a-8bd619be36d0" containerName="payload-pre-processing" containerID="cri-o://4c84496b02cfdacd2013095ab0399ce87557a8b013719405774155f376d3683a" gracePeriod=30
Sep 06 19:35:24.335772 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:35:24.335748    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-84ba6496-7589f4b89d-9wdtn"
Sep 06 19:35:24.455351 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:35:24.455267    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54d3733d-be4a-48c1-bb7a-8bd619be36d0-plugins-config-volume\") pod \"54d3733d-be4a-48c1-bb7a-8bd619be36d0\" (UID: \"54d3733d-be4a-48c1-bb7a-8bd619be36d0\") "
Sep 06 19:35:24.455539 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:35:24.455370    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hb8rd\" (UniqueName: \"kubernetes.io/projected/54d3733d-be4a-48c1-bb7a-8bd619be36d0-kube-api-access-hb8rd\") pod \"54d3733d-be4a-48c1-bb7a-8bd619be36d0\" (UID: \"54d3733d-be4a-48c1-bb7a-8bd619be36d0\") "
Sep 06 19:35:24.455709 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:35:24.455684    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54d3733d-be4a-48c1-bb7a-8bd619be36d0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "54d3733d-be4a-48c1-bb7a-8bd619be36d0" (UID: "54d3733d-be4a-48c1-bb7a-8bd619be36d0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:35:24.457380 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:35:24.457357    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54d3733d-be4a-48c1-bb7a-8bd619be36d0-kube-api-access-hb8rd" (OuterVolumeSpecName: "kube-api-access-hb8rd") pod "54d3733d-be4a-48c1-bb7a-8bd619be36d0" (UID: "54d3733d-be4a-48c1-bb7a-8bd619be36d0"). InnerVolumeSpecName "kube-api-access-hb8rd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:35:24.555886 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:35:24.555837    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hb8rd\" (UniqueName: \"kubernetes.io/projected/54d3733d-be4a-48c1-bb7a-8bd619be36d0-kube-api-access-hb8rd\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:35:24.555886 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:35:24.555882    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54d3733d-be4a-48c1-bb7a-8bd619be36d0-plugins-config-volume\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:35:24.587303 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:35:24.587272    2577 generic.go:356] "Generic (PLEG): container finished" podID="54d3733d-be4a-48c1-bb7a-8bd619be36d0" containerID="4c84496b02cfdacd2013095ab0399ce87557a8b013719405774155f376d3683a" exitCode=0
Sep 06 19:35:24.587405 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:35:24.587310    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-84ba6496-7589f4b89d-9wdtn"
Sep 06 19:35:24.587405 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:35:24.587355    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-84ba6496-7589f4b89d-9wdtn" event={"ID":"54d3733d-be4a-48c1-bb7a-8bd619be36d0","Type":"ContainerDied","Data":"4c84496b02cfdacd2013095ab0399ce87557a8b013719405774155f376d3683a"}
Sep 06 19:35:24.587524 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:35:24.587407    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-84ba6496-7589f4b89d-9wdtn" event={"ID":"54d3733d-be4a-48c1-bb7a-8bd619be36d0","Type":"ContainerDied","Data":"49f5c83f47d0c2e796ff7ee0aa7283b51a7446ab66731795737fb99e5b7dba3b"}
Sep 06 19:35:24.587524 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:35:24.587431    2577 scope.go:117] "RemoveContainer" containerID="4c84496b02cfdacd2013095ab0399ce87557a8b013719405774155f376d3683a"
Sep 06 19:35:24.600057 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:35:24.600001    2577 scope.go:117] "RemoveContainer" containerID="4c84496b02cfdacd2013095ab0399ce87557a8b013719405774155f376d3683a"
Sep 06 19:35:24.600486 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:35:24.600441    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c84496b02cfdacd2013095ab0399ce87557a8b013719405774155f376d3683a\": container with ID starting with 4c84496b02cfdacd2013095ab0399ce87557a8b013719405774155f376d3683a not found: ID does not exist" containerID="4c84496b02cfdacd2013095ab0399ce87557a8b013719405774155f376d3683a"
Sep 06 19:35:24.600589 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:35:24.600550    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c84496b02cfdacd2013095ab0399ce87557a8b013719405774155f376d3683a"} err="failed to get container status \"4c84496b02cfdacd2013095ab0399ce87557a8b013719405774155f376d3683a\": rpc error: code = NotFound desc = could not find container \"4c84496b02cfdacd2013095ab0399ce87557a8b013719405774155f376d3683a\": container with ID starting with 4c84496b02cfdacd2013095ab0399ce87557a8b013719405774155f376d3683a not found: ID does not exist"
Sep 06 19:35:24.609366 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:35:24.609347    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-84ba6496-7589f4b89d-9wdtn"]
Sep 06 19:35:24.612941 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:35:24.612921    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-84ba6496-7589f4b89d-9wdtn"]
Sep 06 19:35:26.388792 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:35:26.388754    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54d3733d-be4a-48c1-bb7a-8bd619be36d0" path="/var/lib/kubelet/pods/54d3733d-be4a-48c1-bb7a-8bd619be36d0/volumes"
Sep 06 19:37:13.355087 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:37:13.355008    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-c31435-7967764d69-w6chv"]
Sep 06 19:37:13.355455 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:37:13.355416    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54d3733d-be4a-48c1-bb7a-8bd619be36d0" containerName="payload-pre-processing"
Sep 06 19:37:13.355455 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:37:13.355428    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="54d3733d-be4a-48c1-bb7a-8bd619be36d0" containerName="payload-pre-processing"
Sep 06 19:37:13.355583 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:37:13.355528    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="54d3733d-be4a-48c1-bb7a-8bd619be36d0" containerName="payload-pre-processing"
Sep 06 19:37:13.358766 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:37:13.358749    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-c31435-7967764d69-w6chv"
Sep 06 19:37:13.360796 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:37:13.360759    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/871c7a60-1e97-43ec-9a84-5e5ab07f43c0-plugins-config-volume\") pod \"payload-processing-e2e-api-a-c31435-7967764d69-w6chv\" (UID: \"871c7a60-1e97-43ec-9a84-5e5ab07f43c0\") " pod="openshift-ingress/payload-processing-e2e-api-a-c31435-7967764d69-w6chv"
Sep 06 19:37:13.360796 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:37:13.360792    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmqff\" (UniqueName: \"kubernetes.io/projected/871c7a60-1e97-43ec-9a84-5e5ab07f43c0-kube-api-access-bmqff\") pod \"payload-processing-e2e-api-a-c31435-7967764d69-w6chv\" (UID: \"871c7a60-1e97-43ec-9a84-5e5ab07f43c0\") " pod="openshift-ingress/payload-processing-e2e-api-a-c31435-7967764d69-w6chv"
Sep 06 19:37:13.360962 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:37:13.360830    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-c31435-dockercfg-7cnvr\""
Sep 06 19:37:13.361090 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:37:13.361077    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-c31435\""
Sep 06 19:37:13.368587 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:37:13.368567    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-c31435-7967764d69-w6chv"]
Sep 06 19:37:13.461790 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:37:13.461757    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/871c7a60-1e97-43ec-9a84-5e5ab07f43c0-plugins-config-volume\") pod \"payload-processing-e2e-api-a-c31435-7967764d69-w6chv\" (UID: \"871c7a60-1e97-43ec-9a84-5e5ab07f43c0\") " pod="openshift-ingress/payload-processing-e2e-api-a-c31435-7967764d69-w6chv"
Sep 06 19:37:13.461965 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:37:13.461799    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmqff\" (UniqueName: \"kubernetes.io/projected/871c7a60-1e97-43ec-9a84-5e5ab07f43c0-kube-api-access-bmqff\") pod \"payload-processing-e2e-api-a-c31435-7967764d69-w6chv\" (UID: \"871c7a60-1e97-43ec-9a84-5e5ab07f43c0\") " pod="openshift-ingress/payload-processing-e2e-api-a-c31435-7967764d69-w6chv"
Sep 06 19:37:13.462418 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:37:13.462395    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/871c7a60-1e97-43ec-9a84-5e5ab07f43c0-plugins-config-volume\") pod \"payload-processing-e2e-api-a-c31435-7967764d69-w6chv\" (UID: \"871c7a60-1e97-43ec-9a84-5e5ab07f43c0\") " pod="openshift-ingress/payload-processing-e2e-api-a-c31435-7967764d69-w6chv"
Sep 06 19:37:13.469148 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:37:13.469105    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmqff\" (UniqueName: \"kubernetes.io/projected/871c7a60-1e97-43ec-9a84-5e5ab07f43c0-kube-api-access-bmqff\") pod \"payload-processing-e2e-api-a-c31435-7967764d69-w6chv\" (UID: \"871c7a60-1e97-43ec-9a84-5e5ab07f43c0\") " pod="openshift-ingress/payload-processing-e2e-api-a-c31435-7967764d69-w6chv"
Sep 06 19:37:13.669857 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:37:13.669775    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-c31435-7967764d69-w6chv"
Sep 06 19:37:13.940120 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:37:13.940094    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-c31435-7967764d69-w6chv"]
Sep 06 19:37:13.942060 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:37:13.942026    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod871c7a60_1e97_43ec_9a84_5e5ab07f43c0.slice/crio-566bdde19264a4574cb28eeb6c85dd0cd5be5e98720ee48b1a41b7a25d03b0df WatchSource:0}: Error finding container 566bdde19264a4574cb28eeb6c85dd0cd5be5e98720ee48b1a41b7a25d03b0df: Status 404 returned error can't find the container with id 566bdde19264a4574cb28eeb6c85dd0cd5be5e98720ee48b1a41b7a25d03b0df
Sep 06 19:37:14.099509 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:37:14.099460    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-c31435-7967764d69-w6chv" event={"ID":"871c7a60-1e97-43ec-9a84-5e5ab07f43c0","Type":"ContainerStarted","Data":"743735d887b62180a0a8fca0fb13009ea2ad1ada4cbefd6b9b736be69b1248b9"}
Sep 06 19:37:14.099679 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:37:14.099534    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-c31435-7967764d69-w6chv" event={"ID":"871c7a60-1e97-43ec-9a84-5e5ab07f43c0","Type":"ContainerStarted","Data":"566bdde19264a4574cb28eeb6c85dd0cd5be5e98720ee48b1a41b7a25d03b0df"}
Sep 06 19:37:14.099679 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:37:14.099561    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-c31435-7967764d69-w6chv"
Sep 06 19:37:14.115000 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:37:14.114956    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-c31435-7967764d69-w6chv" podStartSLOduration=1.114943443 podStartE2EDuration="1.114943443s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:37:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:37:14.113264999 +0000 UTC m=+1580.354150368" watchObservedRunningTime="2026-09-06 19:37:14.114943443 +0000 UTC m=+1580.355828786"
Sep 06 19:37:25.106459 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:37:25.106424    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-c31435-7967764d69-w6chv"
Sep 06 19:37:42.549658 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:37:42.549620    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-49a2d2-7fb8fc4b9c-lqdf8"]
Sep 06 19:37:42.552965 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:37:42.552933    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-49a2d2-7fb8fc4b9c-lqdf8"
Sep 06 19:37:42.555656 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:37:42.555632    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-49a2d2\""
Sep 06 19:37:42.555796 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:37:42.555771    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-49a2d2-dockercfg-ff5fc\""
Sep 06 19:37:42.568205 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:37:42.568170    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-49a2d2-7fb8fc4b9c-lqdf8"]
Sep 06 19:37:42.614196 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:37:42.614157    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8jlh\" (UniqueName: \"kubernetes.io/projected/cac72eaf-90f8-487d-a201-f4535f67d985-kube-api-access-g8jlh\") pod \"payload-processing-e2e-api-b-49a2d2-7fb8fc4b9c-lqdf8\" (UID: \"cac72eaf-90f8-487d-a201-f4535f67d985\") " pod="openshift-ingress/payload-processing-e2e-api-b-49a2d2-7fb8fc4b9c-lqdf8"
Sep 06 19:37:42.614400 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:37:42.614233    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cac72eaf-90f8-487d-a201-f4535f67d985-plugins-config-volume\") pod \"payload-processing-e2e-api-b-49a2d2-7fb8fc4b9c-lqdf8\" (UID: \"cac72eaf-90f8-487d-a201-f4535f67d985\") " pod="openshift-ingress/payload-processing-e2e-api-b-49a2d2-7fb8fc4b9c-lqdf8"
Sep 06 19:37:42.714911 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:37:42.714874    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8jlh\" (UniqueName: \"kubernetes.io/projected/cac72eaf-90f8-487d-a201-f4535f67d985-kube-api-access-g8jlh\") pod \"payload-processing-e2e-api-b-49a2d2-7fb8fc4b9c-lqdf8\" (UID: \"cac72eaf-90f8-487d-a201-f4535f67d985\") " pod="openshift-ingress/payload-processing-e2e-api-b-49a2d2-7fb8fc4b9c-lqdf8"
Sep 06 19:37:42.715087 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:37:42.714934    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cac72eaf-90f8-487d-a201-f4535f67d985-plugins-config-volume\") pod \"payload-processing-e2e-api-b-49a2d2-7fb8fc4b9c-lqdf8\" (UID: \"cac72eaf-90f8-487d-a201-f4535f67d985\") " pod="openshift-ingress/payload-processing-e2e-api-b-49a2d2-7fb8fc4b9c-lqdf8"
Sep 06 19:37:42.715638 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:37:42.715618    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cac72eaf-90f8-487d-a201-f4535f67d985-plugins-config-volume\") pod \"payload-processing-e2e-api-b-49a2d2-7fb8fc4b9c-lqdf8\" (UID: \"cac72eaf-90f8-487d-a201-f4535f67d985\") " pod="openshift-ingress/payload-processing-e2e-api-b-49a2d2-7fb8fc4b9c-lqdf8"
Sep 06 19:37:42.722595 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:37:42.722571    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8jlh\" (UniqueName: \"kubernetes.io/projected/cac72eaf-90f8-487d-a201-f4535f67d985-kube-api-access-g8jlh\") pod \"payload-processing-e2e-api-b-49a2d2-7fb8fc4b9c-lqdf8\" (UID: \"cac72eaf-90f8-487d-a201-f4535f67d985\") " pod="openshift-ingress/payload-processing-e2e-api-b-49a2d2-7fb8fc4b9c-lqdf8"
Sep 06 19:37:42.864609 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:37:42.864508    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-49a2d2-7fb8fc4b9c-lqdf8"
Sep 06 19:37:43.134743 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:37:43.134716    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-49a2d2-7fb8fc4b9c-lqdf8"]
Sep 06 19:37:43.136990 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:37:43.136963    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcac72eaf_90f8_487d_a201_f4535f67d985.slice/crio-1c8a464f86a9b4aaf48b84a78df6307ab4cb86c0b0b8c7e8753a425671d60e30 WatchSource:0}: Error finding container 1c8a464f86a9b4aaf48b84a78df6307ab4cb86c0b0b8c7e8753a425671d60e30: Status 404 returned error can't find the container with id 1c8a464f86a9b4aaf48b84a78df6307ab4cb86c0b0b8c7e8753a425671d60e30
Sep 06 19:37:43.242462 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:37:43.242427    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-49a2d2-7fb8fc4b9c-lqdf8" event={"ID":"cac72eaf-90f8-487d-a201-f4535f67d985","Type":"ContainerStarted","Data":"1ee65b98671184f17fda5049490418c9065d40a29afcb3f73be1c7dd43358884"}
Sep 06 19:37:43.242640 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:37:43.242517    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-49a2d2-7fb8fc4b9c-lqdf8" event={"ID":"cac72eaf-90f8-487d-a201-f4535f67d985","Type":"ContainerStarted","Data":"1c8a464f86a9b4aaf48b84a78df6307ab4cb86c0b0b8c7e8753a425671d60e30"}
Sep 06 19:37:43.242640 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:37:43.242550    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-49a2d2-7fb8fc4b9c-lqdf8"
Sep 06 19:37:43.257654 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:37:43.257598    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-49a2d2-7fb8fc4b9c-lqdf8" podStartSLOduration=1.257581672 podStartE2EDuration="1.257581672s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:37:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:37:43.25579963 +0000 UTC m=+1609.496684994" watchObservedRunningTime="2026-09-06 19:37:43.257581672 +0000 UTC m=+1609.498467038"
Sep 06 19:37:54.251537 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:37:54.251431    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-49a2d2-7fb8fc4b9c-lqdf8"
Sep 06 19:38:24.330911 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:38:24.330876    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-c31435-7967764d69-w6chv"]
Sep 06 19:38:24.331359 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:38:24.331120    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-c31435-7967764d69-w6chv" podUID="871c7a60-1e97-43ec-9a84-5e5ab07f43c0" containerName="payload-processing" containerID="cri-o://743735d887b62180a0a8fca0fb13009ea2ad1ada4cbefd6b9b736be69b1248b9" gracePeriod=30
Sep 06 19:38:24.462376 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:38:24.462345    2577 generic.go:356] "Generic (PLEG): container finished" podID="871c7a60-1e97-43ec-9a84-5e5ab07f43c0" containerID="743735d887b62180a0a8fca0fb13009ea2ad1ada4cbefd6b9b736be69b1248b9" exitCode=0
Sep 06 19:38:24.462515 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:38:24.462414    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-c31435-7967764d69-w6chv" event={"ID":"871c7a60-1e97-43ec-9a84-5e5ab07f43c0","Type":"ContainerDied","Data":"743735d887b62180a0a8fca0fb13009ea2ad1ada4cbefd6b9b736be69b1248b9"}
Sep 06 19:38:24.589944 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:38:24.589870    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-c31435-7967764d69-w6chv"
Sep 06 19:38:24.680205 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:38:24.680175    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/871c7a60-1e97-43ec-9a84-5e5ab07f43c0-plugins-config-volume\") pod \"871c7a60-1e97-43ec-9a84-5e5ab07f43c0\" (UID: \"871c7a60-1e97-43ec-9a84-5e5ab07f43c0\") "
Sep 06 19:38:24.680399 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:38:24.680226    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmqff\" (UniqueName: \"kubernetes.io/projected/871c7a60-1e97-43ec-9a84-5e5ab07f43c0-kube-api-access-bmqff\") pod \"871c7a60-1e97-43ec-9a84-5e5ab07f43c0\" (UID: \"871c7a60-1e97-43ec-9a84-5e5ab07f43c0\") "
Sep 06 19:38:24.680629 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:38:24.680604    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/871c7a60-1e97-43ec-9a84-5e5ab07f43c0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "871c7a60-1e97-43ec-9a84-5e5ab07f43c0" (UID: "871c7a60-1e97-43ec-9a84-5e5ab07f43c0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:38:24.682241 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:38:24.682219    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/871c7a60-1e97-43ec-9a84-5e5ab07f43c0-kube-api-access-bmqff" (OuterVolumeSpecName: "kube-api-access-bmqff") pod "871c7a60-1e97-43ec-9a84-5e5ab07f43c0" (UID: "871c7a60-1e97-43ec-9a84-5e5ab07f43c0"). InnerVolumeSpecName "kube-api-access-bmqff". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:38:24.780804 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:38:24.780778    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/871c7a60-1e97-43ec-9a84-5e5ab07f43c0-plugins-config-volume\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:38:24.780804 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:38:24.780802    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmqff\" (UniqueName: \"kubernetes.io/projected/871c7a60-1e97-43ec-9a84-5e5ab07f43c0-kube-api-access-bmqff\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:38:25.468654 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:38:25.468621    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-c31435-7967764d69-w6chv"
Sep 06 19:38:25.469155 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:38:25.468659    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-c31435-7967764d69-w6chv" event={"ID":"871c7a60-1e97-43ec-9a84-5e5ab07f43c0","Type":"ContainerDied","Data":"566bdde19264a4574cb28eeb6c85dd0cd5be5e98720ee48b1a41b7a25d03b0df"}
Sep 06 19:38:25.469155 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:38:25.468716    2577 scope.go:117] "RemoveContainer" containerID="743735d887b62180a0a8fca0fb13009ea2ad1ada4cbefd6b9b736be69b1248b9"
Sep 06 19:38:25.490078 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:38:25.490053    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-c31435-7967764d69-w6chv"]
Sep 06 19:38:25.493591 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:38:25.493568    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-c31435-7967764d69-w6chv"]
Sep 06 19:38:26.388565 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:38:26.388537    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="871c7a60-1e97-43ec-9a84-5e5ab07f43c0" path="/var/lib/kubelet/pods/871c7a60-1e97-43ec-9a84-5e5ab07f43c0/volumes"
Sep 06 19:38:46.314005 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:38:46.313958    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-49a2d2-7fb8fc4b9c-lqdf8"]
Sep 06 19:38:46.314561 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:38:46.314216    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-49a2d2-7fb8fc4b9c-lqdf8" podUID="cac72eaf-90f8-487d-a201-f4535f67d985" containerName="payload-processing" containerID="cri-o://1ee65b98671184f17fda5049490418c9065d40a29afcb3f73be1c7dd43358884" gracePeriod=30
Sep 06 19:38:46.570347 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:38:46.570256    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-49a2d2-7fb8fc4b9c-lqdf8"
Sep 06 19:38:46.573775 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:38:46.573751    2577 generic.go:356] "Generic (PLEG): container finished" podID="cac72eaf-90f8-487d-a201-f4535f67d985" containerID="1ee65b98671184f17fda5049490418c9065d40a29afcb3f73be1c7dd43358884" exitCode=0
Sep 06 19:38:46.573878 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:38:46.573775    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-49a2d2-7fb8fc4b9c-lqdf8"
Sep 06 19:38:46.573878 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:38:46.573825    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-49a2d2-7fb8fc4b9c-lqdf8" event={"ID":"cac72eaf-90f8-487d-a201-f4535f67d985","Type":"ContainerDied","Data":"1ee65b98671184f17fda5049490418c9065d40a29afcb3f73be1c7dd43358884"}
Sep 06 19:38:46.573878 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:38:46.573873    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-49a2d2-7fb8fc4b9c-lqdf8" event={"ID":"cac72eaf-90f8-487d-a201-f4535f67d985","Type":"ContainerDied","Data":"1c8a464f86a9b4aaf48b84a78df6307ab4cb86c0b0b8c7e8753a425671d60e30"}
Sep 06 19:38:46.573984 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:38:46.573900    2577 scope.go:117] "RemoveContainer" containerID="1ee65b98671184f17fda5049490418c9065d40a29afcb3f73be1c7dd43358884"
Sep 06 19:38:46.584317 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:38:46.584290    2577 scope.go:117] "RemoveContainer" containerID="1ee65b98671184f17fda5049490418c9065d40a29afcb3f73be1c7dd43358884"
Sep 06 19:38:46.584709 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:38:46.584683    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ee65b98671184f17fda5049490418c9065d40a29afcb3f73be1c7dd43358884\": container with ID starting with 1ee65b98671184f17fda5049490418c9065d40a29afcb3f73be1c7dd43358884 not found: ID does not exist" containerID="1ee65b98671184f17fda5049490418c9065d40a29afcb3f73be1c7dd43358884"
Sep 06 19:38:46.584829 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:38:46.584722    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ee65b98671184f17fda5049490418c9065d40a29afcb3f73be1c7dd43358884"} err="failed to get container status \"1ee65b98671184f17fda5049490418c9065d40a29afcb3f73be1c7dd43358884\": rpc error: code = NotFound desc = could not find container \"1ee65b98671184f17fda5049490418c9065d40a29afcb3f73be1c7dd43358884\": container with ID starting with 1ee65b98671184f17fda5049490418c9065d40a29afcb3f73be1c7dd43358884 not found: ID does not exist"
Sep 06 19:38:46.659988 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:38:46.659962    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8jlh\" (UniqueName: \"kubernetes.io/projected/cac72eaf-90f8-487d-a201-f4535f67d985-kube-api-access-g8jlh\") pod \"cac72eaf-90f8-487d-a201-f4535f67d985\" (UID: \"cac72eaf-90f8-487d-a201-f4535f67d985\") "
Sep 06 19:38:46.660102 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:38:46.660015    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cac72eaf-90f8-487d-a201-f4535f67d985-plugins-config-volume\") pod \"cac72eaf-90f8-487d-a201-f4535f67d985\" (UID: \"cac72eaf-90f8-487d-a201-f4535f67d985\") "
Sep 06 19:38:46.660392 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:38:46.660367    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cac72eaf-90f8-487d-a201-f4535f67d985-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cac72eaf-90f8-487d-a201-f4535f67d985" (UID: "cac72eaf-90f8-487d-a201-f4535f67d985"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:38:46.661963 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:38:46.661936    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cac72eaf-90f8-487d-a201-f4535f67d985-kube-api-access-g8jlh" (OuterVolumeSpecName: "kube-api-access-g8jlh") pod "cac72eaf-90f8-487d-a201-f4535f67d985" (UID: "cac72eaf-90f8-487d-a201-f4535f67d985"). InnerVolumeSpecName "kube-api-access-g8jlh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:38:46.761606 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:38:46.761571    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8jlh\" (UniqueName: \"kubernetes.io/projected/cac72eaf-90f8-487d-a201-f4535f67d985-kube-api-access-g8jlh\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:38:46.761747 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:38:46.761627    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cac72eaf-90f8-487d-a201-f4535f67d985-plugins-config-volume\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:38:46.893817 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:38:46.893788    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-49a2d2-7fb8fc4b9c-lqdf8"]
Sep 06 19:38:46.897321 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:38:46.897298    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-49a2d2-7fb8fc4b9c-lqdf8"]
Sep 06 19:38:48.388311 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:38:48.388277    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cac72eaf-90f8-487d-a201-f4535f67d985" path="/var/lib/kubelet/pods/cac72eaf-90f8-487d-a201-f4535f67d985/volumes"
Sep 06 19:39:03.793218 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:03.793182    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz"]
Sep 06 19:39:03.793833 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:03.793487    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz" podUID="8b4b8a67-d6e3-4870-acef-183aac8448f9" containerName="maas-api" containerID="cri-o://4475d5415499008b8ce6962ef0201b7b7cc4fc078d4d18b9e5051f1426692fdd" gracePeriod=30
Sep 06 19:39:03.846621 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:03.845767    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-cf729a-5f47779989-mffbw"]
Sep 06 19:39:03.846621 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:03.846030    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-cf729a-5f47779989-mffbw" podUID="683fbaba-fa90-4d95-a4a3-689def10d0a3" containerName="payload-processing" containerID="cri-o://f926fb27b8ce7552f54c754c9dff3eddff3db37bf27af36804457e8f8c149c97" gracePeriod=30
Sep 06 19:39:03.857067 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:03.857040    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cf729a-5d7f68b5f4-kpvkq"]
Sep 06 19:39:03.857696 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:03.857648    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cf729a-5d7f68b5f4-kpvkq" podUID="c09a5888-976c-4d7d-99ef-1f6999df8aa0" containerName="payload-pre-processing" containerID="cri-o://427465b434f20895074145826c45f6fd39759c7bded367a6b8eafe83e1ed3d0b" gracePeriod=30
Sep 06 19:39:04.109854 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.109687    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz"
Sep 06 19:39:04.132342 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.132312    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-cf729a-5f47779989-mffbw"
Sep 06 19:39:04.157184 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.157164    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cf729a-5d7f68b5f4-kpvkq"
Sep 06 19:39:04.307162 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.307077    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c09a5888-976c-4d7d-99ef-1f6999df8aa0-plugins-config-volume\") pod \"c09a5888-976c-4d7d-99ef-1f6999df8aa0\" (UID: \"c09a5888-976c-4d7d-99ef-1f6999df8aa0\") "
Sep 06 19:39:04.307162 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.307117    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d77bc\" (UniqueName: \"kubernetes.io/projected/c09a5888-976c-4d7d-99ef-1f6999df8aa0-kube-api-access-d77bc\") pod \"c09a5888-976c-4d7d-99ef-1f6999df8aa0\" (UID: \"c09a5888-976c-4d7d-99ef-1f6999df8aa0\") "
Sep 06 19:39:04.307162 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.307144    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/683fbaba-fa90-4d95-a4a3-689def10d0a3-plugins-config-volume\") pod \"683fbaba-fa90-4d95-a4a3-689def10d0a3\" (UID: \"683fbaba-fa90-4d95-a4a3-689def10d0a3\") "
Sep 06 19:39:04.307444 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.307187    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b4b8a67-d6e3-4870-acef-183aac8448f9-metrics-certs\") pod \"8b4b8a67-d6e3-4870-acef-183aac8448f9\" (UID: \"8b4b8a67-d6e3-4870-acef-183aac8448f9\") "
Sep 06 19:39:04.307444 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.307204    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b4b8a67-d6e3-4870-acef-183aac8448f9-maas-api-tls\") pod \"8b4b8a67-d6e3-4870-acef-183aac8448f9\" (UID: \"8b4b8a67-d6e3-4870-acef-183aac8448f9\") "
Sep 06 19:39:04.307444 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.307243    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b4b8a67-d6e3-4870-acef-183aac8448f9-openshift-service-ca\") pod \"8b4b8a67-d6e3-4870-acef-183aac8448f9\" (UID: \"8b4b8a67-d6e3-4870-acef-183aac8448f9\") "
Sep 06 19:39:04.307444 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.307266    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-br4x7\" (UniqueName: \"kubernetes.io/projected/683fbaba-fa90-4d95-a4a3-689def10d0a3-kube-api-access-br4x7\") pod \"683fbaba-fa90-4d95-a4a3-689def10d0a3\" (UID: \"683fbaba-fa90-4d95-a4a3-689def10d0a3\") "
Sep 06 19:39:04.307444 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.307319    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjvfk\" (UniqueName: \"kubernetes.io/projected/8b4b8a67-d6e3-4870-acef-183aac8448f9-kube-api-access-rjvfk\") pod \"8b4b8a67-d6e3-4870-acef-183aac8448f9\" (UID: \"8b4b8a67-d6e3-4870-acef-183aac8448f9\") "
Sep 06 19:39:04.307741 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.307614    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c09a5888-976c-4d7d-99ef-1f6999df8aa0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c09a5888-976c-4d7d-99ef-1f6999df8aa0" (UID: "c09a5888-976c-4d7d-99ef-1f6999df8aa0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:39:04.307741 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.307636    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b4b8a67-d6e3-4870-acef-183aac8448f9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8b4b8a67-d6e3-4870-acef-183aac8448f9" (UID: "8b4b8a67-d6e3-4870-acef-183aac8448f9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:39:04.308005 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.307939    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/683fbaba-fa90-4d95-a4a3-689def10d0a3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "683fbaba-fa90-4d95-a4a3-689def10d0a3" (UID: "683fbaba-fa90-4d95-a4a3-689def10d0a3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:39:04.309407 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.309379    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c09a5888-976c-4d7d-99ef-1f6999df8aa0-kube-api-access-d77bc" (OuterVolumeSpecName: "kube-api-access-d77bc") pod "c09a5888-976c-4d7d-99ef-1f6999df8aa0" (UID: "c09a5888-976c-4d7d-99ef-1f6999df8aa0"). InnerVolumeSpecName "kube-api-access-d77bc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:39:04.309715 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.309687    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b4b8a67-d6e3-4870-acef-183aac8448f9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8b4b8a67-d6e3-4870-acef-183aac8448f9" (UID: "8b4b8a67-d6e3-4870-acef-183aac8448f9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:39:04.309873 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.309847    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/683fbaba-fa90-4d95-a4a3-689def10d0a3-kube-api-access-br4x7" (OuterVolumeSpecName: "kube-api-access-br4x7") pod "683fbaba-fa90-4d95-a4a3-689def10d0a3" (UID: "683fbaba-fa90-4d95-a4a3-689def10d0a3"). InnerVolumeSpecName "kube-api-access-br4x7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:39:04.310052 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.310018    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b4b8a67-d6e3-4870-acef-183aac8448f9-kube-api-access-rjvfk" (OuterVolumeSpecName: "kube-api-access-rjvfk") pod "8b4b8a67-d6e3-4870-acef-183aac8448f9" (UID: "8b4b8a67-d6e3-4870-acef-183aac8448f9"). InnerVolumeSpecName "kube-api-access-rjvfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:39:04.310139 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.310113    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b4b8a67-d6e3-4870-acef-183aac8448f9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8b4b8a67-d6e3-4870-acef-183aac8448f9" (UID: "8b4b8a67-d6e3-4870-acef-183aac8448f9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:39:04.408869 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.408840    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b4b8a67-d6e3-4870-acef-183aac8448f9-metrics-certs\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:39:04.408869 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.408870    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b4b8a67-d6e3-4870-acef-183aac8448f9-maas-api-tls\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:39:04.408997 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.408880    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b4b8a67-d6e3-4870-acef-183aac8448f9-openshift-service-ca\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:39:04.408997 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.408890    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-br4x7\" (UniqueName: \"kubernetes.io/projected/683fbaba-fa90-4d95-a4a3-689def10d0a3-kube-api-access-br4x7\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:39:04.408997 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.408898    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjvfk\" (UniqueName: \"kubernetes.io/projected/8b4b8a67-d6e3-4870-acef-183aac8448f9-kube-api-access-rjvfk\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:39:04.408997 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.408907    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c09a5888-976c-4d7d-99ef-1f6999df8aa0-plugins-config-volume\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:39:04.408997 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.408916    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d77bc\" (UniqueName: \"kubernetes.io/projected/c09a5888-976c-4d7d-99ef-1f6999df8aa0-kube-api-access-d77bc\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:39:04.408997 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.408924    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/683fbaba-fa90-4d95-a4a3-689def10d0a3-plugins-config-volume\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:39:04.670714 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.670632    2577 generic.go:356] "Generic (PLEG): container finished" podID="c09a5888-976c-4d7d-99ef-1f6999df8aa0" containerID="427465b434f20895074145826c45f6fd39759c7bded367a6b8eafe83e1ed3d0b" exitCode=0
Sep 06 19:39:04.670714 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.670673    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cf729a-5d7f68b5f4-kpvkq"
Sep 06 19:39:04.670888 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.670722    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cf729a-5d7f68b5f4-kpvkq" event={"ID":"c09a5888-976c-4d7d-99ef-1f6999df8aa0","Type":"ContainerDied","Data":"427465b434f20895074145826c45f6fd39759c7bded367a6b8eafe83e1ed3d0b"}
Sep 06 19:39:04.670888 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.670776    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cf729a-5d7f68b5f4-kpvkq" event={"ID":"c09a5888-976c-4d7d-99ef-1f6999df8aa0","Type":"ContainerDied","Data":"b9dfb36f71ea9f6956850b1263a73897e412182f7bf048e33d5dd386ca003d1a"}
Sep 06 19:39:04.670888 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.670795    2577 scope.go:117] "RemoveContainer" containerID="427465b434f20895074145826c45f6fd39759c7bded367a6b8eafe83e1ed3d0b"
Sep 06 19:39:04.672228 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.672204    2577 generic.go:356] "Generic (PLEG): container finished" podID="8b4b8a67-d6e3-4870-acef-183aac8448f9" containerID="4475d5415499008b8ce6962ef0201b7b7cc4fc078d4d18b9e5051f1426692fdd" exitCode=0
Sep 06 19:39:04.672350 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.672234    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz" event={"ID":"8b4b8a67-d6e3-4870-acef-183aac8448f9","Type":"ContainerDied","Data":"4475d5415499008b8ce6962ef0201b7b7cc4fc078d4d18b9e5051f1426692fdd"}
Sep 06 19:39:04.672350 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.672257    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz"
Sep 06 19:39:04.672350 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.672282    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz" event={"ID":"8b4b8a67-d6e3-4870-acef-183aac8448f9","Type":"ContainerDied","Data":"bb870b3c3e5fc81caf1845aeff2b5eb81c73bb2f110d9bcce1f52d2bc2e84e90"}
Sep 06 19:39:04.674101 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.674073    2577 generic.go:356] "Generic (PLEG): container finished" podID="683fbaba-fa90-4d95-a4a3-689def10d0a3" containerID="f926fb27b8ce7552f54c754c9dff3eddff3db37bf27af36804457e8f8c149c97" exitCode=0
Sep 06 19:39:04.674284 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.674122    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-cf729a-5f47779989-mffbw"
Sep 06 19:39:04.674284 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.674152    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-cf729a-5f47779989-mffbw" event={"ID":"683fbaba-fa90-4d95-a4a3-689def10d0a3","Type":"ContainerDied","Data":"f926fb27b8ce7552f54c754c9dff3eddff3db37bf27af36804457e8f8c149c97"}
Sep 06 19:39:04.674284 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.674191    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-cf729a-5f47779989-mffbw" event={"ID":"683fbaba-fa90-4d95-a4a3-689def10d0a3","Type":"ContainerDied","Data":"1648eb29c232eda53e64cc82a4bb9e2a69bc8da040ca2437309317260ee09fa3"}
Sep 06 19:39:04.680309 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.680295    2577 scope.go:117] "RemoveContainer" containerID="427465b434f20895074145826c45f6fd39759c7bded367a6b8eafe83e1ed3d0b"
Sep 06 19:39:04.680619 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:39:04.680602    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"427465b434f20895074145826c45f6fd39759c7bded367a6b8eafe83e1ed3d0b\": container with ID starting with 427465b434f20895074145826c45f6fd39759c7bded367a6b8eafe83e1ed3d0b not found: ID does not exist" containerID="427465b434f20895074145826c45f6fd39759c7bded367a6b8eafe83e1ed3d0b"
Sep 06 19:39:04.680682 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.680625    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"427465b434f20895074145826c45f6fd39759c7bded367a6b8eafe83e1ed3d0b"} err="failed to get container status \"427465b434f20895074145826c45f6fd39759c7bded367a6b8eafe83e1ed3d0b\": rpc error: code = NotFound desc = could not find container \"427465b434f20895074145826c45f6fd39759c7bded367a6b8eafe83e1ed3d0b\": container with ID starting with 427465b434f20895074145826c45f6fd39759c7bded367a6b8eafe83e1ed3d0b not found: ID does not exist"
Sep 06 19:39:04.680682 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.680643    2577 scope.go:117] "RemoveContainer" containerID="4475d5415499008b8ce6962ef0201b7b7cc4fc078d4d18b9e5051f1426692fdd"
Sep 06 19:39:04.687863 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.687845    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cf729a-5d7f68b5f4-kpvkq"]
Sep 06 19:39:04.688566 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.688551    2577 scope.go:117] "RemoveContainer" containerID="4475d5415499008b8ce6962ef0201b7b7cc4fc078d4d18b9e5051f1426692fdd"
Sep 06 19:39:04.688891 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:39:04.688847    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4475d5415499008b8ce6962ef0201b7b7cc4fc078d4d18b9e5051f1426692fdd\": container with ID starting with 4475d5415499008b8ce6962ef0201b7b7cc4fc078d4d18b9e5051f1426692fdd not found: ID does not exist" containerID="4475d5415499008b8ce6962ef0201b7b7cc4fc078d4d18b9e5051f1426692fdd"
Sep 06 19:39:04.688891 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.688882    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4475d5415499008b8ce6962ef0201b7b7cc4fc078d4d18b9e5051f1426692fdd"} err="failed to get container status \"4475d5415499008b8ce6962ef0201b7b7cc4fc078d4d18b9e5051f1426692fdd\": rpc error: code = NotFound desc = could not find container \"4475d5415499008b8ce6962ef0201b7b7cc4fc078d4d18b9e5051f1426692fdd\": container with ID starting with 4475d5415499008b8ce6962ef0201b7b7cc4fc078d4d18b9e5051f1426692fdd not found: ID does not exist"
Sep 06 19:39:04.689044 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.688902    2577 scope.go:117] "RemoveContainer" containerID="f926fb27b8ce7552f54c754c9dff3eddff3db37bf27af36804457e8f8c149c97"
Sep 06 19:39:04.691298 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.691278    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cf729a-5d7f68b5f4-kpvkq"]
Sep 06 19:39:04.696747 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.696725    2577 scope.go:117] "RemoveContainer" containerID="f926fb27b8ce7552f54c754c9dff3eddff3db37bf27af36804457e8f8c149c97"
Sep 06 19:39:04.697036 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:39:04.697017    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f926fb27b8ce7552f54c754c9dff3eddff3db37bf27af36804457e8f8c149c97\": container with ID starting with f926fb27b8ce7552f54c754c9dff3eddff3db37bf27af36804457e8f8c149c97 not found: ID does not exist" containerID="f926fb27b8ce7552f54c754c9dff3eddff3db37bf27af36804457e8f8c149c97"
Sep 06 19:39:04.697098 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.697041    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f926fb27b8ce7552f54c754c9dff3eddff3db37bf27af36804457e8f8c149c97"} err="failed to get container status \"f926fb27b8ce7552f54c754c9dff3eddff3db37bf27af36804457e8f8c149c97\": rpc error: code = NotFound desc = could not find container \"f926fb27b8ce7552f54c754c9dff3eddff3db37bf27af36804457e8f8c149c97\": container with ID starting with f926fb27b8ce7552f54c754c9dff3eddff3db37bf27af36804457e8f8c149c97 not found: ID does not exist"
Sep 06 19:39:04.703719 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.703698    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-cf729a-5f47779989-mffbw"]
Sep 06 19:39:04.708546 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.708527    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-cf729a-5f47779989-mffbw"]
Sep 06 19:39:04.717201 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.717179    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz"]
Sep 06 19:39:04.720028 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:04.720007    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-cf729a-6d9cd77587-zccbz"]
Sep 06 19:39:06.389304 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:06.389262    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="683fbaba-fa90-4d95-a4a3-689def10d0a3" path="/var/lib/kubelet/pods/683fbaba-fa90-4d95-a4a3-689def10d0a3/volumes"
Sep 06 19:39:06.389832 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:06.389808    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b4b8a67-d6e3-4870-acef-183aac8448f9" path="/var/lib/kubelet/pods/8b4b8a67-d6e3-4870-acef-183aac8448f9/volumes"
Sep 06 19:39:06.390189 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:06.390169    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c09a5888-976c-4d7d-99ef-1f6999df8aa0" path="/var/lib/kubelet/pods/c09a5888-976c-4d7d-99ef-1f6999df8aa0/volumes"
Sep 06 19:39:20.898706 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:20.898614    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-6bbb53-74c49dfcf5-gsm5r"]
Sep 06 19:39:20.899345 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:20.898919    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6bbb53-74c49dfcf5-gsm5r" podUID="97f6632a-6791-43b5-ba48-258e292e2434" containerName="payload-processing" containerID="cri-o://88005a6b9105fdccf2f83d256f8ab2911d0f728c5cdc7a27c3b82357e816d7fb" gracePeriod=30
Sep 06 19:39:20.901753 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:20.901725    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6bbb53-5fc99d84cd-jw2n5"]
Sep 06 19:39:20.901966 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:20.901928    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6bbb53-5fc99d84cd-jw2n5" podUID="187b375a-a6eb-4b94-b889-23f14f6a42da" containerName="payload-pre-processing" containerID="cri-o://a79447487470ff50f0595ce321a08e3243d3e9190f441475dfc251097f09a8f1" gracePeriod=30
Sep 06 19:39:20.994407 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:20.994371    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6bbb53-74c49dfcf5-gsm5r" podUID="97f6632a-6791-43b5-ba48-258e292e2434" containerName="payload-processing" probeResult="failure" output="dial tcp 10.132.0.56:9004: connect: connection refused"
Sep 06 19:39:20.994571 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:20.994372    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6bbb53-5fc99d84cd-jw2n5" podUID="187b375a-a6eb-4b94-b889-23f14f6a42da" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.55:9004: connect: connection refused"
Sep 06 19:39:21.176262 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:21.176237    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6bbb53-5fc99d84cd-jw2n5"
Sep 06 19:39:21.179255 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:21.179237    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6bbb53-74c49dfcf5-gsm5r"
Sep 06 19:39:21.242984 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:21.242953    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhkfh\" (UniqueName: \"kubernetes.io/projected/97f6632a-6791-43b5-ba48-258e292e2434-kube-api-access-lhkfh\") pod \"97f6632a-6791-43b5-ba48-258e292e2434\" (UID: \"97f6632a-6791-43b5-ba48-258e292e2434\") "
Sep 06 19:39:21.242984 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:21.242986    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqtsg\" (UniqueName: \"kubernetes.io/projected/187b375a-a6eb-4b94-b889-23f14f6a42da-kube-api-access-gqtsg\") pod \"187b375a-a6eb-4b94-b889-23f14f6a42da\" (UID: \"187b375a-a6eb-4b94-b889-23f14f6a42da\") "
Sep 06 19:39:21.243156 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:21.243010    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/187b375a-a6eb-4b94-b889-23f14f6a42da-plugins-config-volume\") pod \"187b375a-a6eb-4b94-b889-23f14f6a42da\" (UID: \"187b375a-a6eb-4b94-b889-23f14f6a42da\") "
Sep 06 19:39:21.243156 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:21.243081    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97f6632a-6791-43b5-ba48-258e292e2434-plugins-config-volume\") pod \"97f6632a-6791-43b5-ba48-258e292e2434\" (UID: \"97f6632a-6791-43b5-ba48-258e292e2434\") "
Sep 06 19:39:21.243438 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:21.243411    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/187b375a-a6eb-4b94-b889-23f14f6a42da-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "187b375a-a6eb-4b94-b889-23f14f6a42da" (UID: "187b375a-a6eb-4b94-b889-23f14f6a42da"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:39:21.243582 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:21.243450    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97f6632a-6791-43b5-ba48-258e292e2434-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "97f6632a-6791-43b5-ba48-258e292e2434" (UID: "97f6632a-6791-43b5-ba48-258e292e2434"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:39:21.245003 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:21.244976    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97f6632a-6791-43b5-ba48-258e292e2434-kube-api-access-lhkfh" (OuterVolumeSpecName: "kube-api-access-lhkfh") pod "97f6632a-6791-43b5-ba48-258e292e2434" (UID: "97f6632a-6791-43b5-ba48-258e292e2434"). InnerVolumeSpecName "kube-api-access-lhkfh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:39:21.245079 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:21.245006    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/187b375a-a6eb-4b94-b889-23f14f6a42da-kube-api-access-gqtsg" (OuterVolumeSpecName: "kube-api-access-gqtsg") pod "187b375a-a6eb-4b94-b889-23f14f6a42da" (UID: "187b375a-a6eb-4b94-b889-23f14f6a42da"). InnerVolumeSpecName "kube-api-access-gqtsg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:39:21.343712 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:21.343688    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97f6632a-6791-43b5-ba48-258e292e2434-plugins-config-volume\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:39:21.343712 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:21.343709    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhkfh\" (UniqueName: \"kubernetes.io/projected/97f6632a-6791-43b5-ba48-258e292e2434-kube-api-access-lhkfh\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:39:21.343849 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:21.343719    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqtsg\" (UniqueName: \"kubernetes.io/projected/187b375a-a6eb-4b94-b889-23f14f6a42da-kube-api-access-gqtsg\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:39:21.343849 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:21.343727    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/187b375a-a6eb-4b94-b889-23f14f6a42da-plugins-config-volume\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:39:21.765943 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:21.765910    2577 generic.go:356] "Generic (PLEG): container finished" podID="97f6632a-6791-43b5-ba48-258e292e2434" containerID="88005a6b9105fdccf2f83d256f8ab2911d0f728c5cdc7a27c3b82357e816d7fb" exitCode=0
Sep 06 19:39:21.766125 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:21.766002    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6bbb53-74c49dfcf5-gsm5r"
Sep 06 19:39:21.766125 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:21.766008    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6bbb53-74c49dfcf5-gsm5r" event={"ID":"97f6632a-6791-43b5-ba48-258e292e2434","Type":"ContainerDied","Data":"88005a6b9105fdccf2f83d256f8ab2911d0f728c5cdc7a27c3b82357e816d7fb"}
Sep 06 19:39:21.766125 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:21.766069    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6bbb53-74c49dfcf5-gsm5r" event={"ID":"97f6632a-6791-43b5-ba48-258e292e2434","Type":"ContainerDied","Data":"2945f36c6a3d7c414d5c39c4a45372edc88eb86c23543293ab3ba2a81698d088"}
Sep 06 19:39:21.766125 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:21.766088    2577 scope.go:117] "RemoveContainer" containerID="88005a6b9105fdccf2f83d256f8ab2911d0f728c5cdc7a27c3b82357e816d7fb"
Sep 06 19:39:21.767545 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:21.767519    2577 generic.go:356] "Generic (PLEG): container finished" podID="187b375a-a6eb-4b94-b889-23f14f6a42da" containerID="a79447487470ff50f0595ce321a08e3243d3e9190f441475dfc251097f09a8f1" exitCode=0
Sep 06 19:39:21.767655 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:21.767557    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6bbb53-5fc99d84cd-jw2n5" event={"ID":"187b375a-a6eb-4b94-b889-23f14f6a42da","Type":"ContainerDied","Data":"a79447487470ff50f0595ce321a08e3243d3e9190f441475dfc251097f09a8f1"}
Sep 06 19:39:21.767655 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:21.767597    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6bbb53-5fc99d84cd-jw2n5"
Sep 06 19:39:21.767655 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:21.767609    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6bbb53-5fc99d84cd-jw2n5" event={"ID":"187b375a-a6eb-4b94-b889-23f14f6a42da","Type":"ContainerDied","Data":"28715520e92e59277764c48c3338a6faf0adffca307c69f3af75570bab876f28"}
Sep 06 19:39:21.774928 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:21.774905    2577 scope.go:117] "RemoveContainer" containerID="88005a6b9105fdccf2f83d256f8ab2911d0f728c5cdc7a27c3b82357e816d7fb"
Sep 06 19:39:21.775207 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:39:21.775183    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88005a6b9105fdccf2f83d256f8ab2911d0f728c5cdc7a27c3b82357e816d7fb\": container with ID starting with 88005a6b9105fdccf2f83d256f8ab2911d0f728c5cdc7a27c3b82357e816d7fb not found: ID does not exist" containerID="88005a6b9105fdccf2f83d256f8ab2911d0f728c5cdc7a27c3b82357e816d7fb"
Sep 06 19:39:21.775303 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:21.775213    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88005a6b9105fdccf2f83d256f8ab2911d0f728c5cdc7a27c3b82357e816d7fb"} err="failed to get container status \"88005a6b9105fdccf2f83d256f8ab2911d0f728c5cdc7a27c3b82357e816d7fb\": rpc error: code = NotFound desc = could not find container \"88005a6b9105fdccf2f83d256f8ab2911d0f728c5cdc7a27c3b82357e816d7fb\": container with ID starting with 88005a6b9105fdccf2f83d256f8ab2911d0f728c5cdc7a27c3b82357e816d7fb not found: ID does not exist"
Sep 06 19:39:21.775303 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:21.775230    2577 scope.go:117] "RemoveContainer" containerID="a79447487470ff50f0595ce321a08e3243d3e9190f441475dfc251097f09a8f1"
Sep 06 19:39:21.783210 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:21.783191    2577 scope.go:117] "RemoveContainer" containerID="a79447487470ff50f0595ce321a08e3243d3e9190f441475dfc251097f09a8f1"
Sep 06 19:39:21.783448 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:39:21.783430    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a79447487470ff50f0595ce321a08e3243d3e9190f441475dfc251097f09a8f1\": container with ID starting with a79447487470ff50f0595ce321a08e3243d3e9190f441475dfc251097f09a8f1 not found: ID does not exist" containerID="a79447487470ff50f0595ce321a08e3243d3e9190f441475dfc251097f09a8f1"
Sep 06 19:39:21.783568 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:21.783456    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a79447487470ff50f0595ce321a08e3243d3e9190f441475dfc251097f09a8f1"} err="failed to get container status \"a79447487470ff50f0595ce321a08e3243d3e9190f441475dfc251097f09a8f1\": rpc error: code = NotFound desc = could not find container \"a79447487470ff50f0595ce321a08e3243d3e9190f441475dfc251097f09a8f1\": container with ID starting with a79447487470ff50f0595ce321a08e3243d3e9190f441475dfc251097f09a8f1 not found: ID does not exist"
Sep 06 19:39:21.790287 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:21.790268    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6bbb53-5fc99d84cd-jw2n5"]
Sep 06 19:39:21.793674 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:21.793656    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6bbb53-5fc99d84cd-jw2n5"]
Sep 06 19:39:21.804554 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:21.804532    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-6bbb53-74c49dfcf5-gsm5r"]
Sep 06 19:39:21.809646 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:21.809622    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-6bbb53-74c49dfcf5-gsm5r"]
Sep 06 19:39:22.387796 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:22.387766    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="187b375a-a6eb-4b94-b889-23f14f6a42da" path="/var/lib/kubelet/pods/187b375a-a6eb-4b94-b889-23f14f6a42da/volumes"
Sep 06 19:39:22.388165 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:39:22.388110    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97f6632a-6791-43b5-ba48-258e292e2434" path="/var/lib/kubelet/pods/97f6632a-6791-43b5-ba48-258e292e2434/volumes"
Sep 06 19:40:12.847701 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:12.847666    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv"]
Sep 06 19:40:12.848185 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:12.848048    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97f6632a-6791-43b5-ba48-258e292e2434" containerName="payload-processing"
Sep 06 19:40:12.848185 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:12.848061    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="97f6632a-6791-43b5-ba48-258e292e2434" containerName="payload-processing"
Sep 06 19:40:12.848185 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:12.848079    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b4b8a67-d6e3-4870-acef-183aac8448f9" containerName="maas-api"
Sep 06 19:40:12.848185 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:12.848085    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b4b8a67-d6e3-4870-acef-183aac8448f9" containerName="maas-api"
Sep 06 19:40:12.848185 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:12.848103    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="871c7a60-1e97-43ec-9a84-5e5ab07f43c0" containerName="payload-processing"
Sep 06 19:40:12.848185 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:12.848111    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="871c7a60-1e97-43ec-9a84-5e5ab07f43c0" containerName="payload-processing"
Sep 06 19:40:12.848185 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:12.848117    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cac72eaf-90f8-487d-a201-f4535f67d985" containerName="payload-processing"
Sep 06 19:40:12.848185 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:12.848123    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cac72eaf-90f8-487d-a201-f4535f67d985" containerName="payload-processing"
Sep 06 19:40:12.848185 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:12.848130    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c09a5888-976c-4d7d-99ef-1f6999df8aa0" containerName="payload-pre-processing"
Sep 06 19:40:12.848185 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:12.848136    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c09a5888-976c-4d7d-99ef-1f6999df8aa0" containerName="payload-pre-processing"
Sep 06 19:40:12.848185 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:12.848145    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="683fbaba-fa90-4d95-a4a3-689def10d0a3" containerName="payload-processing"
Sep 06 19:40:12.848185 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:12.848150    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="683fbaba-fa90-4d95-a4a3-689def10d0a3" containerName="payload-processing"
Sep 06 19:40:12.848185 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:12.848159    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="187b375a-a6eb-4b94-b889-23f14f6a42da" containerName="payload-pre-processing"
Sep 06 19:40:12.848185 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:12.848164    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="187b375a-a6eb-4b94-b889-23f14f6a42da" containerName="payload-pre-processing"
Sep 06 19:40:12.848878 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:12.848227    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c09a5888-976c-4d7d-99ef-1f6999df8aa0" containerName="payload-pre-processing"
Sep 06 19:40:12.848878 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:12.848235    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b4b8a67-d6e3-4870-acef-183aac8448f9" containerName="maas-api"
Sep 06 19:40:12.848878 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:12.848243    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="683fbaba-fa90-4d95-a4a3-689def10d0a3" containerName="payload-processing"
Sep 06 19:40:12.848878 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:12.848250    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="871c7a60-1e97-43ec-9a84-5e5ab07f43c0" containerName="payload-processing"
Sep 06 19:40:12.848878 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:12.848259    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cac72eaf-90f8-487d-a201-f4535f67d985" containerName="payload-processing"
Sep 06 19:40:12.848878 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:12.848269    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="187b375a-a6eb-4b94-b889-23f14f6a42da" containerName="payload-pre-processing"
Sep 06 19:40:12.848878 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:12.848275    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="97f6632a-6791-43b5-ba48-258e292e2434" containerName="payload-processing"
Sep 06 19:40:12.851284 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:12.851261    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv"
Sep 06 19:40:12.854672 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:12.854648    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-410f4d-serving-cert\""
Sep 06 19:40:12.862567 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:12.861314    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv"]
Sep 06 19:40:12.945775 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:12.945741    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4fd352a-14b3-4e2f-8c59-78fa908732a3-maas-api-tls\") pod \"maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv\" (UID: \"b4fd352a-14b3-4e2f-8c59-78fa908732a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv"
Sep 06 19:40:12.945915 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:12.945788    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4fd352a-14b3-4e2f-8c59-78fa908732a3-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv\" (UID: \"b4fd352a-14b3-4e2f-8c59-78fa908732a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv"
Sep 06 19:40:12.945915 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:12.945868    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4fd352a-14b3-4e2f-8c59-78fa908732a3-metrics-certs\") pod \"maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv\" (UID: \"b4fd352a-14b3-4e2f-8c59-78fa908732a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv"
Sep 06 19:40:12.945915 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:12.945897    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtxdl\" (UniqueName: \"kubernetes.io/projected/b4fd352a-14b3-4e2f-8c59-78fa908732a3-kube-api-access-rtxdl\") pod \"maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv\" (UID: \"b4fd352a-14b3-4e2f-8c59-78fa908732a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv"
Sep 06 19:40:13.046608 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:13.046581    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4fd352a-14b3-4e2f-8c59-78fa908732a3-metrics-certs\") pod \"maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv\" (UID: \"b4fd352a-14b3-4e2f-8c59-78fa908732a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv"
Sep 06 19:40:13.046724 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:13.046614    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtxdl\" (UniqueName: \"kubernetes.io/projected/b4fd352a-14b3-4e2f-8c59-78fa908732a3-kube-api-access-rtxdl\") pod \"maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv\" (UID: \"b4fd352a-14b3-4e2f-8c59-78fa908732a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv"
Sep 06 19:40:13.046765 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:13.046747    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4fd352a-14b3-4e2f-8c59-78fa908732a3-maas-api-tls\") pod \"maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv\" (UID: \"b4fd352a-14b3-4e2f-8c59-78fa908732a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv"
Sep 06 19:40:13.046807 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:13.046796    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4fd352a-14b3-4e2f-8c59-78fa908732a3-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv\" (UID: \"b4fd352a-14b3-4e2f-8c59-78fa908732a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv"
Sep 06 19:40:13.046893 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:40:13.046873    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-410f4d-serving-cert: secret "maas-api-e2e-ipp-a-410f4d-serving-cert" not found
Sep 06 19:40:13.046945 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:40:13.046936    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4fd352a-14b3-4e2f-8c59-78fa908732a3-maas-api-tls podName:b4fd352a-14b3-4e2f-8c59-78fa908732a3 nodeName:}" failed. No retries permitted until 2026-09-06 19:40:13.546918401 +0000 UTC m=+1759.787803729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b4fd352a-14b3-4e2f-8c59-78fa908732a3-maas-api-tls") pod "maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv" (UID: "b4fd352a-14b3-4e2f-8c59-78fa908732a3") : secret "maas-api-e2e-ipp-a-410f4d-serving-cert" not found
Sep 06 19:40:13.047361 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:13.047343    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4fd352a-14b3-4e2f-8c59-78fa908732a3-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv\" (UID: \"b4fd352a-14b3-4e2f-8c59-78fa908732a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv"
Sep 06 19:40:13.049090 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:13.049067    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4fd352a-14b3-4e2f-8c59-78fa908732a3-metrics-certs\") pod \"maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv\" (UID: \"b4fd352a-14b3-4e2f-8c59-78fa908732a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv"
Sep 06 19:40:13.055241 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:13.055216    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtxdl\" (UniqueName: \"kubernetes.io/projected/b4fd352a-14b3-4e2f-8c59-78fa908732a3-kube-api-access-rtxdl\") pod \"maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv\" (UID: \"b4fd352a-14b3-4e2f-8c59-78fa908732a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv"
Sep 06 19:40:13.452438 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:13.452403    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-410f4d-7949b4ddf4-6vhgn"]
Sep 06 19:40:13.455888 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:13.455873    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-410f4d-7949b4ddf4-6vhgn"
Sep 06 19:40:13.458962 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:13.458941    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-410f4d-dockercfg-4v272\""
Sep 06 19:40:13.459076 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:13.458965    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-410f4d\""
Sep 06 19:40:13.467718 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:13.467696    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-410f4d-7949b4ddf4-6vhgn"]
Sep 06 19:40:13.486543 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:13.486520    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-410f4d-569cc778d7-l6m7r"]
Sep 06 19:40:13.489663 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:13.489647    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-410f4d-569cc778d7-l6m7r"
Sep 06 19:40:13.498093 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:13.498031    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-410f4d-569cc778d7-l6m7r"]
Sep 06 19:40:13.550425 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:13.550396    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4fd352a-14b3-4e2f-8c59-78fa908732a3-maas-api-tls\") pod \"maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv\" (UID: \"b4fd352a-14b3-4e2f-8c59-78fa908732a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv"
Sep 06 19:40:13.550587 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:13.550507    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x45f\" (UniqueName: \"kubernetes.io/projected/038e5b86-a0dd-4a74-8242-0b3910990fe9-kube-api-access-7x45f\") pod \"payload-pre-processing-e2e-ipp-a-410f4d-7949b4ddf4-6vhgn\" (UID: \"038e5b86-a0dd-4a74-8242-0b3910990fe9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-410f4d-7949b4ddf4-6vhgn"
Sep 06 19:40:13.550587 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:13.550547    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/038e5b86-a0dd-4a74-8242-0b3910990fe9-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-410f4d-7949b4ddf4-6vhgn\" (UID: \"038e5b86-a0dd-4a74-8242-0b3910990fe9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-410f4d-7949b4ddf4-6vhgn"
Sep 06 19:40:13.550707 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:13.550623    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2443b2ff-b35a-4e6d-9ffa-2b1273d35bac-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-410f4d-569cc778d7-l6m7r\" (UID: \"2443b2ff-b35a-4e6d-9ffa-2b1273d35bac\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-410f4d-569cc778d7-l6m7r"
Sep 06 19:40:13.550771 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:13.550713    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnmgn\" (UniqueName: \"kubernetes.io/projected/2443b2ff-b35a-4e6d-9ffa-2b1273d35bac-kube-api-access-mnmgn\") pod \"payload-processing-e2e-ipp-a-410f4d-569cc778d7-l6m7r\" (UID: \"2443b2ff-b35a-4e6d-9ffa-2b1273d35bac\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-410f4d-569cc778d7-l6m7r"
Sep 06 19:40:13.552871 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:13.552848    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4fd352a-14b3-4e2f-8c59-78fa908732a3-maas-api-tls\") pod \"maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv\" (UID: \"b4fd352a-14b3-4e2f-8c59-78fa908732a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv"
Sep 06 19:40:13.651067 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:13.651034    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x45f\" (UniqueName: \"kubernetes.io/projected/038e5b86-a0dd-4a74-8242-0b3910990fe9-kube-api-access-7x45f\") pod \"payload-pre-processing-e2e-ipp-a-410f4d-7949b4ddf4-6vhgn\" (UID: \"038e5b86-a0dd-4a74-8242-0b3910990fe9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-410f4d-7949b4ddf4-6vhgn"
Sep 06 19:40:13.651067 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:13.651069    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/038e5b86-a0dd-4a74-8242-0b3910990fe9-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-410f4d-7949b4ddf4-6vhgn\" (UID: \"038e5b86-a0dd-4a74-8242-0b3910990fe9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-410f4d-7949b4ddf4-6vhgn"
Sep 06 19:40:13.651306 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:13.651283    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2443b2ff-b35a-4e6d-9ffa-2b1273d35bac-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-410f4d-569cc778d7-l6m7r\" (UID: \"2443b2ff-b35a-4e6d-9ffa-2b1273d35bac\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-410f4d-569cc778d7-l6m7r"
Sep 06 19:40:13.651398 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:13.651385    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnmgn\" (UniqueName: \"kubernetes.io/projected/2443b2ff-b35a-4e6d-9ffa-2b1273d35bac-kube-api-access-mnmgn\") pod \"payload-processing-e2e-ipp-a-410f4d-569cc778d7-l6m7r\" (UID: \"2443b2ff-b35a-4e6d-9ffa-2b1273d35bac\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-410f4d-569cc778d7-l6m7r"
Sep 06 19:40:13.651776 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:13.651760    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/038e5b86-a0dd-4a74-8242-0b3910990fe9-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-410f4d-7949b4ddf4-6vhgn\" (UID: \"038e5b86-a0dd-4a74-8242-0b3910990fe9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-410f4d-7949b4ddf4-6vhgn"
Sep 06 19:40:13.652038 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:13.652021    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2443b2ff-b35a-4e6d-9ffa-2b1273d35bac-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-410f4d-569cc778d7-l6m7r\" (UID: \"2443b2ff-b35a-4e6d-9ffa-2b1273d35bac\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-410f4d-569cc778d7-l6m7r"
Sep 06 19:40:13.658057 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:13.658036    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x45f\" (UniqueName: \"kubernetes.io/projected/038e5b86-a0dd-4a74-8242-0b3910990fe9-kube-api-access-7x45f\") pod \"payload-pre-processing-e2e-ipp-a-410f4d-7949b4ddf4-6vhgn\" (UID: \"038e5b86-a0dd-4a74-8242-0b3910990fe9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-410f4d-7949b4ddf4-6vhgn"
Sep 06 19:40:13.658321 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:13.658304    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnmgn\" (UniqueName: \"kubernetes.io/projected/2443b2ff-b35a-4e6d-9ffa-2b1273d35bac-kube-api-access-mnmgn\") pod \"payload-processing-e2e-ipp-a-410f4d-569cc778d7-l6m7r\" (UID: \"2443b2ff-b35a-4e6d-9ffa-2b1273d35bac\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-410f4d-569cc778d7-l6m7r"
Sep 06 19:40:13.766435 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:13.766401    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-410f4d-7949b4ddf4-6vhgn"
Sep 06 19:40:13.766603 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:13.766451    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv"
Sep 06 19:40:13.800594 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:13.800558    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-410f4d-569cc778d7-l6m7r"
Sep 06 19:40:14.055590 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:14.055563    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv"]
Sep 06 19:40:14.056687 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:40:14.056662    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4fd352a_14b3_4e2f_8c59_78fa908732a3.slice/crio-8db35fdda7311cf18ff750d54bb68767d9f1591a6f264b5a08558e0e12b8920b WatchSource:0}: Error finding container 8db35fdda7311cf18ff750d54bb68767d9f1591a6f264b5a08558e0e12b8920b: Status 404 returned error can't find the container with id 8db35fdda7311cf18ff750d54bb68767d9f1591a6f264b5a08558e0e12b8920b
Sep 06 19:40:14.058067 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:14.058047    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 19:40:14.058267 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:14.058243    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-410f4d-7949b4ddf4-6vhgn"]
Sep 06 19:40:14.058354 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:40:14.058289    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod038e5b86_a0dd_4a74_8242_0b3910990fe9.slice/crio-1fa21814471f723c9e69266c0eeb6cc9cdae114fd4127b907bf226b8a4eecc3d WatchSource:0}: Error finding container 1fa21814471f723c9e69266c0eeb6cc9cdae114fd4127b907bf226b8a4eecc3d: Status 404 returned error can't find the container with id 1fa21814471f723c9e69266c0eeb6cc9cdae114fd4127b907bf226b8a4eecc3d
Sep 06 19:40:14.086212 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:14.086177    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-410f4d-569cc778d7-l6m7r"]
Sep 06 19:40:14.093513 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:40:14.093488    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2443b2ff_b35a_4e6d_9ffa_2b1273d35bac.slice/crio-01e80a167c765baee4a1e29f2e3dc8660a2fe0d5ab8012ab9b335d79d36fe13e WatchSource:0}: Error finding container 01e80a167c765baee4a1e29f2e3dc8660a2fe0d5ab8012ab9b335d79d36fe13e: Status 404 returned error can't find the container with id 01e80a167c765baee4a1e29f2e3dc8660a2fe0d5ab8012ab9b335d79d36fe13e
Sep 06 19:40:15.017893 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:15.017849    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-410f4d-7949b4ddf4-6vhgn" event={"ID":"038e5b86-a0dd-4a74-8242-0b3910990fe9","Type":"ContainerStarted","Data":"9d4c4a6258c5f806e39f37adfc6924084067f38f551cbf23c7c67110bf50ae38"}
Sep 06 19:40:15.018095 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:15.018057    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-410f4d-7949b4ddf4-6vhgn"
Sep 06 19:40:15.018166 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:15.018096    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-410f4d-7949b4ddf4-6vhgn" event={"ID":"038e5b86-a0dd-4a74-8242-0b3910990fe9","Type":"ContainerStarted","Data":"1fa21814471f723c9e69266c0eeb6cc9cdae114fd4127b907bf226b8a4eecc3d"}
Sep 06 19:40:15.019462 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:15.019426    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv" event={"ID":"b4fd352a-14b3-4e2f-8c59-78fa908732a3","Type":"ContainerStarted","Data":"9e8e32f2f0e588e7ceb2bb3230fbec593c8579b65604cf4f7fc9104f5e5f7c43"}
Sep 06 19:40:15.019617 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:15.019499    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv" event={"ID":"b4fd352a-14b3-4e2f-8c59-78fa908732a3","Type":"ContainerStarted","Data":"8db35fdda7311cf18ff750d54bb68767d9f1591a6f264b5a08558e0e12b8920b"}
Sep 06 19:40:15.019617 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:15.019530    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv"
Sep 06 19:40:15.021134 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:15.021107    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-410f4d-569cc778d7-l6m7r" event={"ID":"2443b2ff-b35a-4e6d-9ffa-2b1273d35bac","Type":"ContainerStarted","Data":"1947199224cc95da284eb85e5c02ac8a194acd31db5f5b207876927e421459e5"}
Sep 06 19:40:15.021259 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:15.021146    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-410f4d-569cc778d7-l6m7r" event={"ID":"2443b2ff-b35a-4e6d-9ffa-2b1273d35bac","Type":"ContainerStarted","Data":"01e80a167c765baee4a1e29f2e3dc8660a2fe0d5ab8012ab9b335d79d36fe13e"}
Sep 06 19:40:15.021259 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:15.021250    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-410f4d-569cc778d7-l6m7r"
Sep 06 19:40:15.032782 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:15.032745    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-410f4d-7949b4ddf4-6vhgn" podStartSLOduration=2.0327322 podStartE2EDuration="2.0327322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:40:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:40:15.031590515 +0000 UTC m=+1761.272475883" watchObservedRunningTime="2026-09-06 19:40:15.0327322 +0000 UTC m=+1761.273617574"
Sep 06 19:40:15.046644 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:15.046607    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-410f4d-569cc778d7-l6m7r" podStartSLOduration=2.04659908 podStartE2EDuration="2.04659908s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:40:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:40:15.044568886 +0000 UTC m=+1761.285454253" watchObservedRunningTime="2026-09-06 19:40:15.04659908 +0000 UTC m=+1761.287484424"
Sep 06 19:40:15.059401 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:15.059356    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv" podStartSLOduration=2.579048401 podStartE2EDuration="3.059343337s" totalImagesPullingTime="480.294936ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:40:15.05880502 +0000 UTC m=+1761.299690387" watchObservedRunningTime="2026-09-06 19:40:15.059343337 +0000 UTC m=+1761.300228682"
Sep 06 19:40:21.030805 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:21.030775    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv"
Sep 06 19:40:26.028664 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:26.028631    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-410f4d-7949b4ddf4-6vhgn"
Sep 06 19:40:26.029147 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:26.028702    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-410f4d-569cc778d7-l6m7r"
Sep 06 19:40:42.861830 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:42.861799    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-88ac22-65d7c4ccf4-2vmnh"]
Sep 06 19:40:42.865162 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:42.865146    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-88ac22-65d7c4ccf4-2vmnh"
Sep 06 19:40:42.867733 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:42.867709    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-88ac22\""
Sep 06 19:40:42.867884 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:42.867865    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-88ac22-dockercfg-wcvbh\""
Sep 06 19:40:42.878099 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:42.878079    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-88ac22-65d7c4ccf4-2vmnh"]
Sep 06 19:40:42.999169 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:42.999130    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j8ps\" (UniqueName: \"kubernetes.io/projected/f871b5b9-ec13-41c5-8f72-01c59ba84e8c-kube-api-access-5j8ps\") pod \"payload-pre-processing-e2e-ipp-b-88ac22-65d7c4ccf4-2vmnh\" (UID: \"f871b5b9-ec13-41c5-8f72-01c59ba84e8c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-88ac22-65d7c4ccf4-2vmnh"
Sep 06 19:40:42.999359 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:42.999290    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f871b5b9-ec13-41c5-8f72-01c59ba84e8c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-88ac22-65d7c4ccf4-2vmnh\" (UID: \"f871b5b9-ec13-41c5-8f72-01c59ba84e8c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-88ac22-65d7c4ccf4-2vmnh"
Sep 06 19:40:43.100208 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:43.100163    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j8ps\" (UniqueName: \"kubernetes.io/projected/f871b5b9-ec13-41c5-8f72-01c59ba84e8c-kube-api-access-5j8ps\") pod \"payload-pre-processing-e2e-ipp-b-88ac22-65d7c4ccf4-2vmnh\" (UID: \"f871b5b9-ec13-41c5-8f72-01c59ba84e8c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-88ac22-65d7c4ccf4-2vmnh"
Sep 06 19:40:43.100396 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:43.100272    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f871b5b9-ec13-41c5-8f72-01c59ba84e8c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-88ac22-65d7c4ccf4-2vmnh\" (UID: \"f871b5b9-ec13-41c5-8f72-01c59ba84e8c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-88ac22-65d7c4ccf4-2vmnh"
Sep 06 19:40:43.101240 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:43.101211    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f871b5b9-ec13-41c5-8f72-01c59ba84e8c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-88ac22-65d7c4ccf4-2vmnh\" (UID: \"f871b5b9-ec13-41c5-8f72-01c59ba84e8c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-88ac22-65d7c4ccf4-2vmnh"
Sep 06 19:40:43.109302 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:43.109274    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j8ps\" (UniqueName: \"kubernetes.io/projected/f871b5b9-ec13-41c5-8f72-01c59ba84e8c-kube-api-access-5j8ps\") pod \"payload-pre-processing-e2e-ipp-b-88ac22-65d7c4ccf4-2vmnh\" (UID: \"f871b5b9-ec13-41c5-8f72-01c59ba84e8c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-88ac22-65d7c4ccf4-2vmnh"
Sep 06 19:40:43.176195 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:43.176114    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-88ac22-65d7c4ccf4-2vmnh"
Sep 06 19:40:43.446874 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:43.446852    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-88ac22-65d7c4ccf4-2vmnh"]
Sep 06 19:40:43.448798 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:40:43.448769    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf871b5b9_ec13_41c5_8f72_01c59ba84e8c.slice/crio-d101f9909938547d9ce0658faf089826db0c03fdaffff85a8fdf6c40f5b6aefe WatchSource:0}: Error finding container d101f9909938547d9ce0658faf089826db0c03fdaffff85a8fdf6c40f5b6aefe: Status 404 returned error can't find the container with id d101f9909938547d9ce0658faf089826db0c03fdaffff85a8fdf6c40f5b6aefe
Sep 06 19:40:44.164332 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:44.164292    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-88ac22-65d7c4ccf4-2vmnh" event={"ID":"f871b5b9-ec13-41c5-8f72-01c59ba84e8c","Type":"ContainerStarted","Data":"8067a9c87dd40add9ba621b325e215084d3a0552916a56b2ba759a6a04b107b5"}
Sep 06 19:40:44.164790 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:44.164344    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-88ac22-65d7c4ccf4-2vmnh" event={"ID":"f871b5b9-ec13-41c5-8f72-01c59ba84e8c","Type":"ContainerStarted","Data":"d101f9909938547d9ce0658faf089826db0c03fdaffff85a8fdf6c40f5b6aefe"}
Sep 06 19:40:44.164790 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:44.164386    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-88ac22-65d7c4ccf4-2vmnh"
Sep 06 19:40:44.177979 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:44.177932    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-88ac22-65d7c4ccf4-2vmnh" podStartSLOduration=2.177913484 podStartE2EDuration="2.177913484s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:40:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:40:44.177546572 +0000 UTC m=+1790.418431918" watchObservedRunningTime="2026-09-06 19:40:44.177913484 +0000 UTC m=+1790.418798829"
Sep 06 19:40:55.171652 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:40:55.171616    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-88ac22-65d7c4ccf4-2vmnh"
Sep 06 19:41:10.858045 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:10.858014    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-gwhhc_5c4cec7e-5502-46d8-a4e3-6bb673b455e5/payload-processing/0.log"
Sep 06 19:41:48.579939 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:48.579910    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-410f4d-569cc778d7-l6m7r_2443b2ff-b35a-4e6d-9ffa-2b1273d35bac/payload-processing/0.log"
Sep 06 19:41:48.698367 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:48.698334    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-gwhhc_5c4cec7e-5502-46d8-a4e3-6bb673b455e5/payload-processing/0.log"
Sep 06 19:41:53.649260 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:53.649224    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl"]
Sep 06 19:41:53.653207 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:53.653171    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl"
Sep 06 19:41:53.655369 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:53.655344    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-413b7f-serving-cert\""
Sep 06 19:41:53.661424 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:53.661401    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl"]
Sep 06 19:41:53.791374 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:53.791336    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl\" (UID: \"496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl"
Sep 06 19:41:53.791571 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:53.791388    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl\" (UID: \"496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl"
Sep 06 19:41:53.791571 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:53.791429    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl\" (UID: \"496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl"
Sep 06 19:41:53.791571 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:53.791454    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjrd9\" (UniqueName: \"kubernetes.io/projected/496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64-kube-api-access-rjrd9\") pod \"maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl\" (UID: \"496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl"
Sep 06 19:41:53.892667 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:53.892629    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl\" (UID: \"496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl"
Sep 06 19:41:53.892667 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:53.892669    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjrd9\" (UniqueName: \"kubernetes.io/projected/496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64-kube-api-access-rjrd9\") pod \"maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl\" (UID: \"496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl"
Sep 06 19:41:53.892916 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:53.892800    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl\" (UID: \"496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl"
Sep 06 19:41:53.892916 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:53.892834    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl\" (UID: \"496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl"
Sep 06 19:41:53.893374 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:53.893348    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl\" (UID: \"496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl"
Sep 06 19:41:53.895236 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:53.895211    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl\" (UID: \"496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl"
Sep 06 19:41:53.895345 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:53.895325    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl\" (UID: \"496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl"
Sep 06 19:41:53.899581 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:53.899526    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjrd9\" (UniqueName: \"kubernetes.io/projected/496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64-kube-api-access-rjrd9\") pod \"maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl\" (UID: \"496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl"
Sep 06 19:41:53.968367 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:53.968335    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl"
Sep 06 19:41:54.251442 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:54.251374    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl"]
Sep 06 19:41:54.254290 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:41:54.254260    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod496f3fb7_dd6a_40d0_9ef5_1d0f7a29ff64.slice/crio-19e6969ccf1f5e029737fe578d43359fc9db483c365a22e2a1c91af86a9d6f1b WatchSource:0}: Error finding container 19e6969ccf1f5e029737fe578d43359fc9db483c365a22e2a1c91af86a9d6f1b: Status 404 returned error can't find the container with id 19e6969ccf1f5e029737fe578d43359fc9db483c365a22e2a1c91af86a9d6f1b
Sep 06 19:41:54.275300 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:54.275271    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-413b7f-5768bfbd57-xk648"]
Sep 06 19:41:54.279854 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:54.279837    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-413b7f-5768bfbd57-xk648"
Sep 06 19:41:54.281791 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:54.281760    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-413b7f\""
Sep 06 19:41:54.281904 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:54.281846    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-413b7f-dockercfg-nvwh5\""
Sep 06 19:41:54.286922 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:54.286902    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-413b7f-5768bfbd57-xk648"]
Sep 06 19:41:54.397167 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:54.397128    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp2zg\" (UniqueName: \"kubernetes.io/projected/988c2499-9a0f-46ac-b654-76961fc1ccd0-kube-api-access-fp2zg\") pod \"payload-processing-e2e-ipp-cleanup-413b7f-5768bfbd57-xk648\" (UID: \"988c2499-9a0f-46ac-b654-76961fc1ccd0\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-413b7f-5768bfbd57-xk648"
Sep 06 19:41:54.397339 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:54.397171    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/988c2499-9a0f-46ac-b654-76961fc1ccd0-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-413b7f-5768bfbd57-xk648\" (UID: \"988c2499-9a0f-46ac-b654-76961fc1ccd0\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-413b7f-5768bfbd57-xk648"
Sep 06 19:41:54.497169 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:54.497130    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl" event={"ID":"496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64","Type":"ContainerStarted","Data":"19e6969ccf1f5e029737fe578d43359fc9db483c365a22e2a1c91af86a9d6f1b"}
Sep 06 19:41:54.497676 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:54.497645    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fp2zg\" (UniqueName: \"kubernetes.io/projected/988c2499-9a0f-46ac-b654-76961fc1ccd0-kube-api-access-fp2zg\") pod \"payload-processing-e2e-ipp-cleanup-413b7f-5768bfbd57-xk648\" (UID: \"988c2499-9a0f-46ac-b654-76961fc1ccd0\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-413b7f-5768bfbd57-xk648"
Sep 06 19:41:54.497843 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:54.497682    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/988c2499-9a0f-46ac-b654-76961fc1ccd0-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-413b7f-5768bfbd57-xk648\" (UID: \"988c2499-9a0f-46ac-b654-76961fc1ccd0\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-413b7f-5768bfbd57-xk648"
Sep 06 19:41:54.498552 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:54.498525    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/988c2499-9a0f-46ac-b654-76961fc1ccd0-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-413b7f-5768bfbd57-xk648\" (UID: \"988c2499-9a0f-46ac-b654-76961fc1ccd0\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-413b7f-5768bfbd57-xk648"
Sep 06 19:41:54.507076 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:54.507018    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp2zg\" (UniqueName: \"kubernetes.io/projected/988c2499-9a0f-46ac-b654-76961fc1ccd0-kube-api-access-fp2zg\") pod \"payload-processing-e2e-ipp-cleanup-413b7f-5768bfbd57-xk648\" (UID: \"988c2499-9a0f-46ac-b654-76961fc1ccd0\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-413b7f-5768bfbd57-xk648"
Sep 06 19:41:54.592406 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:54.592379    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-413b7f-5768bfbd57-xk648"
Sep 06 19:41:54.866111 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:54.866087    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-413b7f-5768bfbd57-xk648"]
Sep 06 19:41:54.868377 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:41:54.868345    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod988c2499_9a0f_46ac_b654_76961fc1ccd0.slice/crio-85b056ce67d563af8d76272ab999d5d52a79aaeb64c7aed8391a67cd4bc60d9c WatchSource:0}: Error finding container 85b056ce67d563af8d76272ab999d5d52a79aaeb64c7aed8391a67cd4bc60d9c: Status 404 returned error can't find the container with id 85b056ce67d563af8d76272ab999d5d52a79aaeb64c7aed8391a67cd4bc60d9c
Sep 06 19:41:55.504163 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:55.504126    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-413b7f-5768bfbd57-xk648" event={"ID":"988c2499-9a0f-46ac-b654-76961fc1ccd0","Type":"ContainerStarted","Data":"cb68978c6b63e327801d3b16d7a521bcddc30766e5df9e10a896312b95191f6f"}
Sep 06 19:41:55.504410 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:55.504183    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-413b7f-5768bfbd57-xk648" event={"ID":"988c2499-9a0f-46ac-b654-76961fc1ccd0","Type":"ContainerStarted","Data":"85b056ce67d563af8d76272ab999d5d52a79aaeb64c7aed8391a67cd4bc60d9c"}
Sep 06 19:41:55.504410 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:55.504325    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-413b7f-5768bfbd57-xk648"
Sep 06 19:41:55.505841 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:55.505815    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl" event={"ID":"496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64","Type":"ContainerStarted","Data":"48df74600ed7154edd90372225713f0f5ca59006d104d6a5a2af23c4e9169364"}
Sep 06 19:41:55.505953 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:55.505936    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl"
Sep 06 19:41:55.519640 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:55.519567    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-413b7f-5768bfbd57-xk648" podStartSLOduration=1.519555076 podStartE2EDuration="1.519555076s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:41:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:41:55.517319644 +0000 UTC m=+1861.758205010" watchObservedRunningTime="2026-09-06 19:41:55.519555076 +0000 UTC m=+1861.760440420"
Sep 06 19:41:55.531327 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:41:55.531278    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl" podStartSLOduration=2.14319729 podStartE2EDuration="2.531261072s" totalImagesPullingTime="388.063782ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:41:55.530824321 +0000 UTC m=+1861.771709692" watchObservedRunningTime="2026-09-06 19:41:55.531261072 +0000 UTC m=+1861.772146418"
Sep 06 19:42:01.516229 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:01.516200    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl"
Sep 06 19:42:06.512956 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:06.512926    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-413b7f-5768bfbd57-xk648"
Sep 06 19:42:24.033714 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.033635    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl"]
Sep 06 19:42:24.034155 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.033908    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl" podUID="496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64" containerName="maas-api" containerID="cri-o://48df74600ed7154edd90372225713f0f5ca59006d104d6a5a2af23c4e9169364" gracePeriod=30
Sep 06 19:42:24.082678 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.082646    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-413b7f-5768bfbd57-xk648"]
Sep 06 19:42:24.082900 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.082872    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-413b7f-5768bfbd57-xk648" podUID="988c2499-9a0f-46ac-b654-76961fc1ccd0" containerName="payload-processing" containerID="cri-o://cb68978c6b63e327801d3b16d7a521bcddc30766e5df9e10a896312b95191f6f" gracePeriod=30
Sep 06 19:42:24.335365 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.335340    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl"
Sep 06 19:42:24.373842 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.373818    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-413b7f-5768bfbd57-xk648"
Sep 06 19:42:24.445492 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.445437    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjrd9\" (UniqueName: \"kubernetes.io/projected/496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64-kube-api-access-rjrd9\") pod \"496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64\" (UID: \"496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64\") "
Sep 06 19:42:24.445667 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.445501    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fp2zg\" (UniqueName: \"kubernetes.io/projected/988c2499-9a0f-46ac-b654-76961fc1ccd0-kube-api-access-fp2zg\") pod \"988c2499-9a0f-46ac-b654-76961fc1ccd0\" (UID: \"988c2499-9a0f-46ac-b654-76961fc1ccd0\") "
Sep 06 19:42:24.445667 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.445600    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64-metrics-certs\") pod \"496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64\" (UID: \"496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64\") "
Sep 06 19:42:24.445667 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.445661    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64-maas-api-tls\") pod \"496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64\" (UID: \"496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64\") "
Sep 06 19:42:24.445856 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.445694    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64-openshift-service-ca\") pod \"496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64\" (UID: \"496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64\") "
Sep 06 19:42:24.445856 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.445713    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/988c2499-9a0f-46ac-b654-76961fc1ccd0-plugins-config-volume\") pod \"988c2499-9a0f-46ac-b654-76961fc1ccd0\" (UID: \"988c2499-9a0f-46ac-b654-76961fc1ccd0\") "
Sep 06 19:42:24.446096 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.446071    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64" (UID: "496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:42:24.446188 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.446153    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64-openshift-service-ca\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:42:24.446746 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.446713    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/988c2499-9a0f-46ac-b654-76961fc1ccd0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "988c2499-9a0f-46ac-b654-76961fc1ccd0" (UID: "988c2499-9a0f-46ac-b654-76961fc1ccd0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:42:24.447697 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.447676    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/988c2499-9a0f-46ac-b654-76961fc1ccd0-kube-api-access-fp2zg" (OuterVolumeSpecName: "kube-api-access-fp2zg") pod "988c2499-9a0f-46ac-b654-76961fc1ccd0" (UID: "988c2499-9a0f-46ac-b654-76961fc1ccd0"). InnerVolumeSpecName "kube-api-access-fp2zg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:42:24.447796 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.447772    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64" (UID: "496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:42:24.447983 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.447959    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64" (UID: "496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:42:24.448067 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.447967    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64-kube-api-access-rjrd9" (OuterVolumeSpecName: "kube-api-access-rjrd9") pod "496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64" (UID: "496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64"). InnerVolumeSpecName "kube-api-access-rjrd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:42:24.546998 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.546927    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64-maas-api-tls\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:42:24.546998 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.546951    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/988c2499-9a0f-46ac-b654-76961fc1ccd0-plugins-config-volume\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:42:24.546998 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.546961    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjrd9\" (UniqueName: \"kubernetes.io/projected/496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64-kube-api-access-rjrd9\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:42:24.546998 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.546969    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fp2zg\" (UniqueName: \"kubernetes.io/projected/988c2499-9a0f-46ac-b654-76961fc1ccd0-kube-api-access-fp2zg\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:42:24.546998 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.546978    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64-metrics-certs\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:42:24.647649 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.647597    2577 generic.go:356] "Generic (PLEG): container finished" podID="988c2499-9a0f-46ac-b654-76961fc1ccd0" containerID="cb68978c6b63e327801d3b16d7a521bcddc30766e5df9e10a896312b95191f6f" exitCode=0
Sep 06 19:42:24.647649 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.647643    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-413b7f-5768bfbd57-xk648"
Sep 06 19:42:24.647914 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.647688    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-413b7f-5768bfbd57-xk648" event={"ID":"988c2499-9a0f-46ac-b654-76961fc1ccd0","Type":"ContainerDied","Data":"cb68978c6b63e327801d3b16d7a521bcddc30766e5df9e10a896312b95191f6f"}
Sep 06 19:42:24.647914 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.647739    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-413b7f-5768bfbd57-xk648" event={"ID":"988c2499-9a0f-46ac-b654-76961fc1ccd0","Type":"ContainerDied","Data":"85b056ce67d563af8d76272ab999d5d52a79aaeb64c7aed8391a67cd4bc60d9c"}
Sep 06 19:42:24.647914 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.647775    2577 scope.go:117] "RemoveContainer" containerID="cb68978c6b63e327801d3b16d7a521bcddc30766e5df9e10a896312b95191f6f"
Sep 06 19:42:24.649153 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.649133    2577 generic.go:356] "Generic (PLEG): container finished" podID="496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64" containerID="48df74600ed7154edd90372225713f0f5ca59006d104d6a5a2af23c4e9169364" exitCode=0
Sep 06 19:42:24.649233 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.649183    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl"
Sep 06 19:42:24.649233 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.649191    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl" event={"ID":"496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64","Type":"ContainerDied","Data":"48df74600ed7154edd90372225713f0f5ca59006d104d6a5a2af23c4e9169364"}
Sep 06 19:42:24.649233 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.649222    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl" event={"ID":"496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64","Type":"ContainerDied","Data":"19e6969ccf1f5e029737fe578d43359fc9db483c365a22e2a1c91af86a9d6f1b"}
Sep 06 19:42:24.658243 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.658217    2577 scope.go:117] "RemoveContainer" containerID="cb68978c6b63e327801d3b16d7a521bcddc30766e5df9e10a896312b95191f6f"
Sep 06 19:42:24.658550 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:42:24.658531    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb68978c6b63e327801d3b16d7a521bcddc30766e5df9e10a896312b95191f6f\": container with ID starting with cb68978c6b63e327801d3b16d7a521bcddc30766e5df9e10a896312b95191f6f not found: ID does not exist" containerID="cb68978c6b63e327801d3b16d7a521bcddc30766e5df9e10a896312b95191f6f"
Sep 06 19:42:24.658656 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.658562    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb68978c6b63e327801d3b16d7a521bcddc30766e5df9e10a896312b95191f6f"} err="failed to get container status \"cb68978c6b63e327801d3b16d7a521bcddc30766e5df9e10a896312b95191f6f\": rpc error: code = NotFound desc = could not find container \"cb68978c6b63e327801d3b16d7a521bcddc30766e5df9e10a896312b95191f6f\": container with ID starting with cb68978c6b63e327801d3b16d7a521bcddc30766e5df9e10a896312b95191f6f not found: ID does not exist"
Sep 06 19:42:24.658656 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.658584    2577 scope.go:117] "RemoveContainer" containerID="48df74600ed7154edd90372225713f0f5ca59006d104d6a5a2af23c4e9169364"
Sep 06 19:42:24.666342 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.666326    2577 scope.go:117] "RemoveContainer" containerID="48df74600ed7154edd90372225713f0f5ca59006d104d6a5a2af23c4e9169364"
Sep 06 19:42:24.666628 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:42:24.666607    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48df74600ed7154edd90372225713f0f5ca59006d104d6a5a2af23c4e9169364\": container with ID starting with 48df74600ed7154edd90372225713f0f5ca59006d104d6a5a2af23c4e9169364 not found: ID does not exist" containerID="48df74600ed7154edd90372225713f0f5ca59006d104d6a5a2af23c4e9169364"
Sep 06 19:42:24.666686 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.666635    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48df74600ed7154edd90372225713f0f5ca59006d104d6a5a2af23c4e9169364"} err="failed to get container status \"48df74600ed7154edd90372225713f0f5ca59006d104d6a5a2af23c4e9169364\": rpc error: code = NotFound desc = could not find container \"48df74600ed7154edd90372225713f0f5ca59006d104d6a5a2af23c4e9169364\": container with ID starting with 48df74600ed7154edd90372225713f0f5ca59006d104d6a5a2af23c4e9169364 not found: ID does not exist"
Sep 06 19:42:24.672423 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.672395    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl"]
Sep 06 19:42:24.674181 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.674163    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-413b7f-79574dd897-2xkjl"]
Sep 06 19:42:24.682377 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.682359    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-413b7f-5768bfbd57-xk648"]
Sep 06 19:42:24.684169 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:24.684145    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-413b7f-5768bfbd57-xk648"]
Sep 06 19:42:26.394027 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:26.393993    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64" path="/var/lib/kubelet/pods/496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64/volumes"
Sep 06 19:42:26.394460 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:26.394324    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="988c2499-9a0f-46ac-b654-76961fc1ccd0" path="/var/lib/kubelet/pods/988c2499-9a0f-46ac-b654-76961fc1ccd0/volumes"
Sep 06 19:42:49.536942 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:49.536905    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv"]
Sep 06 19:42:49.537328 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:49.537166    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv" podUID="b4fd352a-14b3-4e2f-8c59-78fa908732a3" containerName="maas-api" containerID="cri-o://9e8e32f2f0e588e7ceb2bb3230fbec593c8579b65604cf4f7fc9104f5e5f7c43" gracePeriod=30
Sep 06 19:42:49.584583 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:49.584541    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-410f4d-569cc778d7-l6m7r"]
Sep 06 19:42:49.584810 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:49.584780    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-410f4d-569cc778d7-l6m7r" podUID="2443b2ff-b35a-4e6d-9ffa-2b1273d35bac" containerName="payload-processing" containerID="cri-o://1947199224cc95da284eb85e5c02ac8a194acd31db5f5b207876927e421459e5" gracePeriod=30
Sep 06 19:42:49.591075 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:49.591044    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-410f4d-7949b4ddf4-6vhgn"]
Sep 06 19:42:49.591312 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:49.591266    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-410f4d-7949b4ddf4-6vhgn" podUID="038e5b86-a0dd-4a74-8242-0b3910990fe9" containerName="payload-pre-processing" containerID="cri-o://9d4c4a6258c5f806e39f37adfc6924084067f38f551cbf23c7c67110bf50ae38" gracePeriod=30
Sep 06 19:42:49.777546 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:49.777508    2577 generic.go:356] "Generic (PLEG): container finished" podID="b4fd352a-14b3-4e2f-8c59-78fa908732a3" containerID="9e8e32f2f0e588e7ceb2bb3230fbec593c8579b65604cf4f7fc9104f5e5f7c43" exitCode=0
Sep 06 19:42:49.777728 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:49.777581    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv" event={"ID":"b4fd352a-14b3-4e2f-8c59-78fa908732a3","Type":"ContainerDied","Data":"9e8e32f2f0e588e7ceb2bb3230fbec593c8579b65604cf4f7fc9104f5e5f7c43"}
Sep 06 19:42:49.779747 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:49.779719    2577 generic.go:356] "Generic (PLEG): container finished" podID="2443b2ff-b35a-4e6d-9ffa-2b1273d35bac" containerID="1947199224cc95da284eb85e5c02ac8a194acd31db5f5b207876927e421459e5" exitCode=0
Sep 06 19:42:49.779860 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:49.779830    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-410f4d-569cc778d7-l6m7r" event={"ID":"2443b2ff-b35a-4e6d-9ffa-2b1273d35bac","Type":"ContainerDied","Data":"1947199224cc95da284eb85e5c02ac8a194acd31db5f5b207876927e421459e5"}
Sep 06 19:42:49.781550 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:49.781532    2577 generic.go:356] "Generic (PLEG): container finished" podID="038e5b86-a0dd-4a74-8242-0b3910990fe9" containerID="9d4c4a6258c5f806e39f37adfc6924084067f38f551cbf23c7c67110bf50ae38" exitCode=0
Sep 06 19:42:49.781638 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:49.781596    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-410f4d-7949b4ddf4-6vhgn" event={"ID":"038e5b86-a0dd-4a74-8242-0b3910990fe9","Type":"ContainerDied","Data":"9d4c4a6258c5f806e39f37adfc6924084067f38f551cbf23c7c67110bf50ae38"}
Sep 06 19:42:49.878546 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:49.878524    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-410f4d-569cc778d7-l6m7r"
Sep 06 19:42:49.891246 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:49.891220    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv"
Sep 06 19:42:49.902357 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:49.902331    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-410f4d-7949b4ddf4-6vhgn"
Sep 06 19:42:49.962083 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:49.962052    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtxdl\" (UniqueName: \"kubernetes.io/projected/b4fd352a-14b3-4e2f-8c59-78fa908732a3-kube-api-access-rtxdl\") pod \"b4fd352a-14b3-4e2f-8c59-78fa908732a3\" (UID: \"b4fd352a-14b3-4e2f-8c59-78fa908732a3\") "
Sep 06 19:42:49.962269 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:49.962093    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2443b2ff-b35a-4e6d-9ffa-2b1273d35bac-plugins-config-volume\") pod \"2443b2ff-b35a-4e6d-9ffa-2b1273d35bac\" (UID: \"2443b2ff-b35a-4e6d-9ffa-2b1273d35bac\") "
Sep 06 19:42:49.962269 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:49.962180    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4fd352a-14b3-4e2f-8c59-78fa908732a3-openshift-service-ca\") pod \"b4fd352a-14b3-4e2f-8c59-78fa908732a3\" (UID: \"b4fd352a-14b3-4e2f-8c59-78fa908732a3\") "
Sep 06 19:42:49.962269 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:49.962202    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mnmgn\" (UniqueName: \"kubernetes.io/projected/2443b2ff-b35a-4e6d-9ffa-2b1273d35bac-kube-api-access-mnmgn\") pod \"2443b2ff-b35a-4e6d-9ffa-2b1273d35bac\" (UID: \"2443b2ff-b35a-4e6d-9ffa-2b1273d35bac\") "
Sep 06 19:42:49.962269 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:49.962226    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4fd352a-14b3-4e2f-8c59-78fa908732a3-maas-api-tls\") pod \"b4fd352a-14b3-4e2f-8c59-78fa908732a3\" (UID: \"b4fd352a-14b3-4e2f-8c59-78fa908732a3\") "
Sep 06 19:42:49.962269 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:49.962247    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4fd352a-14b3-4e2f-8c59-78fa908732a3-metrics-certs\") pod \"b4fd352a-14b3-4e2f-8c59-78fa908732a3\" (UID: \"b4fd352a-14b3-4e2f-8c59-78fa908732a3\") "
Sep 06 19:42:49.962619 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:49.962538    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2443b2ff-b35a-4e6d-9ffa-2b1273d35bac-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2443b2ff-b35a-4e6d-9ffa-2b1273d35bac" (UID: "2443b2ff-b35a-4e6d-9ffa-2b1273d35bac"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:42:49.962619 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:49.962570    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4fd352a-14b3-4e2f-8c59-78fa908732a3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b4fd352a-14b3-4e2f-8c59-78fa908732a3" (UID: "b4fd352a-14b3-4e2f-8c59-78fa908732a3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:42:49.964533 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:49.964447    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4fd352a-14b3-4e2f-8c59-78fa908732a3-kube-api-access-rtxdl" (OuterVolumeSpecName: "kube-api-access-rtxdl") pod "b4fd352a-14b3-4e2f-8c59-78fa908732a3" (UID: "b4fd352a-14b3-4e2f-8c59-78fa908732a3"). InnerVolumeSpecName "kube-api-access-rtxdl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:42:49.964533 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:49.964462    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4fd352a-14b3-4e2f-8c59-78fa908732a3-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b4fd352a-14b3-4e2f-8c59-78fa908732a3" (UID: "b4fd352a-14b3-4e2f-8c59-78fa908732a3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:42:49.964735 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:49.964715    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2443b2ff-b35a-4e6d-9ffa-2b1273d35bac-kube-api-access-mnmgn" (OuterVolumeSpecName: "kube-api-access-mnmgn") pod "2443b2ff-b35a-4e6d-9ffa-2b1273d35bac" (UID: "2443b2ff-b35a-4e6d-9ffa-2b1273d35bac"). InnerVolumeSpecName "kube-api-access-mnmgn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:42:49.964735 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:49.964716    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4fd352a-14b3-4e2f-8c59-78fa908732a3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b4fd352a-14b3-4e2f-8c59-78fa908732a3" (UID: "b4fd352a-14b3-4e2f-8c59-78fa908732a3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:42:50.062816 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:50.062783    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/038e5b86-a0dd-4a74-8242-0b3910990fe9-plugins-config-volume\") pod \"038e5b86-a0dd-4a74-8242-0b3910990fe9\" (UID: \"038e5b86-a0dd-4a74-8242-0b3910990fe9\") "
Sep 06 19:42:50.062816 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:50.062830    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7x45f\" (UniqueName: \"kubernetes.io/projected/038e5b86-a0dd-4a74-8242-0b3910990fe9-kube-api-access-7x45f\") pod \"038e5b86-a0dd-4a74-8242-0b3910990fe9\" (UID: \"038e5b86-a0dd-4a74-8242-0b3910990fe9\") "
Sep 06 19:42:50.063029 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:50.062961    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4fd352a-14b3-4e2f-8c59-78fa908732a3-openshift-service-ca\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:42:50.063029 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:50.062972    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mnmgn\" (UniqueName: \"kubernetes.io/projected/2443b2ff-b35a-4e6d-9ffa-2b1273d35bac-kube-api-access-mnmgn\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:42:50.063029 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:50.062981    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4fd352a-14b3-4e2f-8c59-78fa908732a3-maas-api-tls\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:42:50.063029 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:50.062990    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4fd352a-14b3-4e2f-8c59-78fa908732a3-metrics-certs\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:42:50.063029 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:50.062998    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtxdl\" (UniqueName: \"kubernetes.io/projected/b4fd352a-14b3-4e2f-8c59-78fa908732a3-kube-api-access-rtxdl\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:42:50.063029 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:50.063006    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2443b2ff-b35a-4e6d-9ffa-2b1273d35bac-plugins-config-volume\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:42:50.063216 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:50.063179    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/038e5b86-a0dd-4a74-8242-0b3910990fe9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "038e5b86-a0dd-4a74-8242-0b3910990fe9" (UID: "038e5b86-a0dd-4a74-8242-0b3910990fe9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:42:50.064879 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:50.064856    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/038e5b86-a0dd-4a74-8242-0b3910990fe9-kube-api-access-7x45f" (OuterVolumeSpecName: "kube-api-access-7x45f") pod "038e5b86-a0dd-4a74-8242-0b3910990fe9" (UID: "038e5b86-a0dd-4a74-8242-0b3910990fe9"). InnerVolumeSpecName "kube-api-access-7x45f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:42:50.163995 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:50.163903    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/038e5b86-a0dd-4a74-8242-0b3910990fe9-plugins-config-volume\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:42:50.163995 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:50.163940    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7x45f\" (UniqueName: \"kubernetes.io/projected/038e5b86-a0dd-4a74-8242-0b3910990fe9-kube-api-access-7x45f\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:42:50.788940 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:50.788909    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-410f4d-569cc778d7-l6m7r"
Sep 06 19:42:50.788940 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:50.788921    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-410f4d-569cc778d7-l6m7r" event={"ID":"2443b2ff-b35a-4e6d-9ffa-2b1273d35bac","Type":"ContainerDied","Data":"01e80a167c765baee4a1e29f2e3dc8660a2fe0d5ab8012ab9b335d79d36fe13e"}
Sep 06 19:42:50.789489 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:50.788982    2577 scope.go:117] "RemoveContainer" containerID="1947199224cc95da284eb85e5c02ac8a194acd31db5f5b207876927e421459e5"
Sep 06 19:42:50.790727 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:50.790705    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-410f4d-7949b4ddf4-6vhgn"
Sep 06 19:42:50.790861 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:50.790725    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-410f4d-7949b4ddf4-6vhgn" event={"ID":"038e5b86-a0dd-4a74-8242-0b3910990fe9","Type":"ContainerDied","Data":"1fa21814471f723c9e69266c0eeb6cc9cdae114fd4127b907bf226b8a4eecc3d"}
Sep 06 19:42:50.792439 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:50.792417    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv" event={"ID":"b4fd352a-14b3-4e2f-8c59-78fa908732a3","Type":"ContainerDied","Data":"8db35fdda7311cf18ff750d54bb68767d9f1591a6f264b5a08558e0e12b8920b"}
Sep 06 19:42:50.792591 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:50.792449    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv"
Sep 06 19:42:50.799176 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:50.799161    2577 scope.go:117] "RemoveContainer" containerID="9d4c4a6258c5f806e39f37adfc6924084067f38f551cbf23c7c67110bf50ae38"
Sep 06 19:42:50.807678 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:50.807654    2577 scope.go:117] "RemoveContainer" containerID="9e8e32f2f0e588e7ceb2bb3230fbec593c8579b65604cf4f7fc9104f5e5f7c43"
Sep 06 19:42:50.810672 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:50.810649    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-410f4d-569cc778d7-l6m7r"]
Sep 06 19:42:50.817016 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:50.816996    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-410f4d-569cc778d7-l6m7r"]
Sep 06 19:42:50.825681 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:50.825650    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv"]
Sep 06 19:42:50.831346 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:50.831321    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-410f4d-c96877564-vrhmv"]
Sep 06 19:42:50.842362 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:50.842339    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-410f4d-7949b4ddf4-6vhgn"]
Sep 06 19:42:50.843923 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:50.843902    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-410f4d-7949b4ddf4-6vhgn"]
Sep 06 19:42:52.388194 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:52.388164    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="038e5b86-a0dd-4a74-8242-0b3910990fe9" path="/var/lib/kubelet/pods/038e5b86-a0dd-4a74-8242-0b3910990fe9/volumes"
Sep 06 19:42:52.388578 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:52.388516    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2443b2ff-b35a-4e6d-9ffa-2b1273d35bac" path="/var/lib/kubelet/pods/2443b2ff-b35a-4e6d-9ffa-2b1273d35bac/volumes"
Sep 06 19:42:52.388862 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:42:52.388848    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4fd352a-14b3-4e2f-8c59-78fa908732a3" path="/var/lib/kubelet/pods/b4fd352a-14b3-4e2f-8c59-78fa908732a3/volumes"
Sep 06 19:43:48.488159 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:43:48.487972    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-88ac22-65d7c4ccf4-2vmnh"]
Sep 06 19:43:48.488715 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:43:48.488286    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-88ac22-65d7c4ccf4-2vmnh" podUID="f871b5b9-ec13-41c5-8f72-01c59ba84e8c" containerName="payload-pre-processing" containerID="cri-o://8067a9c87dd40add9ba621b325e215084d3a0552916a56b2ba759a6a04b107b5" gracePeriod=30
Sep 06 19:43:48.736195 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:43:48.736172    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-88ac22-65d7c4ccf4-2vmnh"
Sep 06 19:43:48.816892 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:43:48.816816    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5j8ps\" (UniqueName: \"kubernetes.io/projected/f871b5b9-ec13-41c5-8f72-01c59ba84e8c-kube-api-access-5j8ps\") pod \"f871b5b9-ec13-41c5-8f72-01c59ba84e8c\" (UID: \"f871b5b9-ec13-41c5-8f72-01c59ba84e8c\") "
Sep 06 19:43:48.816892 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:43:48.816859    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f871b5b9-ec13-41c5-8f72-01c59ba84e8c-plugins-config-volume\") pod \"f871b5b9-ec13-41c5-8f72-01c59ba84e8c\" (UID: \"f871b5b9-ec13-41c5-8f72-01c59ba84e8c\") "
Sep 06 19:43:48.817215 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:43:48.817192    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f871b5b9-ec13-41c5-8f72-01c59ba84e8c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f871b5b9-ec13-41c5-8f72-01c59ba84e8c" (UID: "f871b5b9-ec13-41c5-8f72-01c59ba84e8c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:43:48.818939 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:43:48.818909    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f871b5b9-ec13-41c5-8f72-01c59ba84e8c-kube-api-access-5j8ps" (OuterVolumeSpecName: "kube-api-access-5j8ps") pod "f871b5b9-ec13-41c5-8f72-01c59ba84e8c" (UID: "f871b5b9-ec13-41c5-8f72-01c59ba84e8c"). InnerVolumeSpecName "kube-api-access-5j8ps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:43:48.917452 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:43:48.917418    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5j8ps\" (UniqueName: \"kubernetes.io/projected/f871b5b9-ec13-41c5-8f72-01c59ba84e8c-kube-api-access-5j8ps\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:43:48.917452 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:43:48.917447    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f871b5b9-ec13-41c5-8f72-01c59ba84e8c-plugins-config-volume\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:43:49.065935 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:43:49.065901    2577 generic.go:356] "Generic (PLEG): container finished" podID="f871b5b9-ec13-41c5-8f72-01c59ba84e8c" containerID="8067a9c87dd40add9ba621b325e215084d3a0552916a56b2ba759a6a04b107b5" exitCode=0
Sep 06 19:43:49.066077 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:43:49.065966    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-88ac22-65d7c4ccf4-2vmnh"
Sep 06 19:43:49.066077 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:43:49.065986    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-88ac22-65d7c4ccf4-2vmnh" event={"ID":"f871b5b9-ec13-41c5-8f72-01c59ba84e8c","Type":"ContainerDied","Data":"8067a9c87dd40add9ba621b325e215084d3a0552916a56b2ba759a6a04b107b5"}
Sep 06 19:43:49.066077 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:43:49.066065    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-88ac22-65d7c4ccf4-2vmnh" event={"ID":"f871b5b9-ec13-41c5-8f72-01c59ba84e8c","Type":"ContainerDied","Data":"d101f9909938547d9ce0658faf089826db0c03fdaffff85a8fdf6c40f5b6aefe"}
Sep 06 19:43:49.066244 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:43:49.066087    2577 scope.go:117] "RemoveContainer" containerID="8067a9c87dd40add9ba621b325e215084d3a0552916a56b2ba759a6a04b107b5"
Sep 06 19:43:49.074639 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:43:49.074624    2577 scope.go:117] "RemoveContainer" containerID="8067a9c87dd40add9ba621b325e215084d3a0552916a56b2ba759a6a04b107b5"
Sep 06 19:43:49.074889 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:43:49.074872    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8067a9c87dd40add9ba621b325e215084d3a0552916a56b2ba759a6a04b107b5\": container with ID starting with 8067a9c87dd40add9ba621b325e215084d3a0552916a56b2ba759a6a04b107b5 not found: ID does not exist" containerID="8067a9c87dd40add9ba621b325e215084d3a0552916a56b2ba759a6a04b107b5"
Sep 06 19:43:49.074954 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:43:49.074895    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8067a9c87dd40add9ba621b325e215084d3a0552916a56b2ba759a6a04b107b5"} err="failed to get container status \"8067a9c87dd40add9ba621b325e215084d3a0552916a56b2ba759a6a04b107b5\": rpc error: code = NotFound desc = could not find container \"8067a9c87dd40add9ba621b325e215084d3a0552916a56b2ba759a6a04b107b5\": container with ID starting with 8067a9c87dd40add9ba621b325e215084d3a0552916a56b2ba759a6a04b107b5 not found: ID does not exist"
Sep 06 19:43:49.086848 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:43:49.086828    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-88ac22-65d7c4ccf4-2vmnh"]
Sep 06 19:43:49.092690 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:43:49.092669    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-88ac22-65d7c4ccf4-2vmnh"]
Sep 06 19:43:50.388334 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:43:50.388299    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f871b5b9-ec13-41c5-8f72-01c59ba84e8c" path="/var/lib/kubelet/pods/f871b5b9-ec13-41c5-8f72-01c59ba84e8c/volumes"
Sep 06 19:44:23.474337 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:23.474305    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-476f98-6467cc8b57-smgr8"]
Sep 06 19:44:23.474949 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:23.474558    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-476f98-6467cc8b57-smgr8" podUID="caa86d8d-0528-4b26-b34b-039ddbdd9f54" containerName="payload-processing" containerID="cri-o://0f539ab847b9f17b6de3353bc7bf176e7ccec379c2bda990362a06ddf6e22f81" gracePeriod=30
Sep 06 19:44:23.479737 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:23.479130    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-476f98-f6556f69d-99sz8"]
Sep 06 19:44:23.479737 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:23.479338    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-476f98-f6556f69d-99sz8" podUID="46d7be9d-5bbf-4907-a72b-ba51cbe73842" containerName="payload-pre-processing" containerID="cri-o://127b6cf875f13a5ec395f8bf8c0f0cb804201b1e857df58899dc69c58bf0369a" gracePeriod=30
Sep 06 19:44:23.758815 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:23.758792    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-476f98-6467cc8b57-smgr8"
Sep 06 19:44:23.761609 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:23.761590    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-476f98-f6556f69d-99sz8"
Sep 06 19:44:23.798988 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:23.798966    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4d92\" (UniqueName: \"kubernetes.io/projected/46d7be9d-5bbf-4907-a72b-ba51cbe73842-kube-api-access-m4d92\") pod \"46d7be9d-5bbf-4907-a72b-ba51cbe73842\" (UID: \"46d7be9d-5bbf-4907-a72b-ba51cbe73842\") "
Sep 06 19:44:23.799127 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:23.799001    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vzpw\" (UniqueName: \"kubernetes.io/projected/caa86d8d-0528-4b26-b34b-039ddbdd9f54-kube-api-access-5vzpw\") pod \"caa86d8d-0528-4b26-b34b-039ddbdd9f54\" (UID: \"caa86d8d-0528-4b26-b34b-039ddbdd9f54\") "
Sep 06 19:44:23.799127 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:23.799024    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46d7be9d-5bbf-4907-a72b-ba51cbe73842-plugins-config-volume\") pod \"46d7be9d-5bbf-4907-a72b-ba51cbe73842\" (UID: \"46d7be9d-5bbf-4907-a72b-ba51cbe73842\") "
Sep 06 19:44:23.799127 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:23.799082    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/caa86d8d-0528-4b26-b34b-039ddbdd9f54-plugins-config-volume\") pod \"caa86d8d-0528-4b26-b34b-039ddbdd9f54\" (UID: \"caa86d8d-0528-4b26-b34b-039ddbdd9f54\") "
Sep 06 19:44:23.799736 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:23.799694    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/caa86d8d-0528-4b26-b34b-039ddbdd9f54-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "caa86d8d-0528-4b26-b34b-039ddbdd9f54" (UID: "caa86d8d-0528-4b26-b34b-039ddbdd9f54"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:44:23.799736 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:23.799709    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46d7be9d-5bbf-4907-a72b-ba51cbe73842-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "46d7be9d-5bbf-4907-a72b-ba51cbe73842" (UID: "46d7be9d-5bbf-4907-a72b-ba51cbe73842"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:44:23.801291 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:23.801266    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46d7be9d-5bbf-4907-a72b-ba51cbe73842-kube-api-access-m4d92" (OuterVolumeSpecName: "kube-api-access-m4d92") pod "46d7be9d-5bbf-4907-a72b-ba51cbe73842" (UID: "46d7be9d-5bbf-4907-a72b-ba51cbe73842"). InnerVolumeSpecName "kube-api-access-m4d92". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:44:23.801451 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:23.801430    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/caa86d8d-0528-4b26-b34b-039ddbdd9f54-kube-api-access-5vzpw" (OuterVolumeSpecName: "kube-api-access-5vzpw") pod "caa86d8d-0528-4b26-b34b-039ddbdd9f54" (UID: "caa86d8d-0528-4b26-b34b-039ddbdd9f54"). InnerVolumeSpecName "kube-api-access-5vzpw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:44:23.899773 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:23.899744    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4d92\" (UniqueName: \"kubernetes.io/projected/46d7be9d-5bbf-4907-a72b-ba51cbe73842-kube-api-access-m4d92\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:44:23.899773 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:23.899772    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vzpw\" (UniqueName: \"kubernetes.io/projected/caa86d8d-0528-4b26-b34b-039ddbdd9f54-kube-api-access-5vzpw\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:44:23.899934 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:23.899786    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46d7be9d-5bbf-4907-a72b-ba51cbe73842-plugins-config-volume\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:44:23.899934 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:23.899800    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/caa86d8d-0528-4b26-b34b-039ddbdd9f54-plugins-config-volume\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:44:24.230198 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:24.230166    2577 generic.go:356] "Generic (PLEG): container finished" podID="caa86d8d-0528-4b26-b34b-039ddbdd9f54" containerID="0f539ab847b9f17b6de3353bc7bf176e7ccec379c2bda990362a06ddf6e22f81" exitCode=0
Sep 06 19:44:24.230373 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:24.230207    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-476f98-6467cc8b57-smgr8"
Sep 06 19:44:24.230373 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:24.230258    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-476f98-6467cc8b57-smgr8" event={"ID":"caa86d8d-0528-4b26-b34b-039ddbdd9f54","Type":"ContainerDied","Data":"0f539ab847b9f17b6de3353bc7bf176e7ccec379c2bda990362a06ddf6e22f81"}
Sep 06 19:44:24.230373 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:24.230308    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-476f98-6467cc8b57-smgr8" event={"ID":"caa86d8d-0528-4b26-b34b-039ddbdd9f54","Type":"ContainerDied","Data":"ffcd64740b7d54bebac41d13251f565d83a574b1a5e3fcaacc71fa5170ccf449"}
Sep 06 19:44:24.230373 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:24.230335    2577 scope.go:117] "RemoveContainer" containerID="0f539ab847b9f17b6de3353bc7bf176e7ccec379c2bda990362a06ddf6e22f81"
Sep 06 19:44:24.231611 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:24.231586    2577 generic.go:356] "Generic (PLEG): container finished" podID="46d7be9d-5bbf-4907-a72b-ba51cbe73842" containerID="127b6cf875f13a5ec395f8bf8c0f0cb804201b1e857df58899dc69c58bf0369a" exitCode=0
Sep 06 19:44:24.231739 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:24.231618    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-476f98-f6556f69d-99sz8" event={"ID":"46d7be9d-5bbf-4907-a72b-ba51cbe73842","Type":"ContainerDied","Data":"127b6cf875f13a5ec395f8bf8c0f0cb804201b1e857df58899dc69c58bf0369a"}
Sep 06 19:44:24.231739 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:24.231647    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-476f98-f6556f69d-99sz8"
Sep 06 19:44:24.231739 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:24.231654    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-476f98-f6556f69d-99sz8" event={"ID":"46d7be9d-5bbf-4907-a72b-ba51cbe73842","Type":"ContainerDied","Data":"2df32d94656093f1ec443303de0a1ff3bf525b942d671e78c9b69dbdae4f06ad"}
Sep 06 19:44:24.238688 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:24.238670    2577 scope.go:117] "RemoveContainer" containerID="0f539ab847b9f17b6de3353bc7bf176e7ccec379c2bda990362a06ddf6e22f81"
Sep 06 19:44:24.238943 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:44:24.238921    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f539ab847b9f17b6de3353bc7bf176e7ccec379c2bda990362a06ddf6e22f81\": container with ID starting with 0f539ab847b9f17b6de3353bc7bf176e7ccec379c2bda990362a06ddf6e22f81 not found: ID does not exist" containerID="0f539ab847b9f17b6de3353bc7bf176e7ccec379c2bda990362a06ddf6e22f81"
Sep 06 19:44:24.238992 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:24.238954    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f539ab847b9f17b6de3353bc7bf176e7ccec379c2bda990362a06ddf6e22f81"} err="failed to get container status \"0f539ab847b9f17b6de3353bc7bf176e7ccec379c2bda990362a06ddf6e22f81\": rpc error: code = NotFound desc = could not find container \"0f539ab847b9f17b6de3353bc7bf176e7ccec379c2bda990362a06ddf6e22f81\": container with ID starting with 0f539ab847b9f17b6de3353bc7bf176e7ccec379c2bda990362a06ddf6e22f81 not found: ID does not exist"
Sep 06 19:44:24.238992 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:24.238977    2577 scope.go:117] "RemoveContainer" containerID="127b6cf875f13a5ec395f8bf8c0f0cb804201b1e857df58899dc69c58bf0369a"
Sep 06 19:44:24.247883 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:24.247861    2577 scope.go:117] "RemoveContainer" containerID="127b6cf875f13a5ec395f8bf8c0f0cb804201b1e857df58899dc69c58bf0369a"
Sep 06 19:44:24.248132 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:44:24.248112    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"127b6cf875f13a5ec395f8bf8c0f0cb804201b1e857df58899dc69c58bf0369a\": container with ID starting with 127b6cf875f13a5ec395f8bf8c0f0cb804201b1e857df58899dc69c58bf0369a not found: ID does not exist" containerID="127b6cf875f13a5ec395f8bf8c0f0cb804201b1e857df58899dc69c58bf0369a"
Sep 06 19:44:24.248197 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:24.248139    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"127b6cf875f13a5ec395f8bf8c0f0cb804201b1e857df58899dc69c58bf0369a"} err="failed to get container status \"127b6cf875f13a5ec395f8bf8c0f0cb804201b1e857df58899dc69c58bf0369a\": rpc error: code = NotFound desc = could not find container \"127b6cf875f13a5ec395f8bf8c0f0cb804201b1e857df58899dc69c58bf0369a\": container with ID starting with 127b6cf875f13a5ec395f8bf8c0f0cb804201b1e857df58899dc69c58bf0369a not found: ID does not exist"
Sep 06 19:44:24.252704 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:24.252683    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-476f98-f6556f69d-99sz8"]
Sep 06 19:44:24.256304 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:24.256283    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-476f98-f6556f69d-99sz8"]
Sep 06 19:44:24.264680 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:24.264657    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-476f98-6467cc8b57-smgr8"]
Sep 06 19:44:24.267312 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:24.267294    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-476f98-6467cc8b57-smgr8"]
Sep 06 19:44:24.387747 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:24.387714    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46d7be9d-5bbf-4907-a72b-ba51cbe73842" path="/var/lib/kubelet/pods/46d7be9d-5bbf-4907-a72b-ba51cbe73842/volumes"
Sep 06 19:44:24.388101 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:24.388088    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="caa86d8d-0528-4b26-b34b-039ddbdd9f54" path="/var/lib/kubelet/pods/caa86d8d-0528-4b26-b34b-039ddbdd9f54/volumes"
Sep 06 19:44:32.231579 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:32.231542    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5694bddd64-8pgvf"]
Sep 06 19:44:32.231977 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:32.231730    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5694bddd64-8pgvf" podUID="0208413f-9c83-4967-9ab8-b27890b4a489" containerName="manager" containerID="cri-o://0f8e089627ac239c66b1c49b840d0537bb58627f0040864fedee698ecf8fb7b1" gracePeriod=30
Sep 06 19:44:32.475207 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:32.475181    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5694bddd64-8pgvf"
Sep 06 19:44:32.558752 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:32.558679    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0208413f-9c83-4967-9ab8-b27890b4a489-metrics-certs\") pod \"0208413f-9c83-4967-9ab8-b27890b4a489\" (UID: \"0208413f-9c83-4967-9ab8-b27890b4a489\") "
Sep 06 19:44:32.558752 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:32.558736    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0208413f-9c83-4967-9ab8-b27890b4a489-webhook-cert\") pod \"0208413f-9c83-4967-9ab8-b27890b4a489\" (UID: \"0208413f-9c83-4967-9ab8-b27890b4a489\") "
Sep 06 19:44:32.558945 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:32.558780    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhfc8\" (UniqueName: \"kubernetes.io/projected/0208413f-9c83-4967-9ab8-b27890b4a489-kube-api-access-lhfc8\") pod \"0208413f-9c83-4967-9ab8-b27890b4a489\" (UID: \"0208413f-9c83-4967-9ab8-b27890b4a489\") "
Sep 06 19:44:32.560719 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:32.560691    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0208413f-9c83-4967-9ab8-b27890b4a489-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0208413f-9c83-4967-9ab8-b27890b4a489" (UID: "0208413f-9c83-4967-9ab8-b27890b4a489"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:44:32.560719 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:32.560711    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0208413f-9c83-4967-9ab8-b27890b4a489-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0208413f-9c83-4967-9ab8-b27890b4a489" (UID: "0208413f-9c83-4967-9ab8-b27890b4a489"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:44:32.560873 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:32.560694    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0208413f-9c83-4967-9ab8-b27890b4a489-kube-api-access-lhfc8" (OuterVolumeSpecName: "kube-api-access-lhfc8") pod "0208413f-9c83-4967-9ab8-b27890b4a489" (UID: "0208413f-9c83-4967-9ab8-b27890b4a489"). InnerVolumeSpecName "kube-api-access-lhfc8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:44:32.659789 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:32.659756    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhfc8\" (UniqueName: \"kubernetes.io/projected/0208413f-9c83-4967-9ab8-b27890b4a489-kube-api-access-lhfc8\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:44:32.659789 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:32.659784    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0208413f-9c83-4967-9ab8-b27890b4a489-metrics-certs\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:44:32.659975 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:32.659799    2577 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0208413f-9c83-4967-9ab8-b27890b4a489-webhook-cert\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:44:33.274388 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:33.274343    2577 generic.go:356] "Generic (PLEG): container finished" podID="0208413f-9c83-4967-9ab8-b27890b4a489" containerID="0f8e089627ac239c66b1c49b840d0537bb58627f0040864fedee698ecf8fb7b1" exitCode=0
Sep 06 19:44:33.274861 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:33.274408    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5694bddd64-8pgvf"
Sep 06 19:44:33.274861 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:33.274409    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5694bddd64-8pgvf" event={"ID":"0208413f-9c83-4967-9ab8-b27890b4a489","Type":"ContainerDied","Data":"0f8e089627ac239c66b1c49b840d0537bb58627f0040864fedee698ecf8fb7b1"}
Sep 06 19:44:33.274861 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:33.274514    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5694bddd64-8pgvf" event={"ID":"0208413f-9c83-4967-9ab8-b27890b4a489","Type":"ContainerDied","Data":"3dd5e88d88b81b951e6f5438fbbbe71480467760a1dc7becf48057e1e77b9aea"}
Sep 06 19:44:33.274861 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:33.274545    2577 scope.go:117] "RemoveContainer" containerID="0f8e089627ac239c66b1c49b840d0537bb58627f0040864fedee698ecf8fb7b1"
Sep 06 19:44:33.283147 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:33.283131    2577 scope.go:117] "RemoveContainer" containerID="0f8e089627ac239c66b1c49b840d0537bb58627f0040864fedee698ecf8fb7b1"
Sep 06 19:44:33.283384 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:44:33.283366    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f8e089627ac239c66b1c49b840d0537bb58627f0040864fedee698ecf8fb7b1\": container with ID starting with 0f8e089627ac239c66b1c49b840d0537bb58627f0040864fedee698ecf8fb7b1 not found: ID does not exist" containerID="0f8e089627ac239c66b1c49b840d0537bb58627f0040864fedee698ecf8fb7b1"
Sep 06 19:44:33.283429 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:33.283390    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f8e089627ac239c66b1c49b840d0537bb58627f0040864fedee698ecf8fb7b1"} err="failed to get container status \"0f8e089627ac239c66b1c49b840d0537bb58627f0040864fedee698ecf8fb7b1\": rpc error: code = NotFound desc = could not find container \"0f8e089627ac239c66b1c49b840d0537bb58627f0040864fedee698ecf8fb7b1\": container with ID starting with 0f8e089627ac239c66b1c49b840d0537bb58627f0040864fedee698ecf8fb7b1 not found: ID does not exist"
Sep 06 19:44:33.295641 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:33.295610    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5694bddd64-8pgvf"]
Sep 06 19:44:33.297643 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:33.297623    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5694bddd64-8pgvf"]
Sep 06 19:44:34.388019 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:44:34.387988    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0208413f-9c83-4967-9ab8-b27890b4a489" path="/var/lib/kubelet/pods/0208413f-9c83-4967-9ab8-b27890b4a489/volumes"
Sep 06 19:45:34.110335 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.110303    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5694bddd64-d8llj"]
Sep 06 19:45:34.110811 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.110633    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46d7be9d-5bbf-4907-a72b-ba51cbe73842" containerName="payload-pre-processing"
Sep 06 19:45:34.110811 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.110644    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="46d7be9d-5bbf-4907-a72b-ba51cbe73842" containerName="payload-pre-processing"
Sep 06 19:45:34.110811 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.110653    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="038e5b86-a0dd-4a74-8242-0b3910990fe9" containerName="payload-pre-processing"
Sep 06 19:45:34.110811 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.110659    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="038e5b86-a0dd-4a74-8242-0b3910990fe9" containerName="payload-pre-processing"
Sep 06 19:45:34.110811 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.110667    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="988c2499-9a0f-46ac-b654-76961fc1ccd0" containerName="payload-processing"
Sep 06 19:45:34.110811 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.110672    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="988c2499-9a0f-46ac-b654-76961fc1ccd0" containerName="payload-processing"
Sep 06 19:45:34.110811 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.110687    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64" containerName="maas-api"
Sep 06 19:45:34.110811 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.110693    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64" containerName="maas-api"
Sep 06 19:45:34.110811 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.110702    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caa86d8d-0528-4b26-b34b-039ddbdd9f54" containerName="payload-processing"
Sep 06 19:45:34.110811 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.110706    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="caa86d8d-0528-4b26-b34b-039ddbdd9f54" containerName="payload-processing"
Sep 06 19:45:34.110811 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.110712    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0208413f-9c83-4967-9ab8-b27890b4a489" containerName="manager"
Sep 06 19:45:34.110811 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.110716    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0208413f-9c83-4967-9ab8-b27890b4a489" containerName="manager"
Sep 06 19:45:34.110811 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.110727    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4fd352a-14b3-4e2f-8c59-78fa908732a3" containerName="maas-api"
Sep 06 19:45:34.110811 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.110732    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4fd352a-14b3-4e2f-8c59-78fa908732a3" containerName="maas-api"
Sep 06 19:45:34.110811 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.110740    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2443b2ff-b35a-4e6d-9ffa-2b1273d35bac" containerName="payload-processing"
Sep 06 19:45:34.110811 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.110745    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2443b2ff-b35a-4e6d-9ffa-2b1273d35bac" containerName="payload-processing"
Sep 06 19:45:34.110811 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.110750    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f871b5b9-ec13-41c5-8f72-01c59ba84e8c" containerName="payload-pre-processing"
Sep 06 19:45:34.110811 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.110754    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f871b5b9-ec13-41c5-8f72-01c59ba84e8c" containerName="payload-pre-processing"
Sep 06 19:45:34.110811 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.110800    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0208413f-9c83-4967-9ab8-b27890b4a489" containerName="manager"
Sep 06 19:45:34.110811 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.110807    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="988c2499-9a0f-46ac-b654-76961fc1ccd0" containerName="payload-processing"
Sep 06 19:45:34.110811 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.110814    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="46d7be9d-5bbf-4907-a72b-ba51cbe73842" containerName="payload-pre-processing"
Sep 06 19:45:34.110811 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.110819    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4fd352a-14b3-4e2f-8c59-78fa908732a3" containerName="maas-api"
Sep 06 19:45:34.111604 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.110825    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="caa86d8d-0528-4b26-b34b-039ddbdd9f54" containerName="payload-processing"
Sep 06 19:45:34.111604 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.110832    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="038e5b86-a0dd-4a74-8242-0b3910990fe9" containerName="payload-pre-processing"
Sep 06 19:45:34.111604 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.110836    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="496f3fb7-dd6a-40d0-9ef5-1d0f7a29ff64" containerName="maas-api"
Sep 06 19:45:34.111604 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.110842    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f871b5b9-ec13-41c5-8f72-01c59ba84e8c" containerName="payload-pre-processing"
Sep 06 19:45:34.111604 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.110847    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2443b2ff-b35a-4e6d-9ffa-2b1273d35bac" containerName="payload-processing"
Sep 06 19:45:34.113890 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.113873    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5694bddd64-d8llj"
Sep 06 19:45:34.116524 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.116494    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 06 19:45:34.116650 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.116580    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 06 19:45:34.116650 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.116608    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 06 19:45:34.116650 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.116631    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-dtb87\""
Sep 06 19:45:34.121150 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.121128    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5694bddd64-d8llj"]
Sep 06 19:45:34.218062 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.218028    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5flzz\" (UniqueName: \"kubernetes.io/projected/2b371161-c18b-478d-81b9-911581d2c609-kube-api-access-5flzz\") pod \"maas-controller-5694bddd64-d8llj\" (UID: \"2b371161-c18b-478d-81b9-911581d2c609\") " pod="opendatahub/maas-controller-5694bddd64-d8llj"
Sep 06 19:45:34.218185 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.218086    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b371161-c18b-478d-81b9-911581d2c609-webhook-cert\") pod \"maas-controller-5694bddd64-d8llj\" (UID: \"2b371161-c18b-478d-81b9-911581d2c609\") " pod="opendatahub/maas-controller-5694bddd64-d8llj"
Sep 06 19:45:34.218185 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.218104    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b371161-c18b-478d-81b9-911581d2c609-metrics-certs\") pod \"maas-controller-5694bddd64-d8llj\" (UID: \"2b371161-c18b-478d-81b9-911581d2c609\") " pod="opendatahub/maas-controller-5694bddd64-d8llj"
Sep 06 19:45:34.319356 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.319330    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b371161-c18b-478d-81b9-911581d2c609-webhook-cert\") pod \"maas-controller-5694bddd64-d8llj\" (UID: \"2b371161-c18b-478d-81b9-911581d2c609\") " pod="opendatahub/maas-controller-5694bddd64-d8llj"
Sep 06 19:45:34.319435 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.319361    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b371161-c18b-478d-81b9-911581d2c609-metrics-certs\") pod \"maas-controller-5694bddd64-d8llj\" (UID: \"2b371161-c18b-478d-81b9-911581d2c609\") " pod="opendatahub/maas-controller-5694bddd64-d8llj"
Sep 06 19:45:34.319435 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.319400    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5flzz\" (UniqueName: \"kubernetes.io/projected/2b371161-c18b-478d-81b9-911581d2c609-kube-api-access-5flzz\") pod \"maas-controller-5694bddd64-d8llj\" (UID: \"2b371161-c18b-478d-81b9-911581d2c609\") " pod="opendatahub/maas-controller-5694bddd64-d8llj"
Sep 06 19:45:34.321759 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.321731    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b371161-c18b-478d-81b9-911581d2c609-metrics-certs\") pod \"maas-controller-5694bddd64-d8llj\" (UID: \"2b371161-c18b-478d-81b9-911581d2c609\") " pod="opendatahub/maas-controller-5694bddd64-d8llj"
Sep 06 19:45:34.321848 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.321792    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b371161-c18b-478d-81b9-911581d2c609-webhook-cert\") pod \"maas-controller-5694bddd64-d8llj\" (UID: \"2b371161-c18b-478d-81b9-911581d2c609\") " pod="opendatahub/maas-controller-5694bddd64-d8llj"
Sep 06 19:45:34.326342 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.326325    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5flzz\" (UniqueName: \"kubernetes.io/projected/2b371161-c18b-478d-81b9-911581d2c609-kube-api-access-5flzz\") pod \"maas-controller-5694bddd64-d8llj\" (UID: \"2b371161-c18b-478d-81b9-911581d2c609\") " pod="opendatahub/maas-controller-5694bddd64-d8llj"
Sep 06 19:45:34.424926 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.424849    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5694bddd64-d8llj"
Sep 06 19:45:34.692634 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.692562    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5694bddd64-d8llj"]
Sep 06 19:45:34.695042 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:45:34.695018    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b371161_c18b_478d_81b9_911581d2c609.slice/crio-e81e80cd8a4469759eea149d1ac1640b2df4c022ecb9b91e7920845a0bc0e3dd WatchSource:0}: Error finding container e81e80cd8a4469759eea149d1ac1640b2df4c022ecb9b91e7920845a0bc0e3dd: Status 404 returned error can't find the container with id e81e80cd8a4469759eea149d1ac1640b2df4c022ecb9b91e7920845a0bc0e3dd
Sep 06 19:45:34.696715 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:34.696698    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 19:45:35.540821 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:35.540778    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5694bddd64-d8llj" event={"ID":"2b371161-c18b-478d-81b9-911581d2c609","Type":"ContainerStarted","Data":"bbbdbb24c4a3a464348d9122f0388abc25edc19c91b37419cf54d85c2fbb45b5"}
Sep 06 19:45:35.541231 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:35.540878    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5694bddd64-d8llj" event={"ID":"2b371161-c18b-478d-81b9-911581d2c609","Type":"ContainerStarted","Data":"e81e80cd8a4469759eea149d1ac1640b2df4c022ecb9b91e7920845a0bc0e3dd"}
Sep 06 19:45:35.541231 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:35.540913    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5694bddd64-d8llj"
Sep 06 19:45:35.556203 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:35.556147    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5694bddd64-d8llj" podStartSLOduration=1.1271875040000001 podStartE2EDuration="1.556132957s" totalImagesPullingTime="428.945453ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:45:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:45:35.554969349 +0000 UTC m=+2081.795854692" watchObservedRunningTime="2026-09-06 19:45:35.556132957 +0000 UTC m=+2081.797018316"
Sep 06 19:45:46.547713 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:46.547679    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5694bddd64-d8llj"
Sep 06 19:45:57.961919 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:57.961882    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5694bddd64-d8llj"]
Sep 06 19:45:57.962316 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:57.962076    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5694bddd64-d8llj" podUID="2b371161-c18b-478d-81b9-911581d2c609" containerName="manager" containerID="cri-o://bbbdbb24c4a3a464348d9122f0388abc25edc19c91b37419cf54d85c2fbb45b5" gracePeriod=30
Sep 06 19:45:58.206131 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:58.206106    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5694bddd64-d8llj"
Sep 06 19:45:58.307072 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:58.307047    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b371161-c18b-478d-81b9-911581d2c609-metrics-certs\") pod \"2b371161-c18b-478d-81b9-911581d2c609\" (UID: \"2b371161-c18b-478d-81b9-911581d2c609\") "
Sep 06 19:45:58.307242 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:58.307095    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b371161-c18b-478d-81b9-911581d2c609-webhook-cert\") pod \"2b371161-c18b-478d-81b9-911581d2c609\" (UID: \"2b371161-c18b-478d-81b9-911581d2c609\") "
Sep 06 19:45:58.307242 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:58.307117    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5flzz\" (UniqueName: \"kubernetes.io/projected/2b371161-c18b-478d-81b9-911581d2c609-kube-api-access-5flzz\") pod \"2b371161-c18b-478d-81b9-911581d2c609\" (UID: \"2b371161-c18b-478d-81b9-911581d2c609\") "
Sep 06 19:45:58.308949 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:58.308918    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b371161-c18b-478d-81b9-911581d2c609-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "2b371161-c18b-478d-81b9-911581d2c609" (UID: "2b371161-c18b-478d-81b9-911581d2c609"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:45:58.309075 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:58.308980    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b371161-c18b-478d-81b9-911581d2c609-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2b371161-c18b-478d-81b9-911581d2c609" (UID: "2b371161-c18b-478d-81b9-911581d2c609"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:45:58.309135 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:58.309120    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b371161-c18b-478d-81b9-911581d2c609-kube-api-access-5flzz" (OuterVolumeSpecName: "kube-api-access-5flzz") pod "2b371161-c18b-478d-81b9-911581d2c609" (UID: "2b371161-c18b-478d-81b9-911581d2c609"). InnerVolumeSpecName "kube-api-access-5flzz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:45:58.407679 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:58.407662    2577 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b371161-c18b-478d-81b9-911581d2c609-webhook-cert\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:45:58.407679 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:58.407681    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5flzz\" (UniqueName: \"kubernetes.io/projected/2b371161-c18b-478d-81b9-911581d2c609-kube-api-access-5flzz\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:45:58.407824 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:58.407690    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b371161-c18b-478d-81b9-911581d2c609-metrics-certs\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:45:58.648302 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:58.648215    2577 generic.go:356] "Generic (PLEG): container finished" podID="2b371161-c18b-478d-81b9-911581d2c609" containerID="bbbdbb24c4a3a464348d9122f0388abc25edc19c91b37419cf54d85c2fbb45b5" exitCode=0
Sep 06 19:45:58.648302 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:58.648268    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5694bddd64-d8llj"
Sep 06 19:45:58.648509 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:58.648299    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5694bddd64-d8llj" event={"ID":"2b371161-c18b-478d-81b9-911581d2c609","Type":"ContainerDied","Data":"bbbdbb24c4a3a464348d9122f0388abc25edc19c91b37419cf54d85c2fbb45b5"}
Sep 06 19:45:58.648509 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:58.648357    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5694bddd64-d8llj" event={"ID":"2b371161-c18b-478d-81b9-911581d2c609","Type":"ContainerDied","Data":"e81e80cd8a4469759eea149d1ac1640b2df4c022ecb9b91e7920845a0bc0e3dd"}
Sep 06 19:45:58.648509 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:58.648379    2577 scope.go:117] "RemoveContainer" containerID="bbbdbb24c4a3a464348d9122f0388abc25edc19c91b37419cf54d85c2fbb45b5"
Sep 06 19:45:58.656578 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:58.656553    2577 scope.go:117] "RemoveContainer" containerID="bbbdbb24c4a3a464348d9122f0388abc25edc19c91b37419cf54d85c2fbb45b5"
Sep 06 19:45:58.656841 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:45:58.656821    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbbdbb24c4a3a464348d9122f0388abc25edc19c91b37419cf54d85c2fbb45b5\": container with ID starting with bbbdbb24c4a3a464348d9122f0388abc25edc19c91b37419cf54d85c2fbb45b5 not found: ID does not exist" containerID="bbbdbb24c4a3a464348d9122f0388abc25edc19c91b37419cf54d85c2fbb45b5"
Sep 06 19:45:58.656892 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:58.656851    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbbdbb24c4a3a464348d9122f0388abc25edc19c91b37419cf54d85c2fbb45b5"} err="failed to get container status \"bbbdbb24c4a3a464348d9122f0388abc25edc19c91b37419cf54d85c2fbb45b5\": rpc error: code = NotFound desc = could not find container \"bbbdbb24c4a3a464348d9122f0388abc25edc19c91b37419cf54d85c2fbb45b5\": container with ID starting with bbbdbb24c4a3a464348d9122f0388abc25edc19c91b37419cf54d85c2fbb45b5 not found: ID does not exist"
Sep 06 19:45:58.663084 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:58.663060    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5694bddd64-d8llj"]
Sep 06 19:45:58.666356 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:58.666338    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5694bddd64-d8llj"]
Sep 06 19:45:59.392753 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:59.392720    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5694bddd64-bb57g"]
Sep 06 19:45:59.393129 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:59.393054    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b371161-c18b-478d-81b9-911581d2c609" containerName="manager"
Sep 06 19:45:59.393129 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:59.393066    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b371161-c18b-478d-81b9-911581d2c609" containerName="manager"
Sep 06 19:45:59.393129 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:59.393127    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b371161-c18b-478d-81b9-911581d2c609" containerName="manager"
Sep 06 19:45:59.396075 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:59.396055    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5694bddd64-bb57g"
Sep 06 19:45:59.398047 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:59.397980    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 06 19:45:59.398047 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:59.397980    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 06 19:45:59.398695 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:59.398678    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-dtb87\""
Sep 06 19:45:59.398778 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:59.398730    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 06 19:45:59.405050 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:59.405016    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5694bddd64-bb57g"]
Sep 06 19:45:59.518028 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:59.518003    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ntp7\" (UniqueName: \"kubernetes.io/projected/dad42734-69cc-432f-a51c-b38b2cae444a-kube-api-access-9ntp7\") pod \"maas-controller-5694bddd64-bb57g\" (UID: \"dad42734-69cc-432f-a51c-b38b2cae444a\") " pod="opendatahub/maas-controller-5694bddd64-bb57g"
Sep 06 19:45:59.518204 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:59.518052    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dad42734-69cc-432f-a51c-b38b2cae444a-webhook-cert\") pod \"maas-controller-5694bddd64-bb57g\" (UID: \"dad42734-69cc-432f-a51c-b38b2cae444a\") " pod="opendatahub/maas-controller-5694bddd64-bb57g"
Sep 06 19:45:59.518204 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:59.518152    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dad42734-69cc-432f-a51c-b38b2cae444a-metrics-certs\") pod \"maas-controller-5694bddd64-bb57g\" (UID: \"dad42734-69cc-432f-a51c-b38b2cae444a\") " pod="opendatahub/maas-controller-5694bddd64-bb57g"
Sep 06 19:45:59.618965 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:59.618919    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dad42734-69cc-432f-a51c-b38b2cae444a-webhook-cert\") pod \"maas-controller-5694bddd64-bb57g\" (UID: \"dad42734-69cc-432f-a51c-b38b2cae444a\") " pod="opendatahub/maas-controller-5694bddd64-bb57g"
Sep 06 19:45:59.619163 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:59.618977    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dad42734-69cc-432f-a51c-b38b2cae444a-metrics-certs\") pod \"maas-controller-5694bddd64-bb57g\" (UID: \"dad42734-69cc-432f-a51c-b38b2cae444a\") " pod="opendatahub/maas-controller-5694bddd64-bb57g"
Sep 06 19:45:59.619163 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:59.619016    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ntp7\" (UniqueName: \"kubernetes.io/projected/dad42734-69cc-432f-a51c-b38b2cae444a-kube-api-access-9ntp7\") pod \"maas-controller-5694bddd64-bb57g\" (UID: \"dad42734-69cc-432f-a51c-b38b2cae444a\") " pod="opendatahub/maas-controller-5694bddd64-bb57g"
Sep 06 19:45:59.621568 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:59.621541    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dad42734-69cc-432f-a51c-b38b2cae444a-metrics-certs\") pod \"maas-controller-5694bddd64-bb57g\" (UID: \"dad42734-69cc-432f-a51c-b38b2cae444a\") " pod="opendatahub/maas-controller-5694bddd64-bb57g"
Sep 06 19:45:59.621568 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:59.621560    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dad42734-69cc-432f-a51c-b38b2cae444a-webhook-cert\") pod \"maas-controller-5694bddd64-bb57g\" (UID: \"dad42734-69cc-432f-a51c-b38b2cae444a\") " pod="opendatahub/maas-controller-5694bddd64-bb57g"
Sep 06 19:45:59.626616 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:59.626590    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ntp7\" (UniqueName: \"kubernetes.io/projected/dad42734-69cc-432f-a51c-b38b2cae444a-kube-api-access-9ntp7\") pod \"maas-controller-5694bddd64-bb57g\" (UID: \"dad42734-69cc-432f-a51c-b38b2cae444a\") " pod="opendatahub/maas-controller-5694bddd64-bb57g"
Sep 06 19:45:59.708550 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:59.708423    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5694bddd64-bb57g"
Sep 06 19:45:59.978615 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:45:59.978588    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5694bddd64-bb57g"]
Sep 06 19:45:59.980907 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:45:59.980884    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad42734_69cc_432f_a51c_b38b2cae444a.slice/crio-628159b269cc95f4b8f99a70f084f4d07bf0f7b7967602d876b548ed66a5918c WatchSource:0}: Error finding container 628159b269cc95f4b8f99a70f084f4d07bf0f7b7967602d876b548ed66a5918c: Status 404 returned error can't find the container with id 628159b269cc95f4b8f99a70f084f4d07bf0f7b7967602d876b548ed66a5918c
Sep 06 19:46:00.387378 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:46:00.387292    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b371161-c18b-478d-81b9-911581d2c609" path="/var/lib/kubelet/pods/2b371161-c18b-478d-81b9-911581d2c609/volumes"
Sep 06 19:46:00.660288 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:46:00.660198    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5694bddd64-bb57g" event={"ID":"dad42734-69cc-432f-a51c-b38b2cae444a","Type":"ContainerStarted","Data":"5fbebcc0ec706a858aedf7a54df7bb9e2bde3cb9bf7fc14e45034d1780cf5b49"}
Sep 06 19:46:00.660288 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:46:00.660258    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5694bddd64-bb57g" event={"ID":"dad42734-69cc-432f-a51c-b38b2cae444a","Type":"ContainerStarted","Data":"628159b269cc95f4b8f99a70f084f4d07bf0f7b7967602d876b548ed66a5918c"}
Sep 06 19:46:00.660288 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:46:00.660285    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5694bddd64-bb57g"
Sep 06 19:46:00.676520 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:46:00.676459    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5694bddd64-bb57g" podStartSLOduration=1.2429109409999999 podStartE2EDuration="1.676443937s" totalImagesPullingTime="433.532996ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:45:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:46:00.674432023 +0000 UTC m=+2106.915317385" watchObservedRunningTime="2026-09-06 19:46:00.676443937 +0000 UTC m=+2106.917329283"
Sep 06 19:46:11.667463 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:46:11.667433    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5694bddd64-bb57g"
Sep 06 19:47:14.426925 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:47:14.426894    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-67qx5"]
Sep 06 19:47:14.427351 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:47:14.427075    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-67qx5" podUID="6d011eef-95b0-4d00-85ea-12b43a8b3236" containerName="manager" containerID="cri-o://1e9906c07e9338c6d5b911050a1e216286c3b8253eb3426fe7b03feb2b0f6031" gracePeriod=10
Sep 06 19:47:14.672923 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:47:14.672901    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-67qx5"
Sep 06 19:47:14.837173 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:47:14.837144    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvltn\" (UniqueName: \"kubernetes.io/projected/6d011eef-95b0-4d00-85ea-12b43a8b3236-kube-api-access-kvltn\") pod \"6d011eef-95b0-4d00-85ea-12b43a8b3236\" (UID: \"6d011eef-95b0-4d00-85ea-12b43a8b3236\") "
Sep 06 19:47:14.837332 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:47:14.837239    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d011eef-95b0-4d00-85ea-12b43a8b3236-extensions-socket-volume\") pod \"6d011eef-95b0-4d00-85ea-12b43a8b3236\" (UID: \"6d011eef-95b0-4d00-85ea-12b43a8b3236\") "
Sep 06 19:47:14.837653 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:47:14.837622    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d011eef-95b0-4d00-85ea-12b43a8b3236-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6d011eef-95b0-4d00-85ea-12b43a8b3236" (UID: "6d011eef-95b0-4d00-85ea-12b43a8b3236"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 19:47:14.839088 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:47:14.839073    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d011eef-95b0-4d00-85ea-12b43a8b3236-kube-api-access-kvltn" (OuterVolumeSpecName: "kube-api-access-kvltn") pod "6d011eef-95b0-4d00-85ea-12b43a8b3236" (UID: "6d011eef-95b0-4d00-85ea-12b43a8b3236"). InnerVolumeSpecName "kube-api-access-kvltn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:47:14.938539 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:47:14.938510    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvltn\" (UniqueName: \"kubernetes.io/projected/6d011eef-95b0-4d00-85ea-12b43a8b3236-kube-api-access-kvltn\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:47:14.938539 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:47:14.938538    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d011eef-95b0-4d00-85ea-12b43a8b3236-extensions-socket-volume\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:47:14.984699 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:47:14.984669    2577 generic.go:356] "Generic (PLEG): container finished" podID="6d011eef-95b0-4d00-85ea-12b43a8b3236" containerID="1e9906c07e9338c6d5b911050a1e216286c3b8253eb3426fe7b03feb2b0f6031" exitCode=0
Sep 06 19:47:14.984789 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:47:14.984714    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-67qx5"
Sep 06 19:47:14.984789 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:47:14.984742    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-67qx5" event={"ID":"6d011eef-95b0-4d00-85ea-12b43a8b3236","Type":"ContainerDied","Data":"1e9906c07e9338c6d5b911050a1e216286c3b8253eb3426fe7b03feb2b0f6031"}
Sep 06 19:47:14.984865 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:47:14.984790    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-67qx5" event={"ID":"6d011eef-95b0-4d00-85ea-12b43a8b3236","Type":"ContainerDied","Data":"f33d4a9d445b284c46b6431c0f8ae955c310b47a372e17164995413b904f871a"}
Sep 06 19:47:14.984865 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:47:14.984816    2577 scope.go:117] "RemoveContainer" containerID="1e9906c07e9338c6d5b911050a1e216286c3b8253eb3426fe7b03feb2b0f6031"
Sep 06 19:47:14.994355 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:47:14.994342    2577 scope.go:117] "RemoveContainer" containerID="1e9906c07e9338c6d5b911050a1e216286c3b8253eb3426fe7b03feb2b0f6031"
Sep 06 19:47:14.994642 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:47:14.994619    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e9906c07e9338c6d5b911050a1e216286c3b8253eb3426fe7b03feb2b0f6031\": container with ID starting with 1e9906c07e9338c6d5b911050a1e216286c3b8253eb3426fe7b03feb2b0f6031 not found: ID does not exist" containerID="1e9906c07e9338c6d5b911050a1e216286c3b8253eb3426fe7b03feb2b0f6031"
Sep 06 19:47:14.994716 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:47:14.994650    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e9906c07e9338c6d5b911050a1e216286c3b8253eb3426fe7b03feb2b0f6031"} err="failed to get container status \"1e9906c07e9338c6d5b911050a1e216286c3b8253eb3426fe7b03feb2b0f6031\": rpc error: code = NotFound desc = could not find container \"1e9906c07e9338c6d5b911050a1e216286c3b8253eb3426fe7b03feb2b0f6031\": container with ID starting with 1e9906c07e9338c6d5b911050a1e216286c3b8253eb3426fe7b03feb2b0f6031 not found: ID does not exist"
Sep 06 19:47:15.005117 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:47:15.005097    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-67qx5"]
Sep 06 19:47:15.010307 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:47:15.010288    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-67qx5"]
Sep 06 19:47:16.387423 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:47:16.387390    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d011eef-95b0-4d00-85ea-12b43a8b3236" path="/var/lib/kubelet/pods/6d011eef-95b0-4d00-85ea-12b43a8b3236/volumes"
Sep 06 19:48:15.106175 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:48:15.106142    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-tnfvc"]
Sep 06 19:48:15.106627 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:48:15.106460    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d011eef-95b0-4d00-85ea-12b43a8b3236" containerName="manager"
Sep 06 19:48:15.106627 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:48:15.106487    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d011eef-95b0-4d00-85ea-12b43a8b3236" containerName="manager"
Sep 06 19:48:15.106627 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:48:15.106558    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d011eef-95b0-4d00-85ea-12b43a8b3236" containerName="manager"
Sep 06 19:48:15.109350 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:48:15.109334    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-tnfvc"
Sep 06 19:48:15.111981 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:48:15.111954    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-24r28\""
Sep 06 19:48:15.111981 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:48:15.111977    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 06 19:48:15.112184 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:48:15.111966    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 06 19:48:15.120115 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:48:15.120092    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-tnfvc"]
Sep 06 19:48:15.173276 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:48:15.173247    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4d9c559-1754-496f-9f8a-8857f60417f3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-tnfvc\" (UID: \"a4d9c559-1754-496f-9f8a-8857f60417f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-tnfvc"
Sep 06 19:48:15.173368 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:48:15.173298    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmc7x\" (UniqueName: \"kubernetes.io/projected/a4d9c559-1754-496f-9f8a-8857f60417f3-kube-api-access-qmc7x\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-tnfvc\" (UID: \"a4d9c559-1754-496f-9f8a-8857f60417f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-tnfvc"
Sep 06 19:48:15.274591 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:48:15.274566    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmc7x\" (UniqueName: \"kubernetes.io/projected/a4d9c559-1754-496f-9f8a-8857f60417f3-kube-api-access-qmc7x\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-tnfvc\" (UID: \"a4d9c559-1754-496f-9f8a-8857f60417f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-tnfvc"
Sep 06 19:48:15.274691 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:48:15.274623    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4d9c559-1754-496f-9f8a-8857f60417f3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-tnfvc\" (UID: \"a4d9c559-1754-496f-9f8a-8857f60417f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-tnfvc"
Sep 06 19:48:15.274924 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:48:15.274908    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4d9c559-1754-496f-9f8a-8857f60417f3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-tnfvc\" (UID: \"a4d9c559-1754-496f-9f8a-8857f60417f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-tnfvc"
Sep 06 19:48:15.285354 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:48:15.285329    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmc7x\" (UniqueName: \"kubernetes.io/projected/a4d9c559-1754-496f-9f8a-8857f60417f3-kube-api-access-qmc7x\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-tnfvc\" (UID: \"a4d9c559-1754-496f-9f8a-8857f60417f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-tnfvc"
Sep 06 19:48:15.419218 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:48:15.419166    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-tnfvc"
Sep 06 19:48:15.694230 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:48:15.694205    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-tnfvc"]
Sep 06 19:48:15.696531 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:48:15.696497    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4d9c559_1754_496f_9f8a_8857f60417f3.slice/crio-a86bb4fde845c26d30e3335ac7b8948cb057ce17c8303c22d12f0e025bfc59dc WatchSource:0}: Error finding container a86bb4fde845c26d30e3335ac7b8948cb057ce17c8303c22d12f0e025bfc59dc: Status 404 returned error can't find the container with id a86bb4fde845c26d30e3335ac7b8948cb057ce17c8303c22d12f0e025bfc59dc
Sep 06 19:48:16.264169 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:48:16.264136    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-tnfvc" event={"ID":"a4d9c559-1754-496f-9f8a-8857f60417f3","Type":"ContainerStarted","Data":"e01a8d5634ff6c20ca01fddbf261e917da5bd961783b39eed5ebeac605fbac9f"}
Sep 06 19:48:16.264644 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:48:16.264194    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-tnfvc" event={"ID":"a4d9c559-1754-496f-9f8a-8857f60417f3","Type":"ContainerStarted","Data":"a86bb4fde845c26d30e3335ac7b8948cb057ce17c8303c22d12f0e025bfc59dc"}
Sep 06 19:48:16.264644 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:48:16.264251    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-tnfvc"
Sep 06 19:48:16.284104 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:48:16.284059    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-tnfvc" podStartSLOduration=1.284046646 podStartE2EDuration="1.284046646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:48:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:48:16.283107168 +0000 UTC m=+2242.523992514" watchObservedRunningTime="2026-09-06 19:48:16.284046646 +0000 UTC m=+2242.524931990"
Sep 06 19:48:27.270995 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:48:27.270961    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-tnfvc"
Sep 06 19:50:40.702736 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:40.702703    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6d767997f7-mszbw"]
Sep 06 19:50:40.705922 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:40.705904    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d767997f7-mszbw"
Sep 06 19:50:40.714972 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:40.714946    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d767997f7-mszbw"]
Sep 06 19:50:40.805162 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:40.805134    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3109ef99-0f01-4098-b335-50b2fcde3f67-openshift-service-ca\") pod \"maas-api-6d767997f7-mszbw\" (UID: \"3109ef99-0f01-4098-b335-50b2fcde3f67\") " pod="odh-ai-gateway-infra/maas-api-6d767997f7-mszbw"
Sep 06 19:50:40.805306 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:40.805168    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3109ef99-0f01-4098-b335-50b2fcde3f67-maas-api-tls\") pod \"maas-api-6d767997f7-mszbw\" (UID: \"3109ef99-0f01-4098-b335-50b2fcde3f67\") " pod="odh-ai-gateway-infra/maas-api-6d767997f7-mszbw"
Sep 06 19:50:40.805306 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:40.805214    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3109ef99-0f01-4098-b335-50b2fcde3f67-metrics-certs\") pod \"maas-api-6d767997f7-mszbw\" (UID: \"3109ef99-0f01-4098-b335-50b2fcde3f67\") " pod="odh-ai-gateway-infra/maas-api-6d767997f7-mszbw"
Sep 06 19:50:40.805306 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:40.805263    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snfkh\" (UniqueName: \"kubernetes.io/projected/3109ef99-0f01-4098-b335-50b2fcde3f67-kube-api-access-snfkh\") pod \"maas-api-6d767997f7-mszbw\" (UID: \"3109ef99-0f01-4098-b335-50b2fcde3f67\") " pod="odh-ai-gateway-infra/maas-api-6d767997f7-mszbw"
Sep 06 19:50:40.906633 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:40.906604    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snfkh\" (UniqueName: \"kubernetes.io/projected/3109ef99-0f01-4098-b335-50b2fcde3f67-kube-api-access-snfkh\") pod \"maas-api-6d767997f7-mszbw\" (UID: \"3109ef99-0f01-4098-b335-50b2fcde3f67\") " pod="odh-ai-gateway-infra/maas-api-6d767997f7-mszbw"
Sep 06 19:50:40.906767 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:40.906652    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3109ef99-0f01-4098-b335-50b2fcde3f67-openshift-service-ca\") pod \"maas-api-6d767997f7-mszbw\" (UID: \"3109ef99-0f01-4098-b335-50b2fcde3f67\") " pod="odh-ai-gateway-infra/maas-api-6d767997f7-mszbw"
Sep 06 19:50:40.906767 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:40.906676    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3109ef99-0f01-4098-b335-50b2fcde3f67-maas-api-tls\") pod \"maas-api-6d767997f7-mszbw\" (UID: \"3109ef99-0f01-4098-b335-50b2fcde3f67\") " pod="odh-ai-gateway-infra/maas-api-6d767997f7-mszbw"
Sep 06 19:50:40.906767 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:40.906741    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3109ef99-0f01-4098-b335-50b2fcde3f67-metrics-certs\") pod \"maas-api-6d767997f7-mszbw\" (UID: \"3109ef99-0f01-4098-b335-50b2fcde3f67\") " pod="odh-ai-gateway-infra/maas-api-6d767997f7-mszbw"
Sep 06 19:50:40.907372 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:40.907346    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3109ef99-0f01-4098-b335-50b2fcde3f67-openshift-service-ca\") pod \"maas-api-6d767997f7-mszbw\" (UID: \"3109ef99-0f01-4098-b335-50b2fcde3f67\") " pod="odh-ai-gateway-infra/maas-api-6d767997f7-mszbw"
Sep 06 19:50:40.909261 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:40.909230    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3109ef99-0f01-4098-b335-50b2fcde3f67-metrics-certs\") pod \"maas-api-6d767997f7-mszbw\" (UID: \"3109ef99-0f01-4098-b335-50b2fcde3f67\") " pod="odh-ai-gateway-infra/maas-api-6d767997f7-mszbw"
Sep 06 19:50:40.909375 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:40.909268    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3109ef99-0f01-4098-b335-50b2fcde3f67-maas-api-tls\") pod \"maas-api-6d767997f7-mszbw\" (UID: \"3109ef99-0f01-4098-b335-50b2fcde3f67\") " pod="odh-ai-gateway-infra/maas-api-6d767997f7-mszbw"
Sep 06 19:50:40.914207 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:40.914190    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snfkh\" (UniqueName: \"kubernetes.io/projected/3109ef99-0f01-4098-b335-50b2fcde3f67-kube-api-access-snfkh\") pod \"maas-api-6d767997f7-mszbw\" (UID: \"3109ef99-0f01-4098-b335-50b2fcde3f67\") " pod="odh-ai-gateway-infra/maas-api-6d767997f7-mszbw"
Sep 06 19:50:41.016407 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:41.016377    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d767997f7-mszbw"
Sep 06 19:50:41.289296 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:41.289216    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d767997f7-mszbw"]
Sep 06 19:50:41.292024 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:50:41.291991    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3109ef99_0f01_4098_b335_50b2fcde3f67.slice/crio-3e0bf4974d8d960ab89bd7e5ed97b35631bf35dfb1c4663a898f08df1de89d05 WatchSource:0}: Error finding container 3e0bf4974d8d960ab89bd7e5ed97b35631bf35dfb1c4663a898f08df1de89d05: Status 404 returned error can't find the container with id 3e0bf4974d8d960ab89bd7e5ed97b35631bf35dfb1c4663a898f08df1de89d05
Sep 06 19:50:41.293560 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:41.293540    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 19:50:41.901267 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:41.901232    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d767997f7-mszbw" event={"ID":"3109ef99-0f01-4098-b335-50b2fcde3f67","Type":"ContainerStarted","Data":"64020bb6ad196ab6dc07ed3771c602646ef2a761f2c8d35c0a89d331c7f851a7"}
Sep 06 19:50:41.901737 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:41.901286    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d767997f7-mszbw" event={"ID":"3109ef99-0f01-4098-b335-50b2fcde3f67","Type":"ContainerStarted","Data":"3e0bf4974d8d960ab89bd7e5ed97b35631bf35dfb1c4663a898f08df1de89d05"}
Sep 06 19:50:41.901737 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:41.901365    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6d767997f7-mszbw"
Sep 06 19:50:41.916317 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:41.916269    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6d767997f7-mszbw" podStartSLOduration=1.522381694 podStartE2EDuration="1.916241526s" totalImagesPullingTime="393.859832ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:50:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:50:41.915736239 +0000 UTC m=+2388.156621607" watchObservedRunningTime="2026-09-06 19:50:41.916241526 +0000 UTC m=+2388.157126872"
Sep 06 19:50:47.911544 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:47.911512    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6d767997f7-mszbw"
Sep 06 19:50:47.953486 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:47.953435    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5cb9864d77-hn8w5"]
Sep 06 19:50:47.953775 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:47.953738    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-5cb9864d77-hn8w5" podUID="5ba11fbc-47b8-4789-9268-15956a082e56" containerName="maas-api" containerID="cri-o://5e07fc3d1d1b4f9cf66cadd81677638b71600c1c3fee7597ff317b60e39f3a98" gracePeriod=30
Sep 06 19:50:49.195886 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:49.195862    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5cb9864d77-hn8w5"
Sep 06 19:50:49.276597 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:49.276521    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ba11fbc-47b8-4789-9268-15956a082e56-maas-api-tls\") pod \"5ba11fbc-47b8-4789-9268-15956a082e56\" (UID: \"5ba11fbc-47b8-4789-9268-15956a082e56\") "
Sep 06 19:50:49.276597 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:49.276578    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ba11fbc-47b8-4789-9268-15956a082e56-openshift-service-ca\") pod \"5ba11fbc-47b8-4789-9268-15956a082e56\" (UID: \"5ba11fbc-47b8-4789-9268-15956a082e56\") "
Sep 06 19:50:49.276811 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:49.276600    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5d2g\" (UniqueName: \"kubernetes.io/projected/5ba11fbc-47b8-4789-9268-15956a082e56-kube-api-access-l5d2g\") pod \"5ba11fbc-47b8-4789-9268-15956a082e56\" (UID: \"5ba11fbc-47b8-4789-9268-15956a082e56\") "
Sep 06 19:50:49.276811 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:49.276633    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ba11fbc-47b8-4789-9268-15956a082e56-metrics-certs\") pod \"5ba11fbc-47b8-4789-9268-15956a082e56\" (UID: \"5ba11fbc-47b8-4789-9268-15956a082e56\") "
Sep 06 19:50:49.276951 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:49.276923    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ba11fbc-47b8-4789-9268-15956a082e56-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5ba11fbc-47b8-4789-9268-15956a082e56" (UID: "5ba11fbc-47b8-4789-9268-15956a082e56"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:50:49.278789 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:49.278762    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ba11fbc-47b8-4789-9268-15956a082e56-kube-api-access-l5d2g" (OuterVolumeSpecName: "kube-api-access-l5d2g") pod "5ba11fbc-47b8-4789-9268-15956a082e56" (UID: "5ba11fbc-47b8-4789-9268-15956a082e56"). InnerVolumeSpecName "kube-api-access-l5d2g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:50:49.278889 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:49.278802    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ba11fbc-47b8-4789-9268-15956a082e56-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5ba11fbc-47b8-4789-9268-15956a082e56" (UID: "5ba11fbc-47b8-4789-9268-15956a082e56"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:50:49.278889 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:49.278833    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ba11fbc-47b8-4789-9268-15956a082e56-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5ba11fbc-47b8-4789-9268-15956a082e56" (UID: "5ba11fbc-47b8-4789-9268-15956a082e56"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:50:49.377344 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:49.377317    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ba11fbc-47b8-4789-9268-15956a082e56-maas-api-tls\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:50:49.377344 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:49.377341    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ba11fbc-47b8-4789-9268-15956a082e56-openshift-service-ca\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:50:49.377496 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:49.377350    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5d2g\" (UniqueName: \"kubernetes.io/projected/5ba11fbc-47b8-4789-9268-15956a082e56-kube-api-access-l5d2g\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:50:49.377496 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:49.377360    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ba11fbc-47b8-4789-9268-15956a082e56-metrics-certs\") on node \"ip-10-0-135-37.ec2.internal\" DevicePath \"\""
Sep 06 19:50:49.937682 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:49.937639    2577 generic.go:356] "Generic (PLEG): container finished" podID="5ba11fbc-47b8-4789-9268-15956a082e56" containerID="5e07fc3d1d1b4f9cf66cadd81677638b71600c1c3fee7597ff317b60e39f3a98" exitCode=0
Sep 06 19:50:49.937682 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:49.937671    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5cb9864d77-hn8w5"
Sep 06 19:50:49.937919 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:49.937752    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5cb9864d77-hn8w5" event={"ID":"5ba11fbc-47b8-4789-9268-15956a082e56","Type":"ContainerDied","Data":"5e07fc3d1d1b4f9cf66cadd81677638b71600c1c3fee7597ff317b60e39f3a98"}
Sep 06 19:50:49.937919 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:49.937802    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5cb9864d77-hn8w5" event={"ID":"5ba11fbc-47b8-4789-9268-15956a082e56","Type":"ContainerDied","Data":"42ccbe86c06c514fb4ccd5272c7b357f8b8ede67fccee5cb4933de0e98e0fdcb"}
Sep 06 19:50:49.937919 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:49.937836    2577 scope.go:117] "RemoveContainer" containerID="5e07fc3d1d1b4f9cf66cadd81677638b71600c1c3fee7597ff317b60e39f3a98"
Sep 06 19:50:49.947878 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:49.947863    2577 scope.go:117] "RemoveContainer" containerID="5e07fc3d1d1b4f9cf66cadd81677638b71600c1c3fee7597ff317b60e39f3a98"
Sep 06 19:50:49.948089 ip-10-0-135-37 kubenswrapper[2577]: E0906 19:50:49.948070    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e07fc3d1d1b4f9cf66cadd81677638b71600c1c3fee7597ff317b60e39f3a98\": container with ID starting with 5e07fc3d1d1b4f9cf66cadd81677638b71600c1c3fee7597ff317b60e39f3a98 not found: ID does not exist" containerID="5e07fc3d1d1b4f9cf66cadd81677638b71600c1c3fee7597ff317b60e39f3a98"
Sep 06 19:50:49.948136 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:49.948101    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e07fc3d1d1b4f9cf66cadd81677638b71600c1c3fee7597ff317b60e39f3a98"} err="failed to get container status \"5e07fc3d1d1b4f9cf66cadd81677638b71600c1c3fee7597ff317b60e39f3a98\": rpc error: code = NotFound desc = could not find container \"5e07fc3d1d1b4f9cf66cadd81677638b71600c1c3fee7597ff317b60e39f3a98\": container with ID starting with 5e07fc3d1d1b4f9cf66cadd81677638b71600c1c3fee7597ff317b60e39f3a98 not found: ID does not exist"
Sep 06 19:50:49.957765 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:49.957745    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5cb9864d77-hn8w5"]
Sep 06 19:50:49.961670 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:49.961651    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-5cb9864d77-hn8w5"]
Sep 06 19:50:50.387598 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:50:50.387568    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ba11fbc-47b8-4789-9268-15956a082e56" path="/var/lib/kubelet/pods/5ba11fbc-47b8-4789-9268-15956a082e56/volumes"
Sep 06 19:51:11.330547 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:11.330514    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5694bddd64-bb57g_dad42734-69cc-432f-a51c-b38b2cae444a/manager/0.log"
Sep 06 19:51:11.434036 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:11.434009    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-zkjwv_47c657a4-8136-42ff-a024-bc21630a0039/server/0.log"
Sep 06 19:51:11.546887 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:11.546861    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-xk8l9_fb5f0c02-5fac-4f5e-9310-73d4b6bb66ef/manager/0.log"
Sep 06 19:51:11.656875 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:11.656811    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d4b9b44b9-5rtds_04e26f01-a4d2-41f8-809f-0ede64e569ab/copy-manifests/0.log"
Sep 06 19:51:11.669588 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:11.669568    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d4b9b44b9-5rtds_04e26f01-a4d2-41f8-809f-0ede64e569ab/manager/0.log"
Sep 06 19:51:12.231283 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:12.231255    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6d767997f7-mszbw_3109ef99-0f01-4098-b335-50b2fcde3f67/maas-api/0.log"
Sep 06 19:51:12.655222 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:12.655149    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-6vbks_9ff6d901-a29c-4a79-9c8c-8d8d0dd02a81/postgres/0.log"
Sep 06 19:51:13.843103 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:13.843074    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-tnfvc_a4d9c559-1754-496f-9f8a-8857f60417f3/manager/0.log"
Sep 06 19:51:14.535791 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:14.535760    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-mqwhm_c7c2e77a-f483-4c54-8594-b94209788dde/discovery/0.log"
Sep 06 19:51:14.643783 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:14.643756    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8b7764445-9nj2h_49454096-8bb7-4173-a3b9-5582f678e39d/kube-auth-proxy/0.log"
Sep 06 19:51:14.969869 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:14.969793    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-65s68_f0824d78-036b-4941-951b-70d428790bbd/payload-pre-processing/0.log"
Sep 06 19:51:15.077904 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:15.077871    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-gwhhc_5c4cec7e-5502-46d8-a4e3-6bb673b455e5/payload-processing/0.log"
Sep 06 19:51:15.625997 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:15.625968    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-rhxrh_68e274a0-ef23-4653-aa71-97001b099f9a/main/0.log"
Sep 06 19:51:15.839976 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:15.839939    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-fgfpj_20057929-47b7-43ac-ac46-08a0eafb78a0/main/0.log"
Sep 06 19:51:16.052268 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:16.052234    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-n4r92_3b70594a-29fd-483e-978f-89fd9e594c76/main/0.log"
Sep 06 19:51:24.276885 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:24.276818    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dtlr6_d89b285b-cadd-4b89-be22-17b20170f51c/global-pull-secret-syncer/0.log"
Sep 06 19:51:24.384649 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:24.384622    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-q6xzx_d77df511-1f2b-4241-a1eb-8b46deadea8d/konnectivity-agent/0.log"
Sep 06 19:51:24.441990 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:24.441956    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-37.ec2.internal_6ec9d6b0deae2fcae3f224177b618fa3/haproxy/0.log"
Sep 06 19:51:29.370012 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:29.369982    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-tnfvc_a4d9c559-1754-496f-9f8a-8857f60417f3/manager/0.log"
Sep 06 19:51:31.266505 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:31.266455    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jzdvv_776dc5e7-889d-43ce-a675-bfc52276aebb/node-exporter/0.log"
Sep 06 19:51:31.287428 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:31.287404    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jzdvv_776dc5e7-889d-43ce-a675-bfc52276aebb/kube-rbac-proxy/0.log"
Sep 06 19:51:31.309289 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:31.309269    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jzdvv_776dc5e7-889d-43ce-a675-bfc52276aebb/init-textfile/0.log"
Sep 06 19:51:33.318351 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:33.318323    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-g982h_d59fb326-5ce6-4955-8d91-1c4f2dda0b15/networking-console-plugin/0.log"
Sep 06 19:51:34.413159 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:34.413125    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cqltr/perf-node-gather-daemonset-p56sg"]
Sep 06 19:51:34.413544 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:34.413436    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ba11fbc-47b8-4789-9268-15956a082e56" containerName="maas-api"
Sep 06 19:51:34.413544 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:34.413450    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ba11fbc-47b8-4789-9268-15956a082e56" containerName="maas-api"
Sep 06 19:51:34.413544 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:34.413531    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ba11fbc-47b8-4789-9268-15956a082e56" containerName="maas-api"
Sep 06 19:51:34.416228 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:34.416208    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cqltr/perf-node-gather-daemonset-p56sg"
Sep 06 19:51:34.418182 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:34.418157    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cqltr\"/\"openshift-service-ca.crt\""
Sep 06 19:51:34.418316 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:34.418300    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cqltr\"/\"kube-root-ca.crt\""
Sep 06 19:51:34.418865 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:34.418839    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-cqltr\"/\"default-dockercfg-dr2sd\""
Sep 06 19:51:34.423277 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:34.423258    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cqltr/perf-node-gather-daemonset-p56sg"]
Sep 06 19:51:34.426092 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:34.426070    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr86x\" (UniqueName: \"kubernetes.io/projected/ba85445a-5030-4daf-a21f-b9de1583c854-kube-api-access-xr86x\") pod \"perf-node-gather-daemonset-p56sg\" (UID: \"ba85445a-5030-4daf-a21f-b9de1583c854\") " pod="openshift-must-gather-cqltr/perf-node-gather-daemonset-p56sg"
Sep 06 19:51:34.426189 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:34.426115    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ba85445a-5030-4daf-a21f-b9de1583c854-proc\") pod \"perf-node-gather-daemonset-p56sg\" (UID: \"ba85445a-5030-4daf-a21f-b9de1583c854\") " pod="openshift-must-gather-cqltr/perf-node-gather-daemonset-p56sg"
Sep 06 19:51:34.426189 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:34.426141    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba85445a-5030-4daf-a21f-b9de1583c854-lib-modules\") pod \"perf-node-gather-daemonset-p56sg\" (UID: \"ba85445a-5030-4daf-a21f-b9de1583c854\") " pod="openshift-must-gather-cqltr/perf-node-gather-daemonset-p56sg"
Sep 06 19:51:34.426322 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:34.426236    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba85445a-5030-4daf-a21f-b9de1583c854-sys\") pod \"perf-node-gather-daemonset-p56sg\" (UID: \"ba85445a-5030-4daf-a21f-b9de1583c854\") " pod="openshift-must-gather-cqltr/perf-node-gather-daemonset-p56sg"
Sep 06 19:51:34.426322 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:34.426282    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ba85445a-5030-4daf-a21f-b9de1583c854-podres\") pod \"perf-node-gather-daemonset-p56sg\" (UID: \"ba85445a-5030-4daf-a21f-b9de1583c854\") " pod="openshift-must-gather-cqltr/perf-node-gather-daemonset-p56sg"
Sep 06 19:51:34.527046 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:34.527019    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba85445a-5030-4daf-a21f-b9de1583c854-sys\") pod \"perf-node-gather-daemonset-p56sg\" (UID: \"ba85445a-5030-4daf-a21f-b9de1583c854\") " pod="openshift-must-gather-cqltr/perf-node-gather-daemonset-p56sg"
Sep 06 19:51:34.527168 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:34.527058    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ba85445a-5030-4daf-a21f-b9de1583c854-podres\") pod \"perf-node-gather-daemonset-p56sg\" (UID: \"ba85445a-5030-4daf-a21f-b9de1583c854\") " pod="openshift-must-gather-cqltr/perf-node-gather-daemonset-p56sg"
Sep 06 19:51:34.527168 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:34.527090    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr86x\" (UniqueName: \"kubernetes.io/projected/ba85445a-5030-4daf-a21f-b9de1583c854-kube-api-access-xr86x\") pod \"perf-node-gather-daemonset-p56sg\" (UID: \"ba85445a-5030-4daf-a21f-b9de1583c854\") " pod="openshift-must-gather-cqltr/perf-node-gather-daemonset-p56sg"
Sep 06 19:51:34.527168 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:34.527118    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ba85445a-5030-4daf-a21f-b9de1583c854-proc\") pod \"perf-node-gather-daemonset-p56sg\" (UID: \"ba85445a-5030-4daf-a21f-b9de1583c854\") " pod="openshift-must-gather-cqltr/perf-node-gather-daemonset-p56sg"
Sep 06 19:51:34.527168 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:34.527132    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba85445a-5030-4daf-a21f-b9de1583c854-lib-modules\") pod \"perf-node-gather-daemonset-p56sg\" (UID: \"ba85445a-5030-4daf-a21f-b9de1583c854\") " pod="openshift-must-gather-cqltr/perf-node-gather-daemonset-p56sg"
Sep 06 19:51:34.527168 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:34.527134    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba85445a-5030-4daf-a21f-b9de1583c854-sys\") pod \"perf-node-gather-daemonset-p56sg\" (UID: \"ba85445a-5030-4daf-a21f-b9de1583c854\") " pod="openshift-must-gather-cqltr/perf-node-gather-daemonset-p56sg"
Sep 06 19:51:34.527361 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:34.527197    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ba85445a-5030-4daf-a21f-b9de1583c854-podres\") pod \"perf-node-gather-daemonset-p56sg\" (UID: \"ba85445a-5030-4daf-a21f-b9de1583c854\") " pod="openshift-must-gather-cqltr/perf-node-gather-daemonset-p56sg"
Sep 06 19:51:34.527361 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:34.527228    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ba85445a-5030-4daf-a21f-b9de1583c854-proc\") pod \"perf-node-gather-daemonset-p56sg\" (UID: \"ba85445a-5030-4daf-a21f-b9de1583c854\") " pod="openshift-must-gather-cqltr/perf-node-gather-daemonset-p56sg"
Sep 06 19:51:34.527361 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:34.527232    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba85445a-5030-4daf-a21f-b9de1583c854-lib-modules\") pod \"perf-node-gather-daemonset-p56sg\" (UID: \"ba85445a-5030-4daf-a21f-b9de1583c854\") " pod="openshift-must-gather-cqltr/perf-node-gather-daemonset-p56sg"
Sep 06 19:51:34.535701 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:34.535676    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr86x\" (UniqueName: \"kubernetes.io/projected/ba85445a-5030-4daf-a21f-b9de1583c854-kube-api-access-xr86x\") pod \"perf-node-gather-daemonset-p56sg\" (UID: \"ba85445a-5030-4daf-a21f-b9de1583c854\") " pod="openshift-must-gather-cqltr/perf-node-gather-daemonset-p56sg"
Sep 06 19:51:34.726806 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:34.726788    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cqltr/perf-node-gather-daemonset-p56sg"
Sep 06 19:51:34.994282 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:34.994258    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cqltr/perf-node-gather-daemonset-p56sg"]
Sep 06 19:51:34.996167 ip-10-0-135-37 kubenswrapper[2577]: W0906 19:51:34.996142    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podba85445a_5030_4daf_a21f_b9de1583c854.slice/crio-12e066e8f57cb8eeffb176168ae65a09b79a86600faa9a5edff5aea03b81a62c WatchSource:0}: Error finding container 12e066e8f57cb8eeffb176168ae65a09b79a86600faa9a5edff5aea03b81a62c: Status 404 returned error can't find the container with id 12e066e8f57cb8eeffb176168ae65a09b79a86600faa9a5edff5aea03b81a62c
Sep 06 19:51:35.143860 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:35.143833    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cqltr/perf-node-gather-daemonset-p56sg" event={"ID":"ba85445a-5030-4daf-a21f-b9de1583c854","Type":"ContainerStarted","Data":"8e3571e38f1f1e9b5421b5f8591ac48766ec59a44947be3f0376c0248de59154"}
Sep 06 19:51:35.143978 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:35.143889    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cqltr/perf-node-gather-daemonset-p56sg" event={"ID":"ba85445a-5030-4daf-a21f-b9de1583c854","Type":"ContainerStarted","Data":"12e066e8f57cb8eeffb176168ae65a09b79a86600faa9a5edff5aea03b81a62c"}
Sep 06 19:51:35.143978 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:35.143933    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-cqltr/perf-node-gather-daemonset-p56sg"
Sep 06 19:51:35.159583 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:35.159541    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-cqltr/perf-node-gather-daemonset-p56sg" podStartSLOduration=1.159527091 podStartE2EDuration="1.159527091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 19:51:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:51:35.157647484 +0000 UTC m=+2441.398532828" watchObservedRunningTime="2026-09-06 19:51:35.159527091 +0000 UTC m=+2441.400412436"
Sep 06 19:51:36.359971 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:36.359916    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2s46l_342dbbef-dc3c-4b6c-bbe6-77727df044e5/dns/0.log"
Sep 06 19:51:36.383139 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:36.383112    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2s46l_342dbbef-dc3c-4b6c-bbe6-77727df044e5/kube-rbac-proxy/0.log"
Sep 06 19:51:36.479285 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:36.479262    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-d7s2q_1dcb8c05-bebe-4e55-bee3-fcda70b424b4/dns-node-resolver/0.log"
Sep 06 19:51:37.057879 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:37.057849    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fxkhd_00c5b89b-8ae6-4d75-9906-3b0ed677d9b2/node-ca/0.log"
Sep 06 19:51:38.259071 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:38.259034    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-mqwhm_c7c2e77a-f483-4c54-8594-b94209788dde/discovery/0.log"
Sep 06 19:51:38.276455 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:38.276432    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8b7764445-9nj2h_49454096-8bb7-4173-a3b9-5582f678e39d/kube-auth-proxy/0.log"
Sep 06 19:51:38.364056 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:38.364030    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-65s68_f0824d78-036b-4941-951b-70d428790bbd/payload-pre-processing/0.log"
Sep 06 19:51:38.394743 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:38.394722    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-gwhhc_5c4cec7e-5502-46d8-a4e3-6bb673b455e5/payload-processing/0.log"
Sep 06 19:51:39.216858 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:39.216827    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jnw6x_f028f00d-b01c-42bf-babe-63aa84ea6b53/serve-healthcheck-canary/0.log"
Sep 06 19:51:39.724339 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:39.724312    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-45m4z_8a2640d1-f766-4c7d-af33-ef7855731bae/kube-rbac-proxy/0.log"
Sep 06 19:51:39.742101 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:39.742079    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-45m4z_8a2640d1-f766-4c7d-af33-ef7855731bae/exporter/0.log"
Sep 06 19:51:39.762662 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:39.762638    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-45m4z_8a2640d1-f766-4c7d-af33-ef7855731bae/extractor/0.log"
Sep 06 19:51:41.157417 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:41.157392    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-cqltr/perf-node-gather-daemonset-p56sg"
Sep 06 19:51:42.242912 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:42.242882    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5694bddd64-bb57g_dad42734-69cc-432f-a51c-b38b2cae444a/manager/0.log"
Sep 06 19:51:42.261844 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:42.261817    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-zkjwv_47c657a4-8136-42ff-a024-bc21630a0039/server/0.log"
Sep 06 19:51:42.339261 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:42.339240    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-xk8l9_fb5f0c02-5fac-4f5e-9310-73d4b6bb66ef/manager/0.log"
Sep 06 19:51:42.411678 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:42.411655    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d4b9b44b9-5rtds_04e26f01-a4d2-41f8-809f-0ede64e569ab/manager/0.log"
Sep 06 19:51:42.428586 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:42.428568    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d4b9b44b9-5rtds_04e26f01-a4d2-41f8-809f-0ede64e569ab/copy-manifests/0.log"
Sep 06 19:51:44.025679 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:44.025654    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-68l9q_082bf3f2-7c45-46f5-80a1-119de026a898/openshift-lws-operator/0.log"
Sep 06 19:51:45.080139 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:45.080105    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-mqwhm_c7c2e77a-f483-4c54-8594-b94209788dde/discovery/0.log"
Sep 06 19:51:45.089117 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:45.089089    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8b7764445-9nj2h_49454096-8bb7-4173-a3b9-5582f678e39d/kube-auth-proxy/0.log"
Sep 06 19:51:45.151393 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:45.151368    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-65s68_f0824d78-036b-4941-951b-70d428790bbd/payload-pre-processing/0.log"
Sep 06 19:51:45.176326 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:45.176278    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-gwhhc_5c4cec7e-5502-46d8-a4e3-6bb673b455e5/payload-processing/0.log"
Sep 06 19:51:46.955139 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:46.955108    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-mqwhm_c7c2e77a-f483-4c54-8594-b94209788dde/discovery/0.log"
Sep 06 19:51:46.968525 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:46.968499    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8b7764445-9nj2h_49454096-8bb7-4173-a3b9-5582f678e39d/kube-auth-proxy/0.log"
Sep 06 19:51:47.042649 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:47.042620    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-65s68_f0824d78-036b-4941-951b-70d428790bbd/payload-pre-processing/0.log"
Sep 06 19:51:47.067809 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:47.067786    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-gwhhc_5c4cec7e-5502-46d8-a4e3-6bb673b455e5/payload-processing/0.log"
Sep 06 19:51:50.531882 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:50.531845    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l5h99_9cdb696e-5c36-4c08-931f-b7fb59581f94/kube-multus-additional-cni-plugins/0.log"
Sep 06 19:51:50.549691 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:50.549669    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l5h99_9cdb696e-5c36-4c08-931f-b7fb59581f94/egress-router-binary-copy/0.log"
Sep 06 19:51:50.566474 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:50.566453    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l5h99_9cdb696e-5c36-4c08-931f-b7fb59581f94/cni-plugins/0.log"
Sep 06 19:51:50.583627 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:50.583608    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l5h99_9cdb696e-5c36-4c08-931f-b7fb59581f94/bond-cni-plugin/0.log"
Sep 06 19:51:50.600727 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:50.600706    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l5h99_9cdb696e-5c36-4c08-931f-b7fb59581f94/routeoverride-cni/0.log"
Sep 06 19:51:50.617942 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:50.617923    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l5h99_9cdb696e-5c36-4c08-931f-b7fb59581f94/whereabouts-cni-bincopy/0.log"
Sep 06 19:51:50.635321 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:50.635300    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l5h99_9cdb696e-5c36-4c08-931f-b7fb59581f94/whereabouts-cni/0.log"
Sep 06 19:51:50.904463 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:50.904437    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xx8sw_85954a2a-213c-4053-86bd-8ea8a7126d88/kube-multus/0.log"
Sep 06 19:51:50.962479 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:50.962445    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vzktl_2f48c221-e457-4c65-b433-902fa3a75f09/network-metrics-daemon/0.log"
Sep 06 19:51:50.977240 ip-10-0-135-37 kubenswrapper[2577]: I0906 19:51:50.977222    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vzktl_2f48c221-e457-4c65-b433-902fa3a75f09/kube-rbac-proxy/0.log"