Sep 15 11:25:19.121897 ip-10-0-131-95 systemd[1]: Starting Kubernetes Kubelet...
Sep 15 11:25:19.496326 ip-10-0-131-95 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 11:25:19.496326 ip-10-0-131-95 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 15 11:25:19.496326 ip-10-0-131-95 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 11:25:19.496326 ip-10-0-131-95 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 15 11:25:19.496326 ip-10-0-131-95 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 11:25:19.498858 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.498737    2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 15 11:25:19.504508 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504491    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 11:25:19.504508 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504508    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 11:25:19.504576 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504512    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 11:25:19.504576 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504515    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 11:25:19.504576 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504519    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 11:25:19.504576 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504522    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 11:25:19.504576 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504525    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 11:25:19.504576 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504528    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 11:25:19.504576 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504531    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 11:25:19.504576 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504539    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 11:25:19.504576 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504542    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 11:25:19.504576 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504545    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 11:25:19.504576 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504548    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 11:25:19.504576 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504550    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 11:25:19.504576 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504553    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 11:25:19.504576 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504555    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 11:25:19.504576 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504558    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 11:25:19.504576 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504560    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 11:25:19.504576 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504563    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 11:25:19.504576 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504566    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 11:25:19.504576 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504568    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 11:25:19.504576 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504571    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 11:25:19.505067 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504574    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 11:25:19.505067 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504576    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 11:25:19.505067 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504579    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 11:25:19.505067 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504582    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 11:25:19.505067 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504585    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 11:25:19.505067 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504600    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 11:25:19.505067 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504603    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 11:25:19.505067 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504606    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 11:25:19.505067 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504608    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 11:25:19.505067 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504611    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 11:25:19.505067 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504614    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 11:25:19.505067 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504616    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 11:25:19.505067 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504619    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 11:25:19.505067 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504622    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 11:25:19.505067 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504624    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 11:25:19.505067 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504627    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 11:25:19.505067 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504629    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 11:25:19.505067 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504632    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 11:25:19.505067 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504635    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 11:25:19.505067 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504637    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 11:25:19.505554 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504641    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 11:25:19.505554 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504644    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 11:25:19.505554 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504646    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 11:25:19.505554 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504648    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 11:25:19.505554 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504653    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 11:25:19.505554 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504656    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 11:25:19.505554 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504659    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 11:25:19.505554 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504662    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 11:25:19.505554 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504677    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 11:25:19.505554 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504680    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 11:25:19.505554 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504683    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 11:25:19.505554 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504686    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 11:25:19.505554 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504689    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 11:25:19.505554 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504692    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 11:25:19.505554 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504695    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 11:25:19.505554 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504698    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 11:25:19.505554 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504702    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 11:25:19.505554 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504705    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 11:25:19.505554 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504708    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 11:25:19.506065 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504711    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 11:25:19.506065 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504713    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 11:25:19.506065 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504716    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 11:25:19.506065 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504718    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 11:25:19.506065 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504721    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 11:25:19.506065 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504723    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 11:25:19.506065 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504726    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 11:25:19.506065 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504729    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 11:25:19.506065 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504732    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 11:25:19.506065 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504735    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 11:25:19.506065 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504738    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 11:25:19.506065 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504740    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 11:25:19.506065 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504743    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 11:25:19.506065 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504747    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 11:25:19.506065 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504750    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 11:25:19.506065 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504753    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 11:25:19.506065 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504756    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 11:25:19.506065 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504758    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 11:25:19.506065 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504761    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 11:25:19.506524 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504763    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 11:25:19.506524 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504766    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 11:25:19.506524 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504768    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 11:25:19.506524 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504771    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 11:25:19.506524 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504773    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 11:25:19.506524 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504776    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 11:25:19.506524 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504778    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 11:25:19.506524 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504782    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 11:25:19.506524 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504785    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 11:25:19.506524 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504788    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 11:25:19.506524 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504791    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 11:25:19.506524 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504793    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 11:25:19.506524 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504796    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 11:25:19.506524 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504798    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 11:25:19.506524 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504801    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 11:25:19.506524 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504804    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 11:25:19.506524 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504806    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 11:25:19.506524 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504809    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 11:25:19.506524 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.504811    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 11:25:19.506524 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505545    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 11:25:19.507060 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505552    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 11:25:19.507060 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505555    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 11:25:19.507060 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505558    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 11:25:19.507060 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505560    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 11:25:19.507060 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505564    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 11:25:19.507060 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505566    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 11:25:19.507060 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505569    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 11:25:19.507060 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505571    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 11:25:19.507060 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505574    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 11:25:19.507060 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505577    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 11:25:19.507060 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505579    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 11:25:19.507060 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505582    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 11:25:19.507060 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505584    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 11:25:19.507060 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505604    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 11:25:19.507060 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505607    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 11:25:19.507060 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505609    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 11:25:19.507060 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505612    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 11:25:19.507060 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505615    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 11:25:19.507060 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505617    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 11:25:19.507060 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505623    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 11:25:19.507553 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505626    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 11:25:19.507553 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505628    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 11:25:19.507553 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505631    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 11:25:19.507553 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505634    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 11:25:19.507553 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505638    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 11:25:19.507553 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505642    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 11:25:19.507553 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505645    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 11:25:19.507553 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505648    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 11:25:19.507553 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505651    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 11:25:19.507553 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505653    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 11:25:19.507553 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505656    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 11:25:19.507553 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505658    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 11:25:19.507553 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505661    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 11:25:19.507553 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505664    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 11:25:19.507553 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505666    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 11:25:19.507553 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505669    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 11:25:19.507553 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505671    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 11:25:19.507553 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505675    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 11:25:19.507553 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505678    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 11:25:19.508062 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505681    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 11:25:19.508062 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505684    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 11:25:19.508062 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505687    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 11:25:19.508062 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505690    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 11:25:19.508062 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505693    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 11:25:19.508062 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505696    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 11:25:19.508062 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505698    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 11:25:19.508062 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505700    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 11:25:19.508062 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505703    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 11:25:19.508062 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505705    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 11:25:19.508062 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505708    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 11:25:19.508062 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505711    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 11:25:19.508062 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505714    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 11:25:19.508062 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505717    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 11:25:19.508062 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505719    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 11:25:19.508062 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505722    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 11:25:19.508062 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505724    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 11:25:19.508062 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505727    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 11:25:19.508062 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505729    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 11:25:19.508062 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505732    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 11:25:19.508565 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505734    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 11:25:19.508565 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505737    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 11:25:19.508565 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505739    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 11:25:19.508565 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505741    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 11:25:19.508565 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505745    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 11:25:19.508565 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505749    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 11:25:19.508565 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505752    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 11:25:19.508565 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505754    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 11:25:19.508565 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505757    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 11:25:19.508565 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505760    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 11:25:19.508565 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505762    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 11:25:19.508565 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505766    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 11:25:19.508565 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505769    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 11:25:19.508565 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505772    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 11:25:19.508565 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505775    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 11:25:19.508565 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505777    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 11:25:19.508565 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505780    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 11:25:19.508565 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505782    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 11:25:19.508565 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505785    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 11:25:19.509045 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505787    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 11:25:19.509045 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505789    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 11:25:19.509045 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505792    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 11:25:19.509045 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505794    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 11:25:19.509045 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505798    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 11:25:19.509045 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505802    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 11:25:19.509045 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505804    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 11:25:19.509045 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505807    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 11:25:19.509045 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505809    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 11:25:19.509045 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505811    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 11:25:19.509045 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505814    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 11:25:19.509045 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505816    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 11:25:19.509045 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505818    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 11:25:19.509045 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505821    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 11:25:19.509045 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505823    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 11:25:19.509045 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505826    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 11:25:19.509045 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505828    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 11:25:19.509045 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505831    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 11:25:19.509045 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505833    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 11:25:19.509045 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.505836    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 11:25:19.509526 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506254    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 11:25:19.509526 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506259    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 11:25:19.509526 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506262    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 11:25:19.509526 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506265    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 11:25:19.509526 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506277    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 11:25:19.509526 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506280    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 11:25:19.509526 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506283    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 11:25:19.509526 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506286    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 11:25:19.509526 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506288    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 11:25:19.509526 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506291    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 11:25:19.509526 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506293    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 11:25:19.509526 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506295    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 11:25:19.509526 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506298    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 11:25:19.509526 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506300    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 11:25:19.509526 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506303    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 11:25:19.509526 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506305    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 11:25:19.509526 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506308    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 11:25:19.509526 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506312    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 11:25:19.509526 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506314    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 11:25:19.509526 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506317    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 11:25:19.510107 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506320    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 11:25:19.510107 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506323    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 11:25:19.510107 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506325    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 11:25:19.510107 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506328    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 11:25:19.510107 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506330    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 11:25:19.510107 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506332    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 11:25:19.510107 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506335    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 11:25:19.510107 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506338    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 11:25:19.510107 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506340    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 11:25:19.510107 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506342    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 11:25:19.510107 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506345    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 11:25:19.510107 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506349    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 11:25:19.510107 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506352    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 11:25:19.510107 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506355    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 11:25:19.510107 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506357    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 11:25:19.510107 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506360    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 11:25:19.510107 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506362    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 11:25:19.510107 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506365    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 11:25:19.510107 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506368    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 11:25:19.510107 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506370    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 11:25:19.510606 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506372    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 11:25:19.510606 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506375    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 11:25:19.510606 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506380    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 11:25:19.510606 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506383    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 11:25:19.510606 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506387    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 11:25:19.510606 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506390    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 11:25:19.510606 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506393    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 11:25:19.510606 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506397    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 11:25:19.510606 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506400    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 11:25:19.510606 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506405    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 11:25:19.510606 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506407    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 11:25:19.510606 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506410    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 11:25:19.510606 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506413    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 11:25:19.510606 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506416    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 11:25:19.510606 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506418    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 11:25:19.510606 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506421    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 11:25:19.510606 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506423    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 11:25:19.510606 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506425    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 11:25:19.510606 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506428    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 11:25:19.510606 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506430    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 11:25:19.511092 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506433    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 11:25:19.511092 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506435    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 11:25:19.511092 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506438    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 11:25:19.511092 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506440    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 11:25:19.511092 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506442    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 11:25:19.511092 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506445    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 11:25:19.511092 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506447    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 11:25:19.511092 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506449    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 11:25:19.511092 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506452    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 11:25:19.511092 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506454    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 11:25:19.511092 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506457    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 11:25:19.511092 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506460    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 11:25:19.511092 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506462    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 11:25:19.511092 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506465    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 11:25:19.511092 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506467    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 11:25:19.511092 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506470    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 11:25:19.511092 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506472    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 11:25:19.511092 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506474    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 11:25:19.511092 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506478    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 11:25:19.511549 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506481    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 11:25:19.511549 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506484    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 11:25:19.511549 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506489    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 11:25:19.511549 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506492    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 11:25:19.511549 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506495    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 11:25:19.511549 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506498    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 11:25:19.511549 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506501    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 11:25:19.511549 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506503    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 11:25:19.511549 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506506    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 11:25:19.511549 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506508    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 11:25:19.511549 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506511    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 11:25:19.511549 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506513    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 11:25:19.511549 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506515    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 11:25:19.511549 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506518    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 11:25:19.511549 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506520    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 11:25:19.511549 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506523    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 11:25:19.511549 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506525    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 11:25:19.511549 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506528    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 11:25:19.511549 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506530    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 11:25:19.511549 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.506533    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 11:25:19.512039 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506625    2582 flags.go:64] FLAG: --address="0.0.0.0"
Sep 15 11:25:19.512039 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506668    2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 15 11:25:19.512039 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506674    2582 flags.go:64] FLAG: --anonymous-auth="true"
Sep 15 11:25:19.512039 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506679    2582 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 15 11:25:19.512039 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506684    2582 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 15 11:25:19.512039 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506688    2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 15 11:25:19.512039 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506693    2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 15 11:25:19.512039 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506697    2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 15 11:25:19.512039 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506700    2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 15 11:25:19.512039 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506703    2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 15 11:25:19.512039 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506706    2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 15 11:25:19.512039 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506710    2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 15 11:25:19.512039 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506713    2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 15 11:25:19.512039 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506716    2582 flags.go:64] FLAG: --cgroup-root=""
Sep 15 11:25:19.512039 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506720    2582 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 15 11:25:19.512039 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506723    2582 flags.go:64] FLAG: --client-ca-file=""
Sep 15 11:25:19.512039 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506725    2582 flags.go:64] FLAG: --cloud-provider="external"
Sep 15 11:25:19.512039 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506728    2582 flags.go:64] FLAG: --cluster-dns="[]"
Sep 15 11:25:19.512039 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506733    2582 flags.go:64] FLAG: --cluster-domain=""
Sep 15 11:25:19.512039 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506735    2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 15 11:25:19.512039 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506738    2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 15 11:25:19.512039 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506741    2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 15 11:25:19.512039 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506744    2582 flags.go:64] FLAG: --container-log-max-files="5"
Sep 15 11:25:19.512039 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506748    2582 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 15 11:25:19.512636 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506751    2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 15 11:25:19.512636 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506754    2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 15 11:25:19.512636 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506757    2582 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 15 11:25:19.512636 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506760    2582 flags.go:64] FLAG: --contention-profiling="false"
Sep 15 11:25:19.512636 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506763    2582 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 15 11:25:19.512636 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506766    2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 15 11:25:19.512636 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506769    2582 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 15 11:25:19.512636 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506771    2582 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 15 11:25:19.512636 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506776    2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 15 11:25:19.512636 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506779    2582 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 15 11:25:19.512636 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506781    2582 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 15 11:25:19.512636 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506784    2582 flags.go:64] FLAG: --enable-load-reader="false"
Sep 15 11:25:19.512636 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506786    2582 flags.go:64] FLAG: --enable-server="true"
Sep 15 11:25:19.512636 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506790    2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 15 11:25:19.512636 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506794    2582 flags.go:64] FLAG: --event-burst="100"
Sep 15 11:25:19.512636 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506797    2582 flags.go:64] FLAG: --event-qps="50"
Sep 15 11:25:19.512636 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506800    2582 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 15 11:25:19.512636 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506803    2582 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 15 11:25:19.512636 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506805    2582 flags.go:64] FLAG: --eviction-hard=""
Sep 15 11:25:19.512636 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506809    2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 15 11:25:19.512636 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506811    2582 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 15 11:25:19.512636 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506817    2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 15 11:25:19.512636 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506820    2582 flags.go:64] FLAG: --eviction-soft=""
Sep 15 11:25:19.512636 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506823    2582 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 15 11:25:19.512636 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506826    2582 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 15 11:25:19.513279 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506829    2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 15 11:25:19.513279 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506832    2582 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 15 11:25:19.513279 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506835    2582 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 15 11:25:19.513279 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506838    2582 flags.go:64] FLAG: --fail-swap-on="true"
Sep 15 11:25:19.513279 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506841    2582 flags.go:64] FLAG: --feature-gates=""
Sep 15 11:25:19.513279 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506845    2582 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 15 11:25:19.513279 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506848    2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 15 11:25:19.513279 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506850    2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 15 11:25:19.513279 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506853    2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 15 11:25:19.513279 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506856    2582 flags.go:64] FLAG: --healthz-port="10248"
Sep 15 11:25:19.513279 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506859    2582 flags.go:64] FLAG: --help="false"
Sep 15 11:25:19.513279 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506862    2582 flags.go:64] FLAG: --hostname-override="ip-10-0-131-95.ec2.internal"
Sep 15 11:25:19.513279 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506865    2582 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 15 11:25:19.513279 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506868    2582 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 15 11:25:19.513279 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506871    2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 15 11:25:19.513279 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506874    2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 15 11:25:19.513279 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506877    2582 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 15 11:25:19.513279 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506880    2582 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 15 11:25:19.513279 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506882    2582 flags.go:64] FLAG: --image-service-endpoint=""
Sep 15 11:25:19.513279 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506885    2582 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 15 11:25:19.513279 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506888    2582 flags.go:64] FLAG: --kube-api-burst="100"
Sep 15 11:25:19.513279 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506891    2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 15 11:25:19.513279 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506894    2582 flags.go:64] FLAG: --kube-api-qps="50"
Sep 15 11:25:19.513279 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506897    2582 flags.go:64] FLAG: --kube-reserved=""
Sep 15 11:25:19.513932 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506900    2582 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 15 11:25:19.513932 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506903    2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 15 11:25:19.513932 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506906    2582 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 15 11:25:19.513932 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506908    2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 15 11:25:19.513932 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506912    2582 flags.go:64] FLAG: --lock-file=""
Sep 15 11:25:19.513932 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506916    2582 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 15 11:25:19.513932 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506919    2582 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 15 11:25:19.513932 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506922    2582 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 15 11:25:19.513932 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506927    2582 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 15 11:25:19.513932 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506930    2582 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 15 11:25:19.513932 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506933    2582 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 15 11:25:19.513932 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506936    2582 flags.go:64] FLAG: --logging-format="text"
Sep 15 11:25:19.513932 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506938    2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 15 11:25:19.513932 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506942    2582 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 15 11:25:19.513932 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506944    2582 flags.go:64] FLAG: --manifest-url=""
Sep 15 11:25:19.513932 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506947    2582 flags.go:64] FLAG: --manifest-url-header=""
Sep 15 11:25:19.513932 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506952    2582 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 15 11:25:19.513932 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506954    2582 flags.go:64] FLAG: --max-open-files="1000000"
Sep 15 11:25:19.513932 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506959    2582 flags.go:64] FLAG: --max-pods="110"
Sep 15 11:25:19.513932 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506962    2582 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 15 11:25:19.513932 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506965    2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 15 11:25:19.513932 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506967    2582 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 15 11:25:19.513932 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506970    2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 15 11:25:19.513932 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506973    2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 15 11:25:19.513932 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506976    2582 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 15 11:25:19.514558 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506979    2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 15 11:25:19.514558 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506986    2582 flags.go:64] FLAG: --node-status-max-images="50"
Sep 15 11:25:19.514558 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506989    2582 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 15 11:25:19.514558 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506992    2582 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 15 11:25:19.514558 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.506995    2582 flags.go:64] FLAG: --pod-cidr=""
Sep 15 11:25:19.514558 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507001    2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 15 11:25:19.514558 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507007    2582 flags.go:64] FLAG: --pod-manifest-path=""
Sep 15 11:25:19.514558 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507010    2582 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 15 11:25:19.514558 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507013    2582 flags.go:64] FLAG: --pods-per-core="0"
Sep 15 11:25:19.514558 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507015    2582 flags.go:64] FLAG: --port="10250"
Sep 15 11:25:19.514558 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507018    2582 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 15 11:25:19.514558 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507021    2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0762f05fc4977e831"
Sep 15 11:25:19.514558 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507026    2582 flags.go:64] FLAG: --qos-reserved=""
Sep 15 11:25:19.514558 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507029    2582 flags.go:64] FLAG: --read-only-port="10255"
Sep 15 11:25:19.514558 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507031    2582 flags.go:64] FLAG: --register-node="true"
Sep 15 11:25:19.514558 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507034    2582 flags.go:64] FLAG: --register-with-taints=""
Sep 15 11:25:19.514558 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507038    2582 flags.go:64] FLAG: --registry-burst="10"
Sep 15 11:25:19.514558 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507040    2582 flags.go:64] FLAG: --registry-qps="5"
Sep 15 11:25:19.514558 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507043    2582 flags.go:64] FLAG: --reserved-cpus=""
Sep 15 11:25:19.514558 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507046    2582 flags.go:64] FLAG: --reserved-memory=""
Sep 15 11:25:19.514558 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507050    2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 15 11:25:19.514558 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507053    2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 15 11:25:19.514558 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507055    2582 flags.go:64] FLAG: --rotate-certificates="false"
Sep 15 11:25:19.514558 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507058    2582 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 15 11:25:19.514558 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507061    2582 flags.go:64] FLAG: --runonce="false"
Sep 15 11:25:19.515181 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507064    2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 15 11:25:19.515181 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507067    2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 15 11:25:19.515181 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507070    2582 flags.go:64] FLAG: --seccomp-default="false"
Sep 15 11:25:19.515181 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507073    2582 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 15 11:25:19.515181 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507076    2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 15 11:25:19.515181 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507079    2582 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 15 11:25:19.515181 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507082    2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 15 11:25:19.515181 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507084    2582 flags.go:64] FLAG: --storage-driver-password="root"
Sep 15 11:25:19.515181 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507087    2582 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 15 11:25:19.515181 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507090    2582 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 15 11:25:19.515181 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507093    2582 flags.go:64] FLAG: --storage-driver-user="root"
Sep 15 11:25:19.515181 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507095    2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 15 11:25:19.515181 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507099    2582 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 15 11:25:19.515181 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507107    2582 flags.go:64] FLAG: --system-cgroups=""
Sep 15 11:25:19.515181 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507110    2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 15 11:25:19.515181 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507115    2582 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 15 11:25:19.515181 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507118    2582 flags.go:64] FLAG: --tls-cert-file=""
Sep 15 11:25:19.515181 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507121    2582 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 15 11:25:19.515181 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507125    2582 flags.go:64] FLAG: --tls-min-version=""
Sep 15 11:25:19.515181 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507130    2582 flags.go:64] FLAG: --tls-private-key-file=""
Sep 15 11:25:19.515181 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507132    2582 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 15 11:25:19.515181 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507135    2582 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 15 11:25:19.515181 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507138    2582 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 15 11:25:19.515181 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507141    2582 flags.go:64] FLAG: --v="2"
Sep 15 11:25:19.515181 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507145    2582 flags.go:64] FLAG: --version="false"
Sep 15 11:25:19.515798 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507149    2582 flags.go:64] FLAG: --vmodule=""
Sep 15 11:25:19.515798 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507152    2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 15 11:25:19.515798 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.507156    2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 15 11:25:19.515798 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507296    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 11:25:19.515798 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507301    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 11:25:19.515798 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507305    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 11:25:19.515798 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507308    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 11:25:19.515798 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507311    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 11:25:19.515798 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507314    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 11:25:19.515798 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507317    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 11:25:19.515798 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507320    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 11:25:19.515798 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507323    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 11:25:19.515798 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507326    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 11:25:19.515798 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507329    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 11:25:19.515798 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507331    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 11:25:19.515798 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507334    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 11:25:19.515798 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507336    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 11:25:19.515798 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507339    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 11:25:19.515798 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507341    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 11:25:19.515798 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507344    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 11:25:19.516291 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507346    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 11:25:19.516291 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507354    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 11:25:19.516291 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507357    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 11:25:19.516291 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507359    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 11:25:19.516291 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507362    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 11:25:19.516291 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507364    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 11:25:19.516291 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507369    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 11:25:19.516291 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507373    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 11:25:19.516291 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507376    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 11:25:19.516291 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507379    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 11:25:19.516291 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507382    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 11:25:19.516291 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507385    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 11:25:19.516291 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507387    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 11:25:19.516291 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507390    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 11:25:19.516291 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507393    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 11:25:19.516291 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507395    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 11:25:19.516291 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507398    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 11:25:19.516291 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507401    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 11:25:19.516291 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507403    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 11:25:19.516795 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507405    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 11:25:19.516795 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507408    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 11:25:19.516795 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507410    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 11:25:19.516795 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507413    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 11:25:19.516795 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507416    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 11:25:19.516795 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507418    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 11:25:19.516795 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507421    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 11:25:19.516795 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507423    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 11:25:19.516795 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507426    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 11:25:19.516795 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507428    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 11:25:19.516795 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507430    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 11:25:19.516795 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507433    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 11:25:19.516795 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507435    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 11:25:19.516795 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507438    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 11:25:19.516795 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507440    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 11:25:19.516795 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507448    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 11:25:19.516795 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507451    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 11:25:19.516795 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507453    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 11:25:19.516795 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507456    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 11:25:19.516795 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507461    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 11:25:19.517291 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507463    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 11:25:19.517291 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507466    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 11:25:19.517291 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507468    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 11:25:19.517291 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507471    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 11:25:19.517291 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507473    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 11:25:19.517291 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507476    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 11:25:19.517291 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507479    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 11:25:19.517291 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507482    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 11:25:19.517291 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507484    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 11:25:19.517291 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507487    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 11:25:19.517291 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507489    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 11:25:19.517291 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507492    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 11:25:19.517291 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507495    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 11:25:19.517291 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507497    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 11:25:19.517291 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507499    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 11:25:19.517291 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507503    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 11:25:19.517291 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507510    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 11:25:19.517291 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507513    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 11:25:19.517291 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507516    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 11:25:19.517771 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507518    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 11:25:19.517771 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507521    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 11:25:19.517771 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507523    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 11:25:19.517771 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507535    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 11:25:19.517771 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507537    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 11:25:19.517771 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507540    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 11:25:19.517771 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507542    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 11:25:19.517771 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507545    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 11:25:19.517771 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507547    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 11:25:19.517771 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507551    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 11:25:19.517771 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507553    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 11:25:19.517771 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507556    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 11:25:19.517771 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507560    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 11:25:19.517771 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507563    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 11:25:19.517771 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507566    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 11:25:19.517771 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507569    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 11:25:19.517771 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507572    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 11:25:19.517771 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507574    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 11:25:19.517771 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507577    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 11:25:19.517771 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507579    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 11:25:19.518264 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507582    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 11:25:19.518264 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507584    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 11:25:19.518264 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507599    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 11:25:19.518264 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.507602    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 11:25:19.518264 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.508227    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 11:25:19.518264 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.515358    2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 15 11:25:19.518264 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.515373    2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 15 11:25:19.518264 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.515392    2582 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 15 11:25:19.518264 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.515397    2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 15 11:25:19.518264 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515464    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 11:25:19.518264 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515469    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 11:25:19.518264 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515472    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 11:25:19.518264 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515476    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 11:25:19.518264 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515478    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 11:25:19.518264 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515481    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 11:25:19.518660 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515484    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 11:25:19.518660 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515487    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 11:25:19.518660 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515490    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 11:25:19.518660 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515492    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 11:25:19.518660 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515495    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 11:25:19.518660 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515498    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 11:25:19.518660 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515500    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 11:25:19.518660 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515503    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 11:25:19.518660 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515505    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 11:25:19.518660 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515508    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 11:25:19.518660 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515510    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 11:25:19.518660 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515513    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 11:25:19.518660 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515515    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 11:25:19.518660 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515518    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 11:25:19.518660 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515520    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 11:25:19.518660 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515523    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 11:25:19.518660 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515525    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 11:25:19.518660 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515528    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 11:25:19.518660 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515531    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 11:25:19.518660 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515533    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 11:25:19.519162 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515536    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 11:25:19.519162 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515538    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 11:25:19.519162 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515541    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 11:25:19.519162 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515545    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 11:25:19.519162 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515548    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 11:25:19.519162 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515551    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 11:25:19.519162 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515553    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 11:25:19.519162 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515556    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 11:25:19.519162 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515558    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 11:25:19.519162 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515561    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 11:25:19.519162 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515563    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 11:25:19.519162 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515566    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 11:25:19.519162 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515568    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 11:25:19.519162 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515570    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 11:25:19.519162 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515573    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 11:25:19.519162 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515575    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 11:25:19.519162 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515578    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 11:25:19.519162 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515580    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 11:25:19.519162 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515582    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 11:25:19.519806 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515585    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 11:25:19.519806 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515604    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 11:25:19.519806 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515607    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 11:25:19.519806 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515610    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 11:25:19.519806 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515612    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 11:25:19.519806 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515615    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 11:25:19.519806 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515617    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 11:25:19.519806 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515620    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 11:25:19.519806 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515622    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 11:25:19.519806 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515625    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 11:25:19.519806 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515628    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 11:25:19.519806 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515631    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 11:25:19.519806 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515633    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 11:25:19.519806 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515636    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 11:25:19.519806 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515639    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 11:25:19.519806 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515641    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 11:25:19.519806 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515645    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 11:25:19.519806 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515648    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 11:25:19.519806 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515651    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 11:25:19.519806 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515653    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 11:25:19.520346 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515656    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 11:25:19.520346 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515658    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 11:25:19.520346 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515661    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 11:25:19.520346 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515665    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 11:25:19.520346 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515668    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 11:25:19.520346 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515671    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 11:25:19.520346 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515673    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 11:25:19.520346 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515675    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 11:25:19.520346 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515678    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 11:25:19.520346 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515681    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 11:25:19.520346 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515683    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 11:25:19.520346 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515686    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 11:25:19.520346 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515688    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 11:25:19.520346 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515690    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 11:25:19.520346 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515693    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 11:25:19.520346 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515695    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 11:25:19.520346 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515698    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 11:25:19.520346 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515701    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 11:25:19.520346 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515703    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 11:25:19.520996 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515707    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 11:25:19.520996 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515711    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 11:25:19.520996 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515714    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 11:25:19.520996 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515717    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 11:25:19.520996 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515720    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 11:25:19.520996 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515722    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 11:25:19.520996 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515725    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 11:25:19.520996 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515727    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 11:25:19.520996 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515729    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 11:25:19.520996 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515732    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 11:25:19.520996 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515734    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 11:25:19.520996 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515737    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 11:25:19.520996 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515740    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 11:25:19.520996 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515743    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 11:25:19.520996 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515747    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 11:25:19.521477 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.515752    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 11:25:19.521477 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515883    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 11:25:19.521477 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515888    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 11:25:19.521477 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515891    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 11:25:19.521477 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515894    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 11:25:19.521477 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515897    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 11:25:19.521477 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515900    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 11:25:19.521477 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515903    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 11:25:19.521477 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515905    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 11:25:19.521477 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515908    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 11:25:19.521477 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515910    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 11:25:19.521477 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515913    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 11:25:19.521477 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515915    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 11:25:19.521477 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515918    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 11:25:19.521477 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515920    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 11:25:19.521870 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515923    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 11:25:19.521870 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515925    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 11:25:19.521870 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515927    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 11:25:19.521870 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515930    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 11:25:19.521870 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515932    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 11:25:19.521870 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515935    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 11:25:19.521870 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515937    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 11:25:19.521870 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515940    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 11:25:19.521870 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515942    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 11:25:19.521870 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515944    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 11:25:19.521870 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515947    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 11:25:19.521870 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515949    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 11:25:19.521870 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515951    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 11:25:19.521870 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515954    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 11:25:19.521870 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515956    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 11:25:19.521870 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515959    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 11:25:19.521870 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515961    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 11:25:19.521870 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515963    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 11:25:19.521870 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515966    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 11:25:19.521870 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515968    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 11:25:19.522716 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515971    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 11:25:19.522716 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515973    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 11:25:19.522716 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515976    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 11:25:19.522716 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515978    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 11:25:19.522716 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515980    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 11:25:19.522716 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515983    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 11:25:19.522716 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515985    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 11:25:19.522716 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515988    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 11:25:19.522716 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515990    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 11:25:19.522716 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515992    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 11:25:19.522716 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515995    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 11:25:19.522716 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.515997    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 11:25:19.522716 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516000    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 11:25:19.522716 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516002    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 11:25:19.522716 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516004    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 11:25:19.522716 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516007    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 11:25:19.522716 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516009    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 11:25:19.522716 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516011    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 11:25:19.522716 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516014    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 11:25:19.522716 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516017    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 11:25:19.523488 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516019    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 11:25:19.523488 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516023    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 11:25:19.523488 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516026    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 11:25:19.523488 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516029    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 11:25:19.523488 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516032    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 11:25:19.523488 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516034    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 11:25:19.523488 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516037    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 11:25:19.523488 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516040    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 11:25:19.523488 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516042    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 11:25:19.523488 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516045    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 11:25:19.523488 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516047    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 11:25:19.523488 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516050    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 11:25:19.523488 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516052    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 11:25:19.523488 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516055    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 11:25:19.523488 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516058    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 11:25:19.523488 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516061    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 11:25:19.523488 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516064    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 11:25:19.523488 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516066    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 11:25:19.523488 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516069    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 11:25:19.524106 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516072    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 11:25:19.524106 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516074    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 11:25:19.524106 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516077    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 11:25:19.524106 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516079    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 11:25:19.524106 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516081    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 11:25:19.524106 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516084    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 11:25:19.524106 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516086    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 11:25:19.524106 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516088    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 11:25:19.524106 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516091    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 11:25:19.524106 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516093    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 11:25:19.524106 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516096    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 11:25:19.524106 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516099    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 11:25:19.524106 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516101    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 11:25:19.524106 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516104    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 11:25:19.524106 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516106    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 11:25:19.524106 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516109    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 11:25:19.524106 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516111    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 11:25:19.524106 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516114    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 11:25:19.524106 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516116    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 11:25:19.524672 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516118    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 11:25:19.524672 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516120    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 11:25:19.524672 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516123    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 11:25:19.524672 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516126    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 11:25:19.524672 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516129    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 11:25:19.524672 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516132    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 11:25:19.524672 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:19.516136    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 11:25:19.524672 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.516140    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 11:25:19.524672 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.516642    2582 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 15 11:25:19.524672 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.518572    2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 15 11:25:19.524672 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.519400    2582 server.go:1019] "Starting client certificate rotation"
Sep 15 11:25:19.524672 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.519544    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 11:25:19.524672 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.519605    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 11:25:19.525002 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.522174    2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 11:25:19.526729 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.526706    2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 11:25:19.538387 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.538210    2582 log.go:25] "Validated CRI v1 runtime API"
Sep 15 11:25:19.541298 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.541282    2582 log.go:25] "Validated CRI v1 image API"
Sep 15 11:25:19.542239 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.542225    2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 15 11:25:19.546764 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.546745    2582 fs.go:135] Filesystem UUIDs: map[620ea23e-5941-4374-8a85-bbd8b838a4f4:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 b534a84a-d709-4764-a35a-0baafd6328da:/dev/nvme0n1p3]
Sep 15 11:25:19.546827 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.546764    2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 15 11:25:19.548839 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.548821    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 11:25:19.551849 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.551731    2582 manager.go:216] Machine: {Timestamp:2026-09-15 11:25:19.550514247 +0000 UTC m=+0.317965974 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3106839 MemoryCapacity:32812150784 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29079d6fd51887cbbb1cceca8fefc6 SystemUUID:ec29079d-6fd5-1887-cbbb-1cceca8fefc6 BootID:05db3be8-22e3-4aaa-8bca-82e2887d264b Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406073344 Type:vfs Inodes:4005389 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:f0:ee:db:87 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:f0:ee:db:87 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:cf:5f:20:ef:8f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812150784 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 15 11:25:19.551849 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.551842    2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 15 11:25:19.551965 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.551932    2582 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 15 11:25:19.555134 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.555100    2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 15 11:25:19.555283 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.555137    2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-95.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 15 11:25:19.555876 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.555865    2582 topology_manager.go:138] "Creating topology manager with none policy"
Sep 15 11:25:19.555908 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.555879    2582 container_manager_linux.go:309] "Creating device plugin manager"
Sep 15 11:25:19.555908 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.555887    2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 11:25:19.555908 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.555901    2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 11:25:19.556678 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.556667    2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 15 11:25:19.561066 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.561049    2582 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 11:25:19.561195 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.561185    2582 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 15 11:25:19.561228 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.561223    2582 kubelet.go:486] "Attempting to sync node with API server"
Sep 15 11:25:19.561255 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.561241    2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 15 11:25:19.561297 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.561261    2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 15 11:25:19.561297 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.561274    2582 kubelet.go:398] "Adding apiserver pod source"
Sep 15 11:25:19.561297 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.561283    2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 15 11:25:19.564829 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.564813    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 11:25:19.564829 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.564835    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 11:25:19.567338 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.567316    2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 15 11:25:19.570110 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.570089    2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 15 11:25:19.570208 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.570133    2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 15 11:25:19.572426 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.572402    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2cnrk"
Sep 15 11:25:19.573347 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.573139    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 15 11:25:19.573415 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.573360    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 15 11:25:19.573415 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.573368    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 15 11:25:19.573415 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.573374    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 15 11:25:19.573415 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.573383    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 15 11:25:19.573415 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.573389    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 15 11:25:19.573415 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.573404    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 15 11:25:19.573415 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.573409    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 15 11:25:19.573415 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.573416    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 15 11:25:19.573658 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.573422    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 15 11:25:19.573658 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.573430    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 15 11:25:19.573658 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.573436    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 15 11:25:19.574092 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.574082    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 15 11:25:19.574092 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.574092    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 15 11:25:19.577888 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:19.577854    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 15 11:25:19.577987 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:19.577930    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-95.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 15 11:25:19.577987 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.577977    2582 server.go:1268] "Started kubelet"
Sep 15 11:25:19.578080 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.577999    2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-95.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 15 11:25:19.578181 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.578096    2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 15 11:25:19.578256 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.578229    2582 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 15 11:25:19.578347 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.578100    2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 15 11:25:19.578973 ip-10-0-131-95 systemd[1]: Started Kubernetes Kubelet.
Sep 15 11:25:19.579658 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.579580    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2cnrk"
Sep 15 11:25:19.580652 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.580639    2582 server.go:310] "Adding debug handlers to kubelet server"
Sep 15 11:25:19.582893 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:19.582875    2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 15 11:25:19.583306 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.583292    2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 15 11:25:19.584338 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:19.583017    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-95.ec2.internal.18d57addb41f48c2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-95.ec2.internal,UID:ip-10-0-131-95.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-95.ec2.internal,},FirstTimestamp:2026-09-15 11:25:19.577950402 +0000 UTC m=+0.345402135,LastTimestamp:2026-09-15 11:25:19.577950402 +0000 UTC m=+0.345402135,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-95.ec2.internal,}"
Sep 15 11:25:19.589787 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.589765    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 15 11:25:19.590442 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.590425    2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 15 11:25:19.590697 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:19.590675    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-95.ec2.internal\" not found"
Sep 15 11:25:19.591105 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.591089    2582 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 15 11:25:19.591177 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.591114    2582 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 15 11:25:19.591177 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.591099    2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 15 11:25:19.591259 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.591183    2582 reconstruct.go:97] "Volume reconstruction finished"
Sep 15 11:25:19.591259 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.591190    2582 reconciler.go:29] "Reconciler: start to sync state"
Sep 15 11:25:19.591325 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.591301    2582 factory.go:55] Registering systemd factory
Sep 15 11:25:19.591325 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.591317    2582 factory.go:223] Registration of the systemd container factory successfully
Sep 15 11:25:19.591525 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.591513    2582 factory.go:153] Registering CRI-O factory
Sep 15 11:25:19.591571 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.591527    2582 factory.go:223] Registration of the crio container factory successfully
Sep 15 11:25:19.591630 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.591575    2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 15 11:25:19.591630 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.591608    2582 factory.go:103] Registering Raw factory
Sep 15 11:25:19.591630 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.591620    2582 manager.go:1196] Started watching for new ooms in manager
Sep 15 11:25:19.592025 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.592009    2582 manager.go:349] Starting recovery of all containers
Sep 15 11:25:19.593426 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.593385    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 11:25:19.597159 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:19.597126    2582 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-131-95.ec2.internal\" not found" node="ip-10-0-131-95.ec2.internal"
Sep 15 11:25:19.603930 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.603910    2582 manager.go:354] Recovery completed
Sep 15 11:25:19.608556 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.608541    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:25:19.610584 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.610567    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-95.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:25:19.610687 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.610613    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-95.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:25:19.610687 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.610625    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-95.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:25:19.611194 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.611180    2582 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 15 11:25:19.611194 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.611192    2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 15 11:25:19.611313 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.611210    2582 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 11:25:19.611313 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.611182    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:25:19.611953 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.611935    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-95.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:25:19.612029 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.611968    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-95.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:25:19.612029 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.611978    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-95.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:25:19.613572 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.613560    2582 policy_none.go:49] "None policy: Start"
Sep 15 11:25:19.613649 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.613578    2582 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 15 11:25:19.613649 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.613613    2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 15 11:25:19.615702 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.615689    2582 policy_none.go:47] "Start"
Sep 15 11:25:19.653284 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.653266    2582 manager.go:337] "Starting Device Plugin manager"
Sep 15 11:25:19.653394 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:19.653310    2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 15 11:25:19.653394 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.653322    2582 server.go:87] "Starting device plugin registration server"
Sep 15 11:25:19.653584 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.653570    2582 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 15 11:25:19.653670 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.653583    2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 15 11:25:19.653745 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.653724    2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 15 11:25:19.653848 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.653836    2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 15 11:25:19.653848 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.653848    2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 15 11:25:19.654633 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:19.654615    2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 15 11:25:19.654715 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:19.654658    2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-95.ec2.internal\" not found"
Sep 15 11:25:19.731792 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.731756    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 15 11:25:19.733059 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.733005    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 15 11:25:19.733059 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.733051    2582 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 15 11:25:19.733189 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.733077    2582 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 15 11:25:19.733189 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:19.733113    2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 15 11:25:19.735671 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.735651    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 11:25:19.754755 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.754682    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:25:19.755494 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.755480    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-95.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:25:19.755559 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.755509    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-95.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:25:19.755559 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.755519    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-95.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:25:19.755559 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.755539    2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-95.ec2.internal"
Sep 15 11:25:19.764227 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.764210    2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-95.ec2.internal"
Sep 15 11:25:19.764271 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:19.764232    2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-95.ec2.internal\": node \"ip-10-0-131-95.ec2.internal\" not found"
Sep 15 11:25:19.780600 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:19.780578    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-95.ec2.internal\" not found"
Sep 15 11:25:19.833823 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.833778    2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-95.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-95.ec2.internal"]
Sep 15 11:25:19.833929 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.833867    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:25:19.834840 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.834824    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-95.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:25:19.834919 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.834853    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-95.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:25:19.834919 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.834863    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-95.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:25:19.837083 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.837071    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:25:19.837233 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.837204    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-95.ec2.internal"
Sep 15 11:25:19.837282 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.837266    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:25:19.837858 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.837842    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-95.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:25:19.837938 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.837875    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-95.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:25:19.837938 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.837891    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-95.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:25:19.837938 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.837848    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-95.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:25:19.838070 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.837943    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-95.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:25:19.838070 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.837952    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-95.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:25:19.840025 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.840009    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-95.ec2.internal"
Sep 15 11:25:19.840108 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.840041    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:25:19.840757 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.840740    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-95.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:25:19.840828 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.840770    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-95.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:25:19.840828 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.840787    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-95.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:25:19.863126 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:19.863107    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-95.ec2.internal\" not found" node="ip-10-0-131-95.ec2.internal"
Sep 15 11:25:19.867249 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:19.867235    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-95.ec2.internal\" not found" node="ip-10-0-131-95.ec2.internal"
Sep 15 11:25:19.880853 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:19.880835    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-95.ec2.internal\" not found"
Sep 15 11:25:19.891702 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.891682    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8f133eefe581cc2b4f83ef628d20097a-config\") pod \"kube-apiserver-proxy-ip-10-0-131-95.ec2.internal\" (UID: \"8f133eefe581cc2b4f83ef628d20097a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-95.ec2.internal"
Sep 15 11:25:19.891759 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.891706    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b2ee1f13b8d1493e22d22da47f4cf77d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-95.ec2.internal\" (UID: \"b2ee1f13b8d1493e22d22da47f4cf77d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-95.ec2.internal"
Sep 15 11:25:19.891759 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.891743    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2ee1f13b8d1493e22d22da47f4cf77d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-95.ec2.internal\" (UID: \"b2ee1f13b8d1493e22d22da47f4cf77d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-95.ec2.internal"
Sep 15 11:25:19.981127 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:19.981101    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-95.ec2.internal\" not found"
Sep 15 11:25:19.992752 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.992709    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8f133eefe581cc2b4f83ef628d20097a-config\") pod \"kube-apiserver-proxy-ip-10-0-131-95.ec2.internal\" (UID: \"8f133eefe581cc2b4f83ef628d20097a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-95.ec2.internal"
Sep 15 11:25:19.992876 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.992753    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b2ee1f13b8d1493e22d22da47f4cf77d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-95.ec2.internal\" (UID: \"b2ee1f13b8d1493e22d22da47f4cf77d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-95.ec2.internal"
Sep 15 11:25:19.992876 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.992774    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2ee1f13b8d1493e22d22da47f4cf77d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-95.ec2.internal\" (UID: \"b2ee1f13b8d1493e22d22da47f4cf77d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-95.ec2.internal"
Sep 15 11:25:19.992876 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.992814    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8f133eefe581cc2b4f83ef628d20097a-config\") pod \"kube-apiserver-proxy-ip-10-0-131-95.ec2.internal\" (UID: \"8f133eefe581cc2b4f83ef628d20097a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-95.ec2.internal"
Sep 15 11:25:19.992876 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.992831    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b2ee1f13b8d1493e22d22da47f4cf77d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-95.ec2.internal\" (UID: \"b2ee1f13b8d1493e22d22da47f4cf77d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-95.ec2.internal"
Sep 15 11:25:19.992876 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:19.992821    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2ee1f13b8d1493e22d22da47f4cf77d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-95.ec2.internal\" (UID: \"b2ee1f13b8d1493e22d22da47f4cf77d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-95.ec2.internal"
Sep 15 11:25:20.082224 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:20.082181    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-95.ec2.internal\" not found"
Sep 15 11:25:20.165771 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:20.165723    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-95.ec2.internal"
Sep 15 11:25:20.170577 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:20.170437    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-95.ec2.internal"
Sep 15 11:25:20.183066 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:20.183041    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-95.ec2.internal\" not found"
Sep 15 11:25:20.283558 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:20.283520    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-95.ec2.internal\" not found"
Sep 15 11:25:20.384077 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:20.384002    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-95.ec2.internal\" not found"
Sep 15 11:25:20.484560 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:20.484526    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-95.ec2.internal\" not found"
Sep 15 11:25:20.519932 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:20.519904    2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 15 11:25:20.520367 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:20.520032    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 15 11:25:20.520367 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:20.520061    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 15 11:25:20.585058 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:20.585031    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-95.ec2.internal\" not found"
Sep 15 11:25:20.589269 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:20.589241    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-14 11:20:20 +0000 UTC" deadline="2028-05-05 18:52:49.751005729 +0000 UTC"
Sep 15 11:25:20.589359 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:20.589270    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14359h27m29.161739236s"
Sep 15 11:25:20.686163 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:20.686092    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-95.ec2.internal\" not found"
Sep 15 11:25:20.717023 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:20.717005    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 11:25:20.736897 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:20.736845    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-95.ec2.internal" event={"ID":"8f133eefe581cc2b4f83ef628d20097a","Type":"ContainerStarted","Data":"ab910a2e7a3716e60779d06154e2691193580970bdb37bddfef9d1ea31164581"}
Sep 15 11:25:20.738266 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:20.738242    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-95.ec2.internal" event={"ID":"b2ee1f13b8d1493e22d22da47f4cf77d","Type":"ContainerStarted","Data":"b744432ebc5fd65f94bc2a86e5881ab2fbc9faa64476216b58a1ecb28efcb7a8"}
Sep 15 11:25:20.786437 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:20.786401    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-95.ec2.internal\" not found"
Sep 15 11:25:22.192532 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:22.192479    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-95.ec2.internal\" not found"
Sep 15 11:25:22.293095 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:22.293025    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-95.ec2.internal\" not found"
Sep 15 11:25:22.303846 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.303817    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 11:25:22.378812 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.378783    2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 11:25:22.396785 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.396761    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-95.ec2.internal"
Sep 15 11:25:22.407386 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.407366    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 11:25:22.408377 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.408364    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-95.ec2.internal"
Sep 15 11:25:22.414430 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.414413    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 11:25:22.665304 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.665280    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 11:25:22.868022 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.867982    2582 apiserver.go:52] "Watching apiserver"
Sep 15 11:25:22.873076 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.873051    2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 15 11:25:22.874354 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.874309    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-sg9pm","openshift-multus/network-metrics-daemon-dzzfd","openshift-cluster-node-tuning-operator/tuned-hg698","openshift-dns/node-resolver-hn4pl","openshift-multus/multus-additional-cni-plugins-bbk72","openshift-network-diagnostics/network-check-target-bk6zq","openshift-network-operator/iptables-alerter-p9c4w","openshift-ovn-kubernetes/ovnkube-node-lspr9","kube-system/global-pull-secret-syncer-dm5z4","kube-system/konnectivity-agent-nbgzq","kube-system/kube-apiserver-proxy-ip-10-0-131-95.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmlpp","openshift-image-registry/node-ca-rxz9x","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-95.ec2.internal"]
Sep 15 11:25:22.876795 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.876774    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p9c4w"
Sep 15 11:25:22.878861 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.878830    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 15 11:25:22.878986 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.878881    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 15 11:25:22.878986 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.878928    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 15 11:25:22.879122 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.879103    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pm6k4\""
Sep 15 11:25:22.879520 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.879499    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rxz9x"
Sep 15 11:25:22.881212 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.881191    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 15 11:25:22.881446 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.881431    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 15 11:25:22.881702 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.881668    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:22.881796 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.881777    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xtmnz\""
Sep 15 11:25:22.882034 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.882007    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 15 11:25:22.883594 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.883573    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 15 11:25:22.883594 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.884083    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hn4pl"
Sep 15 11:25:22.883594 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.884247    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 15 11:25:22.884830 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.884799    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-x4ftj\""
Sep 15 11:25:22.886249 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.886038    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 15 11:25:22.886338 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.886320    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qgddh\""
Sep 15 11:25:22.886743 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.886721    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 15 11:25:22.886906 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.886891    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bbk72"
Sep 15 11:25:22.889628 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.889208    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vzgfm\""
Sep 15 11:25:22.889628 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.889232    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 15 11:25:22.889628 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.889245    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 15 11:25:22.889628 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.889255    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bk6zq"
Sep 15 11:25:22.889628 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.889271    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 15 11:25:22.889628 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.889351    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 15 11:25:22.889628 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:22.889369    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bk6zq" podUID="e1eb4055-797f-4589-8f60-a46f631ad4e9"
Sep 15 11:25:22.889628 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.889457    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 15 11:25:22.891544 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.891522    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm5z4"
Sep 15 11:25:22.891635 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:22.891613    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm5z4" podUID="270f712b-6161-4b60-8f89-0b2bcad6f27c"
Sep 15 11:25:22.893837 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.893818    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:22.895798 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.895776    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 15 11:25:22.895897 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.895845    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-g5ssh\""
Sep 15 11:25:22.896194 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.896164    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzzfd"
Sep 15 11:25:22.896287 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:22.896234    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzzfd" podUID="485ecbb4-5f72-4e62-bce1-0d97de480e0b"
Sep 15 11:25:22.896378 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.896367    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 15 11:25:22.898455 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.898436    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nbgzq"
Sep 15 11:25:22.900434 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.900418    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-f4b9x\""
Sep 15 11:25:22.900602 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.900585    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 15 11:25:22.900748 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.900732    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 15 11:25:22.900994 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.900977    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:22.903149 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.903111    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 15 11:25:22.903514 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.903114    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 15 11:25:22.903514 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.903287    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 15 11:25:22.903514 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.903130    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 15 11:25:22.903514 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.903459    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmlpp"
Sep 15 11:25:22.903514 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.903500    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 15 11:25:22.903763 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.903503    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 15 11:25:22.903763 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.903616    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2wxf9\""
Sep 15 11:25:22.905608 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.905589    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 15 11:25:22.905748 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.905731    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 15 11:25:22.905821 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.905807    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 15 11:25:22.906400 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.906382    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tns7t\""
Sep 15 11:25:22.906825 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.906803    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/355f0ff9-8c8d-4093-b576-2f6060c7c1b2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bbk72\" (UID: \"355f0ff9-8c8d-4093-b576-2f6060c7c1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bbk72"
Sep 15 11:25:22.906906 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.906839    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w9p2\" (UniqueName: \"kubernetes.io/projected/485ecbb4-5f72-4e62-bce1-0d97de480e0b-kube-api-access-5w9p2\") pod \"network-metrics-daemon-dzzfd\" (UID: \"485ecbb4-5f72-4e62-bce1-0d97de480e0b\") " pod="openshift-multus/network-metrics-daemon-dzzfd"
Sep 15 11:25:22.906906 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.906880    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/499ee50f-63c2-4ade-a676-edb6066f3d0e-host-var-lib-cni-multus\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:22.906906 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.906901    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/499ee50f-63c2-4ade-a676-edb6066f3d0e-multus-conf-dir\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:22.907051 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.906923    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f6f444b-ce7e-4f28-81c1-c05b6b7b4763-host-slash\") pod \"iptables-alerter-p9c4w\" (UID: \"6f6f444b-ce7e-4f28-81c1-c05b6b7b4763\") " pod="openshift-network-operator/iptables-alerter-p9c4w"
Sep 15 11:25:22.907051 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.906955    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/03850762-a184-4dec-a14f-e686a043f7c9-run\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:22.907051 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.906990    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03850762-a184-4dec-a14f-e686a043f7c9-sys\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:22.907051 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.907010    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/270f712b-6161-4b60-8f89-0b2bcad6f27c-dbus\") pod \"global-pull-secret-syncer-dm5z4\" (UID: \"270f712b-6161-4b60-8f89-0b2bcad6f27c\") " pod="kube-system/global-pull-secret-syncer-dm5z4"
Sep 15 11:25:22.907051 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.907026    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/499ee50f-63c2-4ade-a676-edb6066f3d0e-host-run-multus-certs\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:22.907276 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.907044    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03850762-a184-4dec-a14f-e686a043f7c9-var-lib-kubelet\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:22.907276 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.907081    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/03850762-a184-4dec-a14f-e686a043f7c9-etc-tuned\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:22.907276 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.907105    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a1800c05-2abc-414f-b183-5ba0aef5ae63-host\") pod \"node-ca-rxz9x\" (UID: \"a1800c05-2abc-414f-b183-5ba0aef5ae63\") " pod="openshift-image-registry/node-ca-rxz9x"
Sep 15 11:25:22.907276 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.907127    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v54f\" (UniqueName: \"kubernetes.io/projected/a1800c05-2abc-414f-b183-5ba0aef5ae63-kube-api-access-4v54f\") pod \"node-ca-rxz9x\" (UID: \"a1800c05-2abc-414f-b183-5ba0aef5ae63\") " pod="openshift-image-registry/node-ca-rxz9x"
Sep 15 11:25:22.907276 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.907189    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8k92\" (UniqueName: \"kubernetes.io/projected/e1eb4055-797f-4589-8f60-a46f631ad4e9-kube-api-access-n8k92\") pod \"network-check-target-bk6zq\" (UID: \"e1eb4055-797f-4589-8f60-a46f631ad4e9\") " pod="openshift-network-diagnostics/network-check-target-bk6zq"
Sep 15 11:25:22.907276 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.907238    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/485ecbb4-5f72-4e62-bce1-0d97de480e0b-metrics-certs\") pod \"network-metrics-daemon-dzzfd\" (UID: \"485ecbb4-5f72-4e62-bce1-0d97de480e0b\") " pod="openshift-multus/network-metrics-daemon-dzzfd"
Sep 15 11:25:22.907537 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.907278    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6f6f444b-ce7e-4f28-81c1-c05b6b7b4763-iptables-alerter-script\") pod \"iptables-alerter-p9c4w\" (UID: \"6f6f444b-ce7e-4f28-81c1-c05b6b7b4763\") " pod="openshift-network-operator/iptables-alerter-p9c4w"
Sep 15 11:25:22.907537 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.907309    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/499ee50f-63c2-4ade-a676-edb6066f3d0e-host-run-k8s-cni-cncf-io\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:22.907537 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.907331    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/03850762-a184-4dec-a14f-e686a043f7c9-lib-modules\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:22.907537 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.907360    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/355f0ff9-8c8d-4093-b576-2f6060c7c1b2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bbk72\" (UID: \"355f0ff9-8c8d-4093-b576-2f6060c7c1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bbk72"
Sep 15 11:25:22.907537 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.907386    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4nm9\" (UniqueName: \"kubernetes.io/projected/355f0ff9-8c8d-4093-b576-2f6060c7c1b2-kube-api-access-s4nm9\") pod \"multus-additional-cni-plugins-bbk72\" (UID: \"355f0ff9-8c8d-4093-b576-2f6060c7c1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bbk72"
Sep 15 11:25:22.907537 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.907410    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cab4df79-1ae2-4498-a8db-7bf2bf6d0042-agent-certs\") pod \"konnectivity-agent-nbgzq\" (UID: \"cab4df79-1ae2-4498-a8db-7bf2bf6d0042\") " pod="kube-system/konnectivity-agent-nbgzq"
Sep 15 11:25:22.907537 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.907433    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gwxq\" (UniqueName: \"kubernetes.io/projected/55799bb6-be25-43c7-b9fa-2dcb81a6fb84-kube-api-access-6gwxq\") pod \"node-resolver-hn4pl\" (UID: \"55799bb6-be25-43c7-b9fa-2dcb81a6fb84\") " pod="openshift-dns/node-resolver-hn4pl"
Sep 15 11:25:22.907537 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.907457    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/03850762-a184-4dec-a14f-e686a043f7c9-etc-sysctl-d\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:22.907537 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.907480    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/03850762-a184-4dec-a14f-e686a043f7c9-host\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:22.907537 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.907503    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/270f712b-6161-4b60-8f89-0b2bcad6f27c-kubelet-config\") pod \"global-pull-secret-syncer-dm5z4\" (UID: \"270f712b-6161-4b60-8f89-0b2bcad6f27c\") " pod="kube-system/global-pull-secret-syncer-dm5z4"
Sep 15 11:25:22.907537 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.907526    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/270f712b-6161-4b60-8f89-0b2bcad6f27c-original-pull-secret\") pod \"global-pull-secret-syncer-dm5z4\" (UID: \"270f712b-6161-4b60-8f89-0b2bcad6f27c\") " pod="kube-system/global-pull-secret-syncer-dm5z4"
Sep 15 11:25:22.908220 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.907556    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/55799bb6-be25-43c7-b9fa-2dcb81a6fb84-hosts-file\") pod \"node-resolver-hn4pl\" (UID: \"55799bb6-be25-43c7-b9fa-2dcb81a6fb84\") " pod="openshift-dns/node-resolver-hn4pl"
Sep 15 11:25:22.908220 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.907595    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/499ee50f-63c2-4ade-a676-edb6066f3d0e-host-var-lib-cni-bin\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:22.908220 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.907624    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/499ee50f-63c2-4ade-a676-edb6066f3d0e-host-var-lib-kubelet\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:22.908220 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.907640    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/499ee50f-63c2-4ade-a676-edb6066f3d0e-multus-daemon-config\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:22.908220 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.907665    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/03850762-a184-4dec-a14f-e686a043f7c9-etc-systemd\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:22.908220 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.907705    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/03850762-a184-4dec-a14f-e686a043f7c9-etc-sysconfig\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:22.908220 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.907728    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/355f0ff9-8c8d-4093-b576-2f6060c7c1b2-cnibin\") pod \"multus-additional-cni-plugins-bbk72\" (UID: \"355f0ff9-8c8d-4093-b576-2f6060c7c1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bbk72"
Sep 15 11:25:22.908220 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.907748    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/499ee50f-63c2-4ade-a676-edb6066f3d0e-cni-binary-copy\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:22.908220 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.907774    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/499ee50f-63c2-4ade-a676-edb6066f3d0e-host-run-netns\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:22.908220 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.907805    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/355f0ff9-8c8d-4093-b576-2f6060c7c1b2-cni-binary-copy\") pod \"multus-additional-cni-plugins-bbk72\" (UID: \"355f0ff9-8c8d-4093-b576-2f6060c7c1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bbk72"
Sep 15 11:25:22.908220 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.907846    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/499ee50f-63c2-4ade-a676-edb6066f3d0e-multus-socket-dir-parent\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:22.908220 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.907881    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55799bb6-be25-43c7-b9fa-2dcb81a6fb84-tmp-dir\") pod \"node-resolver-hn4pl\" (UID: \"55799bb6-be25-43c7-b9fa-2dcb81a6fb84\") " pod="openshift-dns/node-resolver-hn4pl"
Sep 15 11:25:22.908220 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.907894    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/499ee50f-63c2-4ade-a676-edb6066f3d0e-cnibin\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:22.908220 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.907907    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/499ee50f-63c2-4ade-a676-edb6066f3d0e-hostroot\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:22.908220 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.907942    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67znl\" (UniqueName: \"kubernetes.io/projected/499ee50f-63c2-4ade-a676-edb6066f3d0e-kube-api-access-67znl\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:22.908220 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.907987    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/03850762-a184-4dec-a14f-e686a043f7c9-etc-sysctl-conf\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:22.908220 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.908018    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03850762-a184-4dec-a14f-e686a043f7c9-tmp\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:22.908805 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.908042    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/499ee50f-63c2-4ade-a676-edb6066f3d0e-multus-cni-dir\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:22.908805 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.908064    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/03850762-a184-4dec-a14f-e686a043f7c9-etc-modprobe-d\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:22.908805 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.908087    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/355f0ff9-8c8d-4093-b576-2f6060c7c1b2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bbk72\" (UID: \"355f0ff9-8c8d-4093-b576-2f6060c7c1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bbk72"
Sep 15 11:25:22.908805 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.908149    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/499ee50f-63c2-4ade-a676-edb6066f3d0e-system-cni-dir\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:22.908805 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.908193    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03850762-a184-4dec-a14f-e686a043f7c9-etc-kubernetes\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:22.908805 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.908219    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/355f0ff9-8c8d-4093-b576-2f6060c7c1b2-system-cni-dir\") pod \"multus-additional-cni-plugins-bbk72\" (UID: \"355f0ff9-8c8d-4093-b576-2f6060c7c1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bbk72"
Sep 15 11:25:22.908805 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.908258    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a1800c05-2abc-414f-b183-5ba0aef5ae63-serviceca\") pod \"node-ca-rxz9x\" (UID: \"a1800c05-2abc-414f-b183-5ba0aef5ae63\") " pod="openshift-image-registry/node-ca-rxz9x"
Sep 15 11:25:22.908805 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.908323    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cab4df79-1ae2-4498-a8db-7bf2bf6d0042-konnectivity-ca\") pod \"konnectivity-agent-nbgzq\" (UID: \"cab4df79-1ae2-4498-a8db-7bf2bf6d0042\") " pod="kube-system/konnectivity-agent-nbgzq"
Sep 15 11:25:22.908805 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.908355    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/499ee50f-63c2-4ade-a676-edb6066f3d0e-etc-kubernetes\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:22.908805 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.908389    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5hq5\" (UniqueName: \"kubernetes.io/projected/6f6f444b-ce7e-4f28-81c1-c05b6b7b4763-kube-api-access-b5hq5\") pod \"iptables-alerter-p9c4w\" (UID: \"6f6f444b-ce7e-4f28-81c1-c05b6b7b4763\") " pod="openshift-network-operator/iptables-alerter-p9c4w"
Sep 15 11:25:22.908805 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.908420    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k5ss\" (UniqueName: \"kubernetes.io/projected/03850762-a184-4dec-a14f-e686a043f7c9-kube-api-access-4k5ss\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:22.908805 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.908543    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 11:25:22.929371 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.929333    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-r6ltw"
Sep 15 11:25:22.936939 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.936918    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-r6ltw"
Sep 15 11:25:22.997630 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:22.997597    2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 15 11:25:23.008746 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.008714    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f6f444b-ce7e-4f28-81c1-c05b6b7b4763-host-slash\") pod \"iptables-alerter-p9c4w\" (UID: \"6f6f444b-ce7e-4f28-81c1-c05b6b7b4763\") " pod="openshift-network-operator/iptables-alerter-p9c4w"
Sep 15 11:25:23.008746 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.008745    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/03850762-a184-4dec-a14f-e686a043f7c9-run\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:23.008969 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.008763    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03850762-a184-4dec-a14f-e686a043f7c9-sys\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:23.008969 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.008777    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/270f712b-6161-4b60-8f89-0b2bcad6f27c-dbus\") pod \"global-pull-secret-syncer-dm5z4\" (UID: \"270f712b-6161-4b60-8f89-0b2bcad6f27c\") " pod="kube-system/global-pull-secret-syncer-dm5z4"
Sep 15 11:25:23.008969 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.008816    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f6f444b-ce7e-4f28-81c1-c05b6b7b4763-host-slash\") pod \"iptables-alerter-p9c4w\" (UID: \"6f6f444b-ce7e-4f28-81c1-c05b6b7b4763\") " pod="openshift-network-operator/iptables-alerter-p9c4w"
Sep 15 11:25:23.008969 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.008853    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/03850762-a184-4dec-a14f-e686a043f7c9-run\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:23.008969 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.008892    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03850762-a184-4dec-a14f-e686a043f7c9-sys\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:23.008969 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.008933    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/270f712b-6161-4b60-8f89-0b2bcad6f27c-dbus\") pod \"global-pull-secret-syncer-dm5z4\" (UID: \"270f712b-6161-4b60-8f89-0b2bcad6f27c\") " pod="kube-system/global-pull-secret-syncer-dm5z4"
Sep 15 11:25:23.008969 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.008949    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-node-log\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.008969 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.008968    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.009368 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.008986    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/499ee50f-63c2-4ade-a676-edb6066f3d0e-host-run-multus-certs\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:23.009368 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.009001    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03850762-a184-4dec-a14f-e686a043f7c9-var-lib-kubelet\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:23.009368 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.009015    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/03850762-a184-4dec-a14f-e686a043f7c9-etc-tuned\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:23.009368 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.009030    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a1800c05-2abc-414f-b183-5ba0aef5ae63-host\") pod \"node-ca-rxz9x\" (UID: \"a1800c05-2abc-414f-b183-5ba0aef5ae63\") " pod="openshift-image-registry/node-ca-rxz9x"
Sep 15 11:25:23.009368 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.009050    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/499ee50f-63c2-4ade-a676-edb6066f3d0e-host-run-multus-certs\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:23.009368 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.009057    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v54f\" (UniqueName: \"kubernetes.io/projected/a1800c05-2abc-414f-b183-5ba0aef5ae63-kube-api-access-4v54f\") pod \"node-ca-rxz9x\" (UID: \"a1800c05-2abc-414f-b183-5ba0aef5ae63\") " pod="openshift-image-registry/node-ca-rxz9x"
Sep 15 11:25:23.009368 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.009154    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a1800c05-2abc-414f-b183-5ba0aef5ae63-host\") pod \"node-ca-rxz9x\" (UID: \"a1800c05-2abc-414f-b183-5ba0aef5ae63\") " pod="openshift-image-registry/node-ca-rxz9x"
Sep 15 11:25:23.009368 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.009200    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4d410cfe-4ca2-43e1-bf20-06634657a5a6-ovnkube-config\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.009368 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.009162    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03850762-a184-4dec-a14f-e686a043f7c9-var-lib-kubelet\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:23.009368 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.009219    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7xld\" (UniqueName: \"kubernetes.io/projected/4d410cfe-4ca2-43e1-bf20-06634657a5a6-kube-api-access-r7xld\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.009368 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.009240    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-host-run-ovn-kubernetes\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.009368 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.009265    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8k92\" (UniqueName: \"kubernetes.io/projected/e1eb4055-797f-4589-8f60-a46f631ad4e9-kube-api-access-n8k92\") pod \"network-check-target-bk6zq\" (UID: \"e1eb4055-797f-4589-8f60-a46f631ad4e9\") " pod="openshift-network-diagnostics/network-check-target-bk6zq"
Sep 15 11:25:23.009368 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.009285    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/485ecbb4-5f72-4e62-bce1-0d97de480e0b-metrics-certs\") pod \"network-metrics-daemon-dzzfd\" (UID: \"485ecbb4-5f72-4e62-bce1-0d97de480e0b\") " pod="openshift-multus/network-metrics-daemon-dzzfd"
Sep 15 11:25:23.009368 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.009306    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6f6f444b-ce7e-4f28-81c1-c05b6b7b4763-iptables-alerter-script\") pod \"iptables-alerter-p9c4w\" (UID: \"6f6f444b-ce7e-4f28-81c1-c05b6b7b4763\") " pod="openshift-network-operator/iptables-alerter-p9c4w"
Sep 15 11:25:23.009368 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.009330    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/499ee50f-63c2-4ade-a676-edb6066f3d0e-host-run-k8s-cni-cncf-io\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:23.009368 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.009352    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/03850762-a184-4dec-a14f-e686a043f7c9-lib-modules\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:23.009368 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.009376    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/355f0ff9-8c8d-4093-b576-2f6060c7c1b2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bbk72\" (UID: \"355f0ff9-8c8d-4093-b576-2f6060c7c1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bbk72"
Sep 15 11:25:23.009951 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.009397    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4nm9\" (UniqueName: \"kubernetes.io/projected/355f0ff9-8c8d-4093-b576-2f6060c7c1b2-kube-api-access-s4nm9\") pod \"multus-additional-cni-plugins-bbk72\" (UID: \"355f0ff9-8c8d-4093-b576-2f6060c7c1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bbk72"
Sep 15 11:25:23.009951 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.009419    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cab4df79-1ae2-4498-a8db-7bf2bf6d0042-agent-certs\") pod \"konnectivity-agent-nbgzq\" (UID: \"cab4df79-1ae2-4498-a8db-7bf2bf6d0042\") " pod="kube-system/konnectivity-agent-nbgzq"
Sep 15 11:25:23.009951 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.009443    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gwxq\" (UniqueName: \"kubernetes.io/projected/55799bb6-be25-43c7-b9fa-2dcb81a6fb84-kube-api-access-6gwxq\") pod \"node-resolver-hn4pl\" (UID: \"55799bb6-be25-43c7-b9fa-2dcb81a6fb84\") " pod="openshift-dns/node-resolver-hn4pl"
Sep 15 11:25:23.009951 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.009455    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/499ee50f-63c2-4ade-a676-edb6066f3d0e-host-run-k8s-cni-cncf-io\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:23.009951 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.009466    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6efa8cf5-1df2-4916-b7dc-bdc81a06f642-device-dir\") pod \"aws-ebs-csi-driver-node-hmlpp\" (UID: \"6efa8cf5-1df2-4916-b7dc-bdc81a06f642\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmlpp"
Sep 15 11:25:23.009951 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.009493    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/03850762-a184-4dec-a14f-e686a043f7c9-etc-sysctl-d\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:23.009951 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.009515    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/03850762-a184-4dec-a14f-e686a043f7c9-host\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:23.009951 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.009537    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/270f712b-6161-4b60-8f89-0b2bcad6f27c-kubelet-config\") pod \"global-pull-secret-syncer-dm5z4\" (UID: \"270f712b-6161-4b60-8f89-0b2bcad6f27c\") " pod="kube-system/global-pull-secret-syncer-dm5z4"
Sep 15 11:25:23.009951 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.009584    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/270f712b-6161-4b60-8f89-0b2bcad6f27c-original-pull-secret\") pod \"global-pull-secret-syncer-dm5z4\" (UID: \"270f712b-6161-4b60-8f89-0b2bcad6f27c\") " pod="kube-system/global-pull-secret-syncer-dm5z4"
Sep 15 11:25:23.009951 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.009603    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/270f712b-6161-4b60-8f89-0b2bcad6f27c-kubelet-config\") pod \"global-pull-secret-syncer-dm5z4\" (UID: \"270f712b-6161-4b60-8f89-0b2bcad6f27c\") " pod="kube-system/global-pull-secret-syncer-dm5z4"
Sep 15 11:25:23.009951 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.009623    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/55799bb6-be25-43c7-b9fa-2dcb81a6fb84-hosts-file\") pod \"node-resolver-hn4pl\" (UID: \"55799bb6-be25-43c7-b9fa-2dcb81a6fb84\") " pod="openshift-dns/node-resolver-hn4pl"
Sep 15 11:25:23.009951 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.009648    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-host-run-netns\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.009951 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.009671    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-run-openvswitch\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.009951 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.009695    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-host-cni-netd\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.009951 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.009720    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/499ee50f-63c2-4ade-a676-edb6066f3d0e-host-var-lib-cni-bin\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:23.009951 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.009742    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/499ee50f-63c2-4ade-a676-edb6066f3d0e-host-var-lib-kubelet\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:23.009951 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.009773    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/499ee50f-63c2-4ade-a676-edb6066f3d0e-multus-daemon-config\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:23.010676 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.009827    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/03850762-a184-4dec-a14f-e686a043f7c9-etc-systemd\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:23.010676 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.009825    2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 15 11:25:23.010676 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.009881    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/03850762-a184-4dec-a14f-e686a043f7c9-etc-systemd\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:23.010676 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.009881    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/03850762-a184-4dec-a14f-e686a043f7c9-host\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:23.010676 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:23.009910    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:25:23.010676 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.009924    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/55799bb6-be25-43c7-b9fa-2dcb81a6fb84-hosts-file\") pod \"node-resolver-hn4pl\" (UID: \"55799bb6-be25-43c7-b9fa-2dcb81a6fb84\") " pod="openshift-dns/node-resolver-hn4pl"
Sep 15 11:25:23.010676 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.009969    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6f6f444b-ce7e-4f28-81c1-c05b6b7b4763-iptables-alerter-script\") pod \"iptables-alerter-p9c4w\" (UID: \"6f6f444b-ce7e-4f28-81c1-c05b6b7b4763\") " pod="openshift-network-operator/iptables-alerter-p9c4w"
Sep 15 11:25:23.010676 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:23.010036    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/485ecbb4-5f72-4e62-bce1-0d97de480e0b-metrics-certs podName:485ecbb4-5f72-4e62-bce1-0d97de480e0b nodeName:}" failed. No retries permitted until 2026-09-15 11:25:23.509967514 +0000 UTC m=+2.971833545 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/485ecbb4-5f72-4e62-bce1-0d97de480e0b-metrics-certs") pod "network-metrics-daemon-dzzfd" (UID: "485ecbb4-5f72-4e62-bce1-0d97de480e0b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:25:23.010676 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.010036    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/03850762-a184-4dec-a14f-e686a043f7c9-etc-sysctl-d\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:23.010676 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:23.010272    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:25:23.010676 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:23.010319    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/270f712b-6161-4b60-8f89-0b2bcad6f27c-original-pull-secret podName:270f712b-6161-4b60-8f89-0b2bcad6f27c nodeName:}" failed. No retries permitted until 2026-09-15 11:25:23.510304885 +0000 UTC m=+2.972170920 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/270f712b-6161-4b60-8f89-0b2bcad6f27c-original-pull-secret") pod "global-pull-secret-syncer-dm5z4" (UID: "270f712b-6161-4b60-8f89-0b2bcad6f27c") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:25:23.010676 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.010424    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/03850762-a184-4dec-a14f-e686a043f7c9-lib-modules\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:23.010676 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.010427    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/499ee50f-63c2-4ade-a676-edb6066f3d0e-multus-daemon-config\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:23.010676 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.010480    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/499ee50f-63c2-4ade-a676-edb6066f3d0e-host-var-lib-cni-bin\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:23.010676 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.010488    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/499ee50f-63c2-4ade-a676-edb6066f3d0e-host-var-lib-kubelet\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:23.010676 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.010519    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-run-systemd\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.010676 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.010547    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-etc-openvswitch\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.011401 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.010575    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/03850762-a184-4dec-a14f-e686a043f7c9-etc-sysconfig\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:23.011401 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.010597    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-host-cni-bin\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.011401 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.010619    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/355f0ff9-8c8d-4093-b576-2f6060c7c1b2-cnibin\") pod \"multus-additional-cni-plugins-bbk72\" (UID: \"355f0ff9-8c8d-4093-b576-2f6060c7c1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bbk72"
Sep 15 11:25:23.011401 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.010650    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/355f0ff9-8c8d-4093-b576-2f6060c7c1b2-cnibin\") pod \"multus-additional-cni-plugins-bbk72\" (UID: \"355f0ff9-8c8d-4093-b576-2f6060c7c1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bbk72"
Sep 15 11:25:23.011401 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.010653    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4d410cfe-4ca2-43e1-bf20-06634657a5a6-ovn-node-metrics-cert\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.011401 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.010694    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/03850762-a184-4dec-a14f-e686a043f7c9-etc-sysconfig\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:23.011401 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.010712    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/499ee50f-63c2-4ade-a676-edb6066f3d0e-cni-binary-copy\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:23.011401 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.010745    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/499ee50f-63c2-4ade-a676-edb6066f3d0e-host-run-netns\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:23.011401 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.010857    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/355f0ff9-8c8d-4093-b576-2f6060c7c1b2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bbk72\" (UID: \"355f0ff9-8c8d-4093-b576-2f6060c7c1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bbk72"
Sep 15 11:25:23.011401 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.010874    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/355f0ff9-8c8d-4093-b576-2f6060c7c1b2-cni-binary-copy\") pod \"multus-additional-cni-plugins-bbk72\" (UID: \"355f0ff9-8c8d-4093-b576-2f6060c7c1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bbk72"
Sep 15 11:25:23.011401 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.010906    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6efa8cf5-1df2-4916-b7dc-bdc81a06f642-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hmlpp\" (UID: \"6efa8cf5-1df2-4916-b7dc-bdc81a06f642\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmlpp"
Sep 15 11:25:23.011401 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.010934    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-host-kubelet\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.011401 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.010978    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/499ee50f-63c2-4ade-a676-edb6066f3d0e-multus-socket-dir-parent\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:23.011401 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.010993    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/499ee50f-63c2-4ade-a676-edb6066f3d0e-host-run-netns\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:23.011401 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.011007    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55799bb6-be25-43c7-b9fa-2dcb81a6fb84-tmp-dir\") pod \"node-resolver-hn4pl\" (UID: \"55799bb6-be25-43c7-b9fa-2dcb81a6fb84\") " pod="openshift-dns/node-resolver-hn4pl"
Sep 15 11:25:23.011401 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.011085    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/499ee50f-63c2-4ade-a676-edb6066f3d0e-multus-socket-dir-parent\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:23.011401 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.011194    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/499ee50f-63c2-4ade-a676-edb6066f3d0e-cni-binary-copy\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:23.012206 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.011231    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6efa8cf5-1df2-4916-b7dc-bdc81a06f642-sys-fs\") pod \"aws-ebs-csi-driver-node-hmlpp\" (UID: \"6efa8cf5-1df2-4916-b7dc-bdc81a06f642\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmlpp"
Sep 15 11:25:23.012206 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.011256    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-run-ovn\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.012206 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.011278    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-log-socket\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.012206 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.011301    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/499ee50f-63c2-4ade-a676-edb6066f3d0e-cnibin\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:23.012206 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.011324    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/499ee50f-63c2-4ade-a676-edb6066f3d0e-hostroot\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:23.012206 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.011349    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67znl\" (UniqueName: \"kubernetes.io/projected/499ee50f-63c2-4ade-a676-edb6066f3d0e-kube-api-access-67znl\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:23.012206 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.011364    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55799bb6-be25-43c7-b9fa-2dcb81a6fb84-tmp-dir\") pod \"node-resolver-hn4pl\" (UID: \"55799bb6-be25-43c7-b9fa-2dcb81a6fb84\") " pod="openshift-dns/node-resolver-hn4pl"
Sep 15 11:25:23.012206 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.011377    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/03850762-a184-4dec-a14f-e686a043f7c9-etc-sysctl-conf\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:23.012206 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.011401    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03850762-a184-4dec-a14f-e686a043f7c9-tmp\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:23.012206 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.011447    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/499ee50f-63c2-4ade-a676-edb6066f3d0e-cnibin\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:23.012206 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.011475    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6efa8cf5-1df2-4916-b7dc-bdc81a06f642-etc-selinux\") pod \"aws-ebs-csi-driver-node-hmlpp\" (UID: \"6efa8cf5-1df2-4916-b7dc-bdc81a06f642\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmlpp"
Sep 15 11:25:23.012206 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.011498    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-var-lib-openvswitch\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.012206 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.011539    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/499ee50f-63c2-4ade-a676-edb6066f3d0e-multus-cni-dir\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:23.012206 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.011567    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/03850762-a184-4dec-a14f-e686a043f7c9-etc-modprobe-d\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:23.012206 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.011578    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/355f0ff9-8c8d-4093-b576-2f6060c7c1b2-cni-binary-copy\") pod \"multus-additional-cni-plugins-bbk72\" (UID: \"355f0ff9-8c8d-4093-b576-2f6060c7c1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bbk72"
Sep 15 11:25:23.012206 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.011592    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/355f0ff9-8c8d-4093-b576-2f6060c7c1b2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bbk72\" (UID: \"355f0ff9-8c8d-4093-b576-2f6060c7c1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bbk72"
Sep 15 11:25:23.012206 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.011616    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6efa8cf5-1df2-4916-b7dc-bdc81a06f642-socket-dir\") pod \"aws-ebs-csi-driver-node-hmlpp\" (UID: \"6efa8cf5-1df2-4916-b7dc-bdc81a06f642\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmlpp"
Sep 15 11:25:23.013038 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.011640    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/499ee50f-63c2-4ade-a676-edb6066f3d0e-system-cni-dir\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:23.013038 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.011670    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03850762-a184-4dec-a14f-e686a043f7c9-etc-kubernetes\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:23.013038 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.011697    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/355f0ff9-8c8d-4093-b576-2f6060c7c1b2-system-cni-dir\") pod \"multus-additional-cni-plugins-bbk72\" (UID: \"355f0ff9-8c8d-4093-b576-2f6060c7c1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bbk72"
Sep 15 11:25:23.013038 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.011721    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a1800c05-2abc-414f-b183-5ba0aef5ae63-serviceca\") pod \"node-ca-rxz9x\" (UID: \"a1800c05-2abc-414f-b183-5ba0aef5ae63\") " pod="openshift-image-registry/node-ca-rxz9x"
Sep 15 11:25:23.013038 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.011743    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cab4df79-1ae2-4498-a8db-7bf2bf6d0042-konnectivity-ca\") pod \"konnectivity-agent-nbgzq\" (UID: \"cab4df79-1ae2-4498-a8db-7bf2bf6d0042\") " pod="kube-system/konnectivity-agent-nbgzq"
Sep 15 11:25:23.013038 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.011766    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6efa8cf5-1df2-4916-b7dc-bdc81a06f642-registration-dir\") pod \"aws-ebs-csi-driver-node-hmlpp\" (UID: \"6efa8cf5-1df2-4916-b7dc-bdc81a06f642\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmlpp"
Sep 15 11:25:23.013038 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.011790    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/499ee50f-63c2-4ade-a676-edb6066f3d0e-etc-kubernetes\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:23.013038 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.011815    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5hq5\" (UniqueName: \"kubernetes.io/projected/6f6f444b-ce7e-4f28-81c1-c05b6b7b4763-kube-api-access-b5hq5\") pod \"iptables-alerter-p9c4w\" (UID: \"6f6f444b-ce7e-4f28-81c1-c05b6b7b4763\") " pod="openshift-network-operator/iptables-alerter-p9c4w"
Sep 15 11:25:23.013038 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.011844    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/499ee50f-63c2-4ade-a676-edb6066f3d0e-hostroot\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:23.013038 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.011840    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k5ss\" (UniqueName: \"kubernetes.io/projected/03850762-a184-4dec-a14f-e686a043f7c9-kube-api-access-4k5ss\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:23.013038 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.011890    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/355f0ff9-8c8d-4093-b576-2f6060c7c1b2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bbk72\" (UID: \"355f0ff9-8c8d-4093-b576-2f6060c7c1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bbk72"
Sep 15 11:25:23.013038 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.012024    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/03850762-a184-4dec-a14f-e686a043f7c9-etc-modprobe-d\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:23.013038 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.012110    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/03850762-a184-4dec-a14f-e686a043f7c9-etc-sysctl-conf\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:23.013038 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.012112    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/355f0ff9-8c8d-4093-b576-2f6060c7c1b2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bbk72\" (UID: \"355f0ff9-8c8d-4093-b576-2f6060c7c1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bbk72"
Sep 15 11:25:23.013038 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.012165    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/499ee50f-63c2-4ade-a676-edb6066f3d0e-multus-cni-dir\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:23.013038 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.012239    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/499ee50f-63c2-4ade-a676-edb6066f3d0e-etc-kubernetes\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:23.013038 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.012280    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/355f0ff9-8c8d-4093-b576-2f6060c7c1b2-system-cni-dir\") pod \"multus-additional-cni-plugins-bbk72\" (UID: \"355f0ff9-8c8d-4093-b576-2f6060c7c1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bbk72"
Sep 15 11:25:23.013858 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.012328    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-host-slash\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.013858 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.012354    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4d410cfe-4ca2-43e1-bf20-06634657a5a6-env-overrides\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.013858 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.012357    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/499ee50f-63c2-4ade-a676-edb6066f3d0e-system-cni-dir\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:23.013858 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.012382    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w9p2\" (UniqueName: \"kubernetes.io/projected/485ecbb4-5f72-4e62-bce1-0d97de480e0b-kube-api-access-5w9p2\") pod \"network-metrics-daemon-dzzfd\" (UID: \"485ecbb4-5f72-4e62-bce1-0d97de480e0b\") " pod="openshift-multus/network-metrics-daemon-dzzfd"
Sep 15 11:25:23.013858 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.012407    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03850762-a184-4dec-a14f-e686a043f7c9-etc-kubernetes\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:23.013858 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.012409    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fxrb\" (UniqueName: \"kubernetes.io/projected/6efa8cf5-1df2-4916-b7dc-bdc81a06f642-kube-api-access-8fxrb\") pod \"aws-ebs-csi-driver-node-hmlpp\" (UID: \"6efa8cf5-1df2-4916-b7dc-bdc81a06f642\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmlpp"
Sep 15 11:25:23.013858 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.012442    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-systemd-units\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.013858 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.012466    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4d410cfe-4ca2-43e1-bf20-06634657a5a6-ovnkube-script-lib\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.013858 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.012499    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/499ee50f-63c2-4ade-a676-edb6066f3d0e-host-var-lib-cni-multus\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:23.013858 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.012539    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/499ee50f-63c2-4ade-a676-edb6066f3d0e-multus-conf-dir\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:23.013858 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.012629    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/355f0ff9-8c8d-4093-b576-2f6060c7c1b2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bbk72\" (UID: \"355f0ff9-8c8d-4093-b576-2f6060c7c1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bbk72"
Sep 15 11:25:23.013858 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.012640    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/499ee50f-63c2-4ade-a676-edb6066f3d0e-multus-conf-dir\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:23.013858 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.012693    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/499ee50f-63c2-4ade-a676-edb6066f3d0e-host-var-lib-cni-multus\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:23.013858 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.012816    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a1800c05-2abc-414f-b183-5ba0aef5ae63-serviceca\") pod \"node-ca-rxz9x\" (UID: \"a1800c05-2abc-414f-b183-5ba0aef5ae63\") " pod="openshift-image-registry/node-ca-rxz9x"
Sep 15 11:25:23.013858 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.013089    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cab4df79-1ae2-4498-a8db-7bf2bf6d0042-konnectivity-ca\") pod \"konnectivity-agent-nbgzq\" (UID: \"cab4df79-1ae2-4498-a8db-7bf2bf6d0042\") " pod="kube-system/konnectivity-agent-nbgzq"
Sep 15 11:25:23.014567 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.014195    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/03850762-a184-4dec-a14f-e686a043f7c9-etc-tuned\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:23.014567 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.014513    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cab4df79-1ae2-4498-a8db-7bf2bf6d0042-agent-certs\") pod \"konnectivity-agent-nbgzq\" (UID: \"cab4df79-1ae2-4498-a8db-7bf2bf6d0042\") " pod="kube-system/konnectivity-agent-nbgzq"
Sep 15 11:25:23.014992 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.014969    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03850762-a184-4dec-a14f-e686a043f7c9-tmp\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:23.025251 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:23.024768    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:25:23.025251 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:23.024792    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:25:23.025251 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:23.024805    2582 projected.go:196] Error preparing data for projected volume kube-api-access-n8k92 for pod openshift-network-diagnostics/network-check-target-bk6zq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:25:23.025251 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:23.024877    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1eb4055-797f-4589-8f60-a46f631ad4e9-kube-api-access-n8k92 podName:e1eb4055-797f-4589-8f60-a46f631ad4e9 nodeName:}" failed. No retries permitted until 2026-09-15 11:25:23.524859334 +0000 UTC m=+2.986725384 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-n8k92" (UniqueName: "kubernetes.io/projected/e1eb4055-797f-4589-8f60-a46f631ad4e9-kube-api-access-n8k92") pod "network-check-target-bk6zq" (UID: "e1eb4055-797f-4589-8f60-a46f631ad4e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:25:23.027144 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.027118    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gwxq\" (UniqueName: \"kubernetes.io/projected/55799bb6-be25-43c7-b9fa-2dcb81a6fb84-kube-api-access-6gwxq\") pod \"node-resolver-hn4pl\" (UID: \"55799bb6-be25-43c7-b9fa-2dcb81a6fb84\") " pod="openshift-dns/node-resolver-hn4pl"
Sep 15 11:25:23.027767 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.027744    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5hq5\" (UniqueName: \"kubernetes.io/projected/6f6f444b-ce7e-4f28-81c1-c05b6b7b4763-kube-api-access-b5hq5\") pod \"iptables-alerter-p9c4w\" (UID: \"6f6f444b-ce7e-4f28-81c1-c05b6b7b4763\") " pod="openshift-network-operator/iptables-alerter-p9c4w"
Sep 15 11:25:23.027829 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.027768    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w9p2\" (UniqueName: \"kubernetes.io/projected/485ecbb4-5f72-4e62-bce1-0d97de480e0b-kube-api-access-5w9p2\") pod \"network-metrics-daemon-dzzfd\" (UID: \"485ecbb4-5f72-4e62-bce1-0d97de480e0b\") " pod="openshift-multus/network-metrics-daemon-dzzfd"
Sep 15 11:25:23.028277 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.028252    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4nm9\" (UniqueName: \"kubernetes.io/projected/355f0ff9-8c8d-4093-b576-2f6060c7c1b2-kube-api-access-s4nm9\") pod \"multus-additional-cni-plugins-bbk72\" (UID: \"355f0ff9-8c8d-4093-b576-2f6060c7c1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bbk72"
Sep 15 11:25:23.028497 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.028478    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67znl\" (UniqueName: \"kubernetes.io/projected/499ee50f-63c2-4ade-a676-edb6066f3d0e-kube-api-access-67znl\") pod \"multus-sg9pm\" (UID: \"499ee50f-63c2-4ade-a676-edb6066f3d0e\") " pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:23.029075 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.029037    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v54f\" (UniqueName: \"kubernetes.io/projected/a1800c05-2abc-414f-b183-5ba0aef5ae63-kube-api-access-4v54f\") pod \"node-ca-rxz9x\" (UID: \"a1800c05-2abc-414f-b183-5ba0aef5ae63\") " pod="openshift-image-registry/node-ca-rxz9x"
Sep 15 11:25:23.029674 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.029655    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k5ss\" (UniqueName: \"kubernetes.io/projected/03850762-a184-4dec-a14f-e686a043f7c9-kube-api-access-4k5ss\") pod \"tuned-hg698\" (UID: \"03850762-a184-4dec-a14f-e686a043f7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:23.113849 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.113815    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6efa8cf5-1df2-4916-b7dc-bdc81a06f642-socket-dir\") pod \"aws-ebs-csi-driver-node-hmlpp\" (UID: \"6efa8cf5-1df2-4916-b7dc-bdc81a06f642\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmlpp"
Sep 15 11:25:23.113849 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.113852    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6efa8cf5-1df2-4916-b7dc-bdc81a06f642-registration-dir\") pod \"aws-ebs-csi-driver-node-hmlpp\" (UID: \"6efa8cf5-1df2-4916-b7dc-bdc81a06f642\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmlpp"
Sep 15 11:25:23.114099 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.113876    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-host-slash\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.114099 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.113955    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-host-slash\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.114099 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.113963    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6efa8cf5-1df2-4916-b7dc-bdc81a06f642-registration-dir\") pod \"aws-ebs-csi-driver-node-hmlpp\" (UID: \"6efa8cf5-1df2-4916-b7dc-bdc81a06f642\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmlpp"
Sep 15 11:25:23.114099 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.113992    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4d410cfe-4ca2-43e1-bf20-06634657a5a6-env-overrides\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.114099 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114034    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fxrb\" (UniqueName: \"kubernetes.io/projected/6efa8cf5-1df2-4916-b7dc-bdc81a06f642-kube-api-access-8fxrb\") pod \"aws-ebs-csi-driver-node-hmlpp\" (UID: \"6efa8cf5-1df2-4916-b7dc-bdc81a06f642\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmlpp"
Sep 15 11:25:23.114099 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114058    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-systemd-units\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.114099 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114080    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4d410cfe-4ca2-43e1-bf20-06634657a5a6-ovnkube-script-lib\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.114099 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114099    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6efa8cf5-1df2-4916-b7dc-bdc81a06f642-socket-dir\") pod \"aws-ebs-csi-driver-node-hmlpp\" (UID: \"6efa8cf5-1df2-4916-b7dc-bdc81a06f642\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmlpp"
Sep 15 11:25:23.114499 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114108    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-node-log\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.114499 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114133    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.114499 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114165    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4d410cfe-4ca2-43e1-bf20-06634657a5a6-ovnkube-config\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.114499 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114166    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-systemd-units\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.114499 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114200    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-node-log\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.114499 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114209    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7xld\" (UniqueName: \"kubernetes.io/projected/4d410cfe-4ca2-43e1-bf20-06634657a5a6-kube-api-access-r7xld\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.114499 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114261    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-host-run-ovn-kubernetes\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.114499 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114316    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6efa8cf5-1df2-4916-b7dc-bdc81a06f642-device-dir\") pod \"aws-ebs-csi-driver-node-hmlpp\" (UID: \"6efa8cf5-1df2-4916-b7dc-bdc81a06f642\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmlpp"
Sep 15 11:25:23.114499 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114352    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-host-run-netns\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.114499 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114375    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-run-openvswitch\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.114499 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114386    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-host-run-ovn-kubernetes\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.114499 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114405    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-host-cni-netd\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.114499 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114433    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-host-run-netns\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.114499 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114441    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-run-systemd\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.114499 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114464    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-etc-openvswitch\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.114499 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114469    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4d410cfe-4ca2-43e1-bf20-06634657a5a6-env-overrides\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.114499 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114479    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6efa8cf5-1df2-4916-b7dc-bdc81a06f642-device-dir\") pod \"aws-ebs-csi-driver-node-hmlpp\" (UID: \"6efa8cf5-1df2-4916-b7dc-bdc81a06f642\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmlpp"
Sep 15 11:25:23.115170 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114491    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-host-cni-bin\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.115170 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114518    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-host-cni-netd\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.115170 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114518    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-run-openvswitch\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.115170 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114526    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-etc-openvswitch\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.115170 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114535    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-host-cni-bin\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.115170 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114545    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4d410cfe-4ca2-43e1-bf20-06634657a5a6-ovn-node-metrics-cert\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.115170 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114583    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6efa8cf5-1df2-4916-b7dc-bdc81a06f642-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hmlpp\" (UID: \"6efa8cf5-1df2-4916-b7dc-bdc81a06f642\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmlpp"
Sep 15 11:25:23.115170 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114606    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-host-kubelet\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.115170 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114550    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-run-systemd\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.115170 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114632    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6efa8cf5-1df2-4916-b7dc-bdc81a06f642-sys-fs\") pod \"aws-ebs-csi-driver-node-hmlpp\" (UID: \"6efa8cf5-1df2-4916-b7dc-bdc81a06f642\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmlpp"
Sep 15 11:25:23.115170 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114656    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-run-ovn\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.115170 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114657    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-host-kubelet\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.115170 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114662    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6efa8cf5-1df2-4916-b7dc-bdc81a06f642-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hmlpp\" (UID: \"6efa8cf5-1df2-4916-b7dc-bdc81a06f642\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmlpp"
Sep 15 11:25:23.115170 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114674    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4d410cfe-4ca2-43e1-bf20-06634657a5a6-ovnkube-script-lib\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.115170 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114681    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-log-socket\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.115170 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114705    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6efa8cf5-1df2-4916-b7dc-bdc81a06f642-sys-fs\") pod \"aws-ebs-csi-driver-node-hmlpp\" (UID: \"6efa8cf5-1df2-4916-b7dc-bdc81a06f642\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmlpp"
Sep 15 11:25:23.115170 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114714    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-run-ovn\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.115886 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114740    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.115886 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114744    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4d410cfe-4ca2-43e1-bf20-06634657a5a6-ovnkube-config\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.115886 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114760    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6efa8cf5-1df2-4916-b7dc-bdc81a06f642-etc-selinux\") pod \"aws-ebs-csi-driver-node-hmlpp\" (UID: \"6efa8cf5-1df2-4916-b7dc-bdc81a06f642\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmlpp"
Sep 15 11:25:23.115886 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114744    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-log-socket\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.115886 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114795    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-var-lib-openvswitch\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.115886 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114858    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d410cfe-4ca2-43e1-bf20-06634657a5a6-var-lib-openvswitch\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.115886 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.114865    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6efa8cf5-1df2-4916-b7dc-bdc81a06f642-etc-selinux\") pod \"aws-ebs-csi-driver-node-hmlpp\" (UID: \"6efa8cf5-1df2-4916-b7dc-bdc81a06f642\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmlpp"
Sep 15 11:25:23.117518 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.117489    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4d410cfe-4ca2-43e1-bf20-06634657a5a6-ovn-node-metrics-cert\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.122049 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.122022    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7xld\" (UniqueName: \"kubernetes.io/projected/4d410cfe-4ca2-43e1-bf20-06634657a5a6-kube-api-access-r7xld\") pod \"ovnkube-node-lspr9\" (UID: \"4d410cfe-4ca2-43e1-bf20-06634657a5a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.122216 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.122194    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fxrb\" (UniqueName: \"kubernetes.io/projected/6efa8cf5-1df2-4916-b7dc-bdc81a06f642-kube-api-access-8fxrb\") pod \"aws-ebs-csi-driver-node-hmlpp\" (UID: \"6efa8cf5-1df2-4916-b7dc-bdc81a06f642\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmlpp"
Sep 15 11:25:23.191161 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.191075    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p9c4w"
Sep 15 11:25:23.200373 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.200349    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rxz9x"
Sep 15 11:25:23.208447 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.208427    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hg698"
Sep 15 11:25:23.214033 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.214005    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hn4pl"
Sep 15 11:25:23.221550 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.221530    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bbk72"
Sep 15 11:25:23.229127 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.229106    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sg9pm"
Sep 15 11:25:23.235725 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.235707    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nbgzq"
Sep 15 11:25:23.243433 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.243408    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:23.251282 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.251263    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmlpp"
Sep 15 11:25:23.411262 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.411234    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 11:25:23.474145 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:23.474102    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f6f444b_ce7e_4f28_81c1_c05b6b7b4763.slice/crio-35ce498a71f051c37c193ca5eba9b96e2286d494da70773f3fa6f3f6c88434e7 WatchSource:0}: Error finding container 35ce498a71f051c37c193ca5eba9b96e2286d494da70773f3fa6f3f6c88434e7: Status 404 returned error can't find the container with id 35ce498a71f051c37c193ca5eba9b96e2286d494da70773f3fa6f3f6c88434e7
Sep 15 11:25:23.474602 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:23.474572    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6efa8cf5_1df2_4916_b7dc_bdc81a06f642.slice/crio-30648a95f718f85d61adcc1ddf8e2715623cecb5fb6501dcfe07839fa66ccf93 WatchSource:0}: Error finding container 30648a95f718f85d61adcc1ddf8e2715623cecb5fb6501dcfe07839fa66ccf93: Status 404 returned error can't find the container with id 30648a95f718f85d61adcc1ddf8e2715623cecb5fb6501dcfe07839fa66ccf93
Sep 15 11:25:23.477475 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:23.477431    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d410cfe_4ca2_43e1_bf20_06634657a5a6.slice/crio-51bf692dc4f47bacc4c9f0747744a95f6874fbf9560ec34943cb0da060319385 WatchSource:0}: Error finding container 51bf692dc4f47bacc4c9f0747744a95f6874fbf9560ec34943cb0da060319385: Status 404 returned error can't find the container with id 51bf692dc4f47bacc4c9f0747744a95f6874fbf9560ec34943cb0da060319385
Sep 15 11:25:23.479298 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:23.479275    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1800c05_2abc_414f_b183_5ba0aef5ae63.slice/crio-04bc8dee038c8b6234720d529efd12aaec3e0fb167efaeeac2a9c7a73d59318d WatchSource:0}: Error finding container 04bc8dee038c8b6234720d529efd12aaec3e0fb167efaeeac2a9c7a73d59318d: Status 404 returned error can't find the container with id 04bc8dee038c8b6234720d529efd12aaec3e0fb167efaeeac2a9c7a73d59318d
Sep 15 11:25:23.480206 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:23.480156    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55799bb6_be25_43c7_b9fa_2dcb81a6fb84.slice/crio-4c050320fd8526e561057f0d6c311257447f855c55333e0ca8d502948e4cbf01 WatchSource:0}: Error finding container 4c050320fd8526e561057f0d6c311257447f855c55333e0ca8d502948e4cbf01: Status 404 returned error can't find the container with id 4c050320fd8526e561057f0d6c311257447f855c55333e0ca8d502948e4cbf01
Sep 15 11:25:23.482279 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:23.481892    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcab4df79_1ae2_4498_a8db_7bf2bf6d0042.slice/crio-b4022b77a2d7e6a05d19480596b4223d6ae45b5efe8e83ab9b6f36f24b3baf60 WatchSource:0}: Error finding container b4022b77a2d7e6a05d19480596b4223d6ae45b5efe8e83ab9b6f36f24b3baf60: Status 404 returned error can't find the container with id b4022b77a2d7e6a05d19480596b4223d6ae45b5efe8e83ab9b6f36f24b3baf60
Sep 15 11:25:23.484827 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:23.484811    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod355f0ff9_8c8d_4093_b576_2f6060c7c1b2.slice/crio-7e37b77546b28b4ee5babc13f5fe2f45ef39b7401752e7ddc04f400ce1166693 WatchSource:0}: Error finding container 7e37b77546b28b4ee5babc13f5fe2f45ef39b7401752e7ddc04f400ce1166693: Status 404 returned error can't find the container with id 7e37b77546b28b4ee5babc13f5fe2f45ef39b7401752e7ddc04f400ce1166693
Sep 15 11:25:23.486629 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:23.486607    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03850762_a184_4dec_a14f_e686a043f7c9.slice/crio-451dcda69a755b1c4de193f84b372de8a5c05477e97625c54a8bc93713da8b18 WatchSource:0}: Error finding container 451dcda69a755b1c4de193f84b372de8a5c05477e97625c54a8bc93713da8b18: Status 404 returned error can't find the container with id 451dcda69a755b1c4de193f84b372de8a5c05477e97625c54a8bc93713da8b18
Sep 15 11:25:23.487078 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:25:23.487060    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod499ee50f_63c2_4ade_a676_edb6066f3d0e.slice/crio-7e4d9bef167f21431425fd4c76be49f2147d345f7278b927b6f186250b281740 WatchSource:0}: Error finding container 7e4d9bef167f21431425fd4c76be49f2147d345f7278b927b6f186250b281740: Status 404 returned error can't find the container with id 7e4d9bef167f21431425fd4c76be49f2147d345f7278b927b6f186250b281740
Sep 15 11:25:23.517803 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.517781    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/485ecbb4-5f72-4e62-bce1-0d97de480e0b-metrics-certs\") pod \"network-metrics-daemon-dzzfd\" (UID: \"485ecbb4-5f72-4e62-bce1-0d97de480e0b\") " pod="openshift-multus/network-metrics-daemon-dzzfd"
Sep 15 11:25:23.517918 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.517813    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/270f712b-6161-4b60-8f89-0b2bcad6f27c-original-pull-secret\") pod \"global-pull-secret-syncer-dm5z4\" (UID: \"270f712b-6161-4b60-8f89-0b2bcad6f27c\") " pod="kube-system/global-pull-secret-syncer-dm5z4"
Sep 15 11:25:23.517918 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:23.517908    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:25:23.518032 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:23.517928    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:25:23.518032 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:23.517950    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/270f712b-6161-4b60-8f89-0b2bcad6f27c-original-pull-secret podName:270f712b-6161-4b60-8f89-0b2bcad6f27c nodeName:}" failed. No retries permitted until 2026-09-15 11:25:24.517937647 +0000 UTC m=+3.979803678 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/270f712b-6161-4b60-8f89-0b2bcad6f27c-original-pull-secret") pod "global-pull-secret-syncer-dm5z4" (UID: "270f712b-6161-4b60-8f89-0b2bcad6f27c") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:25:23.518032 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:23.517987    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/485ecbb4-5f72-4e62-bce1-0d97de480e0b-metrics-certs podName:485ecbb4-5f72-4e62-bce1-0d97de480e0b nodeName:}" failed. No retries permitted until 2026-09-15 11:25:24.517969013 +0000 UTC m=+3.979835057 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/485ecbb4-5f72-4e62-bce1-0d97de480e0b-metrics-certs") pod "network-metrics-daemon-dzzfd" (UID: "485ecbb4-5f72-4e62-bce1-0d97de480e0b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:25:23.619043 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.619008    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8k92\" (UniqueName: \"kubernetes.io/projected/e1eb4055-797f-4589-8f60-a46f631ad4e9-kube-api-access-n8k92\") pod \"network-check-target-bk6zq\" (UID: \"e1eb4055-797f-4589-8f60-a46f631ad4e9\") " pod="openshift-network-diagnostics/network-check-target-bk6zq"
Sep 15 11:25:23.619218 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:23.619170    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:25:23.619259 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:23.619210    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:25:23.619259 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:23.619238    2582 projected.go:196] Error preparing data for projected volume kube-api-access-n8k92 for pod openshift-network-diagnostics/network-check-target-bk6zq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:25:23.619327 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:23.619293    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1eb4055-797f-4589-8f60-a46f631ad4e9-kube-api-access-n8k92 podName:e1eb4055-797f-4589-8f60-a46f631ad4e9 nodeName:}" failed. No retries permitted until 2026-09-15 11:25:24.619278178 +0000 UTC m=+4.081144213 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-n8k92" (UniqueName: "kubernetes.io/projected/e1eb4055-797f-4589-8f60-a46f631ad4e9-kube-api-access-n8k92") pod "network-check-target-bk6zq" (UID: "e1eb4055-797f-4589-8f60-a46f631ad4e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:25:23.940467 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.940400    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 11:20:22 +0000 UTC" deadline="2028-06-13 05:22:12.592647486 +0000 UTC"
Sep 15 11:25:23.940467 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:23.940465    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15281h56m48.652187088s"
Sep 15 11:25:24.062411 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:24.062308    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sg9pm" event={"ID":"499ee50f-63c2-4ade-a676-edb6066f3d0e","Type":"ContainerStarted","Data":"7e4d9bef167f21431425fd4c76be49f2147d345f7278b927b6f186250b281740"}
Sep 15 11:25:24.080641 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:24.080601    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bbk72" event={"ID":"355f0ff9-8c8d-4093-b576-2f6060c7c1b2","Type":"ContainerStarted","Data":"7e37b77546b28b4ee5babc13f5fe2f45ef39b7401752e7ddc04f400ce1166693"}
Sep 15 11:25:24.085017 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:24.084891    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nbgzq" event={"ID":"cab4df79-1ae2-4498-a8db-7bf2bf6d0042","Type":"ContainerStarted","Data":"b4022b77a2d7e6a05d19480596b4223d6ae45b5efe8e83ab9b6f36f24b3baf60"}
Sep 15 11:25:24.087728 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:24.087652    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmlpp" event={"ID":"6efa8cf5-1df2-4916-b7dc-bdc81a06f642","Type":"ContainerStarted","Data":"30648a95f718f85d61adcc1ddf8e2715623cecb5fb6501dcfe07839fa66ccf93"}
Sep 15 11:25:24.097646 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:24.096716    2582 generic.go:356] "Generic (PLEG): container finished" podID="b2ee1f13b8d1493e22d22da47f4cf77d" containerID="81549999b2e6fc200b04f3c5e0aa0c1388512f3184d1bdf59e0ee9d297ebbee9" exitCode=0
Sep 15 11:25:24.097646 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:24.096800    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-95.ec2.internal" event={"ID":"b2ee1f13b8d1493e22d22da47f4cf77d","Type":"ContainerDied","Data":"81549999b2e6fc200b04f3c5e0aa0c1388512f3184d1bdf59e0ee9d297ebbee9"}
Sep 15 11:25:24.109071 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:24.108993    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hg698" event={"ID":"03850762-a184-4dec-a14f-e686a043f7c9","Type":"ContainerStarted","Data":"451dcda69a755b1c4de193f84b372de8a5c05477e97625c54a8bc93713da8b18"}
Sep 15 11:25:24.116073 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:24.116045    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hn4pl" event={"ID":"55799bb6-be25-43c7-b9fa-2dcb81a6fb84","Type":"ContainerStarted","Data":"4c050320fd8526e561057f0d6c311257447f855c55333e0ca8d502948e4cbf01"}
Sep 15 11:25:24.122772 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:24.122745    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rxz9x" event={"ID":"a1800c05-2abc-414f-b183-5ba0aef5ae63","Type":"ContainerStarted","Data":"04bc8dee038c8b6234720d529efd12aaec3e0fb167efaeeac2a9c7a73d59318d"}
Sep 15 11:25:24.143642 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:24.143600    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lspr9" event={"ID":"4d410cfe-4ca2-43e1-bf20-06634657a5a6","Type":"ContainerStarted","Data":"51bf692dc4f47bacc4c9f0747744a95f6874fbf9560ec34943cb0da060319385"}
Sep 15 11:25:24.155727 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:24.155690    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p9c4w" event={"ID":"6f6f444b-ce7e-4f28-81c1-c05b6b7b4763","Type":"ContainerStarted","Data":"35ce498a71f051c37c193ca5eba9b96e2286d494da70773f3fa6f3f6c88434e7"}
Sep 15 11:25:24.527781 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:24.527742    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/485ecbb4-5f72-4e62-bce1-0d97de480e0b-metrics-certs\") pod \"network-metrics-daemon-dzzfd\" (UID: \"485ecbb4-5f72-4e62-bce1-0d97de480e0b\") " pod="openshift-multus/network-metrics-daemon-dzzfd"
Sep 15 11:25:24.527970 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:24.527802    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/270f712b-6161-4b60-8f89-0b2bcad6f27c-original-pull-secret\") pod \"global-pull-secret-syncer-dm5z4\" (UID: \"270f712b-6161-4b60-8f89-0b2bcad6f27c\") " pod="kube-system/global-pull-secret-syncer-dm5z4"
Sep 15 11:25:24.527970 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:24.527962    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:25:24.528082 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:24.528024    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/270f712b-6161-4b60-8f89-0b2bcad6f27c-original-pull-secret podName:270f712b-6161-4b60-8f89-0b2bcad6f27c nodeName:}" failed. No retries permitted until 2026-09-15 11:25:26.528006352 +0000 UTC m=+5.989872401 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/270f712b-6161-4b60-8f89-0b2bcad6f27c-original-pull-secret") pod "global-pull-secret-syncer-dm5z4" (UID: "270f712b-6161-4b60-8f89-0b2bcad6f27c") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:25:24.528453 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:24.528435    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:25:24.528530 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:24.528496    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/485ecbb4-5f72-4e62-bce1-0d97de480e0b-metrics-certs podName:485ecbb4-5f72-4e62-bce1-0d97de480e0b nodeName:}" failed. No retries permitted until 2026-09-15 11:25:26.528479814 +0000 UTC m=+5.990345866 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/485ecbb4-5f72-4e62-bce1-0d97de480e0b-metrics-certs") pod "network-metrics-daemon-dzzfd" (UID: "485ecbb4-5f72-4e62-bce1-0d97de480e0b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:25:24.629572 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:24.628882    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8k92\" (UniqueName: \"kubernetes.io/projected/e1eb4055-797f-4589-8f60-a46f631ad4e9-kube-api-access-n8k92\") pod \"network-check-target-bk6zq\" (UID: \"e1eb4055-797f-4589-8f60-a46f631ad4e9\") " pod="openshift-network-diagnostics/network-check-target-bk6zq"
Sep 15 11:25:24.629572 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:24.629082    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:25:24.629572 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:24.629103    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:25:24.629572 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:24.629116    2582 projected.go:196] Error preparing data for projected volume kube-api-access-n8k92 for pod openshift-network-diagnostics/network-check-target-bk6zq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:25:24.629572 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:24.629192    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1eb4055-797f-4589-8f60-a46f631ad4e9-kube-api-access-n8k92 podName:e1eb4055-797f-4589-8f60-a46f631ad4e9 nodeName:}" failed. No retries permitted until 2026-09-15 11:25:26.629158102 +0000 UTC m=+6.091024155 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-n8k92" (UniqueName: "kubernetes.io/projected/e1eb4055-797f-4589-8f60-a46f631ad4e9-kube-api-access-n8k92") pod "network-check-target-bk6zq" (UID: "e1eb4055-797f-4589-8f60-a46f631ad4e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:25:24.941687 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:24.941595    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 11:20:22 +0000 UTC" deadline="2028-05-14 09:37:19.086752266 +0000 UTC"
Sep 15 11:25:24.941687 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:24.941641    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14566h11m54.14511671s"
Sep 15 11:25:25.041415 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:25.041381    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bk6zq"
Sep 15 11:25:25.041594 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:25.041514    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bk6zq" podUID="e1eb4055-797f-4589-8f60-a46f631ad4e9"
Sep 15 11:25:25.041951 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:25.041927    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzzfd"
Sep 15 11:25:25.042067 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:25.042046    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzzfd" podUID="485ecbb4-5f72-4e62-bce1-0d97de480e0b"
Sep 15 11:25:25.042126 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:25.042112    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm5z4"
Sep 15 11:25:25.042211 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:25.042193    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm5z4" podUID="270f712b-6161-4b60-8f89-0b2bcad6f27c"
Sep 15 11:25:25.176824 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:25.175964    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-95.ec2.internal" event={"ID":"b2ee1f13b8d1493e22d22da47f4cf77d","Type":"ContainerStarted","Data":"779a9708e00362d6e2f1ff223d6c8a272e05978a80ff9aa7f8aea6dbbe1f79d0"}
Sep 15 11:25:26.547462 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:26.547171    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/485ecbb4-5f72-4e62-bce1-0d97de480e0b-metrics-certs\") pod \"network-metrics-daemon-dzzfd\" (UID: \"485ecbb4-5f72-4e62-bce1-0d97de480e0b\") " pod="openshift-multus/network-metrics-daemon-dzzfd"
Sep 15 11:25:26.547946 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:26.547498    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/270f712b-6161-4b60-8f89-0b2bcad6f27c-original-pull-secret\") pod \"global-pull-secret-syncer-dm5z4\" (UID: \"270f712b-6161-4b60-8f89-0b2bcad6f27c\") " pod="kube-system/global-pull-secret-syncer-dm5z4"
Sep 15 11:25:26.547946 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:26.547662    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:25:26.547946 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:26.547729    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/270f712b-6161-4b60-8f89-0b2bcad6f27c-original-pull-secret podName:270f712b-6161-4b60-8f89-0b2bcad6f27c nodeName:}" failed. No retries permitted until 2026-09-15 11:25:30.547707872 +0000 UTC m=+10.009573925 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/270f712b-6161-4b60-8f89-0b2bcad6f27c-original-pull-secret") pod "global-pull-secret-syncer-dm5z4" (UID: "270f712b-6161-4b60-8f89-0b2bcad6f27c") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:25:26.548168 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:26.548144    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:25:26.548240 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:26.548226    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/485ecbb4-5f72-4e62-bce1-0d97de480e0b-metrics-certs podName:485ecbb4-5f72-4e62-bce1-0d97de480e0b nodeName:}" failed. No retries permitted until 2026-09-15 11:25:30.54820805 +0000 UTC m=+10.010074098 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/485ecbb4-5f72-4e62-bce1-0d97de480e0b-metrics-certs") pod "network-metrics-daemon-dzzfd" (UID: "485ecbb4-5f72-4e62-bce1-0d97de480e0b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:25:26.648231 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:26.648191    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8k92\" (UniqueName: \"kubernetes.io/projected/e1eb4055-797f-4589-8f60-a46f631ad4e9-kube-api-access-n8k92\") pod \"network-check-target-bk6zq\" (UID: \"e1eb4055-797f-4589-8f60-a46f631ad4e9\") " pod="openshift-network-diagnostics/network-check-target-bk6zq"
Sep 15 11:25:26.648419 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:26.648399    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:25:26.648478 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:26.648422    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:25:26.648478 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:26.648434    2582 projected.go:196] Error preparing data for projected volume kube-api-access-n8k92 for pod openshift-network-diagnostics/network-check-target-bk6zq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:25:26.648577 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:26.648494    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1eb4055-797f-4589-8f60-a46f631ad4e9-kube-api-access-n8k92 podName:e1eb4055-797f-4589-8f60-a46f631ad4e9 nodeName:}" failed. No retries permitted until 2026-09-15 11:25:30.648476739 +0000 UTC m=+10.110342785 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-n8k92" (UniqueName: "kubernetes.io/projected/e1eb4055-797f-4589-8f60-a46f631ad4e9-kube-api-access-n8k92") pod "network-check-target-bk6zq" (UID: "e1eb4055-797f-4589-8f60-a46f631ad4e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:25:27.041816 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:27.041782    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm5z4"
Sep 15 11:25:27.042003 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:27.041893    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm5z4" podUID="270f712b-6161-4b60-8f89-0b2bcad6f27c"
Sep 15 11:25:27.042294 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:27.042277    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bk6zq"
Sep 15 11:25:27.042383 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:27.042366    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bk6zq" podUID="e1eb4055-797f-4589-8f60-a46f631ad4e9"
Sep 15 11:25:27.042443 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:27.042421    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzzfd"
Sep 15 11:25:27.042498 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:27.042472    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzzfd" podUID="485ecbb4-5f72-4e62-bce1-0d97de480e0b"
Sep 15 11:25:29.040204 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:29.039461    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bk6zq"
Sep 15 11:25:29.040204 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:29.039599    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bk6zq" podUID="e1eb4055-797f-4589-8f60-a46f631ad4e9"
Sep 15 11:25:29.040204 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:29.039461    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzzfd"
Sep 15 11:25:29.040204 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:29.039654    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm5z4"
Sep 15 11:25:29.040204 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:29.039768    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzzfd" podUID="485ecbb4-5f72-4e62-bce1-0d97de480e0b"
Sep 15 11:25:29.040204 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:29.039847    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm5z4" podUID="270f712b-6161-4b60-8f89-0b2bcad6f27c"
Sep 15 11:25:30.581707 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:30.581667    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/485ecbb4-5f72-4e62-bce1-0d97de480e0b-metrics-certs\") pod \"network-metrics-daemon-dzzfd\" (UID: \"485ecbb4-5f72-4e62-bce1-0d97de480e0b\") " pod="openshift-multus/network-metrics-daemon-dzzfd"
Sep 15 11:25:30.581707 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:30.581721    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/270f712b-6161-4b60-8f89-0b2bcad6f27c-original-pull-secret\") pod \"global-pull-secret-syncer-dm5z4\" (UID: \"270f712b-6161-4b60-8f89-0b2bcad6f27c\") " pod="kube-system/global-pull-secret-syncer-dm5z4"
Sep 15 11:25:30.582194 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:30.581856    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:25:30.582194 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:30.581915    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/270f712b-6161-4b60-8f89-0b2bcad6f27c-original-pull-secret podName:270f712b-6161-4b60-8f89-0b2bcad6f27c nodeName:}" failed. No retries permitted until 2026-09-15 11:25:38.581901431 +0000 UTC m=+18.043767476 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/270f712b-6161-4b60-8f89-0b2bcad6f27c-original-pull-secret") pod "global-pull-secret-syncer-dm5z4" (UID: "270f712b-6161-4b60-8f89-0b2bcad6f27c") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:25:30.582338 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:30.582323    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:25:30.582387 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:30.582377    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/485ecbb4-5f72-4e62-bce1-0d97de480e0b-metrics-certs podName:485ecbb4-5f72-4e62-bce1-0d97de480e0b nodeName:}" failed. No retries permitted until 2026-09-15 11:25:38.582359973 +0000 UTC m=+18.044226020 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/485ecbb4-5f72-4e62-bce1-0d97de480e0b-metrics-certs") pod "network-metrics-daemon-dzzfd" (UID: "485ecbb4-5f72-4e62-bce1-0d97de480e0b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:25:30.682980 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:30.682944    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8k92\" (UniqueName: \"kubernetes.io/projected/e1eb4055-797f-4589-8f60-a46f631ad4e9-kube-api-access-n8k92\") pod \"network-check-target-bk6zq\" (UID: \"e1eb4055-797f-4589-8f60-a46f631ad4e9\") " pod="openshift-network-diagnostics/network-check-target-bk6zq"
Sep 15 11:25:30.683191 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:30.683115    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:25:30.683191 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:30.683138    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:25:30.683191 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:30.683147    2582 projected.go:196] Error preparing data for projected volume kube-api-access-n8k92 for pod openshift-network-diagnostics/network-check-target-bk6zq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:25:30.683379 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:30.683219    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1eb4055-797f-4589-8f60-a46f631ad4e9-kube-api-access-n8k92 podName:e1eb4055-797f-4589-8f60-a46f631ad4e9 nodeName:}" failed. No retries permitted until 2026-09-15 11:25:38.68320412 +0000 UTC m=+18.145070151 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-n8k92" (UniqueName: "kubernetes.io/projected/e1eb4055-797f-4589-8f60-a46f631ad4e9-kube-api-access-n8k92") pod "network-check-target-bk6zq" (UID: "e1eb4055-797f-4589-8f60-a46f631ad4e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:25:31.038900 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:31.038869    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bk6zq"
Sep 15 11:25:31.039099 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:31.038979    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bk6zq" podUID="e1eb4055-797f-4589-8f60-a46f631ad4e9"
Sep 15 11:25:31.040464 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:31.040436    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzzfd"
Sep 15 11:25:31.040603 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:31.040536    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzzfd" podUID="485ecbb4-5f72-4e62-bce1-0d97de480e0b"
Sep 15 11:25:31.040603 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:31.040598    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm5z4"
Sep 15 11:25:31.040703 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:31.040665    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm5z4" podUID="270f712b-6161-4b60-8f89-0b2bcad6f27c"
Sep 15 11:25:33.042436 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:33.041930    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzzfd"
Sep 15 11:25:33.042436 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:33.041930    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm5z4"
Sep 15 11:25:33.042436 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:33.042075    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzzfd" podUID="485ecbb4-5f72-4e62-bce1-0d97de480e0b"
Sep 15 11:25:33.042436 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:33.042128    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm5z4" podUID="270f712b-6161-4b60-8f89-0b2bcad6f27c"
Sep 15 11:25:33.042436 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:33.041929    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bk6zq"
Sep 15 11:25:33.042436 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:33.042260    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bk6zq" podUID="e1eb4055-797f-4589-8f60-a46f631ad4e9"
Sep 15 11:25:35.042726 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:35.042694    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm5z4"
Sep 15 11:25:35.043201 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:35.042819    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bk6zq"
Sep 15 11:25:35.043201 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:35.042834    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm5z4" podUID="270f712b-6161-4b60-8f89-0b2bcad6f27c"
Sep 15 11:25:35.043201 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:35.042858    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzzfd"
Sep 15 11:25:35.043201 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:35.042954    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bk6zq" podUID="e1eb4055-797f-4589-8f60-a46f631ad4e9"
Sep 15 11:25:35.043201 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:35.043045    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzzfd" podUID="485ecbb4-5f72-4e62-bce1-0d97de480e0b"
Sep 15 11:25:37.039641 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:37.039607    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzzfd"
Sep 15 11:25:37.039641 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:37.039634    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm5z4"
Sep 15 11:25:37.039641 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:37.039607    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bk6zq"
Sep 15 11:25:37.040203 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:37.039745    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm5z4" podUID="270f712b-6161-4b60-8f89-0b2bcad6f27c"
Sep 15 11:25:37.040203 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:37.039779    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bk6zq" podUID="e1eb4055-797f-4589-8f60-a46f631ad4e9"
Sep 15 11:25:37.040203 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:37.039851    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzzfd" podUID="485ecbb4-5f72-4e62-bce1-0d97de480e0b"
Sep 15 11:25:38.639904 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:38.639876    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/485ecbb4-5f72-4e62-bce1-0d97de480e0b-metrics-certs\") pod \"network-metrics-daemon-dzzfd\" (UID: \"485ecbb4-5f72-4e62-bce1-0d97de480e0b\") " pod="openshift-multus/network-metrics-daemon-dzzfd"
Sep 15 11:25:38.640350 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:38.639913    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/270f712b-6161-4b60-8f89-0b2bcad6f27c-original-pull-secret\") pod \"global-pull-secret-syncer-dm5z4\" (UID: \"270f712b-6161-4b60-8f89-0b2bcad6f27c\") " pod="kube-system/global-pull-secret-syncer-dm5z4"
Sep 15 11:25:38.640350 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:38.640014    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:25:38.640350 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:38.640053    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:25:38.640350 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:38.640076    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/270f712b-6161-4b60-8f89-0b2bcad6f27c-original-pull-secret podName:270f712b-6161-4b60-8f89-0b2bcad6f27c nodeName:}" failed. No retries permitted until 2026-09-15 11:25:54.640059292 +0000 UTC m=+34.101925340 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/270f712b-6161-4b60-8f89-0b2bcad6f27c-original-pull-secret") pod "global-pull-secret-syncer-dm5z4" (UID: "270f712b-6161-4b60-8f89-0b2bcad6f27c") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:25:38.640350 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:38.640113    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/485ecbb4-5f72-4e62-bce1-0d97de480e0b-metrics-certs podName:485ecbb4-5f72-4e62-bce1-0d97de480e0b nodeName:}" failed. No retries permitted until 2026-09-15 11:25:54.640095186 +0000 UTC m=+34.101961231 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/485ecbb4-5f72-4e62-bce1-0d97de480e0b-metrics-certs") pod "network-metrics-daemon-dzzfd" (UID: "485ecbb4-5f72-4e62-bce1-0d97de480e0b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:25:38.740310 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:38.740231    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8k92\" (UniqueName: \"kubernetes.io/projected/e1eb4055-797f-4589-8f60-a46f631ad4e9-kube-api-access-n8k92\") pod \"network-check-target-bk6zq\" (UID: \"e1eb4055-797f-4589-8f60-a46f631ad4e9\") " pod="openshift-network-diagnostics/network-check-target-bk6zq"
Sep 15 11:25:38.740452 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:38.740384    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:25:38.740452 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:38.740407    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:25:38.740452 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:38.740420    2582 projected.go:196] Error preparing data for projected volume kube-api-access-n8k92 for pod openshift-network-diagnostics/network-check-target-bk6zq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:25:38.740555 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:38.740478    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1eb4055-797f-4589-8f60-a46f631ad4e9-kube-api-access-n8k92 podName:e1eb4055-797f-4589-8f60-a46f631ad4e9 nodeName:}" failed. No retries permitted until 2026-09-15 11:25:54.740460749 +0000 UTC m=+34.202326796 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-n8k92" (UniqueName: "kubernetes.io/projected/e1eb4055-797f-4589-8f60-a46f631ad4e9-kube-api-access-n8k92") pod "network-check-target-bk6zq" (UID: "e1eb4055-797f-4589-8f60-a46f631ad4e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:25:39.040050 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:39.039961    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzzfd"
Sep 15 11:25:39.040050 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:39.040009    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bk6zq"
Sep 15 11:25:39.040260 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:39.040088    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm5z4"
Sep 15 11:25:39.040260 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:39.040095    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzzfd" podUID="485ecbb4-5f72-4e62-bce1-0d97de480e0b"
Sep 15 11:25:39.040260 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:39.040169    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm5z4" podUID="270f712b-6161-4b60-8f89-0b2bcad6f27c"
Sep 15 11:25:39.040357 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:39.040257    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bk6zq" podUID="e1eb4055-797f-4589-8f60-a46f631ad4e9"
Sep 15 11:25:41.040458 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:41.040421    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bk6zq"
Sep 15 11:25:41.040914 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:41.040532    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bk6zq" podUID="e1eb4055-797f-4589-8f60-a46f631ad4e9"
Sep 15 11:25:41.040914 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:41.040538    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzzfd"
Sep 15 11:25:41.040914 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:41.040560    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm5z4"
Sep 15 11:25:41.040914 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:41.040649    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzzfd" podUID="485ecbb4-5f72-4e62-bce1-0d97de480e0b"
Sep 15 11:25:41.040914 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:41.040719    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm5z4" podUID="270f712b-6161-4b60-8f89-0b2bcad6f27c"
Sep 15 11:25:43.039869 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:43.039703    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bk6zq"
Sep 15 11:25:43.040544 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:43.039706    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzzfd"
Sep 15 11:25:43.040544 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:43.039965    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bk6zq" podUID="e1eb4055-797f-4589-8f60-a46f631ad4e9"
Sep 15 11:25:43.040544 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:43.039722    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm5z4"
Sep 15 11:25:43.040544 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:43.040020    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzzfd" podUID="485ecbb4-5f72-4e62-bce1-0d97de480e0b"
Sep 15 11:25:43.040544 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:43.040084    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm5z4" podUID="270f712b-6161-4b60-8f89-0b2bcad6f27c"
Sep 15 11:25:43.242849 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:43.242770    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lspr9" event={"ID":"4d410cfe-4ca2-43e1-bf20-06634657a5a6","Type":"ContainerStarted","Data":"c828c7530613c6509abf3444aac7b61e3fcd2fe1b42ef16606a8c9770d670445"}
Sep 15 11:25:43.243004 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:43.242873    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lspr9" event={"ID":"4d410cfe-4ca2-43e1-bf20-06634657a5a6","Type":"ContainerStarted","Data":"ce145adc92c7371170048c6292249ae593a172b91e45eab0db7c89a5864b314b"}
Sep 15 11:25:43.243004 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:43.242934    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lspr9" event={"ID":"4d410cfe-4ca2-43e1-bf20-06634657a5a6","Type":"ContainerStarted","Data":"4d135f2be67c4df48f3a4f63fddb6d7603d77c84195ed3eddfbf8195f5f60099"}
Sep 15 11:25:43.243004 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:43.242966    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lspr9" event={"ID":"4d410cfe-4ca2-43e1-bf20-06634657a5a6","Type":"ContainerStarted","Data":"ff0d2522e301845a54f3e4f047b1831224f2f1db77a971a6c6f4604f15a0ce32"}
Sep 15 11:25:43.243004 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:43.242994    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lspr9" event={"ID":"4d410cfe-4ca2-43e1-bf20-06634657a5a6","Type":"ContainerStarted","Data":"b9ce428be2d400402070afe0d8db773b35879c3dc32162df4bf9992720d90869"}
Sep 15 11:25:43.243294 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:43.243021    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lspr9" event={"ID":"4d410cfe-4ca2-43e1-bf20-06634657a5a6","Type":"ContainerStarted","Data":"1126cddba3368fbae5d152f1c1eb1c956b942df2a7c33fe7c48c10dae94a551b"}
Sep 15 11:25:43.244683 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:43.244657    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-95.ec2.internal" event={"ID":"8f133eefe581cc2b4f83ef628d20097a","Type":"ContainerStarted","Data":"17601b05ef30b08be48fa7efb0f66a6982e3488d2b3f50147972698831821a30"}
Sep 15 11:25:43.246527 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:43.246504    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sg9pm" event={"ID":"499ee50f-63c2-4ade-a676-edb6066f3d0e","Type":"ContainerStarted","Data":"1dc573a4355cfca3a2664b218ea671905469244dac8cccc1d78b82eae7a43ea1"}
Sep 15 11:25:43.248143 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:43.248120    2582 generic.go:356] "Generic (PLEG): container finished" podID="355f0ff9-8c8d-4093-b576-2f6060c7c1b2" containerID="2f08866ad843a97a5f444253e1668d9a236e6d2227e21dc49c1e6e4db8abef22" exitCode=0
Sep 15 11:25:43.248259 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:43.248229    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bbk72" event={"ID":"355f0ff9-8c8d-4093-b576-2f6060c7c1b2","Type":"ContainerDied","Data":"2f08866ad843a97a5f444253e1668d9a236e6d2227e21dc49c1e6e4db8abef22"}
Sep 15 11:25:43.250142 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:43.250114    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nbgzq" event={"ID":"cab4df79-1ae2-4498-a8db-7bf2bf6d0042","Type":"ContainerStarted","Data":"168fc1aa0ed4121a806e2e2fc80dce15e3b71e7ad75d65b112e54838120df479"}
Sep 15 11:25:43.251815 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:43.251793    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmlpp" event={"ID":"6efa8cf5-1df2-4916-b7dc-bdc81a06f642","Type":"ContainerStarted","Data":"a9f3879979d87a3d2cec57c530a6f0905d7845072549f49d61495569a29223fe"}
Sep 15 11:25:43.253064 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:43.253044    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hg698" event={"ID":"03850762-a184-4dec-a14f-e686a043f7c9","Type":"ContainerStarted","Data":"477c18387d40cc4d027191d40a0f9af62d8abb6481f374ac5e3b4873758e6365"}
Sep 15 11:25:43.254691 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:43.254672    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hn4pl" event={"ID":"55799bb6-be25-43c7-b9fa-2dcb81a6fb84","Type":"ContainerStarted","Data":"8487cc0dce0343ad8b1f84e17e5e7f2a0cf52991dd1a363fd21ca9c608795b76"}
Sep 15 11:25:43.256195 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:43.256158    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rxz9x" event={"ID":"a1800c05-2abc-414f-b183-5ba0aef5ae63","Type":"ContainerStarted","Data":"a386f25ebe0af5f176deb8ecd987448304a7bb716103ed7642eec3118179b4bb"}
Sep 15 11:25:43.259752 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:43.259714    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-95.ec2.internal" podStartSLOduration=21.259703707 podStartE2EDuration="21.259703707s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:25:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:25:25.19908986 +0000 UTC m=+4.660955913" watchObservedRunningTime="2026-09-15 11:25:43.259703707 +0000 UTC m=+22.721569759"
Sep 15 11:25:43.260340 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:43.260311    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-95.ec2.internal" podStartSLOduration=21.260304017 podStartE2EDuration="21.260304017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:25:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:25:43.259605046 +0000 UTC m=+22.721471099" watchObservedRunningTime="2026-09-15 11:25:43.260304017 +0000 UTC m=+22.722170070"
Sep 15 11:25:43.274968 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:43.274923    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-sg9pm" podStartSLOduration=3.329175785 podStartE2EDuration="22.274907552s" totalImagesPullingTime="18.945731767s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:25:43.274714738 +0000 UTC m=+22.736580791" watchObservedRunningTime="2026-09-15 11:25:43.274907552 +0000 UTC m=+22.736773626"
Sep 15 11:25:43.300384 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:43.300332    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nbgzq" podStartSLOduration=3.377363872 podStartE2EDuration="22.300309592s" totalImagesPullingTime="18.92294572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:25:43.287695059 +0000 UTC m=+22.749561112" watchObservedRunningTime="2026-09-15 11:25:43.300309592 +0000 UTC m=+22.762175644"
Sep 15 11:25:43.300532 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:43.300512    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rxz9x" podStartSLOduration=3.373972429 podStartE2EDuration="22.300506211s" totalImagesPullingTime="18.926533782s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:25:43.30046427 +0000 UTC m=+22.762330309" watchObservedRunningTime="2026-09-15 11:25:43.300506211 +0000 UTC m=+22.762372264"
Sep 15 11:25:43.320731 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:43.320672    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hg698" podStartSLOduration=3.397167157 podStartE2EDuration="22.320650862s" totalImagesPullingTime="18.923483705s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:25:43.31986398 +0000 UTC m=+22.781730034" watchObservedRunningTime="2026-09-15 11:25:43.320650862 +0000 UTC m=+22.782516915"
Sep 15 11:25:43.349793 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:43.349725    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hn4pl" podStartSLOduration=3.415653189 podStartE2EDuration="22.349704445s" totalImagesPullingTime="18.934051256s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:25:43.348913842 +0000 UTC m=+22.810779895" watchObservedRunningTime="2026-09-15 11:25:43.349704445 +0000 UTC m=+22.811570500"
Sep 15 11:25:43.862361 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:43.862198    2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 15 11:25:43.971798 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:43.971668    2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-15T11:25:43.8623463Z","UUID":"5a6bc8cd-5e7c-4536-aa8b-a20ef3b5e726","Handler":null,"Name":"","Endpoint":""}
Sep 15 11:25:43.973504 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:43.973483    2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 15 11:25:43.973504 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:43.973519    2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 15 11:25:44.260754 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:44.260716    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p9c4w" event={"ID":"6f6f444b-ce7e-4f28-81c1-c05b6b7b4763","Type":"ContainerStarted","Data":"7473ac4723d3a7de8a0a8f25e848a0678e302e29a967ff38b7a7f898d10505e4"}
Sep 15 11:25:44.263030 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:44.262963    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmlpp" event={"ID":"6efa8cf5-1df2-4916-b7dc-bdc81a06f642","Type":"ContainerStarted","Data":"6dd82f126a05b5ca621f1c78b57a0a1bcd5821d315e585941f66ac5c3a4236fd"}
Sep 15 11:25:45.039760 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:45.039733    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bk6zq"
Sep 15 11:25:45.039927 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:45.039730    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm5z4"
Sep 15 11:25:45.039927 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:45.039832    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bk6zq" podUID="e1eb4055-797f-4589-8f60-a46f631ad4e9"
Sep 15 11:25:45.039927 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:45.039878    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzzfd"
Sep 15 11:25:45.040085 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:45.039959    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm5z4" podUID="270f712b-6161-4b60-8f89-0b2bcad6f27c"
Sep 15 11:25:45.040085 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:45.040033    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzzfd" podUID="485ecbb4-5f72-4e62-bce1-0d97de480e0b"
Sep 15 11:25:45.267806 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:45.267764    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmlpp" event={"ID":"6efa8cf5-1df2-4916-b7dc-bdc81a06f642","Type":"ContainerStarted","Data":"4a25a7b091bec83ad0196093904f2f1aabba7ac7ac610d098c55400418688c91"}
Sep 15 11:25:45.287575 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:45.287526    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-p9c4w" podStartSLOduration=5.355336009 podStartE2EDuration="24.287510959s" totalImagesPullingTime="18.93217495s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:25:44.280258233 +0000 UTC m=+23.742124288" watchObservedRunningTime="2026-09-15 11:25:45.287510959 +0000 UTC m=+24.749377011"
Sep 15 11:25:45.287895 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:45.287867    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmlpp" podStartSLOduration=3.205132653 podStartE2EDuration="24.287858587s" totalImagesPullingTime="21.082725934s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:25:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:25:45.287105189 +0000 UTC m=+24.748971245" watchObservedRunningTime="2026-09-15 11:25:45.287858587 +0000 UTC m=+24.749724641"
Sep 15 11:25:46.274684 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:46.274646    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lspr9" event={"ID":"4d410cfe-4ca2-43e1-bf20-06634657a5a6","Type":"ContainerStarted","Data":"436241a48cab8a990c53e2a7a1d72d3bf54ae752f3e3c48ba5291391f7681c94"}
Sep 15 11:25:47.039123 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:47.039088    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bk6zq"
Sep 15 11:25:47.039324 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:47.039092    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzzfd"
Sep 15 11:25:47.039324 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:47.039234    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bk6zq" podUID="e1eb4055-797f-4589-8f60-a46f631ad4e9"
Sep 15 11:25:47.039445 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:47.039331    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzzfd" podUID="485ecbb4-5f72-4e62-bce1-0d97de480e0b"
Sep 15 11:25:47.039445 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:47.039092    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm5z4"
Sep 15 11:25:47.039445 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:47.039431    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm5z4" podUID="270f712b-6161-4b60-8f89-0b2bcad6f27c"
Sep 15 11:25:47.552342 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:47.552306    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nbgzq"
Sep 15 11:25:47.552873 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:47.552849    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nbgzq"
Sep 15 11:25:48.282763 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:48.282493    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lspr9" event={"ID":"4d410cfe-4ca2-43e1-bf20-06634657a5a6","Type":"ContainerStarted","Data":"4b77c270788557c833cc5cdd5835b4d018cbcfa415549220ef0db4787294a33f"}
Sep 15 11:25:48.282945 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:48.282788    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:48.282945 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:48.282832    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:48.284390 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:48.284366    2582 generic.go:356] "Generic (PLEG): container finished" podID="355f0ff9-8c8d-4093-b576-2f6060c7c1b2" containerID="896ebe901944cd019728677c391415568fc7cb5a77bc03a0a372b04cf8ec1f9d" exitCode=0
Sep 15 11:25:48.284511 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:48.284445    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bbk72" event={"ID":"355f0ff9-8c8d-4093-b576-2f6060c7c1b2","Type":"ContainerDied","Data":"896ebe901944cd019728677c391415568fc7cb5a77bc03a0a372b04cf8ec1f9d"}
Sep 15 11:25:48.284511 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:48.284506    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nbgzq"
Sep 15 11:25:48.285066 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:48.285050    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nbgzq"
Sep 15 11:25:48.299149 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:48.299128    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:48.310774 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:48.310737    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lspr9" podStartSLOduration=8.378996485 podStartE2EDuration="27.310725024s" totalImagesPullingTime="18.931728539s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:25:48.310414124 +0000 UTC m=+27.772280204" watchObservedRunningTime="2026-09-15 11:25:48.310725024 +0000 UTC m=+27.772591076"
Sep 15 11:25:49.039853 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:49.039821    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzzfd"
Sep 15 11:25:49.040800 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:49.039818    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bk6zq"
Sep 15 11:25:49.040800 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:49.039963    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzzfd" podUID="485ecbb4-5f72-4e62-bce1-0d97de480e0b"
Sep 15 11:25:49.040800 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:49.039829    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm5z4"
Sep 15 11:25:49.040800 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:49.040039    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bk6zq" podUID="e1eb4055-797f-4589-8f60-a46f631ad4e9"
Sep 15 11:25:49.040800 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:49.040107    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm5z4" podUID="270f712b-6161-4b60-8f89-0b2bcad6f27c"
Sep 15 11:25:49.287148 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:49.287121    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:49.306748 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:49.306691    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:25:49.577047 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:49.576855    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dm5z4"]
Sep 15 11:25:49.577190 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:49.577149    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm5z4"
Sep 15 11:25:49.577276 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:49.577258    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm5z4" podUID="270f712b-6161-4b60-8f89-0b2bcad6f27c"
Sep 15 11:25:49.580205 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:49.580160    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bk6zq"]
Sep 15 11:25:49.580346 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:49.580272    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bk6zq"
Sep 15 11:25:49.580413 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:49.580345    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bk6zq" podUID="e1eb4055-797f-4589-8f60-a46f631ad4e9"
Sep 15 11:25:49.580851 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:49.580834    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dzzfd"]
Sep 15 11:25:49.580949 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:49.580920    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzzfd"
Sep 15 11:25:49.581006 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:49.580992    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzzfd" podUID="485ecbb4-5f72-4e62-bce1-0d97de480e0b"
Sep 15 11:25:50.291048 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:50.291015    2582 generic.go:356] "Generic (PLEG): container finished" podID="355f0ff9-8c8d-4093-b576-2f6060c7c1b2" containerID="41d539f8d0057cf0c2fa211be2e86eb484de16658b4a0aa7f8779f3d8942cab3" exitCode=0
Sep 15 11:25:50.291502 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:50.291079    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bbk72" event={"ID":"355f0ff9-8c8d-4093-b576-2f6060c7c1b2","Type":"ContainerDied","Data":"41d539f8d0057cf0c2fa211be2e86eb484de16658b4a0aa7f8779f3d8942cab3"}
Sep 15 11:25:51.040507 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:51.040478    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bk6zq"
Sep 15 11:25:51.040676 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:51.040558    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bk6zq" podUID="e1eb4055-797f-4589-8f60-a46f631ad4e9"
Sep 15 11:25:51.040676 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:51.040643    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzzfd"
Sep 15 11:25:51.040767 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:51.040744    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzzfd" podUID="485ecbb4-5f72-4e62-bce1-0d97de480e0b"
Sep 15 11:25:51.040818 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:51.040784    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm5z4"
Sep 15 11:25:51.040855 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:51.040832    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm5z4" podUID="270f712b-6161-4b60-8f89-0b2bcad6f27c"
Sep 15 11:25:52.298542 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:52.298486    2582 generic.go:356] "Generic (PLEG): container finished" podID="355f0ff9-8c8d-4093-b576-2f6060c7c1b2" containerID="3976319adb5398373c410fbe9609673c9b0b6bfc5779aaef56cef511da3248c5" exitCode=0
Sep 15 11:25:52.298910 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:52.298561    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bbk72" event={"ID":"355f0ff9-8c8d-4093-b576-2f6060c7c1b2","Type":"ContainerDied","Data":"3976319adb5398373c410fbe9609673c9b0b6bfc5779aaef56cef511da3248c5"}
Sep 15 11:25:53.039292 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:53.039261    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bk6zq"
Sep 15 11:25:53.039475 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:53.039386    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bk6zq" podUID="e1eb4055-797f-4589-8f60-a46f631ad4e9"
Sep 15 11:25:53.039475 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:53.039453    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzzfd"
Sep 15 11:25:53.039600 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:53.039538    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzzfd" podUID="485ecbb4-5f72-4e62-bce1-0d97de480e0b"
Sep 15 11:25:53.039600 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:53.039591    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm5z4"
Sep 15 11:25:53.039704 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:53.039667    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm5z4" podUID="270f712b-6161-4b60-8f89-0b2bcad6f27c"
Sep 15 11:25:54.658470 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:54.658430    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/485ecbb4-5f72-4e62-bce1-0d97de480e0b-metrics-certs\") pod \"network-metrics-daemon-dzzfd\" (UID: \"485ecbb4-5f72-4e62-bce1-0d97de480e0b\") " pod="openshift-multus/network-metrics-daemon-dzzfd"
Sep 15 11:25:54.658470 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:54.658469    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/270f712b-6161-4b60-8f89-0b2bcad6f27c-original-pull-secret\") pod \"global-pull-secret-syncer-dm5z4\" (UID: \"270f712b-6161-4b60-8f89-0b2bcad6f27c\") " pod="kube-system/global-pull-secret-syncer-dm5z4"
Sep 15 11:25:54.658911 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:54.658593    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:25:54.658911 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:54.658595    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:25:54.658911 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:54.658652    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/270f712b-6161-4b60-8f89-0b2bcad6f27c-original-pull-secret podName:270f712b-6161-4b60-8f89-0b2bcad6f27c nodeName:}" failed. No retries permitted until 2026-09-15 11:26:26.658632059 +0000 UTC m=+66.120498103 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/270f712b-6161-4b60-8f89-0b2bcad6f27c-original-pull-secret") pod "global-pull-secret-syncer-dm5z4" (UID: "270f712b-6161-4b60-8f89-0b2bcad6f27c") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:25:54.658911 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:54.658665    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/485ecbb4-5f72-4e62-bce1-0d97de480e0b-metrics-certs podName:485ecbb4-5f72-4e62-bce1-0d97de480e0b nodeName:}" failed. No retries permitted until 2026-09-15 11:26:26.658659386 +0000 UTC m=+66.120525416 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/485ecbb4-5f72-4e62-bce1-0d97de480e0b-metrics-certs") pod "network-metrics-daemon-dzzfd" (UID: "485ecbb4-5f72-4e62-bce1-0d97de480e0b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:25:54.759225 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:54.759151    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8k92\" (UniqueName: \"kubernetes.io/projected/e1eb4055-797f-4589-8f60-a46f631ad4e9-kube-api-access-n8k92\") pod \"network-check-target-bk6zq\" (UID: \"e1eb4055-797f-4589-8f60-a46f631ad4e9\") " pod="openshift-network-diagnostics/network-check-target-bk6zq"
Sep 15 11:25:54.759396 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:54.759338    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:25:54.759396 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:54.759361    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:25:54.759396 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:54.759374    2582 projected.go:196] Error preparing data for projected volume kube-api-access-n8k92 for pod openshift-network-diagnostics/network-check-target-bk6zq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:25:54.759514 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:54.759444    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1eb4055-797f-4589-8f60-a46f631ad4e9-kube-api-access-n8k92 podName:e1eb4055-797f-4589-8f60-a46f631ad4e9 nodeName:}" failed. No retries permitted until 2026-09-15 11:26:26.759424386 +0000 UTC m=+66.221290420 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-n8k92" (UniqueName: "kubernetes.io/projected/e1eb4055-797f-4589-8f60-a46f631ad4e9-kube-api-access-n8k92") pod "network-check-target-bk6zq" (UID: "e1eb4055-797f-4589-8f60-a46f631ad4e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:25:55.039140 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:55.039062    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm5z4"
Sep 15 11:25:55.039323 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:55.039062    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzzfd"
Sep 15 11:25:55.039323 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:55.039205    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm5z4" podUID="270f712b-6161-4b60-8f89-0b2bcad6f27c"
Sep 15 11:25:55.039323 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:55.039216    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bk6zq"
Sep 15 11:25:55.039323 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:55.039308    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzzfd" podUID="485ecbb4-5f72-4e62-bce1-0d97de480e0b"
Sep 15 11:25:55.039534 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:25:55.039414    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bk6zq" podUID="e1eb4055-797f-4589-8f60-a46f631ad4e9"
Sep 15 11:25:55.230043 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:55.230014    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hn4pl_55799bb6-be25-43c7-b9fa-2dcb81a6fb84/dns-node-resolver/0.log"
Sep 15 11:25:56.311344 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:56.311194    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bbk72" event={"ID":"355f0ff9-8c8d-4093-b576-2f6060c7c1b2","Type":"ContainerStarted","Data":"233cd9f576db2ef4babc2090ae8a356c96169ac2fd22bbb9bc58412839479df9"}
Sep 15 11:25:56.315822 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:56.315805    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-95.ec2.internal" event="NodeReady"
Sep 15 11:25:56.315940 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:56.315929    2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 15 11:25:56.413208 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:56.413168    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rxz9x_a1800c05-2abc-414f-b183-5ba0aef5ae63/node-ca/0.log"
Sep 15 11:25:57.039293 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:57.039263    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bk6zq"
Sep 15 11:25:57.039480 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:57.039272    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzzfd"
Sep 15 11:25:57.039480 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:57.039377    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm5z4"
Sep 15 11:25:57.041819 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:57.041797    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 11:25:57.042571 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:57.042551    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 15 11:25:57.042665 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:57.042586    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 11:25:57.042665 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:57.042602    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 15 11:25:57.042665 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:57.042650    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-q47md\""
Sep 15 11:25:57.042843 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:57.042695    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mvt2n\""
Sep 15 11:25:57.319031 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:57.316521    2582 generic.go:356] "Generic (PLEG): container finished" podID="355f0ff9-8c8d-4093-b576-2f6060c7c1b2" containerID="233cd9f576db2ef4babc2090ae8a356c96169ac2fd22bbb9bc58412839479df9" exitCode=0
Sep 15 11:25:57.319031 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:57.316581    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bbk72" event={"ID":"355f0ff9-8c8d-4093-b576-2f6060c7c1b2","Type":"ContainerDied","Data":"233cd9f576db2ef4babc2090ae8a356c96169ac2fd22bbb9bc58412839479df9"}
Sep 15 11:25:58.321918 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:58.321885    2582 generic.go:356] "Generic (PLEG): container finished" podID="355f0ff9-8c8d-4093-b576-2f6060c7c1b2" containerID="19cfb6db61d93bf44ddd8406f11f5e06105f64c11457680d4baa3dfff6212836" exitCode=0
Sep 15 11:25:58.322321 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:58.321935    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bbk72" event={"ID":"355f0ff9-8c8d-4093-b576-2f6060c7c1b2","Type":"ContainerDied","Data":"19cfb6db61d93bf44ddd8406f11f5e06105f64c11457680d4baa3dfff6212836"}
Sep 15 11:25:59.327337 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:59.327301    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bbk72" event={"ID":"355f0ff9-8c8d-4093-b576-2f6060c7c1b2","Type":"ContainerStarted","Data":"9f5de8097b6e862118c4a654537a657e85c7e04d128287fd7b0ddb4077bb6a50"}
Sep 15 11:25:59.354653 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:25:59.354605    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bbk72" podStartSLOduration=9.100629802 podStartE2EDuration="38.354590132s" totalImagesPullingTime="29.25396033s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:25:21 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:25:59.353474845 +0000 UTC m=+38.815340897" watchObservedRunningTime="2026-09-15 11:25:59.354590132 +0000 UTC m=+38.816456185"
Sep 15 11:26:15.478524 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.478488    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856657c8f-fnxpf"]
Sep 15 11:26:15.482620 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.482594    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-588fc65958-mfd5d"]
Sep 15 11:26:15.482756 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.482722    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856657c8f-fnxpf"
Sep 15 11:26:15.484358 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.484334    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588fc65958-mfd5d"
Sep 15 11:26:15.485233 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.485212    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 15 11:26:15.487781 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.487763    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 15 11:26:15.487945 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.487922    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 15 11:26:15.488077 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.488061    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 15 11:26:15.488702 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.488680    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 15 11:26:15.488815 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.488718    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 15 11:26:15.488815 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.488685    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 15 11:26:15.488815 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.488732    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 15 11:26:15.498885 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.498866    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-588fc65958-mfd5d"]
Sep 15 11:26:15.501713 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.501693    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856657c8f-fnxpf"]
Sep 15 11:26:15.571779 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.571747    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-mc9fm"]
Sep 15 11:26:15.573660 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.573645    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-mc9fm"
Sep 15 11:26:15.575809 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.575787    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 15 11:26:15.576360 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.576345    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-d8bdn\""
Sep 15 11:26:15.579006 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.578977    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-596pk"]
Sep 15 11:26:15.580819 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.580802    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-545ff"]
Sep 15 11:26:15.580945 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.580929    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-596pk"
Sep 15 11:26:15.582442 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.582426    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-64d479d79d-ztcsf"]
Sep 15 11:26:15.582549 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.582532    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-545ff"
Sep 15 11:26:15.583006 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.582987    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 15 11:26:15.584104 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.584088    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64d479d79d-ztcsf"
Sep 15 11:26:15.584592 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.584575    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 15 11:26:15.584868 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.584844    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 15 11:26:15.584868 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.584862    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fs9cl\""
Sep 15 11:26:15.584992 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.584980    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-z2sd6\""
Sep 15 11:26:15.584992 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.584988    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 15 11:26:15.585222 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.585207    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 15 11:26:15.586049 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.586033    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 15 11:26:15.586415 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.586402    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 15 11:26:15.586651 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.586636    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-n56tl\""
Sep 15 11:26:15.587103 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.587091    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 15 11:26:15.589391 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.589341    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-mc9fm"]
Sep 15 11:26:15.595200 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.595162    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 15 11:26:15.598686 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.598666    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-596pk"]
Sep 15 11:26:15.598787 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.598712    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-545ff"]
Sep 15 11:26:15.603711 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.603690    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64d479d79d-ztcsf"]
Sep 15 11:26:15.608541 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.608521    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/330bb348-367a-4018-86d1-143ca8a3a4aa-additional-service-ca\") pod \"cluster-proxy-proxy-agent-856657c8f-fnxpf\" (UID: \"330bb348-367a-4018-86d1-143ca8a3a4aa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856657c8f-fnxpf"
Sep 15 11:26:15.608640 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.608558    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/53fdfc58-492d-48b4-bd3c-c129fe352e1c-klusterlet-config\") pod \"klusterlet-addon-workmgr-588fc65958-mfd5d\" (UID: \"53fdfc58-492d-48b4-bd3c-c129fe352e1c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588fc65958-mfd5d"
Sep 15 11:26:15.608640 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.608599    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/330bb348-367a-4018-86d1-143ca8a3a4aa-hub\") pod \"cluster-proxy-proxy-agent-856657c8f-fnxpf\" (UID: \"330bb348-367a-4018-86d1-143ca8a3a4aa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856657c8f-fnxpf"
Sep 15 11:26:15.608750 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.608655    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk7kj\" (UniqueName: \"kubernetes.io/projected/330bb348-367a-4018-86d1-143ca8a3a4aa-kube-api-access-qk7kj\") pod \"cluster-proxy-proxy-agent-856657c8f-fnxpf\" (UID: \"330bb348-367a-4018-86d1-143ca8a3a4aa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856657c8f-fnxpf"
Sep 15 11:26:15.608750 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.608703    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/330bb348-367a-4018-86d1-143ca8a3a4aa-ca\") pod \"cluster-proxy-proxy-agent-856657c8f-fnxpf\" (UID: \"330bb348-367a-4018-86d1-143ca8a3a4aa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856657c8f-fnxpf"
Sep 15 11:26:15.608750 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.608727    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/330bb348-367a-4018-86d1-143ca8a3a4aa-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-856657c8f-fnxpf\" (UID: \"330bb348-367a-4018-86d1-143ca8a3a4aa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856657c8f-fnxpf"
Sep 15 11:26:15.608863 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.608751    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/330bb348-367a-4018-86d1-143ca8a3a4aa-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-856657c8f-fnxpf\" (UID: \"330bb348-367a-4018-86d1-143ca8a3a4aa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856657c8f-fnxpf"
Sep 15 11:26:15.608863 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.608790    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53fdfc58-492d-48b4-bd3c-c129fe352e1c-tmp\") pod \"klusterlet-addon-workmgr-588fc65958-mfd5d\" (UID: \"53fdfc58-492d-48b4-bd3c-c129fe352e1c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588fc65958-mfd5d"
Sep 15 11:26:15.608863 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.608812    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tx6g\" (UniqueName: \"kubernetes.io/projected/53fdfc58-492d-48b4-bd3c-c129fe352e1c-kube-api-access-2tx6g\") pod \"klusterlet-addon-workmgr-588fc65958-mfd5d\" (UID: \"53fdfc58-492d-48b4-bd3c-c129fe352e1c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588fc65958-mfd5d"
Sep 15 11:26:15.671472 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.671442    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vmxh2"]
Sep 15 11:26:15.673600 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.673580    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vmxh2"
Sep 15 11:26:15.677374 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.677357    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 15 11:26:15.677702 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.677687    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 15 11:26:15.677754 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.677730    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 15 11:26:15.678034 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.678020    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jd6pn\""
Sep 15 11:26:15.678083 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.678026    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 15 11:26:15.683916 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.683893    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vmxh2"]
Sep 15 11:26:15.709462 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.709434    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/330bb348-367a-4018-86d1-143ca8a3a4aa-hub\") pod \"cluster-proxy-proxy-agent-856657c8f-fnxpf\" (UID: \"330bb348-367a-4018-86d1-143ca8a3a4aa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856657c8f-fnxpf"
Sep 15 11:26:15.709462 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.709465    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqbc7\" (UniqueName: \"kubernetes.io/projected/3d055f0d-31e8-4cca-bd4b-8b856dbb3966-kube-api-access-rqbc7\") pod \"ingress-canary-596pk\" (UID: \"3d055f0d-31e8-4cca-bd4b-8b856dbb3966\") " pod="openshift-ingress-canary/ingress-canary-596pk"
Sep 15 11:26:15.709626 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.709498    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk7kj\" (UniqueName: \"kubernetes.io/projected/330bb348-367a-4018-86d1-143ca8a3a4aa-kube-api-access-qk7kj\") pod \"cluster-proxy-proxy-agent-856657c8f-fnxpf\" (UID: \"330bb348-367a-4018-86d1-143ca8a3a4aa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856657c8f-fnxpf"
Sep 15 11:26:15.709626 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.709518    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e3fd00a-fbc1-4297-90de-8e45975e3648-tmp-dir\") pod \"dns-default-545ff\" (UID: \"9e3fd00a-fbc1-4297-90de-8e45975e3648\") " pod="openshift-dns/dns-default-545ff"
Sep 15 11:26:15.709626 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.709564    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf-trusted-ca\") pod \"image-registry-64d479d79d-ztcsf\" (UID: \"050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf\") " pod="openshift-image-registry/image-registry-64d479d79d-ztcsf"
Sep 15 11:26:15.709626 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.709597    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf-bound-sa-token\") pod \"image-registry-64d479d79d-ztcsf\" (UID: \"050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf\") " pod="openshift-image-registry/image-registry-64d479d79d-ztcsf"
Sep 15 11:26:15.709781 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.709647    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/330bb348-367a-4018-86d1-143ca8a3a4aa-ca\") pod \"cluster-proxy-proxy-agent-856657c8f-fnxpf\" (UID: \"330bb348-367a-4018-86d1-143ca8a3a4aa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856657c8f-fnxpf"
Sep 15 11:26:15.709781 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.709671    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/330bb348-367a-4018-86d1-143ca8a3a4aa-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-856657c8f-fnxpf\" (UID: \"330bb348-367a-4018-86d1-143ca8a3a4aa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856657c8f-fnxpf"
Sep 15 11:26:15.709781 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.709693    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/330bb348-367a-4018-86d1-143ca8a3a4aa-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-856657c8f-fnxpf\" (UID: \"330bb348-367a-4018-86d1-143ca8a3a4aa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856657c8f-fnxpf"
Sep 15 11:26:15.709781 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.709717    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53fdfc58-492d-48b4-bd3c-c129fe352e1c-tmp\") pod \"klusterlet-addon-workmgr-588fc65958-mfd5d\" (UID: \"53fdfc58-492d-48b4-bd3c-c129fe352e1c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588fc65958-mfd5d"
Sep 15 11:26:15.709781 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.709741    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tx6g\" (UniqueName: \"kubernetes.io/projected/53fdfc58-492d-48b4-bd3c-c129fe352e1c-kube-api-access-2tx6g\") pod \"klusterlet-addon-workmgr-588fc65958-mfd5d\" (UID: \"53fdfc58-492d-48b4-bd3c-c129fe352e1c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588fc65958-mfd5d"
Sep 15 11:26:15.709997 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.709812    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/76a3e53b-84f0-4737-96f6-94d90381a83a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-mc9fm\" (UID: \"76a3e53b-84f0-4737-96f6-94d90381a83a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-mc9fm"
Sep 15 11:26:15.709997 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.709843    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/330bb348-367a-4018-86d1-143ca8a3a4aa-additional-service-ca\") pod \"cluster-proxy-proxy-agent-856657c8f-fnxpf\" (UID: \"330bb348-367a-4018-86d1-143ca8a3a4aa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856657c8f-fnxpf"
Sep 15 11:26:15.709997 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.709870    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf-installation-pull-secrets\") pod \"image-registry-64d479d79d-ztcsf\" (UID: \"050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf\") " pod="openshift-image-registry/image-registry-64d479d79d-ztcsf"
Sep 15 11:26:15.709997 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.709897    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4729\" (UniqueName: \"kubernetes.io/projected/9e3fd00a-fbc1-4297-90de-8e45975e3648-kube-api-access-f4729\") pod \"dns-default-545ff\" (UID: \"9e3fd00a-fbc1-4297-90de-8e45975e3648\") " pod="openshift-dns/dns-default-545ff"
Sep 15 11:26:15.709997 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.709920    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mj6v\" (UniqueName: \"kubernetes.io/projected/050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf-kube-api-access-6mj6v\") pod \"image-registry-64d479d79d-ztcsf\" (UID: \"050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf\") " pod="openshift-image-registry/image-registry-64d479d79d-ztcsf"
Sep 15 11:26:15.709997 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.709952    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9e3fd00a-fbc1-4297-90de-8e45975e3648-config-volume\") pod \"dns-default-545ff\" (UID: \"9e3fd00a-fbc1-4297-90de-8e45975e3648\") " pod="openshift-dns/dns-default-545ff"
Sep 15 11:26:15.709997 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.709975    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d055f0d-31e8-4cca-bd4b-8b856dbb3966-cert\") pod \"ingress-canary-596pk\" (UID: \"3d055f0d-31e8-4cca-bd4b-8b856dbb3966\") " pod="openshift-ingress-canary/ingress-canary-596pk"
Sep 15 11:26:15.710344 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.709998    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf-image-registry-private-configuration\") pod \"image-registry-64d479d79d-ztcsf\" (UID: \"050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf\") " pod="openshift-image-registry/image-registry-64d479d79d-ztcsf"
Sep 15 11:26:15.710344 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.710043    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/53fdfc58-492d-48b4-bd3c-c129fe352e1c-klusterlet-config\") pod \"klusterlet-addon-workmgr-588fc65958-mfd5d\" (UID: \"53fdfc58-492d-48b4-bd3c-c129fe352e1c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588fc65958-mfd5d"
Sep 15 11:26:15.710344 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.710074    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf-registry-tls\") pod \"image-registry-64d479d79d-ztcsf\" (UID: \"050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf\") " pod="openshift-image-registry/image-registry-64d479d79d-ztcsf"
Sep 15 11:26:15.710344 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.710107    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf-ca-trust-extracted\") pod \"image-registry-64d479d79d-ztcsf\" (UID: \"050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf\") " pod="openshift-image-registry/image-registry-64d479d79d-ztcsf"
Sep 15 11:26:15.710344 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.710170    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf-registry-certificates\") pod \"image-registry-64d479d79d-ztcsf\" (UID: \"050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf\") " pod="openshift-image-registry/image-registry-64d479d79d-ztcsf"
Sep 15 11:26:15.710344 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.710288    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e3fd00a-fbc1-4297-90de-8e45975e3648-metrics-tls\") pod \"dns-default-545ff\" (UID: \"9e3fd00a-fbc1-4297-90de-8e45975e3648\") " pod="openshift-dns/dns-default-545ff"
Sep 15 11:26:15.710344 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.710309    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53fdfc58-492d-48b4-bd3c-c129fe352e1c-tmp\") pod \"klusterlet-addon-workmgr-588fc65958-mfd5d\" (UID: \"53fdfc58-492d-48b4-bd3c-c129fe352e1c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588fc65958-mfd5d"
Sep 15 11:26:15.710856 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.710794    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/330bb348-367a-4018-86d1-143ca8a3a4aa-additional-service-ca\") pod \"cluster-proxy-proxy-agent-856657c8f-fnxpf\" (UID: \"330bb348-367a-4018-86d1-143ca8a3a4aa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856657c8f-fnxpf"
Sep 15 11:26:15.713876 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.713854    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/330bb348-367a-4018-86d1-143ca8a3a4aa-ca\") pod \"cluster-proxy-proxy-agent-856657c8f-fnxpf\" (UID: \"330bb348-367a-4018-86d1-143ca8a3a4aa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856657c8f-fnxpf"
Sep 15 11:26:15.714017 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.713990    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/330bb348-367a-4018-86d1-143ca8a3a4aa-hub\") pod \"cluster-proxy-proxy-agent-856657c8f-fnxpf\" (UID: \"330bb348-367a-4018-86d1-143ca8a3a4aa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856657c8f-fnxpf"
Sep 15 11:26:15.714065 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.714054    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/330bb348-367a-4018-86d1-143ca8a3a4aa-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-856657c8f-fnxpf\" (UID: \"330bb348-367a-4018-86d1-143ca8a3a4aa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856657c8f-fnxpf"
Sep 15 11:26:15.714100 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.714055    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/330bb348-367a-4018-86d1-143ca8a3a4aa-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-856657c8f-fnxpf\" (UID: \"330bb348-367a-4018-86d1-143ca8a3a4aa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856657c8f-fnxpf"
Sep 15 11:26:15.714132 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.714125    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/53fdfc58-492d-48b4-bd3c-c129fe352e1c-klusterlet-config\") pod \"klusterlet-addon-workmgr-588fc65958-mfd5d\" (UID: \"53fdfc58-492d-48b4-bd3c-c129fe352e1c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588fc65958-mfd5d"
Sep 15 11:26:15.719721 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.719703    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tx6g\" (UniqueName: \"kubernetes.io/projected/53fdfc58-492d-48b4-bd3c-c129fe352e1c-kube-api-access-2tx6g\") pod \"klusterlet-addon-workmgr-588fc65958-mfd5d\" (UID: \"53fdfc58-492d-48b4-bd3c-c129fe352e1c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588fc65958-mfd5d"
Sep 15 11:26:15.719819 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.719769    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk7kj\" (UniqueName: \"kubernetes.io/projected/330bb348-367a-4018-86d1-143ca8a3a4aa-kube-api-access-qk7kj\") pod \"cluster-proxy-proxy-agent-856657c8f-fnxpf\" (UID: \"330bb348-367a-4018-86d1-143ca8a3a4aa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856657c8f-fnxpf"
Sep 15 11:26:15.810967 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.810871    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/76a3e53b-84f0-4737-96f6-94d90381a83a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-mc9fm\" (UID: \"76a3e53b-84f0-4737-96f6-94d90381a83a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-mc9fm"
Sep 15 11:26:15.810967 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.810927    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d055f0d-31e8-4cca-bd4b-8b856dbb3966-cert\") pod \"ingress-canary-596pk\" (UID: \"3d055f0d-31e8-4cca-bd4b-8b856dbb3966\") " pod="openshift-ingress-canary/ingress-canary-596pk"
Sep 15 11:26:15.810967 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.810957    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zwbz\" (UniqueName: \"kubernetes.io/projected/76f2f3eb-5c06-4648-a30d-80cc7356d880-kube-api-access-4zwbz\") pod \"insights-runtime-extractor-vmxh2\" (UID: \"76f2f3eb-5c06-4648-a30d-80cc7356d880\") " pod="openshift-insights/insights-runtime-extractor-vmxh2"
Sep 15 11:26:15.811274 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.810976    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4729\" (UniqueName: \"kubernetes.io/projected/9e3fd00a-fbc1-4297-90de-8e45975e3648-kube-api-access-f4729\") pod \"dns-default-545ff\" (UID: \"9e3fd00a-fbc1-4297-90de-8e45975e3648\") " pod="openshift-dns/dns-default-545ff"
Sep 15 11:26:15.811274 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.810999    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf-installation-pull-secrets\") pod \"image-registry-64d479d79d-ztcsf\" (UID: \"050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf\") " pod="openshift-image-registry/image-registry-64d479d79d-ztcsf"
Sep 15 11:26:15.811274 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.811021    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76f2f3eb-5c06-4648-a30d-80cc7356d880-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vmxh2\" (UID: \"76f2f3eb-5c06-4648-a30d-80cc7356d880\") " pod="openshift-insights/insights-runtime-extractor-vmxh2"
Sep 15 11:26:15.811274 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.811038    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mj6v\" (UniqueName: \"kubernetes.io/projected/050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf-kube-api-access-6mj6v\") pod \"image-registry-64d479d79d-ztcsf\" (UID: \"050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf\") " pod="openshift-image-registry/image-registry-64d479d79d-ztcsf"
Sep 15 11:26:15.811274 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.811087    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf-image-registry-private-configuration\") pod \"image-registry-64d479d79d-ztcsf\" (UID: \"050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf\") " pod="openshift-image-registry/image-registry-64d479d79d-ztcsf"
Sep 15 11:26:15.811274 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.811127    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf-registry-tls\") pod \"image-registry-64d479d79d-ztcsf\" (UID: \"050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf\") " pod="openshift-image-registry/image-registry-64d479d79d-ztcsf"
Sep 15 11:26:15.811274 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.811229    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e3fd00a-fbc1-4297-90de-8e45975e3648-metrics-tls\") pod \"dns-default-545ff\" (UID: \"9e3fd00a-fbc1-4297-90de-8e45975e3648\") " pod="openshift-dns/dns-default-545ff"
Sep 15 11:26:15.811274 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.811268    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqbc7\" (UniqueName: \"kubernetes.io/projected/3d055f0d-31e8-4cca-bd4b-8b856dbb3966-kube-api-access-rqbc7\") pod \"ingress-canary-596pk\" (UID: \"3d055f0d-31e8-4cca-bd4b-8b856dbb3966\") " pod="openshift-ingress-canary/ingress-canary-596pk"
Sep 15 11:26:15.811662 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.811296    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/76f2f3eb-5c06-4648-a30d-80cc7356d880-data-volume\") pod \"insights-runtime-extractor-vmxh2\" (UID: \"76f2f3eb-5c06-4648-a30d-80cc7356d880\") " pod="openshift-insights/insights-runtime-extractor-vmxh2"
Sep 15 11:26:15.811662 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.811319    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76f2f3eb-5c06-4648-a30d-80cc7356d880-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vmxh2\" (UID: \"76f2f3eb-5c06-4648-a30d-80cc7356d880\") " pod="openshift-insights/insights-runtime-extractor-vmxh2"
Sep 15 11:26:15.811662 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.811354    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e3fd00a-fbc1-4297-90de-8e45975e3648-tmp-dir\") pod \"dns-default-545ff\" (UID: \"9e3fd00a-fbc1-4297-90de-8e45975e3648\") " pod="openshift-dns/dns-default-545ff"
Sep 15 11:26:15.811662 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.811377    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf-trusted-ca\") pod \"image-registry-64d479d79d-ztcsf\" (UID: \"050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf\") " pod="openshift-image-registry/image-registry-64d479d79d-ztcsf"
Sep 15 11:26:15.811662 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.811403    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf-bound-sa-token\") pod \"image-registry-64d479d79d-ztcsf\" (UID: \"050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf\") " pod="openshift-image-registry/image-registry-64d479d79d-ztcsf"
Sep 15 11:26:15.811662 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.811441    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9e3fd00a-fbc1-4297-90de-8e45975e3648-config-volume\") pod \"dns-default-545ff\" (UID: \"9e3fd00a-fbc1-4297-90de-8e45975e3648\") " pod="openshift-dns/dns-default-545ff"
Sep 15 11:26:15.811662 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.811502    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/76f2f3eb-5c06-4648-a30d-80cc7356d880-crio-socket\") pod \"insights-runtime-extractor-vmxh2\" (UID: \"76f2f3eb-5c06-4648-a30d-80cc7356d880\") " pod="openshift-insights/insights-runtime-extractor-vmxh2"
Sep 15 11:26:15.811662 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.811530    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf-ca-trust-extracted\") pod \"image-registry-64d479d79d-ztcsf\" (UID: \"050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf\") " pod="openshift-image-registry/image-registry-64d479d79d-ztcsf"
Sep 15 11:26:15.811662 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.811565    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf-registry-certificates\") pod \"image-registry-64d479d79d-ztcsf\" (UID: \"050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf\") " pod="openshift-image-registry/image-registry-64d479d79d-ztcsf"
Sep 15 11:26:15.812101 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.811771    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e3fd00a-fbc1-4297-90de-8e45975e3648-tmp-dir\") pod \"dns-default-545ff\" (UID: \"9e3fd00a-fbc1-4297-90de-8e45975e3648\") " pod="openshift-dns/dns-default-545ff"
Sep 15 11:26:15.812642 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.812612    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf-registry-certificates\") pod \"image-registry-64d479d79d-ztcsf\" (UID: \"050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf\") " pod="openshift-image-registry/image-registry-64d479d79d-ztcsf"
Sep 15 11:26:15.813076 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.813047    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf-trusted-ca\") pod \"image-registry-64d479d79d-ztcsf\" (UID: \"050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf\") " pod="openshift-image-registry/image-registry-64d479d79d-ztcsf"
Sep 15 11:26:15.813908 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.813861    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf-ca-trust-extracted\") pod \"image-registry-64d479d79d-ztcsf\" (UID: \"050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf\") " pod="openshift-image-registry/image-registry-64d479d79d-ztcsf"
Sep 15 11:26:15.814260 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.814232    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf-registry-tls\") pod \"image-registry-64d479d79d-ztcsf\" (UID: \"050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf\") " pod="openshift-image-registry/image-registry-64d479d79d-ztcsf"
Sep 15 11:26:15.814417 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.814393    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9e3fd00a-fbc1-4297-90de-8e45975e3648-config-volume\") pod \"dns-default-545ff\" (UID: \"9e3fd00a-fbc1-4297-90de-8e45975e3648\") " pod="openshift-dns/dns-default-545ff"
Sep 15 11:26:15.814480 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.814459    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf-image-registry-private-configuration\") pod \"image-registry-64d479d79d-ztcsf\" (UID: \"050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf\") " pod="openshift-image-registry/image-registry-64d479d79d-ztcsf"
Sep 15 11:26:15.814667 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.814643    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf-installation-pull-secrets\") pod \"image-registry-64d479d79d-ztcsf\" (UID: \"050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf\") " pod="openshift-image-registry/image-registry-64d479d79d-ztcsf"
Sep 15 11:26:15.814667 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.814666    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/76a3e53b-84f0-4737-96f6-94d90381a83a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-mc9fm\" (UID: \"76a3e53b-84f0-4737-96f6-94d90381a83a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-mc9fm"
Sep 15 11:26:15.814828 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.814805    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e3fd00a-fbc1-4297-90de-8e45975e3648-metrics-tls\") pod \"dns-default-545ff\" (UID: \"9e3fd00a-fbc1-4297-90de-8e45975e3648\") " pod="openshift-dns/dns-default-545ff"
Sep 15 11:26:15.815030 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.815007    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d055f0d-31e8-4cca-bd4b-8b856dbb3966-cert\") pod \"ingress-canary-596pk\" (UID: \"3d055f0d-31e8-4cca-bd4b-8b856dbb3966\") " pod="openshift-ingress-canary/ingress-canary-596pk"
Sep 15 11:26:15.816851 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.816834    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856657c8f-fnxpf"
Sep 15 11:26:15.820725 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.820624    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588fc65958-mfd5d"
Sep 15 11:26:15.821393 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.821367    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4729\" (UniqueName: \"kubernetes.io/projected/9e3fd00a-fbc1-4297-90de-8e45975e3648-kube-api-access-f4729\") pod \"dns-default-545ff\" (UID: \"9e3fd00a-fbc1-4297-90de-8e45975e3648\") " pod="openshift-dns/dns-default-545ff"
Sep 15 11:26:15.822321 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.822296    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqbc7\" (UniqueName: \"kubernetes.io/projected/3d055f0d-31e8-4cca-bd4b-8b856dbb3966-kube-api-access-rqbc7\") pod \"ingress-canary-596pk\" (UID: \"3d055f0d-31e8-4cca-bd4b-8b856dbb3966\") " pod="openshift-ingress-canary/ingress-canary-596pk"
Sep 15 11:26:15.823336 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.823311    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf-bound-sa-token\") pod \"image-registry-64d479d79d-ztcsf\" (UID: \"050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf\") " pod="openshift-image-registry/image-registry-64d479d79d-ztcsf"
Sep 15 11:26:15.823419 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.823350    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mj6v\" (UniqueName: \"kubernetes.io/projected/050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf-kube-api-access-6mj6v\") pod \"image-registry-64d479d79d-ztcsf\" (UID: \"050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf\") " pod="openshift-image-registry/image-registry-64d479d79d-ztcsf"
Sep 15 11:26:15.883808 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.883489    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-mc9fm"
Sep 15 11:26:15.894072 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.894000    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-596pk"
Sep 15 11:26:15.900874 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.900846    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-545ff"
Sep 15 11:26:15.906116 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.906092    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64d479d79d-ztcsf"
Sep 15 11:26:15.912414 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.912387    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76f2f3eb-5c06-4648-a30d-80cc7356d880-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vmxh2\" (UID: \"76f2f3eb-5c06-4648-a30d-80cc7356d880\") " pod="openshift-insights/insights-runtime-extractor-vmxh2"
Sep 15 11:26:15.912474 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.912451    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/76f2f3eb-5c06-4648-a30d-80cc7356d880-data-volume\") pod \"insights-runtime-extractor-vmxh2\" (UID: \"76f2f3eb-5c06-4648-a30d-80cc7356d880\") " pod="openshift-insights/insights-runtime-extractor-vmxh2"
Sep 15 11:26:15.912514 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.912480    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76f2f3eb-5c06-4648-a30d-80cc7356d880-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vmxh2\" (UID: \"76f2f3eb-5c06-4648-a30d-80cc7356d880\") " pod="openshift-insights/insights-runtime-extractor-vmxh2"
Sep 15 11:26:15.912699 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.912675    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/76f2f3eb-5c06-4648-a30d-80cc7356d880-crio-socket\") pod \"insights-runtime-extractor-vmxh2\" (UID: \"76f2f3eb-5c06-4648-a30d-80cc7356d880\") " pod="openshift-insights/insights-runtime-extractor-vmxh2"
Sep 15 11:26:15.912793 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.912770    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zwbz\" (UniqueName: \"kubernetes.io/projected/76f2f3eb-5c06-4648-a30d-80cc7356d880-kube-api-access-4zwbz\") pod \"insights-runtime-extractor-vmxh2\" (UID: \"76f2f3eb-5c06-4648-a30d-80cc7356d880\") " pod="openshift-insights/insights-runtime-extractor-vmxh2"
Sep 15 11:26:15.912971 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.912825    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/76f2f3eb-5c06-4648-a30d-80cc7356d880-data-volume\") pod \"insights-runtime-extractor-vmxh2\" (UID: \"76f2f3eb-5c06-4648-a30d-80cc7356d880\") " pod="openshift-insights/insights-runtime-extractor-vmxh2"
Sep 15 11:26:15.912971 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.912896    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/76f2f3eb-5c06-4648-a30d-80cc7356d880-crio-socket\") pod \"insights-runtime-extractor-vmxh2\" (UID: \"76f2f3eb-5c06-4648-a30d-80cc7356d880\") " pod="openshift-insights/insights-runtime-extractor-vmxh2"
Sep 15 11:26:15.913113 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.912982    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76f2f3eb-5c06-4648-a30d-80cc7356d880-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vmxh2\" (UID: \"76f2f3eb-5c06-4648-a30d-80cc7356d880\") " pod="openshift-insights/insights-runtime-extractor-vmxh2"
Sep 15 11:26:15.917522 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.917416    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76f2f3eb-5c06-4648-a30d-80cc7356d880-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vmxh2\" (UID: \"76f2f3eb-5c06-4648-a30d-80cc7356d880\") " pod="openshift-insights/insights-runtime-extractor-vmxh2"
Sep 15 11:26:15.928003 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.927975    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zwbz\" (UniqueName: \"kubernetes.io/projected/76f2f3eb-5c06-4648-a30d-80cc7356d880-kube-api-access-4zwbz\") pod \"insights-runtime-extractor-vmxh2\" (UID: \"76f2f3eb-5c06-4648-a30d-80cc7356d880\") " pod="openshift-insights/insights-runtime-extractor-vmxh2"
Sep 15 11:26:15.982570 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:15.982498    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vmxh2"
Sep 15 11:26:16.103556 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:16.103470    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-588fc65958-mfd5d"]
Sep 15 11:26:16.106125 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:16.106099    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856657c8f-fnxpf"]
Sep 15 11:26:16.107775 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:26:16.107751    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53fdfc58_492d_48b4_bd3c_c129fe352e1c.slice/crio-4903e3569ac7d27cd112d317b499b8ee2bb923a74e049b740b3d5c4f3220e043 WatchSource:0}: Error finding container 4903e3569ac7d27cd112d317b499b8ee2bb923a74e049b740b3d5c4f3220e043: Status 404 returned error can't find the container with id 4903e3569ac7d27cd112d317b499b8ee2bb923a74e049b740b3d5c4f3220e043
Sep 15 11:26:16.109235 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:26:16.109213    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod330bb348_367a_4018_86d1_143ca8a3a4aa.slice/crio-0b53658e3db38fb62997ef03a3dd39e96773453f2eda04164c1d2222a6859849 WatchSource:0}: Error finding container 0b53658e3db38fb62997ef03a3dd39e96773453f2eda04164c1d2222a6859849: Status 404 returned error can't find the container with id 0b53658e3db38fb62997ef03a3dd39e96773453f2eda04164c1d2222a6859849
Sep 15 11:26:16.169793 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:16.169758    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-mc9fm"]
Sep 15 11:26:16.174233 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:26:16.174204    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76a3e53b_84f0_4737_96f6_94d90381a83a.slice/crio-adc41e4f67cb2342be5f79ef25ceaf933f6aa773f0b0323fd24a36478d3775b4 WatchSource:0}: Error finding container adc41e4f67cb2342be5f79ef25ceaf933f6aa773f0b0323fd24a36478d3775b4: Status 404 returned error can't find the container with id adc41e4f67cb2342be5f79ef25ceaf933f6aa773f0b0323fd24a36478d3775b4
Sep 15 11:26:16.197070 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:16.197040    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-545ff"]
Sep 15 11:26:16.200311 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:16.200244    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64d479d79d-ztcsf"]
Sep 15 11:26:16.203995 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:26:16.203947    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod050bb0ba_ec3c_4a7a_ad4d_2cd96497a9cf.slice/crio-30c2ede20969169a7559137ba457f84b966885538f3a638798d96ace7d2ddca6 WatchSource:0}: Error finding container 30c2ede20969169a7559137ba457f84b966885538f3a638798d96ace7d2ddca6: Status 404 returned error can't find the container with id 30c2ede20969169a7559137ba457f84b966885538f3a638798d96ace7d2ddca6
Sep 15 11:26:16.213948 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:16.213820    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-596pk"]
Sep 15 11:26:16.217251 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:26:16.217228    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d055f0d_31e8_4cca_bd4b_8b856dbb3966.slice/crio-a713614ff4543f7d0ae0a28ad95cb5cd71ebd3330b2e50d2154caed33f315b41 WatchSource:0}: Error finding container a713614ff4543f7d0ae0a28ad95cb5cd71ebd3330b2e50d2154caed33f315b41: Status 404 returned error can't find the container with id a713614ff4543f7d0ae0a28ad95cb5cd71ebd3330b2e50d2154caed33f315b41
Sep 15 11:26:16.261156 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:16.261128    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vmxh2"]
Sep 15 11:26:16.265394 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:26:16.265365    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76f2f3eb_5c06_4648_a30d_80cc7356d880.slice/crio-8b185ad622e1353c6dedc9cd12d8a98781fdcfe9fd84c325601ecd142d7e84bd WatchSource:0}: Error finding container 8b185ad622e1353c6dedc9cd12d8a98781fdcfe9fd84c325601ecd142d7e84bd: Status 404 returned error can't find the container with id 8b185ad622e1353c6dedc9cd12d8a98781fdcfe9fd84c325601ecd142d7e84bd
Sep 15 11:26:16.366407 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:16.366322    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588fc65958-mfd5d" event={"ID":"53fdfc58-492d-48b4-bd3c-c129fe352e1c","Type":"ContainerStarted","Data":"4903e3569ac7d27cd112d317b499b8ee2bb923a74e049b740b3d5c4f3220e043"}
Sep 15 11:26:16.368009 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:16.367968    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64d479d79d-ztcsf" event={"ID":"050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf","Type":"ContainerStarted","Data":"fcfaab3deb07ee12f3e28a81028beb5a1953ee2d4f2707f9c09f37e29c507bf9"}
Sep 15 11:26:16.368158 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:16.368032    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64d479d79d-ztcsf" event={"ID":"050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf","Type":"ContainerStarted","Data":"30c2ede20969169a7559137ba457f84b966885538f3a638798d96ace7d2ddca6"}
Sep 15 11:26:16.368158 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:16.368059    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-64d479d79d-ztcsf"
Sep 15 11:26:16.369484 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:16.369452    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vmxh2" event={"ID":"76f2f3eb-5c06-4648-a30d-80cc7356d880","Type":"ContainerStarted","Data":"78bf2ae75703da1057d69fdae6b62829b67d2b272054163a69019632c688a38d"}
Sep 15 11:26:16.369609 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:16.369499    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vmxh2" event={"ID":"76f2f3eb-5c06-4648-a30d-80cc7356d880","Type":"ContainerStarted","Data":"8b185ad622e1353c6dedc9cd12d8a98781fdcfe9fd84c325601ecd142d7e84bd"}
Sep 15 11:26:16.370747 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:16.370724    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-545ff" event={"ID":"9e3fd00a-fbc1-4297-90de-8e45975e3648","Type":"ContainerStarted","Data":"ec114af75c9b8f2fa38718aa4f7e9313e360bc738d37cefbb1418d54e8dd08bf"}
Sep 15 11:26:16.371833 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:16.371808    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-596pk" event={"ID":"3d055f0d-31e8-4cca-bd4b-8b856dbb3966","Type":"ContainerStarted","Data":"a713614ff4543f7d0ae0a28ad95cb5cd71ebd3330b2e50d2154caed33f315b41"}
Sep 15 11:26:16.372961 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:16.372941    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-mc9fm" event={"ID":"76a3e53b-84f0-4737-96f6-94d90381a83a","Type":"ContainerStarted","Data":"adc41e4f67cb2342be5f79ef25ceaf933f6aa773f0b0323fd24a36478d3775b4"}
Sep 15 11:26:16.374096 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:16.374079    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856657c8f-fnxpf" event={"ID":"330bb348-367a-4018-86d1-143ca8a3a4aa","Type":"ContainerStarted","Data":"0b53658e3db38fb62997ef03a3dd39e96773453f2eda04164c1d2222a6859849"}
Sep 15 11:26:16.386014 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:16.385958    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-64d479d79d-ztcsf" podStartSLOduration=1.38594463 podStartE2EDuration="1.38594463s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:26:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:16.385257444 +0000 UTC m=+55.847123498" watchObservedRunningTime="2026-09-15 11:26:16.38594463 +0000 UTC m=+55.847810677"
Sep 15 11:26:17.380699 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:17.380621    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vmxh2" event={"ID":"76f2f3eb-5c06-4648-a30d-80cc7356d880","Type":"ContainerStarted","Data":"9e85b718dbcc235654e0e8cefacdc0603140ee64e700f986e470f89c8adf22d3"}
Sep 15 11:26:20.391442 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:20.391406    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-545ff" event={"ID":"9e3fd00a-fbc1-4297-90de-8e45975e3648","Type":"ContainerStarted","Data":"30107f39cb4ffd2b007317553ee7d49b3f6acba2da95a82a02afc54fc2ec2986"}
Sep 15 11:26:21.310973 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:21.310883    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lspr9"
Sep 15 11:26:22.399433 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:22.399405    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vmxh2" event={"ID":"76f2f3eb-5c06-4648-a30d-80cc7356d880","Type":"ContainerStarted","Data":"91a0161920c2a4fced420f904bb2b9f3cbad7ebc02f2588a078a478a4d4ac65a"}
Sep 15 11:26:22.401339 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:22.401306    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-545ff" event={"ID":"9e3fd00a-fbc1-4297-90de-8e45975e3648","Type":"ContainerStarted","Data":"71dbe34fdc8e52979cd327a70c3a0f61bb0ce7c90841f0c6e105e36af1c8c1cb"}
Sep 15 11:26:22.401475 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:22.401434    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-545ff"
Sep 15 11:26:22.402829 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:22.402803    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-596pk" event={"ID":"3d055f0d-31e8-4cca-bd4b-8b856dbb3966","Type":"ContainerStarted","Data":"38459c154917eb5fa6760a65f4330f1003557953d851859ca801d49659c933e0"}
Sep 15 11:26:22.404350 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:22.404320    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-mc9fm" event={"ID":"76a3e53b-84f0-4737-96f6-94d90381a83a","Type":"ContainerStarted","Data":"b4a9bfd27717b6d9d9ea1df616a7a53b193cd56d828d5c5a5b8b63c6641af178"}
Sep 15 11:26:22.404484 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:22.404469    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-mc9fm"
Sep 15 11:26:22.406595 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:22.406576    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856657c8f-fnxpf" event={"ID":"330bb348-367a-4018-86d1-143ca8a3a4aa","Type":"ContainerStarted","Data":"590fafb4ecf77369589b1a3a13cc88f0d40f84930d10b487eb62e5d0fe9e8956"}
Sep 15 11:26:22.406703 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:22.406603    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856657c8f-fnxpf" event={"ID":"330bb348-367a-4018-86d1-143ca8a3a4aa","Type":"ContainerStarted","Data":"463ec44f30a9378c0e582ea69ec60d135b087494ca7b99b094f87d042f801b7d"}
Sep 15 11:26:22.406703 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:22.406620    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856657c8f-fnxpf" event={"ID":"330bb348-367a-4018-86d1-143ca8a3a4aa","Type":"ContainerStarted","Data":"542385ca06c495f02e5f8ff4a0d8dcea4f66fbbb2640e730a9b5818f068d6929"}
Sep 15 11:26:22.409221 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:22.409208    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-mc9fm"
Sep 15 11:26:22.417502 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:22.417443    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vmxh2" podStartSLOduration=1.877921 podStartE2EDuration="7.417425424s" totalImagesPullingTime="5.539504424s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:26:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:22.416318966 +0000 UTC m=+61.878185014" watchObservedRunningTime="2026-09-15 11:26:22.417425424 +0000 UTC m=+61.879291483"
Sep 15 11:26:22.433317 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:22.433270    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856657c8f-fnxpf" podStartSLOduration=1.6038886890000001 podStartE2EDuration="7.433253374s" totalImagesPullingTime="5.829364685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:26:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:22.432276114 +0000 UTC m=+61.894142168" watchObservedRunningTime="2026-09-15 11:26:22.433253374 +0000 UTC m=+61.895119427"
Sep 15 11:26:22.446090 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:22.446047    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-mc9fm" podStartSLOduration=1.6759655169999998 podStartE2EDuration="7.44603184s" totalImagesPullingTime="5.770066323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:26:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:22.44535988 +0000 UTC m=+61.907225933" watchObservedRunningTime="2026-09-15 11:26:22.44603184 +0000 UTC m=+61.907897893"
Sep 15 11:26:22.460842 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:22.460797    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-596pk" podStartSLOduration=1.729447798 podStartE2EDuration="7.460781204s" totalImagesPullingTime="5.731333406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:26:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:22.460388538 +0000 UTC m=+61.922254604" watchObservedRunningTime="2026-09-15 11:26:22.460781204 +0000 UTC m=+61.922647302"
Sep 15 11:26:22.480949 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:22.480902    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-545ff" podStartSLOduration=3.483818158 podStartE2EDuration="7.480885698s" totalImagesPullingTime="3.99706754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:26:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:22.480660689 +0000 UTC m=+61.942526743" watchObservedRunningTime="2026-09-15 11:26:22.480885698 +0000 UTC m=+61.942751750"
Sep 15 11:26:26.702160 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:26.702126    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/485ecbb4-5f72-4e62-bce1-0d97de480e0b-metrics-certs\") pod \"network-metrics-daemon-dzzfd\" (UID: \"485ecbb4-5f72-4e62-bce1-0d97de480e0b\") " pod="openshift-multus/network-metrics-daemon-dzzfd"
Sep 15 11:26:26.702582 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:26.702168    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/270f712b-6161-4b60-8f89-0b2bcad6f27c-original-pull-secret\") pod \"global-pull-secret-syncer-dm5z4\" (UID: \"270f712b-6161-4b60-8f89-0b2bcad6f27c\") " pod="kube-system/global-pull-secret-syncer-dm5z4"
Sep 15 11:26:26.704441 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:26.704416    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 11:26:26.704899 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:26.704883    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 11:26:26.714893 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:26.714860    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/485ecbb4-5f72-4e62-bce1-0d97de480e0b-metrics-certs\") pod \"network-metrics-daemon-dzzfd\" (UID: \"485ecbb4-5f72-4e62-bce1-0d97de480e0b\") " pod="openshift-multus/network-metrics-daemon-dzzfd"
Sep 15 11:26:26.714996 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:26.714943    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/270f712b-6161-4b60-8f89-0b2bcad6f27c-original-pull-secret\") pod \"global-pull-secret-syncer-dm5z4\" (UID: \"270f712b-6161-4b60-8f89-0b2bcad6f27c\") " pod="kube-system/global-pull-secret-syncer-dm5z4"
Sep 15 11:26:26.755159 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:26.755116    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm5z4"
Sep 15 11:26:26.761285 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:26.761262    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mvt2n\""
Sep 15 11:26:26.769400 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:26.769236    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzzfd"
Sep 15 11:26:26.803256 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:26.803113    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8k92\" (UniqueName: \"kubernetes.io/projected/e1eb4055-797f-4589-8f60-a46f631ad4e9-kube-api-access-n8k92\") pod \"network-check-target-bk6zq\" (UID: \"e1eb4055-797f-4589-8f60-a46f631ad4e9\") " pod="openshift-network-diagnostics/network-check-target-bk6zq"
Sep 15 11:26:26.805488 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:26.805461    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 15 11:26:26.816141 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:26.815926    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 15 11:26:26.828663 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:26.828604    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8k92\" (UniqueName: \"kubernetes.io/projected/e1eb4055-797f-4589-8f60-a46f631ad4e9-kube-api-access-n8k92\") pod \"network-check-target-bk6zq\" (UID: \"e1eb4055-797f-4589-8f60-a46f631ad4e9\") " pod="openshift-network-diagnostics/network-check-target-bk6zq"
Sep 15 11:26:27.022427 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:27.022354    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dm5z4"]
Sep 15 11:26:27.026776 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:26:27.026746    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod270f712b_6161_4b60_8f89_0b2bcad6f27c.slice/crio-9694352633f4cee60e16ebe60de950f6f17b67218852fb60d53c44ca1a2a5fbc WatchSource:0}: Error finding container 9694352633f4cee60e16ebe60de950f6f17b67218852fb60d53c44ca1a2a5fbc: Status 404 returned error can't find the container with id 9694352633f4cee60e16ebe60de950f6f17b67218852fb60d53c44ca1a2a5fbc
Sep 15 11:26:27.049025 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:27.048962    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dzzfd"]
Sep 15 11:26:27.050799 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:27.050777    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-q47md\""
Sep 15 11:26:27.051340 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:26:27.051319    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod485ecbb4_5f72_4e62_bce1_0d97de480e0b.slice/crio-3f3f6aad37fab5a81c6c8ea3fca63fdfbd39b7e7875ebe907aaf2b747f8d610c WatchSource:0}: Error finding container 3f3f6aad37fab5a81c6c8ea3fca63fdfbd39b7e7875ebe907aaf2b747f8d610c: Status 404 returned error can't find the container with id 3f3f6aad37fab5a81c6c8ea3fca63fdfbd39b7e7875ebe907aaf2b747f8d610c
Sep 15 11:26:27.059250 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:27.059230    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bk6zq"
Sep 15 11:26:27.332845 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:27.332771    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bk6zq"]
Sep 15 11:26:27.337860 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:26:27.337823    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1eb4055_797f_4589_8f60_a46f631ad4e9.slice/crio-95cb2756b71f4df630e1f63556410c425789170fa8f4aea6175079f4f5043645 WatchSource:0}: Error finding container 95cb2756b71f4df630e1f63556410c425789170fa8f4aea6175079f4f5043645: Status 404 returned error can't find the container with id 95cb2756b71f4df630e1f63556410c425789170fa8f4aea6175079f4f5043645
Sep 15 11:26:27.424131 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:27.424100    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dm5z4" event={"ID":"270f712b-6161-4b60-8f89-0b2bcad6f27c","Type":"ContainerStarted","Data":"9694352633f4cee60e16ebe60de950f6f17b67218852fb60d53c44ca1a2a5fbc"}
Sep 15 11:26:27.425314 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:27.425288    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bk6zq" event={"ID":"e1eb4055-797f-4589-8f60-a46f631ad4e9","Type":"ContainerStarted","Data":"95cb2756b71f4df630e1f63556410c425789170fa8f4aea6175079f4f5043645"}
Sep 15 11:26:27.426400 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:27.426381    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dzzfd" event={"ID":"485ecbb4-5f72-4e62-bce1-0d97de480e0b","Type":"ContainerStarted","Data":"3f3f6aad37fab5a81c6c8ea3fca63fdfbd39b7e7875ebe907aaf2b747f8d610c"}
Sep 15 11:26:28.255097 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:28.255062    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-g4nq7"]
Sep 15 11:26:28.279698 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:28.279669    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g4nq7"
Sep 15 11:26:28.282326 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:28.282299    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 15 11:26:28.282464 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:28.282328    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 15 11:26:28.282464 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:28.282389    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 15 11:26:28.282678 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:28.282652    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 15 11:26:28.283250 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:28.283232    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hsgvp\""
Sep 15 11:26:28.283557 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:28.283537    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 15 11:26:28.283735 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:28.283720    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 15 11:26:28.312988 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:28.312961    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aee1ae9c-c04a-413c-821e-b2a39a29f192-root\") pod \"node-exporter-g4nq7\" (UID: \"aee1ae9c-c04a-413c-821e-b2a39a29f192\") " pod="openshift-monitoring/node-exporter-g4nq7"
Sep 15 11:26:28.313149 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:28.313002    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aee1ae9c-c04a-413c-821e-b2a39a29f192-node-exporter-accelerators-collector-config\") pod \"node-exporter-g4nq7\" (UID: \"aee1ae9c-c04a-413c-821e-b2a39a29f192\") " pod="openshift-monitoring/node-exporter-g4nq7"
Sep 15 11:26:28.313149 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:28.313025    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aee1ae9c-c04a-413c-821e-b2a39a29f192-sys\") pod \"node-exporter-g4nq7\" (UID: \"aee1ae9c-c04a-413c-821e-b2a39a29f192\") " pod="openshift-monitoring/node-exporter-g4nq7"
Sep 15 11:26:28.313149 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:28.313048    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aee1ae9c-c04a-413c-821e-b2a39a29f192-metrics-client-ca\") pod \"node-exporter-g4nq7\" (UID: \"aee1ae9c-c04a-413c-821e-b2a39a29f192\") " pod="openshift-monitoring/node-exporter-g4nq7"
Sep 15 11:26:28.313149 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:28.313070    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aee1ae9c-c04a-413c-821e-b2a39a29f192-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g4nq7\" (UID: \"aee1ae9c-c04a-413c-821e-b2a39a29f192\") " pod="openshift-monitoring/node-exporter-g4nq7"
Sep 15 11:26:28.313149 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:28.313098    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aee1ae9c-c04a-413c-821e-b2a39a29f192-node-exporter-wtmp\") pod \"node-exporter-g4nq7\" (UID: \"aee1ae9c-c04a-413c-821e-b2a39a29f192\") " pod="openshift-monitoring/node-exporter-g4nq7"
Sep 15 11:26:28.313149 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:28.313134    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aee1ae9c-c04a-413c-821e-b2a39a29f192-node-exporter-tls\") pod \"node-exporter-g4nq7\" (UID: \"aee1ae9c-c04a-413c-821e-b2a39a29f192\") " pod="openshift-monitoring/node-exporter-g4nq7"
Sep 15 11:26:28.313530 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:28.313169    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6lfg\" (UniqueName: \"kubernetes.io/projected/aee1ae9c-c04a-413c-821e-b2a39a29f192-kube-api-access-k6lfg\") pod \"node-exporter-g4nq7\" (UID: \"aee1ae9c-c04a-413c-821e-b2a39a29f192\") " pod="openshift-monitoring/node-exporter-g4nq7"
Sep 15 11:26:28.313530 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:28.313227    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aee1ae9c-c04a-413c-821e-b2a39a29f192-node-exporter-textfile\") pod \"node-exporter-g4nq7\" (UID: \"aee1ae9c-c04a-413c-821e-b2a39a29f192\") " pod="openshift-monitoring/node-exporter-g4nq7"
Sep 15 11:26:28.414505 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:28.414460    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6lfg\" (UniqueName: \"kubernetes.io/projected/aee1ae9c-c04a-413c-821e-b2a39a29f192-kube-api-access-k6lfg\") pod \"node-exporter-g4nq7\" (UID: \"aee1ae9c-c04a-413c-821e-b2a39a29f192\") " pod="openshift-monitoring/node-exporter-g4nq7"
Sep 15 11:26:28.414726 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:28.414523    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aee1ae9c-c04a-413c-821e-b2a39a29f192-node-exporter-textfile\") pod \"node-exporter-g4nq7\" (UID: \"aee1ae9c-c04a-413c-821e-b2a39a29f192\") " pod="openshift-monitoring/node-exporter-g4nq7"
Sep 15 11:26:28.414726 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:28.414566    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aee1ae9c-c04a-413c-821e-b2a39a29f192-root\") pod \"node-exporter-g4nq7\" (UID: \"aee1ae9c-c04a-413c-821e-b2a39a29f192\") " pod="openshift-monitoring/node-exporter-g4nq7"
Sep 15 11:26:28.414726 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:28.414595    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aee1ae9c-c04a-413c-821e-b2a39a29f192-node-exporter-accelerators-collector-config\") pod \"node-exporter-g4nq7\" (UID: \"aee1ae9c-c04a-413c-821e-b2a39a29f192\") " pod="openshift-monitoring/node-exporter-g4nq7"
Sep 15 11:26:28.414726 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:28.414620    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aee1ae9c-c04a-413c-821e-b2a39a29f192-sys\") pod \"node-exporter-g4nq7\" (UID: \"aee1ae9c-c04a-413c-821e-b2a39a29f192\") " pod="openshift-monitoring/node-exporter-g4nq7"
Sep 15 11:26:28.414726 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:28.414648    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aee1ae9c-c04a-413c-821e-b2a39a29f192-metrics-client-ca\") pod \"node-exporter-g4nq7\" (UID: \"aee1ae9c-c04a-413c-821e-b2a39a29f192\") " pod="openshift-monitoring/node-exporter-g4nq7"
Sep 15 11:26:28.414726 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:28.414670    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aee1ae9c-c04a-413c-821e-b2a39a29f192-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g4nq7\" (UID: \"aee1ae9c-c04a-413c-821e-b2a39a29f192\") " pod="openshift-monitoring/node-exporter-g4nq7"
Sep 15 11:26:28.414726 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:28.414687    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aee1ae9c-c04a-413c-821e-b2a39a29f192-root\") pod \"node-exporter-g4nq7\" (UID: \"aee1ae9c-c04a-413c-821e-b2a39a29f192\") " pod="openshift-monitoring/node-exporter-g4nq7"
Sep 15 11:26:28.414726 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:28.414689    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aee1ae9c-c04a-413c-821e-b2a39a29f192-node-exporter-wtmp\") pod \"node-exporter-g4nq7\" (UID: \"aee1ae9c-c04a-413c-821e-b2a39a29f192\") " pod="openshift-monitoring/node-exporter-g4nq7"
Sep 15 11:26:28.415264 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:28.414769    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aee1ae9c-c04a-413c-821e-b2a39a29f192-node-exporter-tls\") pod \"node-exporter-g4nq7\" (UID: \"aee1ae9c-c04a-413c-821e-b2a39a29f192\") " pod="openshift-monitoring/node-exporter-g4nq7"
Sep 15 11:26:28.415264 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:28.414798    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aee1ae9c-c04a-413c-821e-b2a39a29f192-sys\") pod \"node-exporter-g4nq7\" (UID: \"aee1ae9c-c04a-413c-821e-b2a39a29f192\") " pod="openshift-monitoring/node-exporter-g4nq7"
Sep 15 11:26:28.415264 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:28.414803    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aee1ae9c-c04a-413c-821e-b2a39a29f192-node-exporter-wtmp\") pod \"node-exporter-g4nq7\" (UID: \"aee1ae9c-c04a-413c-821e-b2a39a29f192\") " pod="openshift-monitoring/node-exporter-g4nq7"
Sep 15 11:26:28.415425 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:28.415409    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aee1ae9c-c04a-413c-821e-b2a39a29f192-node-exporter-textfile\") pod \"node-exporter-g4nq7\" (UID: \"aee1ae9c-c04a-413c-821e-b2a39a29f192\") " pod="openshift-monitoring/node-exporter-g4nq7"
Sep 15 11:26:28.415664 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:28.415629    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aee1ae9c-c04a-413c-821e-b2a39a29f192-node-exporter-accelerators-collector-config\") pod \"node-exporter-g4nq7\" (UID: \"aee1ae9c-c04a-413c-821e-b2a39a29f192\") " pod="openshift-monitoring/node-exporter-g4nq7"
Sep 15 11:26:28.415926 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:28.415898    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aee1ae9c-c04a-413c-821e-b2a39a29f192-metrics-client-ca\") pod \"node-exporter-g4nq7\" (UID: \"aee1ae9c-c04a-413c-821e-b2a39a29f192\") " pod="openshift-monitoring/node-exporter-g4nq7"
Sep 15 11:26:28.417592 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:28.417570    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aee1ae9c-c04a-413c-821e-b2a39a29f192-node-exporter-tls\") pod \"node-exporter-g4nq7\" (UID: \"aee1ae9c-c04a-413c-821e-b2a39a29f192\") " pod="openshift-monitoring/node-exporter-g4nq7"
Sep 15 11:26:28.419017 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:28.418995    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aee1ae9c-c04a-413c-821e-b2a39a29f192-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g4nq7\" (UID: \"aee1ae9c-c04a-413c-821e-b2a39a29f192\") " pod="openshift-monitoring/node-exporter-g4nq7"
Sep 15 11:26:28.424791 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:28.424767    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6lfg\" (UniqueName: \"kubernetes.io/projected/aee1ae9c-c04a-413c-821e-b2a39a29f192-kube-api-access-k6lfg\") pod \"node-exporter-g4nq7\" (UID: \"aee1ae9c-c04a-413c-821e-b2a39a29f192\") " pod="openshift-monitoring/node-exporter-g4nq7"
Sep 15 11:26:28.593335 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:28.593254    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g4nq7"
Sep 15 11:26:29.439326 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:29.439283    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dzzfd" event={"ID":"485ecbb4-5f72-4e62-bce1-0d97de480e0b","Type":"ContainerStarted","Data":"92b174bc8365833d0914d5a8f66e5eefd88fb749a33a6b2c8c47bfb0c6ec8f2f"}
Sep 15 11:26:29.439755 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:29.439358    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dzzfd" event={"ID":"485ecbb4-5f72-4e62-bce1-0d97de480e0b","Type":"ContainerStarted","Data":"2ca1277285f0ca36ac36fae4c6c77f28e76608d9dbacba8fcd45c5911fd4a976"}
Sep 15 11:26:29.442266 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:29.442235    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g4nq7" event={"ID":"aee1ae9c-c04a-413c-821e-b2a39a29f192","Type":"ContainerStarted","Data":"a0b37eb0709a7e23cb962a6d708d4b1318c71d658e06806b885a2e07067fb52b"}
Sep 15 11:26:29.455372 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:29.455318    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dzzfd" podStartSLOduration=66.88280536 podStartE2EDuration="1m8.455298761s" totalImagesPullingTime="1.572493401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:29.454383331 +0000 UTC m=+68.916249385" watchObservedRunningTime="2026-09-15 11:26:29.455298761 +0000 UTC m=+68.917164816"
Sep 15 11:26:32.414345 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:32.414314    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-545ff"
Sep 15 11:26:32.458940 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:32.458905    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bk6zq" event={"ID":"e1eb4055-797f-4589-8f60-a46f631ad4e9","Type":"ContainerStarted","Data":"04a9dfa7433b1f020fc19843d45c1f19209e377dc78a49a0abf8844ba4d5c3fd"}
Sep 15 11:26:32.459148 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:32.459114    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bk6zq"
Sep 15 11:26:32.462010 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:32.461984    2582 generic.go:356] "Generic (PLEG): container finished" podID="aee1ae9c-c04a-413c-821e-b2a39a29f192" containerID="8f7692807dd41e41b239a0b8092928a38af123998a2d31faf6072e937014f633" exitCode=0
Sep 15 11:26:32.462132 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:32.462085    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g4nq7" event={"ID":"aee1ae9c-c04a-413c-821e-b2a39a29f192","Type":"ContainerDied","Data":"8f7692807dd41e41b239a0b8092928a38af123998a2d31faf6072e937014f633"}
Sep 15 11:26:32.464795 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:32.464735    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dm5z4" event={"ID":"270f712b-6161-4b60-8f89-0b2bcad6f27c","Type":"ContainerStarted","Data":"289d75247bfa07a354819d3d1c5ad22c821fe276cc0823dab37b07e91673815f"}
Sep 15 11:26:32.474979 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:32.474906    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bk6zq" podStartSLOduration=66.789063343 podStartE2EDuration="1m11.474888158s" totalImagesPullingTime="4.685824815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:32.472548432 +0000 UTC m=+71.934414486" watchObservedRunningTime="2026-09-15 11:26:32.474888158 +0000 UTC m=+71.936754212"
Sep 15 11:26:32.488145 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:32.487170    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dm5z4" podStartSLOduration=66.484168145 podStartE2EDuration="1m11.487148275s" totalImagesPullingTime="5.00298013s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:32.486676151 +0000 UTC m=+71.948542207" watchObservedRunningTime="2026-09-15 11:26:32.487148275 +0000 UTC m=+71.949014330"
Sep 15 11:26:33.472956 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:33.472906    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g4nq7" event={"ID":"aee1ae9c-c04a-413c-821e-b2a39a29f192","Type":"ContainerStarted","Data":"2c98413a290a133a4bafc707cc94c0613a69b0fda987e26ba492aec78ae5d650"}
Sep 15 11:26:33.473441 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:33.472981    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g4nq7" event={"ID":"aee1ae9c-c04a-413c-821e-b2a39a29f192","Type":"ContainerStarted","Data":"7b7353cb68a30cf64a3a8d39ea2e93a9d7e16ee081e1fbce657a5d1a556a026b"}
Sep 15 11:26:33.493999 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:33.493945    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-g4nq7" podStartSLOduration=2.031674255 podStartE2EDuration="5.493928502s" totalImagesPullingTime="3.382398535s" totalInitContainerRuntime="79.855712ms" isStatefulPod=true podCreationTimestamp="2026-09-15 11:26:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:33.492267502 +0000 UTC m=+72.954133557" watchObservedRunningTime="2026-09-15 11:26:33.493928502 +0000 UTC m=+72.955794555"
Sep 15 11:26:34.580792 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:34.580755    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-6tqxc"]
Sep 15 11:26:34.583112 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:34.583091    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-6tqxc"
Sep 15 11:26:34.585419 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:34.585384    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-66hnf\""
Sep 15 11:26:34.585542 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:34.585449    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 15 11:26:34.585542 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:34.585481    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 15 11:26:34.597739 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:34.597718    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-6tqxc"]
Sep 15 11:26:34.668062 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:34.668029    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kbdl\" (UniqueName: \"kubernetes.io/projected/8abc8e28-e2ec-4c09-a19e-83c506dafe45-kube-api-access-6kbdl\") pod \"downloads-76f99584f4-6tqxc\" (UID: \"8abc8e28-e2ec-4c09-a19e-83c506dafe45\") " pod="openshift-console/downloads-76f99584f4-6tqxc"
Sep 15 11:26:34.768427 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:34.768387    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kbdl\" (UniqueName: \"kubernetes.io/projected/8abc8e28-e2ec-4c09-a19e-83c506dafe45-kube-api-access-6kbdl\") pod \"downloads-76f99584f4-6tqxc\" (UID: \"8abc8e28-e2ec-4c09-a19e-83c506dafe45\") " pod="openshift-console/downloads-76f99584f4-6tqxc"
Sep 15 11:26:34.780631 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:34.780601    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kbdl\" (UniqueName: \"kubernetes.io/projected/8abc8e28-e2ec-4c09-a19e-83c506dafe45-kube-api-access-6kbdl\") pod \"downloads-76f99584f4-6tqxc\" (UID: \"8abc8e28-e2ec-4c09-a19e-83c506dafe45\") " pod="openshift-console/downloads-76f99584f4-6tqxc"
Sep 15 11:26:34.894533 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:34.894494    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-6tqxc"
Sep 15 11:26:35.369114 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:35.369078    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-6tqxc"]
Sep 15 11:26:35.373230 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:26:35.373171    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8abc8e28_e2ec_4c09_a19e_83c506dafe45.slice/crio-9b15b34d7f04b19789ca976ed8fbc5f834aeb015d20edce7dcbbfad6cd0def0c WatchSource:0}: Error finding container 9b15b34d7f04b19789ca976ed8fbc5f834aeb015d20edce7dcbbfad6cd0def0c: Status 404 returned error can't find the container with id 9b15b34d7f04b19789ca976ed8fbc5f834aeb015d20edce7dcbbfad6cd0def0c
Sep 15 11:26:35.482137 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:35.482038    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-6tqxc" event={"ID":"8abc8e28-e2ec-4c09-a19e-83c506dafe45","Type":"ContainerStarted","Data":"9b15b34d7f04b19789ca976ed8fbc5f834aeb015d20edce7dcbbfad6cd0def0c"}
Sep 15 11:26:35.483595 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:35.483569    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588fc65958-mfd5d" event={"ID":"53fdfc58-492d-48b4-bd3c-c129fe352e1c","Type":"ContainerStarted","Data":"afc297c855ef5a6e69344231fcaaf78361b389717f2537fabe066bc66a228196"}
Sep 15 11:26:35.483803 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:35.483785    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588fc65958-mfd5d"
Sep 15 11:26:35.485621 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:35.485602    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588fc65958-mfd5d"
Sep 15 11:26:35.502290 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:35.502244    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588fc65958-mfd5d" podStartSLOduration=1.466110961 podStartE2EDuration="20.502229233s" totalImagesPullingTime="19.036118272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:26:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:35.501835486 +0000 UTC m=+74.963701546" watchObservedRunningTime="2026-09-15 11:26:35.502229233 +0000 UTC m=+74.964095285"
Sep 15 11:26:37.385210 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:37.385157    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-64d479d79d-ztcsf"
Sep 15 11:26:52.546916 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:52.546877    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-6tqxc" event={"ID":"8abc8e28-e2ec-4c09-a19e-83c506dafe45","Type":"ContainerStarted","Data":"4049bf97dd5ea5c2bad071961456a6338ac57cb014e84e740a32866689189b64"}
Sep 15 11:26:52.547407 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:52.547092    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-6tqxc"
Sep 15 11:26:52.560681 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:52.560650    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-6tqxc"
Sep 15 11:26:52.565526 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:26:52.565481    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-6tqxc" podStartSLOduration=2.257486802 podStartE2EDuration="18.565463929s" totalImagesPullingTime="16.307977127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:26:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:52.563768226 +0000 UTC m=+92.025634280" watchObservedRunningTime="2026-09-15 11:26:52.565463929 +0000 UTC m=+92.027329985"
Sep 15 11:27:03.475957 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:27:03.475927    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bk6zq"
Sep 15 11:30:20.907935 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:30:20.907903    2582 kubelet.go:1648] "Image garbage collection succeeded"
Sep 15 11:30:57.904530 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:30:57.904496    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5gn2j"]
Sep 15 11:30:57.906636 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:30:57.906616    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5gn2j"
Sep 15 11:30:57.909170 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:30:57.909149    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-krhh9\""
Sep 15 11:30:57.909308 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:30:57.909156    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 15 11:30:57.909670 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:30:57.909655    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 15 11:30:57.917994 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:30:57.917971    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5gn2j"]
Sep 15 11:30:58.042006 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:30:58.041964    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grmrb\" (UniqueName: \"kubernetes.io/projected/533fdea2-e855-42f8-a728-349905f03b92-kube-api-access-grmrb\") pod \"openshift-lws-operator-fd8ccff4c-5gn2j\" (UID: \"533fdea2-e855-42f8-a728-349905f03b92\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5gn2j"
Sep 15 11:30:58.042230 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:30:58.042022    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/533fdea2-e855-42f8-a728-349905f03b92-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5gn2j\" (UID: \"533fdea2-e855-42f8-a728-349905f03b92\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5gn2j"
Sep 15 11:30:58.143307 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:30:58.143267    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grmrb\" (UniqueName: \"kubernetes.io/projected/533fdea2-e855-42f8-a728-349905f03b92-kube-api-access-grmrb\") pod \"openshift-lws-operator-fd8ccff4c-5gn2j\" (UID: \"533fdea2-e855-42f8-a728-349905f03b92\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5gn2j"
Sep 15 11:30:58.143477 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:30:58.143316    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/533fdea2-e855-42f8-a728-349905f03b92-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5gn2j\" (UID: \"533fdea2-e855-42f8-a728-349905f03b92\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5gn2j"
Sep 15 11:30:58.143659 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:30:58.143643    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/533fdea2-e855-42f8-a728-349905f03b92-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5gn2j\" (UID: \"533fdea2-e855-42f8-a728-349905f03b92\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5gn2j"
Sep 15 11:30:58.158514 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:30:58.158446    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grmrb\" (UniqueName: \"kubernetes.io/projected/533fdea2-e855-42f8-a728-349905f03b92-kube-api-access-grmrb\") pod \"openshift-lws-operator-fd8ccff4c-5gn2j\" (UID: \"533fdea2-e855-42f8-a728-349905f03b92\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5gn2j"
Sep 15 11:30:58.215309 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:30:58.215270    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5gn2j"
Sep 15 11:30:58.490306 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:30:58.490226    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5gn2j"]
Sep 15 11:30:58.493153 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:30:58.493127    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod533fdea2_e855_42f8_a728_349905f03b92.slice/crio-50284b26bc09ba4afdc0241c6485cee5e5e11ee461d20e0820eba4a57fa334cd WatchSource:0}: Error finding container 50284b26bc09ba4afdc0241c6485cee5e5e11ee461d20e0820eba4a57fa334cd: Status 404 returned error can't find the container with id 50284b26bc09ba4afdc0241c6485cee5e5e11ee461d20e0820eba4a57fa334cd
Sep 15 11:30:58.494618 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:30:58.494600    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 11:30:59.352791 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:30:59.352750    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5gn2j" event={"ID":"533fdea2-e855-42f8-a728-349905f03b92","Type":"ContainerStarted","Data":"50284b26bc09ba4afdc0241c6485cee5e5e11ee461d20e0820eba4a57fa334cd"}
Sep 15 11:31:01.361491 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:01.361454    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5gn2j" event={"ID":"533fdea2-e855-42f8-a728-349905f03b92","Type":"ContainerStarted","Data":"eb30b351eab452bb850f79b883572e1a61584c15687a9e150af6153dd7d3c74d"}
Sep 15 11:31:01.382699 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:01.382651    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5gn2j" podStartSLOduration=2.185295009 podStartE2EDuration="4.382635956s" totalImagesPullingTime="2.197340947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:30:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:31:01.38138259 +0000 UTC m=+340.843248644" watchObservedRunningTime="2026-09-15 11:31:01.382635956 +0000 UTC m=+340.844502006"
Sep 15 11:31:17.193020 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:17.192930    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-99f4658c8-r2prg"]
Sep 15 11:31:17.195082 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:17.195066    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-r2prg"
Sep 15 11:31:17.199795 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:17.199775    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 15 11:31:17.201310 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:17.200983    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7mtn4\""
Sep 15 11:31:17.201310 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:17.200992    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 15 11:31:17.201310 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:17.201053    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 15 11:31:17.207509 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:17.207492    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 15 11:31:17.271922 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:17.271890    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-99f4658c8-r2prg"]
Sep 15 11:31:17.286680 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:17.286658    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f497f61-05e4-483d-8466-3324e1c333ea-tmp\") pod \"opendatahub-operator-controller-manager-99f4658c8-r2prg\" (UID: \"5f497f61-05e4-483d-8466-3324e1c333ea\") " pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-r2prg"
Sep 15 11:31:17.286797 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:17.286689    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5f497f61-05e4-483d-8466-3324e1c333ea-manifests\") pod \"opendatahub-operator-controller-manager-99f4658c8-r2prg\" (UID: \"5f497f61-05e4-483d-8466-3324e1c333ea\") " pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-r2prg"
Sep 15 11:31:17.286797 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:17.286720    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5f497f61-05e4-483d-8466-3324e1c333ea-apiservice-cert\") pod \"opendatahub-operator-controller-manager-99f4658c8-r2prg\" (UID: \"5f497f61-05e4-483d-8466-3324e1c333ea\") " pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-r2prg"
Sep 15 11:31:17.286797 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:17.286777    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f497f61-05e4-483d-8466-3324e1c333ea-webhook-cert\") pod \"opendatahub-operator-controller-manager-99f4658c8-r2prg\" (UID: \"5f497f61-05e4-483d-8466-3324e1c333ea\") " pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-r2prg"
Sep 15 11:31:17.286937 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:17.286799    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2hjr\" (UniqueName: \"kubernetes.io/projected/5f497f61-05e4-483d-8466-3324e1c333ea-kube-api-access-h2hjr\") pod \"opendatahub-operator-controller-manager-99f4658c8-r2prg\" (UID: \"5f497f61-05e4-483d-8466-3324e1c333ea\") " pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-r2prg"
Sep 15 11:31:17.387595 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:17.387561    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5f497f61-05e4-483d-8466-3324e1c333ea-apiservice-cert\") pod \"opendatahub-operator-controller-manager-99f4658c8-r2prg\" (UID: \"5f497f61-05e4-483d-8466-3324e1c333ea\") " pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-r2prg"
Sep 15 11:31:17.387595 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:17.387597    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f497f61-05e4-483d-8466-3324e1c333ea-webhook-cert\") pod \"opendatahub-operator-controller-manager-99f4658c8-r2prg\" (UID: \"5f497f61-05e4-483d-8466-3324e1c333ea\") " pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-r2prg"
Sep 15 11:31:17.387805 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:17.387614    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2hjr\" (UniqueName: \"kubernetes.io/projected/5f497f61-05e4-483d-8466-3324e1c333ea-kube-api-access-h2hjr\") pod \"opendatahub-operator-controller-manager-99f4658c8-r2prg\" (UID: \"5f497f61-05e4-483d-8466-3324e1c333ea\") " pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-r2prg"
Sep 15 11:31:17.387805 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:17.387656    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f497f61-05e4-483d-8466-3324e1c333ea-tmp\") pod \"opendatahub-operator-controller-manager-99f4658c8-r2prg\" (UID: \"5f497f61-05e4-483d-8466-3324e1c333ea\") " pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-r2prg"
Sep 15 11:31:17.387805 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:17.387674    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5f497f61-05e4-483d-8466-3324e1c333ea-manifests\") pod \"opendatahub-operator-controller-manager-99f4658c8-r2prg\" (UID: \"5f497f61-05e4-483d-8466-3324e1c333ea\") " pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-r2prg"
Sep 15 11:31:17.388091 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:17.388070    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5f497f61-05e4-483d-8466-3324e1c333ea-manifests\") pod \"opendatahub-operator-controller-manager-99f4658c8-r2prg\" (UID: \"5f497f61-05e4-483d-8466-3324e1c333ea\") " pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-r2prg"
Sep 15 11:31:17.389966 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:17.389944    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f497f61-05e4-483d-8466-3324e1c333ea-tmp\") pod \"opendatahub-operator-controller-manager-99f4658c8-r2prg\" (UID: \"5f497f61-05e4-483d-8466-3324e1c333ea\") " pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-r2prg"
Sep 15 11:31:17.390291 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:17.390271    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f497f61-05e4-483d-8466-3324e1c333ea-webhook-cert\") pod \"opendatahub-operator-controller-manager-99f4658c8-r2prg\" (UID: \"5f497f61-05e4-483d-8466-3324e1c333ea\") " pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-r2prg"
Sep 15 11:31:17.390374 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:17.390299    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5f497f61-05e4-483d-8466-3324e1c333ea-apiservice-cert\") pod \"opendatahub-operator-controller-manager-99f4658c8-r2prg\" (UID: \"5f497f61-05e4-483d-8466-3324e1c333ea\") " pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-r2prg"
Sep 15 11:31:17.397962 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:17.397934    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2hjr\" (UniqueName: \"kubernetes.io/projected/5f497f61-05e4-483d-8466-3324e1c333ea-kube-api-access-h2hjr\") pod \"opendatahub-operator-controller-manager-99f4658c8-r2prg\" (UID: \"5f497f61-05e4-483d-8466-3324e1c333ea\") " pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-r2prg"
Sep 15 11:31:17.505081 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:17.504985    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-r2prg"
Sep 15 11:31:17.788273 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:17.788168    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-99f4658c8-r2prg"]
Sep 15 11:31:17.792146 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:31:17.792119    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f497f61_05e4_483d_8466_3324e1c333ea.slice/crio-f26f13b365f7f3c0b81d446159275f750248377bb19096ea51b2847074b492ef WatchSource:0}: Error finding container f26f13b365f7f3c0b81d446159275f750248377bb19096ea51b2847074b492ef: Status 404 returned error can't find the container with id f26f13b365f7f3c0b81d446159275f750248377bb19096ea51b2847074b492ef
Sep 15 11:31:18.422534 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:18.422492    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-r2prg" event={"ID":"5f497f61-05e4-483d-8466-3324e1c333ea","Type":"ContainerStarted","Data":"f26f13b365f7f3c0b81d446159275f750248377bb19096ea51b2847074b492ef"}
Sep 15 11:31:21.436528 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:21.436487    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-r2prg" event={"ID":"5f497f61-05e4-483d-8466-3324e1c333ea","Type":"ContainerStarted","Data":"0c2066a18786887b58e666c621571e6dcedfdd190a61e77fddea1bfdd26e6cde"}
Sep 15 11:31:22.441955 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:22.441924    2582 generic.go:356] "Generic (PLEG): container finished" podID="5f497f61-05e4-483d-8466-3324e1c333ea" containerID="0c2066a18786887b58e666c621571e6dcedfdd190a61e77fddea1bfdd26e6cde" exitCode=0
Sep 15 11:31:22.442396 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:22.441965    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-r2prg" event={"ID":"5f497f61-05e4-483d-8466-3324e1c333ea","Type":"ContainerDied","Data":"0c2066a18786887b58e666c621571e6dcedfdd190a61e77fddea1bfdd26e6cde"}
Sep 15 11:31:23.447851 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:23.447814    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-r2prg" event={"ID":"5f497f61-05e4-483d-8466-3324e1c333ea","Type":"ContainerStarted","Data":"ce05bf75e5c2baa61c9ee3ce2db1c3f73cf782e1d67d9ae6c84e9d842c73c531"}
Sep 15 11:31:23.448367 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:23.447955    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-r2prg"
Sep 15 11:31:23.470919 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:23.470850    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-r2prg" podStartSLOduration=2.139576725 podStartE2EDuration="6.470832563s" totalImagesPullingTime="3.278880477s" totalInitContainerRuntime="1.052375361s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:31:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:31:23.469327633 +0000 UTC m=+362.931193689" watchObservedRunningTime="2026-09-15 11:31:23.470832563 +0000 UTC m=+362.932698615"
Sep 15 11:31:34.454147 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:34.454109    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-99f4658c8-r2prg"
Sep 15 11:31:38.116148 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:38.116113    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-59bc95f796-6kfg5"]
Sep 15 11:31:38.127507 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:38.127479    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59bc95f796-6kfg5"
Sep 15 11:31:38.130065 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:38.130038    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 15 11:31:38.130212 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:38.130079    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 15 11:31:38.130212 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:38.130083    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 15 11:31:38.130212 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:38.130099    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 15 11:31:38.143061 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:38.143039    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59bc95f796-6kfg5"]
Sep 15 11:31:38.249603 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:38.249568    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgk4g\" (UniqueName: \"kubernetes.io/projected/9ed3b65d-fc65-4f40-9e21-ef52dfe796ef-kube-api-access-mgk4g\") pod \"kube-auth-proxy-59bc95f796-6kfg5\" (UID: \"9ed3b65d-fc65-4f40-9e21-ef52dfe796ef\") " pod="openshift-ingress/kube-auth-proxy-59bc95f796-6kfg5"
Sep 15 11:31:38.249764 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:38.249618    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ed3b65d-fc65-4f40-9e21-ef52dfe796ef-tls-certs\") pod \"kube-auth-proxy-59bc95f796-6kfg5\" (UID: \"9ed3b65d-fc65-4f40-9e21-ef52dfe796ef\") " pod="openshift-ingress/kube-auth-proxy-59bc95f796-6kfg5"
Sep 15 11:31:38.249764 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:38.249709    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ed3b65d-fc65-4f40-9e21-ef52dfe796ef-tmp\") pod \"kube-auth-proxy-59bc95f796-6kfg5\" (UID: \"9ed3b65d-fc65-4f40-9e21-ef52dfe796ef\") " pod="openshift-ingress/kube-auth-proxy-59bc95f796-6kfg5"
Sep 15 11:31:38.350010 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:38.349977    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ed3b65d-fc65-4f40-9e21-ef52dfe796ef-tls-certs\") pod \"kube-auth-proxy-59bc95f796-6kfg5\" (UID: \"9ed3b65d-fc65-4f40-9e21-ef52dfe796ef\") " pod="openshift-ingress/kube-auth-proxy-59bc95f796-6kfg5"
Sep 15 11:31:38.350163 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:38.350026    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ed3b65d-fc65-4f40-9e21-ef52dfe796ef-tmp\") pod \"kube-auth-proxy-59bc95f796-6kfg5\" (UID: \"9ed3b65d-fc65-4f40-9e21-ef52dfe796ef\") " pod="openshift-ingress/kube-auth-proxy-59bc95f796-6kfg5"
Sep 15 11:31:38.350163 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:38.350050    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgk4g\" (UniqueName: \"kubernetes.io/projected/9ed3b65d-fc65-4f40-9e21-ef52dfe796ef-kube-api-access-mgk4g\") pod \"kube-auth-proxy-59bc95f796-6kfg5\" (UID: \"9ed3b65d-fc65-4f40-9e21-ef52dfe796ef\") " pod="openshift-ingress/kube-auth-proxy-59bc95f796-6kfg5"
Sep 15 11:31:38.350163 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:31:38.350125    2582 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 15 11:31:38.350313 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:31:38.350219    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ed3b65d-fc65-4f40-9e21-ef52dfe796ef-tls-certs podName:9ed3b65d-fc65-4f40-9e21-ef52dfe796ef nodeName:}" failed. No retries permitted until 2026-09-15 11:31:38.850202295 +0000 UTC m=+378.312068325 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/9ed3b65d-fc65-4f40-9e21-ef52dfe796ef-tls-certs") pod "kube-auth-proxy-59bc95f796-6kfg5" (UID: "9ed3b65d-fc65-4f40-9e21-ef52dfe796ef") : secret "kube-auth-proxy-tls" not found
Sep 15 11:31:38.352072 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:38.352054    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ed3b65d-fc65-4f40-9e21-ef52dfe796ef-tmp\") pod \"kube-auth-proxy-59bc95f796-6kfg5\" (UID: \"9ed3b65d-fc65-4f40-9e21-ef52dfe796ef\") " pod="openshift-ingress/kube-auth-proxy-59bc95f796-6kfg5"
Sep 15 11:31:38.360458 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:38.360436    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgk4g\" (UniqueName: \"kubernetes.io/projected/9ed3b65d-fc65-4f40-9e21-ef52dfe796ef-kube-api-access-mgk4g\") pod \"kube-auth-proxy-59bc95f796-6kfg5\" (UID: \"9ed3b65d-fc65-4f40-9e21-ef52dfe796ef\") " pod="openshift-ingress/kube-auth-proxy-59bc95f796-6kfg5"
Sep 15 11:31:38.855023 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:38.854968    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ed3b65d-fc65-4f40-9e21-ef52dfe796ef-tls-certs\") pod \"kube-auth-proxy-59bc95f796-6kfg5\" (UID: \"9ed3b65d-fc65-4f40-9e21-ef52dfe796ef\") " pod="openshift-ingress/kube-auth-proxy-59bc95f796-6kfg5"
Sep 15 11:31:38.857622 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:38.857589    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ed3b65d-fc65-4f40-9e21-ef52dfe796ef-tls-certs\") pod \"kube-auth-proxy-59bc95f796-6kfg5\" (UID: \"9ed3b65d-fc65-4f40-9e21-ef52dfe796ef\") " pod="openshift-ingress/kube-auth-proxy-59bc95f796-6kfg5"
Sep 15 11:31:39.036671 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:39.036630    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59bc95f796-6kfg5"
Sep 15 11:31:39.319079 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:39.319039    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59bc95f796-6kfg5"]
Sep 15 11:31:39.323092 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:31:39.323065    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ed3b65d_fc65_4f40_9e21_ef52dfe796ef.slice/crio-369c7eaed9da343c76b7d6ab66702cc5f8ebe687abfe27d8614c6c623d611a4f WatchSource:0}: Error finding container 369c7eaed9da343c76b7d6ab66702cc5f8ebe687abfe27d8614c6c623d611a4f: Status 404 returned error can't find the container with id 369c7eaed9da343c76b7d6ab66702cc5f8ebe687abfe27d8614c6c623d611a4f
Sep 15 11:31:39.503576 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:39.503537    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59bc95f796-6kfg5" event={"ID":"9ed3b65d-fc65-4f40-9e21-ef52dfe796ef","Type":"ContainerStarted","Data":"369c7eaed9da343c76b7d6ab66702cc5f8ebe687abfe27d8614c6c623d611a4f"}
Sep 15 11:31:39.585947 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:39.585867    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j"]
Sep 15 11:31:39.588919 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:39.588886    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j"
Sep 15 11:31:39.591963 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:39.591930    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 15 11:31:39.592130 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:39.591970    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 15 11:31:39.592130 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:39.591944    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 15 11:31:39.592130 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:39.592085    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-lxpv9\""
Sep 15 11:31:39.592308 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:39.592293    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 15 11:31:39.609094 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:39.609063    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j"]
Sep 15 11:31:39.662512 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:39.662474    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a25511aa-eec1-4e10-bba0-f8bc964a74b4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-bjh6j\" (UID: \"a25511aa-eec1-4e10-bba0-f8bc964a74b4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j"
Sep 15 11:31:39.662712 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:39.662542    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a25511aa-eec1-4e10-bba0-f8bc964a74b4-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-bjh6j\" (UID: \"a25511aa-eec1-4e10-bba0-f8bc964a74b4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j"
Sep 15 11:31:39.662712 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:39.662643    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a25511aa-eec1-4e10-bba0-f8bc964a74b4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-bjh6j\" (UID: \"a25511aa-eec1-4e10-bba0-f8bc964a74b4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j"
Sep 15 11:31:39.662712 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:39.662679    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a25511aa-eec1-4e10-bba0-f8bc964a74b4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-bjh6j\" (UID: \"a25511aa-eec1-4e10-bba0-f8bc964a74b4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j"
Sep 15 11:31:39.662873 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:39.662744    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scs9t\" (UniqueName: \"kubernetes.io/projected/a25511aa-eec1-4e10-bba0-f8bc964a74b4-kube-api-access-scs9t\") pod \"istiod-openshift-gateway-7b7995d5cd-bjh6j\" (UID: \"a25511aa-eec1-4e10-bba0-f8bc964a74b4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j"
Sep 15 11:31:39.662873 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:39.662783    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a25511aa-eec1-4e10-bba0-f8bc964a74b4-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-bjh6j\" (UID: \"a25511aa-eec1-4e10-bba0-f8bc964a74b4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j"
Sep 15 11:31:39.662948 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:39.662866    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a25511aa-eec1-4e10-bba0-f8bc964a74b4-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-bjh6j\" (UID: \"a25511aa-eec1-4e10-bba0-f8bc964a74b4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j"
Sep 15 11:31:39.763537 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:39.763497    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a25511aa-eec1-4e10-bba0-f8bc964a74b4-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-bjh6j\" (UID: \"a25511aa-eec1-4e10-bba0-f8bc964a74b4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j"
Sep 15 11:31:39.763747 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:39.763557    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a25511aa-eec1-4e10-bba0-f8bc964a74b4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-bjh6j\" (UID: \"a25511aa-eec1-4e10-bba0-f8bc964a74b4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j"
Sep 15 11:31:39.763747 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:39.763598    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a25511aa-eec1-4e10-bba0-f8bc964a74b4-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-bjh6j\" (UID: \"a25511aa-eec1-4e10-bba0-f8bc964a74b4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j"
Sep 15 11:31:39.763747 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:39.763622    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a25511aa-eec1-4e10-bba0-f8bc964a74b4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-bjh6j\" (UID: \"a25511aa-eec1-4e10-bba0-f8bc964a74b4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j"
Sep 15 11:31:39.763747 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:39.763647    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a25511aa-eec1-4e10-bba0-f8bc964a74b4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-bjh6j\" (UID: \"a25511aa-eec1-4e10-bba0-f8bc964a74b4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j"
Sep 15 11:31:39.763747 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:39.763680    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scs9t\" (UniqueName: \"kubernetes.io/projected/a25511aa-eec1-4e10-bba0-f8bc964a74b4-kube-api-access-scs9t\") pod \"istiod-openshift-gateway-7b7995d5cd-bjh6j\" (UID: \"a25511aa-eec1-4e10-bba0-f8bc964a74b4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j"
Sep 15 11:31:39.763747 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:39.763708    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a25511aa-eec1-4e10-bba0-f8bc964a74b4-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-bjh6j\" (UID: \"a25511aa-eec1-4e10-bba0-f8bc964a74b4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j"
Sep 15 11:31:39.764643 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:39.764582    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a25511aa-eec1-4e10-bba0-f8bc964a74b4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-bjh6j\" (UID: \"a25511aa-eec1-4e10-bba0-f8bc964a74b4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j"
Sep 15 11:31:39.766553 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:39.766521    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a25511aa-eec1-4e10-bba0-f8bc964a74b4-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-bjh6j\" (UID: \"a25511aa-eec1-4e10-bba0-f8bc964a74b4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j"
Sep 15 11:31:39.767286 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:39.767261    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a25511aa-eec1-4e10-bba0-f8bc964a74b4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-bjh6j\" (UID: \"a25511aa-eec1-4e10-bba0-f8bc964a74b4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j"
Sep 15 11:31:39.767412 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:39.767296    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a25511aa-eec1-4e10-bba0-f8bc964a74b4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-bjh6j\" (UID: \"a25511aa-eec1-4e10-bba0-f8bc964a74b4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j"
Sep 15 11:31:39.767567 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:39.767547    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a25511aa-eec1-4e10-bba0-f8bc964a74b4-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-bjh6j\" (UID: \"a25511aa-eec1-4e10-bba0-f8bc964a74b4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j"
Sep 15 11:31:39.771717 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:39.771695    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a25511aa-eec1-4e10-bba0-f8bc964a74b4-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-bjh6j\" (UID: \"a25511aa-eec1-4e10-bba0-f8bc964a74b4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j"
Sep 15 11:31:39.772288 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:39.772268    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scs9t\" (UniqueName: \"kubernetes.io/projected/a25511aa-eec1-4e10-bba0-f8bc964a74b4-kube-api-access-scs9t\") pod \"istiod-openshift-gateway-7b7995d5cd-bjh6j\" (UID: \"a25511aa-eec1-4e10-bba0-f8bc964a74b4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j"
Sep 15 11:31:39.899380 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:39.899336    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j"
Sep 15 11:31:40.188224 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:40.188023    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j"]
Sep 15 11:31:40.191263 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:31:40.191220    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda25511aa_eec1_4e10_bba0_f8bc964a74b4.slice/crio-db9bf25e6aae6a5a9db57346f8876b9fc3c210a4997bd117d8b6ec56c4e547a9 WatchSource:0}: Error finding container db9bf25e6aae6a5a9db57346f8876b9fc3c210a4997bd117d8b6ec56c4e547a9: Status 404 returned error can't find the container with id db9bf25e6aae6a5a9db57346f8876b9fc3c210a4997bd117d8b6ec56c4e547a9
Sep 15 11:31:40.509263 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:40.509164    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j" event={"ID":"a25511aa-eec1-4e10-bba0-f8bc964a74b4","Type":"ContainerStarted","Data":"db9bf25e6aae6a5a9db57346f8876b9fc3c210a4997bd117d8b6ec56c4e547a9"}
Sep 15 11:31:42.520386 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:42.520346    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59bc95f796-6kfg5" event={"ID":"9ed3b65d-fc65-4f40-9e21-ef52dfe796ef","Type":"ContainerStarted","Data":"f6eece89341d42736f4bb5095b627efe46a904c1f035b6f6a51e4a427eb28f8d"}
Sep 15 11:31:42.537561 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:42.537499    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-59bc95f796-6kfg5" podStartSLOduration=2.135442835 podStartE2EDuration="4.537479122s" totalImagesPullingTime="2.402036287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:31:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:31:42.536652505 +0000 UTC m=+381.998518561" watchObservedRunningTime="2026-09-15 11:31:42.537479122 +0000 UTC m=+381.999345179"
Sep 15 11:31:43.554413 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:43.554371    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 15 11:31:43.554674 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:43.554446    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 15 11:31:44.529444 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:44.529407    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j" event={"ID":"a25511aa-eec1-4e10-bba0-f8bc964a74b4","Type":"ContainerStarted","Data":"619e6dffc582f9a92e163fd2216a317aca373f3a62c102b9e8ebb32a9e8b4aeb"}
Sep 15 11:31:44.529759 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:44.529729    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j"
Sep 15 11:31:44.531197 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:44.531151    2582 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-bjh6j container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 11:31:44.531304 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:44.531223    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j" podUID="a25511aa-eec1-4e10-bba0-f8bc964a74b4" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 11:31:44.551012 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:44.550970    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j" podStartSLOduration=2.191249176 podStartE2EDuration="5.550958218s" totalImagesPullingTime="3.359709042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:31:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:31:44.549990154 +0000 UTC m=+384.011856220" watchObservedRunningTime="2026-09-15 11:31:44.550958218 +0000 UTC m=+384.012824270"
Sep 15 11:31:45.534096 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:45.534062    2582 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-bjh6j container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 11:31:45.534563 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:45.534110    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j" podUID="a25511aa-eec1-4e10-bba0-f8bc964a74b4" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 11:31:48.534799 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:48.534766    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j"
Sep 15 11:31:54.282269 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:54.282229    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-7pdsq"]
Sep 15 11:31:54.285721 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:54.285698    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7pdsq"
Sep 15 11:31:54.301256 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:54.301231    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-7pdsq"]
Sep 15 11:31:54.384595 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:54.384562    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/41aa5744-80c2-4bdb-8266-9c47a73cdb55-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-7pdsq\" (UID: \"41aa5744-80c2-4bdb-8266-9c47a73cdb55\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7pdsq"
Sep 15 11:31:54.384774 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:54.384615    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41aa5744-80c2-4bdb-8266-9c47a73cdb55-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-7pdsq\" (UID: \"41aa5744-80c2-4bdb-8266-9c47a73cdb55\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7pdsq"
Sep 15 11:31:54.384774 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:54.384635    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/41aa5744-80c2-4bdb-8266-9c47a73cdb55-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-7pdsq\" (UID: \"41aa5744-80c2-4bdb-8266-9c47a73cdb55\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7pdsq"
Sep 15 11:31:54.384774 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:54.384718    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/41aa5744-80c2-4bdb-8266-9c47a73cdb55-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-7pdsq\" (UID: \"41aa5744-80c2-4bdb-8266-9c47a73cdb55\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7pdsq"
Sep 15 11:31:54.384774 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:54.384750    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/41aa5744-80c2-4bdb-8266-9c47a73cdb55-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-7pdsq\" (UID: \"41aa5744-80c2-4bdb-8266-9c47a73cdb55\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7pdsq"
Sep 15 11:31:54.384774 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:54.384769    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmck4\" (UniqueName: \"kubernetes.io/projected/41aa5744-80c2-4bdb-8266-9c47a73cdb55-kube-api-access-nmck4\") pod \"istiod-openshift-gateway-5677ccb49b-7pdsq\" (UID: \"41aa5744-80c2-4bdb-8266-9c47a73cdb55\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7pdsq"
Sep 15 11:31:54.384933 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:54.384821    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/41aa5744-80c2-4bdb-8266-9c47a73cdb55-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-7pdsq\" (UID: \"41aa5744-80c2-4bdb-8266-9c47a73cdb55\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7pdsq"
Sep 15 11:31:54.485619 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:54.485587    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/41aa5744-80c2-4bdb-8266-9c47a73cdb55-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-7pdsq\" (UID: \"41aa5744-80c2-4bdb-8266-9c47a73cdb55\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7pdsq"
Sep 15 11:31:54.485805 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:54.485627    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/41aa5744-80c2-4bdb-8266-9c47a73cdb55-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-7pdsq\" (UID: \"41aa5744-80c2-4bdb-8266-9c47a73cdb55\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7pdsq"
Sep 15 11:31:54.485805 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:54.485659    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41aa5744-80c2-4bdb-8266-9c47a73cdb55-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-7pdsq\" (UID: \"41aa5744-80c2-4bdb-8266-9c47a73cdb55\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7pdsq"
Sep 15 11:31:54.485805 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:54.485680    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/41aa5744-80c2-4bdb-8266-9c47a73cdb55-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-7pdsq\" (UID: \"41aa5744-80c2-4bdb-8266-9c47a73cdb55\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7pdsq"
Sep 15 11:31:54.485805 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:54.485709    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/41aa5744-80c2-4bdb-8266-9c47a73cdb55-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-7pdsq\" (UID: \"41aa5744-80c2-4bdb-8266-9c47a73cdb55\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7pdsq"
Sep 15 11:31:54.485805 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:54.485736    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/41aa5744-80c2-4bdb-8266-9c47a73cdb55-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-7pdsq\" (UID: \"41aa5744-80c2-4bdb-8266-9c47a73cdb55\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7pdsq"
Sep 15 11:31:54.485805 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:54.485759    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmck4\" (UniqueName: \"kubernetes.io/projected/41aa5744-80c2-4bdb-8266-9c47a73cdb55-kube-api-access-nmck4\") pod \"istiod-openshift-gateway-5677ccb49b-7pdsq\" (UID: \"41aa5744-80c2-4bdb-8266-9c47a73cdb55\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7pdsq"
Sep 15 11:31:54.486270 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:54.486251    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/41aa5744-80c2-4bdb-8266-9c47a73cdb55-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-7pdsq\" (UID: \"41aa5744-80c2-4bdb-8266-9c47a73cdb55\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7pdsq"
Sep 15 11:31:54.488371 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:54.488342    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/41aa5744-80c2-4bdb-8266-9c47a73cdb55-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-7pdsq\" (UID: \"41aa5744-80c2-4bdb-8266-9c47a73cdb55\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7pdsq"
Sep 15 11:31:54.488603 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:54.488582    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/41aa5744-80c2-4bdb-8266-9c47a73cdb55-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-7pdsq\" (UID: \"41aa5744-80c2-4bdb-8266-9c47a73cdb55\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7pdsq"
Sep 15 11:31:54.488674 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:54.488605    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/41aa5744-80c2-4bdb-8266-9c47a73cdb55-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-7pdsq\" (UID: \"41aa5744-80c2-4bdb-8266-9c47a73cdb55\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7pdsq"
Sep 15 11:31:54.488981 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:54.488957    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/41aa5744-80c2-4bdb-8266-9c47a73cdb55-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-7pdsq\" (UID: \"41aa5744-80c2-4bdb-8266-9c47a73cdb55\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7pdsq"
Sep 15 11:31:54.495158 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:54.495136    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmck4\" (UniqueName: \"kubernetes.io/projected/41aa5744-80c2-4bdb-8266-9c47a73cdb55-kube-api-access-nmck4\") pod \"istiod-openshift-gateway-5677ccb49b-7pdsq\" (UID: \"41aa5744-80c2-4bdb-8266-9c47a73cdb55\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7pdsq"
Sep 15 11:31:54.496695 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:54.496676    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41aa5744-80c2-4bdb-8266-9c47a73cdb55-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-7pdsq\" (UID: \"41aa5744-80c2-4bdb-8266-9c47a73cdb55\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7pdsq"
Sep 15 11:31:54.594307 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:54.594241    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7pdsq"
Sep 15 11:31:54.873246 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:54.873143    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-7pdsq"]
Sep 15 11:31:54.876961 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:31:54.876935    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41aa5744_80c2_4bdb_8266_9c47a73cdb55.slice/crio-a117fb369265c5f21451664acf6c604c2b9aa296abadeabbcf2020b821c09231 WatchSource:0}: Error finding container a117fb369265c5f21451664acf6c604c2b9aa296abadeabbcf2020b821c09231: Status 404 returned error can't find the container with id a117fb369265c5f21451664acf6c604c2b9aa296abadeabbcf2020b821c09231
Sep 15 11:31:54.878906 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:54.878878    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 15 11:31:54.878964 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:54.878934    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 15 11:31:55.574000 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:55.573961    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7pdsq" event={"ID":"41aa5744-80c2-4bdb-8266-9c47a73cdb55","Type":"ContainerStarted","Data":"cef81361fc70be589d46a8750dd40f94456920f001ff0d8061d359ac7aa21eb3"}
Sep 15 11:31:55.574522 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:55.574019    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7pdsq" event={"ID":"41aa5744-80c2-4bdb-8266-9c47a73cdb55","Type":"ContainerStarted","Data":"a117fb369265c5f21451664acf6c604c2b9aa296abadeabbcf2020b821c09231"}
Sep 15 11:31:55.574522 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:55.574298    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7pdsq"
Sep 15 11:31:55.576247 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:55.576221    2582 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-7pdsq container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 11:31:55.576398 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:55.576269    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7pdsq" podUID="41aa5744-80c2-4bdb-8266-9c47a73cdb55" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 11:31:55.623876 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:55.623828    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7pdsq" podStartSLOduration=1.623811564 podStartE2EDuration="1.623811564s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:31:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:31:55.622720254 +0000 UTC m=+395.084586332" watchObservedRunningTime="2026-09-15 11:31:55.623811564 +0000 UTC m=+395.085677615"
Sep 15 11:31:56.578973 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:56.578949    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7pdsq"
Sep 15 11:31:56.639073 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:56.639042    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j"]
Sep 15 11:31:56.639310 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:56.639289    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j" podUID="a25511aa-eec1-4e10-bba0-f8bc964a74b4" containerName="discovery" containerID="cri-o://619e6dffc582f9a92e163fd2216a317aca373f3a62c102b9e8ebb32a9e8b4aeb" gracePeriod=30
Sep 15 11:31:56.891077 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:56.891042    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j"
Sep 15 11:31:57.010421 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.010392    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a25511aa-eec1-4e10-bba0-f8bc964a74b4-istio-kubeconfig\") pod \"a25511aa-eec1-4e10-bba0-f8bc964a74b4\" (UID: \"a25511aa-eec1-4e10-bba0-f8bc964a74b4\") "
Sep 15 11:31:57.010611 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.010444    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a25511aa-eec1-4e10-bba0-f8bc964a74b4-local-certs\") pod \"a25511aa-eec1-4e10-bba0-f8bc964a74b4\" (UID: \"a25511aa-eec1-4e10-bba0-f8bc964a74b4\") "
Sep 15 11:31:57.010611 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.010460    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a25511aa-eec1-4e10-bba0-f8bc964a74b4-istio-token\") pod \"a25511aa-eec1-4e10-bba0-f8bc964a74b4\" (UID: \"a25511aa-eec1-4e10-bba0-f8bc964a74b4\") "
Sep 15 11:31:57.010611 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.010486    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a25511aa-eec1-4e10-bba0-f8bc964a74b4-istio-csr-ca-configmap\") pod \"a25511aa-eec1-4e10-bba0-f8bc964a74b4\" (UID: \"a25511aa-eec1-4e10-bba0-f8bc964a74b4\") "
Sep 15 11:31:57.010611 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.010531    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a25511aa-eec1-4e10-bba0-f8bc964a74b4-istio-csr-dns-cert\") pod \"a25511aa-eec1-4e10-bba0-f8bc964a74b4\" (UID: \"a25511aa-eec1-4e10-bba0-f8bc964a74b4\") "
Sep 15 11:31:57.010611 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.010557    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a25511aa-eec1-4e10-bba0-f8bc964a74b4-cacerts\") pod \"a25511aa-eec1-4e10-bba0-f8bc964a74b4\" (UID: \"a25511aa-eec1-4e10-bba0-f8bc964a74b4\") "
Sep 15 11:31:57.010611 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.010585    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-scs9t\" (UniqueName: \"kubernetes.io/projected/a25511aa-eec1-4e10-bba0-f8bc964a74b4-kube-api-access-scs9t\") pod \"a25511aa-eec1-4e10-bba0-f8bc964a74b4\" (UID: \"a25511aa-eec1-4e10-bba0-f8bc964a74b4\") "
Sep 15 11:31:57.010929 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.010905    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a25511aa-eec1-4e10-bba0-f8bc964a74b4-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "a25511aa-eec1-4e10-bba0-f8bc964a74b4" (UID: "a25511aa-eec1-4e10-bba0-f8bc964a74b4"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:31:57.013036 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.012987    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a25511aa-eec1-4e10-bba0-f8bc964a74b4-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "a25511aa-eec1-4e10-bba0-f8bc964a74b4" (UID: "a25511aa-eec1-4e10-bba0-f8bc964a74b4"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:31:57.013036 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.012987    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a25511aa-eec1-4e10-bba0-f8bc964a74b4-local-certs" (OuterVolumeSpecName: "local-certs") pod "a25511aa-eec1-4e10-bba0-f8bc964a74b4" (UID: "a25511aa-eec1-4e10-bba0-f8bc964a74b4"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:31:57.013262 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.013233    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a25511aa-eec1-4e10-bba0-f8bc964a74b4-cacerts" (OuterVolumeSpecName: "cacerts") pod "a25511aa-eec1-4e10-bba0-f8bc964a74b4" (UID: "a25511aa-eec1-4e10-bba0-f8bc964a74b4"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:31:57.013318 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.013257    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a25511aa-eec1-4e10-bba0-f8bc964a74b4-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "a25511aa-eec1-4e10-bba0-f8bc964a74b4" (UID: "a25511aa-eec1-4e10-bba0-f8bc964a74b4"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:31:57.013429 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.013404    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a25511aa-eec1-4e10-bba0-f8bc964a74b4-kube-api-access-scs9t" (OuterVolumeSpecName: "kube-api-access-scs9t") pod "a25511aa-eec1-4e10-bba0-f8bc964a74b4" (UID: "a25511aa-eec1-4e10-bba0-f8bc964a74b4"). InnerVolumeSpecName "kube-api-access-scs9t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:31:57.013468 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.013439    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a25511aa-eec1-4e10-bba0-f8bc964a74b4-istio-token" (OuterVolumeSpecName: "istio-token") pod "a25511aa-eec1-4e10-bba0-f8bc964a74b4" (UID: "a25511aa-eec1-4e10-bba0-f8bc964a74b4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:31:57.111402 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.111358    2582 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a25511aa-eec1-4e10-bba0-f8bc964a74b4-istio-kubeconfig\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:31:57.111402 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.111392    2582 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a25511aa-eec1-4e10-bba0-f8bc964a74b4-local-certs\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:31:57.111402 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.111401    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a25511aa-eec1-4e10-bba0-f8bc964a74b4-istio-token\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:31:57.111402 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.111410    2582 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a25511aa-eec1-4e10-bba0-f8bc964a74b4-istio-csr-ca-configmap\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:31:57.111668 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.111419    2582 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a25511aa-eec1-4e10-bba0-f8bc964a74b4-istio-csr-dns-cert\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:31:57.111668 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.111428    2582 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a25511aa-eec1-4e10-bba0-f8bc964a74b4-cacerts\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:31:57.111668 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.111436    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-scs9t\" (UniqueName: \"kubernetes.io/projected/a25511aa-eec1-4e10-bba0-f8bc964a74b4-kube-api-access-scs9t\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:31:57.583891 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.583859    2582 generic.go:356] "Generic (PLEG): container finished" podID="a25511aa-eec1-4e10-bba0-f8bc964a74b4" containerID="619e6dffc582f9a92e163fd2216a317aca373f3a62c102b9e8ebb32a9e8b4aeb" exitCode=0
Sep 15 11:31:57.584459 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.583912    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j"
Sep 15 11:31:57.584459 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.583946    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j" event={"ID":"a25511aa-eec1-4e10-bba0-f8bc964a74b4","Type":"ContainerDied","Data":"619e6dffc582f9a92e163fd2216a317aca373f3a62c102b9e8ebb32a9e8b4aeb"}
Sep 15 11:31:57.584459 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.583999    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j" event={"ID":"a25511aa-eec1-4e10-bba0-f8bc964a74b4","Type":"ContainerDied","Data":"db9bf25e6aae6a5a9db57346f8876b9fc3c210a4997bd117d8b6ec56c4e547a9"}
Sep 15 11:31:57.584459 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.584036    2582 scope.go:117] "RemoveContainer" containerID="619e6dffc582f9a92e163fd2216a317aca373f3a62c102b9e8ebb32a9e8b4aeb"
Sep 15 11:31:57.593353 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.593326    2582 scope.go:117] "RemoveContainer" containerID="619e6dffc582f9a92e163fd2216a317aca373f3a62c102b9e8ebb32a9e8b4aeb"
Sep 15 11:31:57.593637 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:31:57.593619    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"619e6dffc582f9a92e163fd2216a317aca373f3a62c102b9e8ebb32a9e8b4aeb\": container with ID starting with 619e6dffc582f9a92e163fd2216a317aca373f3a62c102b9e8ebb32a9e8b4aeb not found: ID does not exist" containerID="619e6dffc582f9a92e163fd2216a317aca373f3a62c102b9e8ebb32a9e8b4aeb"
Sep 15 11:31:57.593686 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.593644    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"619e6dffc582f9a92e163fd2216a317aca373f3a62c102b9e8ebb32a9e8b4aeb"} err="failed to get container status \"619e6dffc582f9a92e163fd2216a317aca373f3a62c102b9e8ebb32a9e8b4aeb\": rpc error: code = NotFound desc = could not find container \"619e6dffc582f9a92e163fd2216a317aca373f3a62c102b9e8ebb32a9e8b4aeb\": container with ID starting with 619e6dffc582f9a92e163fd2216a317aca373f3a62c102b9e8ebb32a9e8b4aeb not found: ID does not exist"
Sep 15 11:31:57.616339 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.616293    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j"]
Sep 15 11:31:57.622548 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.622521    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j"]
Sep 15 11:31:57.668701 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.668667    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9ttpp"]
Sep 15 11:31:57.668937 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.668927    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a25511aa-eec1-4e10-bba0-f8bc964a74b4" containerName="discovery"
Sep 15 11:31:57.668980 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.668939    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a25511aa-eec1-4e10-bba0-f8bc964a74b4" containerName="discovery"
Sep 15 11:31:57.669016 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.668986    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a25511aa-eec1-4e10-bba0-f8bc964a74b4" containerName="discovery"
Sep 15 11:31:57.673008 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.672988    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9ttpp"
Sep 15 11:31:57.675293 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.675267    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 15 11:31:57.675293 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.675286    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-z9hn6\""
Sep 15 11:31:57.683061 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.683038    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-rkl98"]
Sep 15 11:31:57.686270 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.686252    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9ttpp"]
Sep 15 11:31:57.686370 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.686333    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rkl98"
Sep 15 11:31:57.688556 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.688538    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 15 11:31:57.690461 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.690443    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-2h7j2\""
Sep 15 11:31:57.697293 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.697271    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-rkl98"]
Sep 15 11:31:57.817235 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.817161    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8sdx\" (UniqueName: \"kubernetes.io/projected/a09ce552-8d39-46c9-8636-4a4e660f35d4-kube-api-access-d8sdx\") pod \"kserve-controller-manager-d6f4b65b8-9ttpp\" (UID: \"a09ce552-8d39-46c9-8636-4a4e660f35d4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9ttpp"
Sep 15 11:31:57.817421 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.817279    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a09ce552-8d39-46c9-8636-4a4e660f35d4-cert\") pod \"kserve-controller-manager-d6f4b65b8-9ttpp\" (UID: \"a09ce552-8d39-46c9-8636-4a4e660f35d4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9ttpp"
Sep 15 11:31:57.817421 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.817310    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c49bde6-f1d3-4a2a-88cf-941b03a40cec-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rkl98\" (UID: \"5c49bde6-f1d3-4a2a-88cf-941b03a40cec\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rkl98"
Sep 15 11:31:57.817421 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.817359    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkr47\" (UniqueName: \"kubernetes.io/projected/5c49bde6-f1d3-4a2a-88cf-941b03a40cec-kube-api-access-bkr47\") pod \"llmisvc-controller-manager-777c6bd7d5-rkl98\" (UID: \"5c49bde6-f1d3-4a2a-88cf-941b03a40cec\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rkl98"
Sep 15 11:31:57.917827 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.917777    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkr47\" (UniqueName: \"kubernetes.io/projected/5c49bde6-f1d3-4a2a-88cf-941b03a40cec-kube-api-access-bkr47\") pod \"llmisvc-controller-manager-777c6bd7d5-rkl98\" (UID: \"5c49bde6-f1d3-4a2a-88cf-941b03a40cec\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rkl98"
Sep 15 11:31:57.917827 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.917837    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8sdx\" (UniqueName: \"kubernetes.io/projected/a09ce552-8d39-46c9-8636-4a4e660f35d4-kube-api-access-d8sdx\") pod \"kserve-controller-manager-d6f4b65b8-9ttpp\" (UID: \"a09ce552-8d39-46c9-8636-4a4e660f35d4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9ttpp"
Sep 15 11:31:57.918043 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.918011    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a09ce552-8d39-46c9-8636-4a4e660f35d4-cert\") pod \"kserve-controller-manager-d6f4b65b8-9ttpp\" (UID: \"a09ce552-8d39-46c9-8636-4a4e660f35d4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9ttpp"
Sep 15 11:31:57.918078 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.918048    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c49bde6-f1d3-4a2a-88cf-941b03a40cec-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rkl98\" (UID: \"5c49bde6-f1d3-4a2a-88cf-941b03a40cec\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rkl98"
Sep 15 11:31:57.918152 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:31:57.918125    2582 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 15 11:31:57.918222 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:31:57.918139    2582 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 15 11:31:57.918257 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:31:57.918243    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a09ce552-8d39-46c9-8636-4a4e660f35d4-cert podName:a09ce552-8d39-46c9-8636-4a4e660f35d4 nodeName:}" failed. No retries permitted until 2026-09-15 11:31:58.41822332 +0000 UTC m=+397.880089354 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a09ce552-8d39-46c9-8636-4a4e660f35d4-cert") pod "kserve-controller-manager-d6f4b65b8-9ttpp" (UID: "a09ce552-8d39-46c9-8636-4a4e660f35d4") : secret "kserve-webhook-server-cert" not found
Sep 15 11:31:57.918301 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:31:57.918259    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c49bde6-f1d3-4a2a-88cf-941b03a40cec-cert podName:5c49bde6-f1d3-4a2a-88cf-941b03a40cec nodeName:}" failed. No retries permitted until 2026-09-15 11:31:58.418252806 +0000 UTC m=+397.880118837 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5c49bde6-f1d3-4a2a-88cf-941b03a40cec-cert") pod "llmisvc-controller-manager-777c6bd7d5-rkl98" (UID: "5c49bde6-f1d3-4a2a-88cf-941b03a40cec") : secret "llmisvc-webhook-server-cert" not found
Sep 15 11:31:57.928548 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.928523    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8sdx\" (UniqueName: \"kubernetes.io/projected/a09ce552-8d39-46c9-8636-4a4e660f35d4-kube-api-access-d8sdx\") pod \"kserve-controller-manager-d6f4b65b8-9ttpp\" (UID: \"a09ce552-8d39-46c9-8636-4a4e660f35d4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9ttpp"
Sep 15 11:31:57.928668 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:57.928648    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkr47\" (UniqueName: \"kubernetes.io/projected/5c49bde6-f1d3-4a2a-88cf-941b03a40cec-kube-api-access-bkr47\") pod \"llmisvc-controller-manager-777c6bd7d5-rkl98\" (UID: \"5c49bde6-f1d3-4a2a-88cf-941b03a40cec\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rkl98"
Sep 15 11:31:58.422373 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:58.422336    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a09ce552-8d39-46c9-8636-4a4e660f35d4-cert\") pod \"kserve-controller-manager-d6f4b65b8-9ttpp\" (UID: \"a09ce552-8d39-46c9-8636-4a4e660f35d4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9ttpp"
Sep 15 11:31:58.422373 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:58.422377    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c49bde6-f1d3-4a2a-88cf-941b03a40cec-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rkl98\" (UID: \"5c49bde6-f1d3-4a2a-88cf-941b03a40cec\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rkl98"
Sep 15 11:31:58.425019 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:58.424988    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a09ce552-8d39-46c9-8636-4a4e660f35d4-cert\") pod \"kserve-controller-manager-d6f4b65b8-9ttpp\" (UID: \"a09ce552-8d39-46c9-8636-4a4e660f35d4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9ttpp"
Sep 15 11:31:58.425019 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:58.425002    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c49bde6-f1d3-4a2a-88cf-941b03a40cec-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rkl98\" (UID: \"5c49bde6-f1d3-4a2a-88cf-941b03a40cec\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rkl98"
Sep 15 11:31:58.583025 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:58.582984    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9ttpp"
Sep 15 11:31:58.595679 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:58.595655    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rkl98"
Sep 15 11:31:58.870758 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:58.870685    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9ttpp"]
Sep 15 11:31:58.873842 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:31:58.873811    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda09ce552_8d39_46c9_8636_4a4e660f35d4.slice/crio-ad0320a479311d2911ceb0d5aa66d2194cc308b5a2741bdeb3e848a01a34b437 WatchSource:0}: Error finding container ad0320a479311d2911ceb0d5aa66d2194cc308b5a2741bdeb3e848a01a34b437: Status 404 returned error can't find the container with id ad0320a479311d2911ceb0d5aa66d2194cc308b5a2741bdeb3e848a01a34b437
Sep 15 11:31:58.892354 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:58.892326    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-rkl98"]
Sep 15 11:31:58.895168 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:31:58.895138    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5c49bde6_f1d3_4a2a_88cf_941b03a40cec.slice/crio-9feec02d89444f0e68dec7a6305e619932affb25cff9457874c1dfce38c64ad4 WatchSource:0}: Error finding container 9feec02d89444f0e68dec7a6305e619932affb25cff9457874c1dfce38c64ad4: Status 404 returned error can't find the container with id 9feec02d89444f0e68dec7a6305e619932affb25cff9457874c1dfce38c64ad4
Sep 15 11:31:59.044006 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:59.043976    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a25511aa-eec1-4e10-bba0-f8bc964a74b4" path="/var/lib/kubelet/pods/a25511aa-eec1-4e10-bba0-f8bc964a74b4/volumes"
Sep 15 11:31:59.594768 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:59.594695    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rkl98" event={"ID":"5c49bde6-f1d3-4a2a-88cf-941b03a40cec","Type":"ContainerStarted","Data":"9feec02d89444f0e68dec7a6305e619932affb25cff9457874c1dfce38c64ad4"}
Sep 15 11:31:59.595888 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:31:59.595863    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9ttpp" event={"ID":"a09ce552-8d39-46c9-8636-4a4e660f35d4","Type":"ContainerStarted","Data":"ad0320a479311d2911ceb0d5aa66d2194cc308b5a2741bdeb3e848a01a34b437"}
Sep 15 11:32:02.610750 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:32:02.610708    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9ttpp" event={"ID":"a09ce552-8d39-46c9-8636-4a4e660f35d4","Type":"ContainerStarted","Data":"dc958a3672a4f71b14d057e89e7f31b8a2e86d5c9bf3f184fee28495add16023"}
Sep 15 11:32:02.611268 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:32:02.610968    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9ttpp"
Sep 15 11:32:02.612407 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:32:02.612384    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rkl98" event={"ID":"5c49bde6-f1d3-4a2a-88cf-941b03a40cec","Type":"ContainerStarted","Data":"18f2a0ba84d29fca59943fbfe989cc6836a21e5c632b6f3a71350f0d8455aabc"}
Sep 15 11:32:02.612608 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:32:02.612592    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rkl98"
Sep 15 11:32:02.630030 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:32:02.629979    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9ttpp" podStartSLOduration=2.5229854080000003 podStartE2EDuration="5.629964113s" totalImagesPullingTime="3.106978705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:31:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:32:02.628986412 +0000 UTC m=+402.090852466" watchObservedRunningTime="2026-09-15 11:32:02.629964113 +0000 UTC m=+402.091830178"
Sep 15 11:32:02.654589 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:32:02.654529    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rkl98" podStartSLOduration=2.570207918 podStartE2EDuration="5.654512447s" totalImagesPullingTime="3.084304529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:31:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:32:02.652336465 +0000 UTC m=+402.114202519" watchObservedRunningTime="2026-09-15 11:32:02.654512447 +0000 UTC m=+402.116378500"
Sep 15 11:32:33.618355 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:32:33.618323    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rkl98"
Sep 15 11:32:33.621360 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:32:33.621339    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9ttpp"
Sep 15 11:33:16.024993 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:33:16.024954    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ctrdh"]
Sep 15 11:33:16.027186 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:33:16.027157    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ctrdh"
Sep 15 11:33:16.033397 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:33:16.033109    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-lqr88\""
Sep 15 11:33:16.033397 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:33:16.033298    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 15 11:33:16.033397 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:33:16.033388    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 15 11:33:16.033801 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:33:16.033783    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 15 11:33:16.045931 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:33:16.045904    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ctrdh"]
Sep 15 11:33:16.201039 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:33:16.200988    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl5c2\" (UniqueName: \"kubernetes.io/projected/6d8ceef5-19b0-4e77-a5b5-76541dd78766-kube-api-access-zl5c2\") pod \"dns-operator-controller-manager-7b84cd7c9c-ctrdh\" (UID: \"6d8ceef5-19b0-4e77-a5b5-76541dd78766\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ctrdh"
Sep 15 11:33:16.301993 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:33:16.301899    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl5c2\" (UniqueName: \"kubernetes.io/projected/6d8ceef5-19b0-4e77-a5b5-76541dd78766-kube-api-access-zl5c2\") pod \"dns-operator-controller-manager-7b84cd7c9c-ctrdh\" (UID: \"6d8ceef5-19b0-4e77-a5b5-76541dd78766\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ctrdh"
Sep 15 11:33:16.311472 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:33:16.311447    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl5c2\" (UniqueName: \"kubernetes.io/projected/6d8ceef5-19b0-4e77-a5b5-76541dd78766-kube-api-access-zl5c2\") pod \"dns-operator-controller-manager-7b84cd7c9c-ctrdh\" (UID: \"6d8ceef5-19b0-4e77-a5b5-76541dd78766\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ctrdh"
Sep 15 11:33:16.336471 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:33:16.336439    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ctrdh"
Sep 15 11:33:16.606377 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:33:16.606297    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ctrdh"]
Sep 15 11:33:16.609441 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:33:16.609412    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d8ceef5_19b0_4e77_a5b5_76541dd78766.slice/crio-a6db6b9e6ce399f3743e4528aa771f3d781767e75ebb8c9f001e0a24142ba624 WatchSource:0}: Error finding container a6db6b9e6ce399f3743e4528aa771f3d781767e75ebb8c9f001e0a24142ba624: Status 404 returned error can't find the container with id a6db6b9e6ce399f3743e4528aa771f3d781767e75ebb8c9f001e0a24142ba624
Sep 15 11:33:16.914049 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:33:16.914013    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ctrdh" event={"ID":"6d8ceef5-19b0-4e77-a5b5-76541dd78766","Type":"ContainerStarted","Data":"a6db6b9e6ce399f3743e4528aa771f3d781767e75ebb8c9f001e0a24142ba624"}
Sep 15 11:33:19.928168 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:33:19.928135    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ctrdh" event={"ID":"6d8ceef5-19b0-4e77-a5b5-76541dd78766","Type":"ContainerStarted","Data":"352cabf244fb2739c0e612e90c271b027d1eb45209a02f399da087f532e5e48e"}
Sep 15 11:33:19.928589 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:33:19.928309    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ctrdh"
Sep 15 11:33:19.957094 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:33:19.957032    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ctrdh" podStartSLOduration=2.622426581 podStartE2EDuration="4.956993488s" totalImagesPullingTime="2.334566907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:33:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:33:19.956420255 +0000 UTC m=+479.418286309" watchObservedRunningTime="2026-09-15 11:33:19.956993488 +0000 UTC m=+479.418859541"
Sep 15 11:33:20.771527 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:33:20.771489    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-kmmpd"]
Sep 15 11:33:20.773860 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:33:20.773820    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-kmmpd"
Sep 15 11:33:20.776745 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:33:20.776719    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-7pq8l\""
Sep 15 11:33:20.791936 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:33:20.791912    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-kmmpd"]
Sep 15 11:33:20.942133 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:33:20.942094    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk58t\" (UniqueName: \"kubernetes.io/projected/d6e2a4e8-765f-4062-b864-598b9d15b6da-kube-api-access-fk58t\") pod \"authorino-operator-76b478bd78-kmmpd\" (UID: \"d6e2a4e8-765f-4062-b864-598b9d15b6da\") " pod="kuadrant-system/authorino-operator-76b478bd78-kmmpd"
Sep 15 11:33:21.042999 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:33:21.042906    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk58t\" (UniqueName: \"kubernetes.io/projected/d6e2a4e8-765f-4062-b864-598b9d15b6da-kube-api-access-fk58t\") pod \"authorino-operator-76b478bd78-kmmpd\" (UID: \"d6e2a4e8-765f-4062-b864-598b9d15b6da\") " pod="kuadrant-system/authorino-operator-76b478bd78-kmmpd"
Sep 15 11:33:21.051937 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:33:21.051906    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk58t\" (UniqueName: \"kubernetes.io/projected/d6e2a4e8-765f-4062-b864-598b9d15b6da-kube-api-access-fk58t\") pod \"authorino-operator-76b478bd78-kmmpd\" (UID: \"d6e2a4e8-765f-4062-b864-598b9d15b6da\") " pod="kuadrant-system/authorino-operator-76b478bd78-kmmpd"
Sep 15 11:33:21.087135 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:33:21.087104    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-7pq8l\""
Sep 15 11:33:21.095988 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:33:21.095968    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-kmmpd"
Sep 15 11:33:21.373128 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:33:21.373044    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-kmmpd"]
Sep 15 11:33:21.376292 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:33:21.376263    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6e2a4e8_765f_4062_b864_598b9d15b6da.slice/crio-a0ab520ffe888cd98b195d8a495e2cb533c523ccf1463181f944a22276fbb078 WatchSource:0}: Error finding container a0ab520ffe888cd98b195d8a495e2cb533c523ccf1463181f944a22276fbb078: Status 404 returned error can't find the container with id a0ab520ffe888cd98b195d8a495e2cb533c523ccf1463181f944a22276fbb078
Sep 15 11:33:21.937321 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:33:21.937288    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-kmmpd" event={"ID":"d6e2a4e8-765f-4062-b864-598b9d15b6da","Type":"ContainerStarted","Data":"a0ab520ffe888cd98b195d8a495e2cb533c523ccf1463181f944a22276fbb078"}
Sep 15 11:33:22.943260 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:33:22.943228    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-kmmpd" event={"ID":"d6e2a4e8-765f-4062-b864-598b9d15b6da","Type":"ContainerStarted","Data":"dacdf13b29e5d3f6f301ff4f1ff18e80e1944617efe64565ffd673c717ab11c4"}
Sep 15 11:33:22.943627 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:33:22.943355    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-kmmpd"
Sep 15 11:33:22.970656 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:33:22.970610    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-kmmpd" podStartSLOduration=1.801712619 podStartE2EDuration="2.970596114s" totalImagesPullingTime="1.168883495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:33:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:33:22.9694926 +0000 UTC m=+482.431358656" watchObservedRunningTime="2026-09-15 11:33:22.970596114 +0000 UTC m=+482.432462167"
Sep 15 11:33:30.934682 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:33:30.934646    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ctrdh"
Sep 15 11:33:33.951998 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:33:33.951966    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-kmmpd"
Sep 15 11:34:02.335667 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:02.335631    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-xl52b"]
Sep 15 11:34:02.338719 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:02.338701    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-xl52b"
Sep 15 11:34:02.340899 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:02.340871    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bvzzp\""
Sep 15 11:34:02.341028 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:02.340962    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 15 11:34:02.348764 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:02.348741    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-xl52b"]
Sep 15 11:34:02.440034 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:02.439995    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-xl52b"]
Sep 15 11:34:02.448095 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:02.448064    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/41f68784-f6a5-41fb-b7e5-893caa2c230b-config-file\") pod \"limitador-limitador-8588749977-xl52b\" (UID: \"41f68784-f6a5-41fb-b7e5-893caa2c230b\") " pod="kuadrant-system/limitador-limitador-8588749977-xl52b"
Sep 15 11:34:02.448289 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:02.448105    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg797\" (UniqueName: \"kubernetes.io/projected/41f68784-f6a5-41fb-b7e5-893caa2c230b-kube-api-access-kg797\") pod \"limitador-limitador-8588749977-xl52b\" (UID: \"41f68784-f6a5-41fb-b7e5-893caa2c230b\") " pod="kuadrant-system/limitador-limitador-8588749977-xl52b"
Sep 15 11:34:02.549324 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:02.549294    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/41f68784-f6a5-41fb-b7e5-893caa2c230b-config-file\") pod \"limitador-limitador-8588749977-xl52b\" (UID: \"41f68784-f6a5-41fb-b7e5-893caa2c230b\") " pod="kuadrant-system/limitador-limitador-8588749977-xl52b"
Sep 15 11:34:02.549324 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:02.549330    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg797\" (UniqueName: \"kubernetes.io/projected/41f68784-f6a5-41fb-b7e5-893caa2c230b-kube-api-access-kg797\") pod \"limitador-limitador-8588749977-xl52b\" (UID: \"41f68784-f6a5-41fb-b7e5-893caa2c230b\") " pod="kuadrant-system/limitador-limitador-8588749977-xl52b"
Sep 15 11:34:02.549864 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:02.549846    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/41f68784-f6a5-41fb-b7e5-893caa2c230b-config-file\") pod \"limitador-limitador-8588749977-xl52b\" (UID: \"41f68784-f6a5-41fb-b7e5-893caa2c230b\") " pod="kuadrant-system/limitador-limitador-8588749977-xl52b"
Sep 15 11:34:02.566977 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:02.566948    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg797\" (UniqueName: \"kubernetes.io/projected/41f68784-f6a5-41fb-b7e5-893caa2c230b-kube-api-access-kg797\") pod \"limitador-limitador-8588749977-xl52b\" (UID: \"41f68784-f6a5-41fb-b7e5-893caa2c230b\") " pod="kuadrant-system/limitador-limitador-8588749977-xl52b"
Sep 15 11:34:02.648501 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:02.648462    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-xl52b"
Sep 15 11:34:02.926964 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:02.926893    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-xl52b"]
Sep 15 11:34:02.931047 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:34:02.931020    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41f68784_f6a5_41fb_b7e5_893caa2c230b.slice/crio-c9b6e1fd0d736167e8d283567f83edeb996899d1227652bbe55b348f4bc53734 WatchSource:0}: Error finding container c9b6e1fd0d736167e8d283567f83edeb996899d1227652bbe55b348f4bc53734: Status 404 returned error can't find the container with id c9b6e1fd0d736167e8d283567f83edeb996899d1227652bbe55b348f4bc53734
Sep 15 11:34:03.109701 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:03.109668    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-xl52b" event={"ID":"41f68784-f6a5-41fb-b7e5-893caa2c230b","Type":"ContainerStarted","Data":"c9b6e1fd0d736167e8d283567f83edeb996899d1227652bbe55b348f4bc53734"}
Sep 15 11:34:04.116101 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:04.116061    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-xl52b" event={"ID":"41f68784-f6a5-41fb-b7e5-893caa2c230b","Type":"ContainerStarted","Data":"5b8699eec2c02e3aa4ed03fc5ad508544344214df606429b12679335c3062232"}
Sep 15 11:34:04.116499 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:04.116218    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-xl52b"
Sep 15 11:34:15.120557 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:15.120475    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-xl52b"
Sep 15 11:34:15.138375 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:15.138324    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-xl52b" podStartSLOduration=12.026073988 podStartE2EDuration="13.138305938s" totalImagesPullingTime="1.11223195s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:34:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:34:04.136434129 +0000 UTC m=+523.598300196" watchObservedRunningTime="2026-09-15 11:34:15.138305938 +0000 UTC m=+534.600171990"
Sep 15 11:34:15.410213 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:15.410161    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-xl52b"]
Sep 15 11:34:15.410442 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:15.410394    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-xl52b" podUID="41f68784-f6a5-41fb-b7e5-893caa2c230b" containerName="limitador" containerID="cri-o://5b8699eec2c02e3aa4ed03fc5ad508544344214df606429b12679335c3062232" gracePeriod=30
Sep 15 11:34:15.944742 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:15.944715    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-xl52b"
Sep 15 11:34:16.064722 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:16.064642    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kg797\" (UniqueName: \"kubernetes.io/projected/41f68784-f6a5-41fb-b7e5-893caa2c230b-kube-api-access-kg797\") pod \"41f68784-f6a5-41fb-b7e5-893caa2c230b\" (UID: \"41f68784-f6a5-41fb-b7e5-893caa2c230b\") "
Sep 15 11:34:16.064722 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:16.064698    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/41f68784-f6a5-41fb-b7e5-893caa2c230b-config-file\") pod \"41f68784-f6a5-41fb-b7e5-893caa2c230b\" (UID: \"41f68784-f6a5-41fb-b7e5-893caa2c230b\") "
Sep 15 11:34:16.065102 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:16.065064    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41f68784-f6a5-41fb-b7e5-893caa2c230b-config-file" (OuterVolumeSpecName: "config-file") pod "41f68784-f6a5-41fb-b7e5-893caa2c230b" (UID: "41f68784-f6a5-41fb-b7e5-893caa2c230b"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:34:16.067018 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:16.066994    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41f68784-f6a5-41fb-b7e5-893caa2c230b-kube-api-access-kg797" (OuterVolumeSpecName: "kube-api-access-kg797") pod "41f68784-f6a5-41fb-b7e5-893caa2c230b" (UID: "41f68784-f6a5-41fb-b7e5-893caa2c230b"). InnerVolumeSpecName "kube-api-access-kg797". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:34:16.165299 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:16.165269    2582 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/41f68784-f6a5-41fb-b7e5-893caa2c230b-config-file\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:34:16.165299 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:16.165294    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kg797\" (UniqueName: \"kubernetes.io/projected/41f68784-f6a5-41fb-b7e5-893caa2c230b-kube-api-access-kg797\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:34:16.168601 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:16.168571    2582 generic.go:356] "Generic (PLEG): container finished" podID="41f68784-f6a5-41fb-b7e5-893caa2c230b" containerID="5b8699eec2c02e3aa4ed03fc5ad508544344214df606429b12679335c3062232" exitCode=0
Sep 15 11:34:16.168718 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:16.168615    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-xl52b"
Sep 15 11:34:16.168718 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:16.168665    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-xl52b" event={"ID":"41f68784-f6a5-41fb-b7e5-893caa2c230b","Type":"ContainerDied","Data":"5b8699eec2c02e3aa4ed03fc5ad508544344214df606429b12679335c3062232"}
Sep 15 11:34:16.168718 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:16.168712    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-xl52b" event={"ID":"41f68784-f6a5-41fb-b7e5-893caa2c230b","Type":"ContainerDied","Data":"c9b6e1fd0d736167e8d283567f83edeb996899d1227652bbe55b348f4bc53734"}
Sep 15 11:34:16.168823 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:16.168733    2582 scope.go:117] "RemoveContainer" containerID="5b8699eec2c02e3aa4ed03fc5ad508544344214df606429b12679335c3062232"
Sep 15 11:34:16.177792 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:16.177774    2582 scope.go:117] "RemoveContainer" containerID="5b8699eec2c02e3aa4ed03fc5ad508544344214df606429b12679335c3062232"
Sep 15 11:34:16.178050 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:34:16.178030    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b8699eec2c02e3aa4ed03fc5ad508544344214df606429b12679335c3062232\": container with ID starting with 5b8699eec2c02e3aa4ed03fc5ad508544344214df606429b12679335c3062232 not found: ID does not exist" containerID="5b8699eec2c02e3aa4ed03fc5ad508544344214df606429b12679335c3062232"
Sep 15 11:34:16.178113 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:16.178063    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b8699eec2c02e3aa4ed03fc5ad508544344214df606429b12679335c3062232"} err="failed to get container status \"5b8699eec2c02e3aa4ed03fc5ad508544344214df606429b12679335c3062232\": rpc error: code = NotFound desc = could not find container \"5b8699eec2c02e3aa4ed03fc5ad508544344214df606429b12679335c3062232\": container with ID starting with 5b8699eec2c02e3aa4ed03fc5ad508544344214df606429b12679335c3062232 not found: ID does not exist"
Sep 15 11:34:16.188435 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:16.188412    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-xl52b"]
Sep 15 11:34:16.192290 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:16.192268    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-xl52b"]
Sep 15 11:34:17.044865 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:17.044832    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41f68784-f6a5-41fb-b7e5-893caa2c230b" path="/var/lib/kubelet/pods/41f68784-f6a5-41fb-b7e5-893caa2c230b/volumes"
Sep 15 11:34:18.883834 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:18.883801    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-nrlw6"]
Sep 15 11:34:18.884297 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:18.884151    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41f68784-f6a5-41fb-b7e5-893caa2c230b" containerName="limitador"
Sep 15 11:34:18.884297 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:18.884165    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="41f68784-f6a5-41fb-b7e5-893caa2c230b" containerName="limitador"
Sep 15 11:34:18.884297 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:18.884247    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="41f68784-f6a5-41fb-b7e5-893caa2c230b" containerName="limitador"
Sep 15 11:34:18.888745 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:18.888729    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nrlw6"
Sep 15 11:34:18.891063 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:18.891040    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 11:34:18.891063 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:18.891062    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-gs8gz\""
Sep 15 11:34:18.891240 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:18.891195    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 11:34:18.891818 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:18.891800    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 15 11:34:18.897230 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:18.897211    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-nrlw6"]
Sep 15 11:34:18.986801 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:18.986769    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/962add8e-530f-4c89-a7e3-38016c28de49-data\") pod \"postgres-69fb4594cf-nrlw6\" (UID: \"962add8e-530f-4c89-a7e3-38016c28de49\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-nrlw6"
Sep 15 11:34:18.986960 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:18.986808    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl7hj\" (UniqueName: \"kubernetes.io/projected/962add8e-530f-4c89-a7e3-38016c28de49-kube-api-access-vl7hj\") pod \"postgres-69fb4594cf-nrlw6\" (UID: \"962add8e-530f-4c89-a7e3-38016c28de49\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-nrlw6"
Sep 15 11:34:19.087446 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:19.087406    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/962add8e-530f-4c89-a7e3-38016c28de49-data\") pod \"postgres-69fb4594cf-nrlw6\" (UID: \"962add8e-530f-4c89-a7e3-38016c28de49\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-nrlw6"
Sep 15 11:34:19.087446 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:19.087458    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl7hj\" (UniqueName: \"kubernetes.io/projected/962add8e-530f-4c89-a7e3-38016c28de49-kube-api-access-vl7hj\") pod \"postgres-69fb4594cf-nrlw6\" (UID: \"962add8e-530f-4c89-a7e3-38016c28de49\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-nrlw6"
Sep 15 11:34:19.087811 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:19.087790    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/962add8e-530f-4c89-a7e3-38016c28de49-data\") pod \"postgres-69fb4594cf-nrlw6\" (UID: \"962add8e-530f-4c89-a7e3-38016c28de49\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-nrlw6"
Sep 15 11:34:19.096332 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:19.096306    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl7hj\" (UniqueName: \"kubernetes.io/projected/962add8e-530f-4c89-a7e3-38016c28de49-kube-api-access-vl7hj\") pod \"postgres-69fb4594cf-nrlw6\" (UID: \"962add8e-530f-4c89-a7e3-38016c28de49\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-nrlw6"
Sep 15 11:34:19.199453 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:19.199355    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nrlw6"
Sep 15 11:34:19.469642 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:19.469443    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-nrlw6"]
Sep 15 11:34:19.472286 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:34:19.472260    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod962add8e_530f_4c89_a7e3_38016c28de49.slice/crio-b51fbeb508f73d174212c630a188af2bfaa2d471809a9fc80162470ae0de9248 WatchSource:0}: Error finding container b51fbeb508f73d174212c630a188af2bfaa2d471809a9fc80162470ae0de9248: Status 404 returned error can't find the container with id b51fbeb508f73d174212c630a188af2bfaa2d471809a9fc80162470ae0de9248
Sep 15 11:34:20.192726 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:20.192612    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nrlw6" event={"ID":"962add8e-530f-4c89-a7e3-38016c28de49","Type":"ContainerStarted","Data":"b51fbeb508f73d174212c630a188af2bfaa2d471809a9fc80162470ae0de9248"}
Sep 15 11:34:24.116289 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:24.116269    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 15 11:34:24.212775 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:24.212740    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nrlw6" event={"ID":"962add8e-530f-4c89-a7e3-38016c28de49","Type":"ContainerStarted","Data":"06e1f5bdedb624dda7ee6848c46374facd77cebe91958884860b2e0c3e144381"}
Sep 15 11:34:24.212982 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:24.212835    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nrlw6"
Sep 15 11:34:24.228092 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:24.228022    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nrlw6" podStartSLOduration=1.587875629 podStartE2EDuration="6.228004629s" totalImagesPullingTime="4.640129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:34:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:34:24.227800859 +0000 UTC m=+543.689666914" watchObservedRunningTime="2026-09-15 11:34:24.228004629 +0000 UTC m=+543.689870683"
Sep 15 11:34:30.246167 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:30.246140    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nrlw6"
Sep 15 11:34:38.090602 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:38.090204    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-684d4b58f5-99jnp"]
Sep 15 11:34:38.109889 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:38.109860    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-684d4b58f5-99jnp"]
Sep 15 11:34:38.110033 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:38.109953    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-684d4b58f5-99jnp"
Sep 15 11:34:38.112280 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:38.112216    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 15 11:34:38.112415 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:38.112220    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w7hxh\""
Sep 15 11:34:38.112897 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:38.112879    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 15 11:34:38.112987 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:38.112882    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 15 11:34:38.256251 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:38.256217    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mml6h\" (UniqueName: \"kubernetes.io/projected/8062336b-e4c9-40e4-9af1-940114bcdcfc-kube-api-access-mml6h\") pod \"maas-controller-684d4b58f5-99jnp\" (UID: \"8062336b-e4c9-40e4-9af1-940114bcdcfc\") " pod="opendatahub/maas-controller-684d4b58f5-99jnp"
Sep 15 11:34:38.256417 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:38.256282    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8062336b-e4c9-40e4-9af1-940114bcdcfc-webhook-cert\") pod \"maas-controller-684d4b58f5-99jnp\" (UID: \"8062336b-e4c9-40e4-9af1-940114bcdcfc\") " pod="opendatahub/maas-controller-684d4b58f5-99jnp"
Sep 15 11:34:38.256417 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:38.256333    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8062336b-e4c9-40e4-9af1-940114bcdcfc-metrics-certs\") pod \"maas-controller-684d4b58f5-99jnp\" (UID: \"8062336b-e4c9-40e4-9af1-940114bcdcfc\") " pod="opendatahub/maas-controller-684d4b58f5-99jnp"
Sep 15 11:34:38.261117 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:38.261090    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-84f7f65f89-w8k9f"]
Sep 15 11:34:38.263550 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:38.263534    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84f7f65f89-w8k9f"
Sep 15 11:34:38.274893 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:38.274867    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84f7f65f89-w8k9f"]
Sep 15 11:34:38.356888 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:38.356789    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8062336b-e4c9-40e4-9af1-940114bcdcfc-metrics-certs\") pod \"maas-controller-684d4b58f5-99jnp\" (UID: \"8062336b-e4c9-40e4-9af1-940114bcdcfc\") " pod="opendatahub/maas-controller-684d4b58f5-99jnp"
Sep 15 11:34:38.356888 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:38.356845    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mml6h\" (UniqueName: \"kubernetes.io/projected/8062336b-e4c9-40e4-9af1-940114bcdcfc-kube-api-access-mml6h\") pod \"maas-controller-684d4b58f5-99jnp\" (UID: \"8062336b-e4c9-40e4-9af1-940114bcdcfc\") " pod="opendatahub/maas-controller-684d4b58f5-99jnp"
Sep 15 11:34:38.357091 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:38.356922    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8062336b-e4c9-40e4-9af1-940114bcdcfc-webhook-cert\") pod \"maas-controller-684d4b58f5-99jnp\" (UID: \"8062336b-e4c9-40e4-9af1-940114bcdcfc\") " pod="opendatahub/maas-controller-684d4b58f5-99jnp"
Sep 15 11:34:38.359795 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:38.359761    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8062336b-e4c9-40e4-9af1-940114bcdcfc-metrics-certs\") pod \"maas-controller-684d4b58f5-99jnp\" (UID: \"8062336b-e4c9-40e4-9af1-940114bcdcfc\") " pod="opendatahub/maas-controller-684d4b58f5-99jnp"
Sep 15 11:34:38.359943 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:38.359845    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8062336b-e4c9-40e4-9af1-940114bcdcfc-webhook-cert\") pod \"maas-controller-684d4b58f5-99jnp\" (UID: \"8062336b-e4c9-40e4-9af1-940114bcdcfc\") " pod="opendatahub/maas-controller-684d4b58f5-99jnp"
Sep 15 11:34:38.368704 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:38.368677    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mml6h\" (UniqueName: \"kubernetes.io/projected/8062336b-e4c9-40e4-9af1-940114bcdcfc-kube-api-access-mml6h\") pod \"maas-controller-684d4b58f5-99jnp\" (UID: \"8062336b-e4c9-40e4-9af1-940114bcdcfc\") " pod="opendatahub/maas-controller-684d4b58f5-99jnp"
Sep 15 11:34:38.420609 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:38.420575    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-684d4b58f5-99jnp"
Sep 15 11:34:38.457962 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:38.457927    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fxmg\" (UniqueName: \"kubernetes.io/projected/b46fa9f1-352a-42e7-a11e-5c3619643249-kube-api-access-8fxmg\") pod \"maas-controller-84f7f65f89-w8k9f\" (UID: \"b46fa9f1-352a-42e7-a11e-5c3619643249\") " pod="opendatahub/maas-controller-84f7f65f89-w8k9f"
Sep 15 11:34:38.458098 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:38.458011    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b46fa9f1-352a-42e7-a11e-5c3619643249-metrics-certs\") pod \"maas-controller-84f7f65f89-w8k9f\" (UID: \"b46fa9f1-352a-42e7-a11e-5c3619643249\") " pod="opendatahub/maas-controller-84f7f65f89-w8k9f"
Sep 15 11:34:38.458098 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:38.458034    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b46fa9f1-352a-42e7-a11e-5c3619643249-webhook-cert\") pod \"maas-controller-84f7f65f89-w8k9f\" (UID: \"b46fa9f1-352a-42e7-a11e-5c3619643249\") " pod="opendatahub/maas-controller-84f7f65f89-w8k9f"
Sep 15 11:34:38.558871 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:38.558828    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b46fa9f1-352a-42e7-a11e-5c3619643249-webhook-cert\") pod \"maas-controller-84f7f65f89-w8k9f\" (UID: \"b46fa9f1-352a-42e7-a11e-5c3619643249\") " pod="opendatahub/maas-controller-84f7f65f89-w8k9f"
Sep 15 11:34:38.559027 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:38.558891    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fxmg\" (UniqueName: \"kubernetes.io/projected/b46fa9f1-352a-42e7-a11e-5c3619643249-kube-api-access-8fxmg\") pod \"maas-controller-84f7f65f89-w8k9f\" (UID: \"b46fa9f1-352a-42e7-a11e-5c3619643249\") " pod="opendatahub/maas-controller-84f7f65f89-w8k9f"
Sep 15 11:34:38.559027 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:38.558949    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b46fa9f1-352a-42e7-a11e-5c3619643249-metrics-certs\") pod \"maas-controller-84f7f65f89-w8k9f\" (UID: \"b46fa9f1-352a-42e7-a11e-5c3619643249\") " pod="opendatahub/maas-controller-84f7f65f89-w8k9f"
Sep 15 11:34:38.561487 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:38.561457    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b46fa9f1-352a-42e7-a11e-5c3619643249-metrics-certs\") pod \"maas-controller-84f7f65f89-w8k9f\" (UID: \"b46fa9f1-352a-42e7-a11e-5c3619643249\") " pod="opendatahub/maas-controller-84f7f65f89-w8k9f"
Sep 15 11:34:38.561597 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:38.561502    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b46fa9f1-352a-42e7-a11e-5c3619643249-webhook-cert\") pod \"maas-controller-84f7f65f89-w8k9f\" (UID: \"b46fa9f1-352a-42e7-a11e-5c3619643249\") " pod="opendatahub/maas-controller-84f7f65f89-w8k9f"
Sep 15 11:34:38.568229 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:38.568212    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fxmg\" (UniqueName: \"kubernetes.io/projected/b46fa9f1-352a-42e7-a11e-5c3619643249-kube-api-access-8fxmg\") pod \"maas-controller-84f7f65f89-w8k9f\" (UID: \"b46fa9f1-352a-42e7-a11e-5c3619643249\") " pod="opendatahub/maas-controller-84f7f65f89-w8k9f"
Sep 15 11:34:38.574064 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:38.574045    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84f7f65f89-w8k9f"
Sep 15 11:34:38.694700 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:38.694672    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-684d4b58f5-99jnp"]
Sep 15 11:34:38.697385 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:34:38.697355    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8062336b_e4c9_40e4_9af1_940114bcdcfc.slice/crio-89dcd77d4fec6b0e0fbc8fd6e86ab15833616b6440af1d0f318f0499227a4671 WatchSource:0}: Error finding container 89dcd77d4fec6b0e0fbc8fd6e86ab15833616b6440af1d0f318f0499227a4671: Status 404 returned error can't find the container with id 89dcd77d4fec6b0e0fbc8fd6e86ab15833616b6440af1d0f318f0499227a4671
Sep 15 11:34:38.849582 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:38.849556    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84f7f65f89-w8k9f"]
Sep 15 11:34:38.851824 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:34:38.851791    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb46fa9f1_352a_42e7_a11e_5c3619643249.slice/crio-4a1ce94797bb5c18a01819b314c1c4c625e69e86b174f8ce1d614a6c69bcdca4 WatchSource:0}: Error finding container 4a1ce94797bb5c18a01819b314c1c4c625e69e86b174f8ce1d614a6c69bcdca4: Status 404 returned error can't find the container with id 4a1ce94797bb5c18a01819b314c1c4c625e69e86b174f8ce1d614a6c69bcdca4
Sep 15 11:34:39.278881 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:39.278831    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84f7f65f89-w8k9f" event={"ID":"b46fa9f1-352a-42e7-a11e-5c3619643249","Type":"ContainerStarted","Data":"4a1ce94797bb5c18a01819b314c1c4c625e69e86b174f8ce1d614a6c69bcdca4"}
Sep 15 11:34:39.280524 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:39.280494    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-684d4b58f5-99jnp" event={"ID":"8062336b-e4c9-40e4-9af1-940114bcdcfc","Type":"ContainerStarted","Data":"89dcd77d4fec6b0e0fbc8fd6e86ab15833616b6440af1d0f318f0499227a4671"}
Sep 15 11:34:42.296542 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:42.296505    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84f7f65f89-w8k9f" event={"ID":"b46fa9f1-352a-42e7-a11e-5c3619643249","Type":"ContainerStarted","Data":"b76e972ba05b18ecfc0ae5974cc89372b4e58f21992a6581495a46f725eea06e"}
Sep 15 11:34:42.296972 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:42.296627    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-84f7f65f89-w8k9f"
Sep 15 11:34:42.298227 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:42.298202    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-684d4b58f5-99jnp" event={"ID":"8062336b-e4c9-40e4-9af1-940114bcdcfc","Type":"ContainerStarted","Data":"4cae7b3e642ba5a3f78d08b7b30d40f65cd178d251fb4faea2cb364f7fe60a8c"}
Sep 15 11:34:42.298344 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:42.298326    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-684d4b58f5-99jnp"
Sep 15 11:34:42.315983 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:42.315929    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-84f7f65f89-w8k9f" podStartSLOduration=1.833989403 podStartE2EDuration="4.315915656s" totalImagesPullingTime="2.481926253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:34:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:34:42.314491285 +0000 UTC m=+561.776357356" watchObservedRunningTime="2026-09-15 11:34:42.315915656 +0000 UTC m=+561.777781702"
Sep 15 11:34:53.305000 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:53.304963    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-84f7f65f89-w8k9f"
Sep 15 11:34:53.305469 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:53.305101    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-684d4b58f5-99jnp"
Sep 15 11:34:53.323502 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:53.323451    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-684d4b58f5-99jnp" podStartSLOduration=12.695875451 podStartE2EDuration="15.323436099s" totalImagesPullingTime="2.627560648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:34:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:34:42.336675459 +0000 UTC m=+561.798541514" watchObservedRunningTime="2026-09-15 11:34:53.323436099 +0000 UTC m=+572.785302160"
Sep 15 11:34:53.372208 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:53.372148    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-684d4b58f5-99jnp"]
Sep 15 11:34:53.372472 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:53.372441    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-684d4b58f5-99jnp" podUID="8062336b-e4c9-40e4-9af1-940114bcdcfc" containerName="manager" containerID="cri-o://4cae7b3e642ba5a3f78d08b7b30d40f65cd178d251fb4faea2cb364f7fe60a8c" gracePeriod=30
Sep 15 11:34:53.610866 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:53.610842    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-684d4b58f5-99jnp"
Sep 15 11:34:53.674414 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:53.674385    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8062336b-e4c9-40e4-9af1-940114bcdcfc-webhook-cert\") pod \"8062336b-e4c9-40e4-9af1-940114bcdcfc\" (UID: \"8062336b-e4c9-40e4-9af1-940114bcdcfc\") "
Sep 15 11:34:53.674584 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:53.674434    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8062336b-e4c9-40e4-9af1-940114bcdcfc-metrics-certs\") pod \"8062336b-e4c9-40e4-9af1-940114bcdcfc\" (UID: \"8062336b-e4c9-40e4-9af1-940114bcdcfc\") "
Sep 15 11:34:53.674584 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:53.674480    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mml6h\" (UniqueName: \"kubernetes.io/projected/8062336b-e4c9-40e4-9af1-940114bcdcfc-kube-api-access-mml6h\") pod \"8062336b-e4c9-40e4-9af1-940114bcdcfc\" (UID: \"8062336b-e4c9-40e4-9af1-940114bcdcfc\") "
Sep 15 11:34:53.676760 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:53.676730    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8062336b-e4c9-40e4-9af1-940114bcdcfc-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8062336b-e4c9-40e4-9af1-940114bcdcfc" (UID: "8062336b-e4c9-40e4-9af1-940114bcdcfc"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:34:53.676875 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:53.676759    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8062336b-e4c9-40e4-9af1-940114bcdcfc-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8062336b-e4c9-40e4-9af1-940114bcdcfc" (UID: "8062336b-e4c9-40e4-9af1-940114bcdcfc"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:34:53.676875 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:53.676848    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8062336b-e4c9-40e4-9af1-940114bcdcfc-kube-api-access-mml6h" (OuterVolumeSpecName: "kube-api-access-mml6h") pod "8062336b-e4c9-40e4-9af1-940114bcdcfc" (UID: "8062336b-e4c9-40e4-9af1-940114bcdcfc"). InnerVolumeSpecName "kube-api-access-mml6h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:34:53.775425 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:53.775389    2582 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8062336b-e4c9-40e4-9af1-940114bcdcfc-webhook-cert\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:34:53.775425 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:53.775419    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8062336b-e4c9-40e4-9af1-940114bcdcfc-metrics-certs\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:34:53.775425 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:53.775429    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mml6h\" (UniqueName: \"kubernetes.io/projected/8062336b-e4c9-40e4-9af1-940114bcdcfc-kube-api-access-mml6h\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:34:54.348427 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:54.348390    2582 generic.go:356] "Generic (PLEG): container finished" podID="8062336b-e4c9-40e4-9af1-940114bcdcfc" containerID="4cae7b3e642ba5a3f78d08b7b30d40f65cd178d251fb4faea2cb364f7fe60a8c" exitCode=0
Sep 15 11:34:54.348902 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:54.348436    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-684d4b58f5-99jnp"
Sep 15 11:34:54.348902 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:54.348466    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-684d4b58f5-99jnp" event={"ID":"8062336b-e4c9-40e4-9af1-940114bcdcfc","Type":"ContainerDied","Data":"4cae7b3e642ba5a3f78d08b7b30d40f65cd178d251fb4faea2cb364f7fe60a8c"}
Sep 15 11:34:54.348902 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:54.348515    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-684d4b58f5-99jnp" event={"ID":"8062336b-e4c9-40e4-9af1-940114bcdcfc","Type":"ContainerDied","Data":"89dcd77d4fec6b0e0fbc8fd6e86ab15833616b6440af1d0f318f0499227a4671"}
Sep 15 11:34:54.348902 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:54.348536    2582 scope.go:117] "RemoveContainer" containerID="4cae7b3e642ba5a3f78d08b7b30d40f65cd178d251fb4faea2cb364f7fe60a8c"
Sep 15 11:34:54.356861 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:54.356842    2582 scope.go:117] "RemoveContainer" containerID="4cae7b3e642ba5a3f78d08b7b30d40f65cd178d251fb4faea2cb364f7fe60a8c"
Sep 15 11:34:54.357127 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:34:54.357108    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cae7b3e642ba5a3f78d08b7b30d40f65cd178d251fb4faea2cb364f7fe60a8c\": container with ID starting with 4cae7b3e642ba5a3f78d08b7b30d40f65cd178d251fb4faea2cb364f7fe60a8c not found: ID does not exist" containerID="4cae7b3e642ba5a3f78d08b7b30d40f65cd178d251fb4faea2cb364f7fe60a8c"
Sep 15 11:34:54.357213 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:54.357138    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cae7b3e642ba5a3f78d08b7b30d40f65cd178d251fb4faea2cb364f7fe60a8c"} err="failed to get container status \"4cae7b3e642ba5a3f78d08b7b30d40f65cd178d251fb4faea2cb364f7fe60a8c\": rpc error: code = NotFound desc = could not find container \"4cae7b3e642ba5a3f78d08b7b30d40f65cd178d251fb4faea2cb364f7fe60a8c\": container with ID starting with 4cae7b3e642ba5a3f78d08b7b30d40f65cd178d251fb4faea2cb364f7fe60a8c not found: ID does not exist"
Sep 15 11:34:54.368696 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:54.368673    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-684d4b58f5-99jnp"]
Sep 15 11:34:54.372420 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:54.372401    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-684d4b58f5-99jnp"]
Sep 15 11:34:55.045032 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:34:55.044997    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8062336b-e4c9-40e4-9af1-940114bcdcfc" path="/var/lib/kubelet/pods/8062336b-e4c9-40e4-9af1-940114bcdcfc/volumes"
Sep 15 11:35:17.175317 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:17.175277    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-9fb85669f-gspbg"]
Sep 15 11:35:17.175750 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:17.175584    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8062336b-e4c9-40e4-9af1-940114bcdcfc" containerName="manager"
Sep 15 11:35:17.175750 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:17.175594    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8062336b-e4c9-40e4-9af1-940114bcdcfc" containerName="manager"
Sep 15 11:35:17.175750 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:17.175652    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8062336b-e4c9-40e4-9af1-940114bcdcfc" containerName="manager"
Sep 15 11:35:17.181654 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:17.181630    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-9fb85669f-gspbg"
Sep 15 11:35:17.185307 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:17.185280    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 15 11:35:17.185457 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:17.185284    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 15 11:35:17.185457 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:17.185382    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-x24k9\""
Sep 15 11:35:17.194746 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:17.194725    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-9fb85669f-gspbg"]
Sep 15 11:35:17.251672 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:17.251643    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6md9d\" (UniqueName: \"kubernetes.io/projected/484f8c91-969e-4c57-bf18-1213c48cd1d7-kube-api-access-6md9d\") pod \"maas-api-9fb85669f-gspbg\" (UID: \"484f8c91-969e-4c57-bf18-1213c48cd1d7\") " pod="odh-ai-gateway-infra/maas-api-9fb85669f-gspbg"
Sep 15 11:35:17.251840 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:17.251684    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/484f8c91-969e-4c57-bf18-1213c48cd1d7-maas-api-tls\") pod \"maas-api-9fb85669f-gspbg\" (UID: \"484f8c91-969e-4c57-bf18-1213c48cd1d7\") " pod="odh-ai-gateway-infra/maas-api-9fb85669f-gspbg"
Sep 15 11:35:17.251840 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:17.251747    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/484f8c91-969e-4c57-bf18-1213c48cd1d7-openshift-service-ca\") pod \"maas-api-9fb85669f-gspbg\" (UID: \"484f8c91-969e-4c57-bf18-1213c48cd1d7\") " pod="odh-ai-gateway-infra/maas-api-9fb85669f-gspbg"
Sep 15 11:35:17.251840 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:17.251792    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/484f8c91-969e-4c57-bf18-1213c48cd1d7-metrics-certs\") pod \"maas-api-9fb85669f-gspbg\" (UID: \"484f8c91-969e-4c57-bf18-1213c48cd1d7\") " pod="odh-ai-gateway-infra/maas-api-9fb85669f-gspbg"
Sep 15 11:35:17.352834 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:17.352801    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/484f8c91-969e-4c57-bf18-1213c48cd1d7-metrics-certs\") pod \"maas-api-9fb85669f-gspbg\" (UID: \"484f8c91-969e-4c57-bf18-1213c48cd1d7\") " pod="odh-ai-gateway-infra/maas-api-9fb85669f-gspbg"
Sep 15 11:35:17.353006 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:17.352865    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6md9d\" (UniqueName: \"kubernetes.io/projected/484f8c91-969e-4c57-bf18-1213c48cd1d7-kube-api-access-6md9d\") pod \"maas-api-9fb85669f-gspbg\" (UID: \"484f8c91-969e-4c57-bf18-1213c48cd1d7\") " pod="odh-ai-gateway-infra/maas-api-9fb85669f-gspbg"
Sep 15 11:35:17.353006 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:17.352892    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/484f8c91-969e-4c57-bf18-1213c48cd1d7-maas-api-tls\") pod \"maas-api-9fb85669f-gspbg\" (UID: \"484f8c91-969e-4c57-bf18-1213c48cd1d7\") " pod="odh-ai-gateway-infra/maas-api-9fb85669f-gspbg"
Sep 15 11:35:17.353006 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:17.352917    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/484f8c91-969e-4c57-bf18-1213c48cd1d7-openshift-service-ca\") pod \"maas-api-9fb85669f-gspbg\" (UID: \"484f8c91-969e-4c57-bf18-1213c48cd1d7\") " pod="odh-ai-gateway-infra/maas-api-9fb85669f-gspbg"
Sep 15 11:35:17.353571 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:17.353550    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/484f8c91-969e-4c57-bf18-1213c48cd1d7-openshift-service-ca\") pod \"maas-api-9fb85669f-gspbg\" (UID: \"484f8c91-969e-4c57-bf18-1213c48cd1d7\") " pod="odh-ai-gateway-infra/maas-api-9fb85669f-gspbg"
Sep 15 11:35:17.355521 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:17.355496    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/484f8c91-969e-4c57-bf18-1213c48cd1d7-metrics-certs\") pod \"maas-api-9fb85669f-gspbg\" (UID: \"484f8c91-969e-4c57-bf18-1213c48cd1d7\") " pod="odh-ai-gateway-infra/maas-api-9fb85669f-gspbg"
Sep 15 11:35:17.355623 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:17.355502    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/484f8c91-969e-4c57-bf18-1213c48cd1d7-maas-api-tls\") pod \"maas-api-9fb85669f-gspbg\" (UID: \"484f8c91-969e-4c57-bf18-1213c48cd1d7\") " pod="odh-ai-gateway-infra/maas-api-9fb85669f-gspbg"
Sep 15 11:35:17.361465 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:17.361434    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6md9d\" (UniqueName: \"kubernetes.io/projected/484f8c91-969e-4c57-bf18-1213c48cd1d7-kube-api-access-6md9d\") pod \"maas-api-9fb85669f-gspbg\" (UID: \"484f8c91-969e-4c57-bf18-1213c48cd1d7\") " pod="odh-ai-gateway-infra/maas-api-9fb85669f-gspbg"
Sep 15 11:35:17.491704 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:17.491616    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-9fb85669f-gspbg"
Sep 15 11:35:17.596246 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:17.596216    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-7frsd"]
Sep 15 11:35:17.599546 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:17.599524    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-7frsd"
Sep 15 11:35:17.601764 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:17.601738    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 15 11:35:17.601871 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:17.601777    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-5frzm\""
Sep 15 11:35:17.625502 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:17.625480    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-7frsd"]
Sep 15 11:35:17.656283 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:17.656255    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aba71c39-2aa1-4e31-bc47-a7106371c009-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-7frsd\" (UID: \"aba71c39-2aa1-4e31-bc47-a7106371c009\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-7frsd"
Sep 15 11:35:17.656439 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:17.656301    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k464l\" (UniqueName: \"kubernetes.io/projected/aba71c39-2aa1-4e31-bc47-a7106371c009-kube-api-access-k464l\") pod \"payload-processing-5b54b7fbb7-7frsd\" (UID: \"aba71c39-2aa1-4e31-bc47-a7106371c009\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-7frsd"
Sep 15 11:35:17.757651 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:17.757568    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k464l\" (UniqueName: \"kubernetes.io/projected/aba71c39-2aa1-4e31-bc47-a7106371c009-kube-api-access-k464l\") pod \"payload-processing-5b54b7fbb7-7frsd\" (UID: \"aba71c39-2aa1-4e31-bc47-a7106371c009\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-7frsd"
Sep 15 11:35:17.757651 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:17.757639    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aba71c39-2aa1-4e31-bc47-a7106371c009-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-7frsd\" (UID: \"aba71c39-2aa1-4e31-bc47-a7106371c009\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-7frsd"
Sep 15 11:35:17.758311 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:17.758293    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aba71c39-2aa1-4e31-bc47-a7106371c009-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-7frsd\" (UID: \"aba71c39-2aa1-4e31-bc47-a7106371c009\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-7frsd"
Sep 15 11:35:17.766529 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:17.766499    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-9fb85669f-gspbg"]
Sep 15 11:35:17.770625 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:35:17.770600    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod484f8c91_969e_4c57_bf18_1213c48cd1d7.slice/crio-8122b3e32dddd23d2117ec1680713a6740e4cad089ba6cdb154595dc499ad0ba WatchSource:0}: Error finding container 8122b3e32dddd23d2117ec1680713a6740e4cad089ba6cdb154595dc499ad0ba: Status 404 returned error can't find the container with id 8122b3e32dddd23d2117ec1680713a6740e4cad089ba6cdb154595dc499ad0ba
Sep 15 11:35:17.771629 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:17.771601    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k464l\" (UniqueName: \"kubernetes.io/projected/aba71c39-2aa1-4e31-bc47-a7106371c009-kube-api-access-k464l\") pod \"payload-processing-5b54b7fbb7-7frsd\" (UID: \"aba71c39-2aa1-4e31-bc47-a7106371c009\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-7frsd"
Sep 15 11:35:17.910950 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:17.910911    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-7frsd"
Sep 15 11:35:18.186162 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:18.186129    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-7frsd"]
Sep 15 11:35:18.189428 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:35:18.189400    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaba71c39_2aa1_4e31_bc47_a7106371c009.slice/crio-953a7e7f59486ca0a356ff2d67fadc1fabc05961496101f7e77f6b64e3066a29 WatchSource:0}: Error finding container 953a7e7f59486ca0a356ff2d67fadc1fabc05961496101f7e77f6b64e3066a29: Status 404 returned error can't find the container with id 953a7e7f59486ca0a356ff2d67fadc1fabc05961496101f7e77f6b64e3066a29
Sep 15 11:35:18.455800 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:18.455710    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-7frsd" event={"ID":"aba71c39-2aa1-4e31-bc47-a7106371c009","Type":"ContainerStarted","Data":"953a7e7f59486ca0a356ff2d67fadc1fabc05961496101f7e77f6b64e3066a29"}
Sep 15 11:35:18.457523 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:18.457493    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-9fb85669f-gspbg" event={"ID":"484f8c91-969e-4c57-bf18-1213c48cd1d7","Type":"ContainerStarted","Data":"8122b3e32dddd23d2117ec1680713a6740e4cad089ba6cdb154595dc499ad0ba"}
Sep 15 11:35:21.472833 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:21.472800    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-7frsd" event={"ID":"aba71c39-2aa1-4e31-bc47-a7106371c009","Type":"ContainerStarted","Data":"c4d9997d159ebae39f2a6e46395de52f0e6f29ede5b204506ce54841143c1a9a"}
Sep 15 11:35:21.473314 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:21.472969    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-7frsd"
Sep 15 11:35:21.474502 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:21.474474    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-9fb85669f-gspbg" event={"ID":"484f8c91-969e-4c57-bf18-1213c48cd1d7","Type":"ContainerStarted","Data":"f613a59f36916be7600bc0afdb83f842dec8de28fa1346cab2f848ee311e5451"}
Sep 15 11:35:21.474589 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:21.474560    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-9fb85669f-gspbg"
Sep 15 11:35:21.490352 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:21.490301    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-7frsd" podStartSLOduration=2.136554805 podStartE2EDuration="4.490283434s" totalImagesPullingTime="2.353728629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:35:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:35:21.488604925 +0000 UTC m=+600.950470981" watchObservedRunningTime="2026-09-15 11:35:21.490283434 +0000 UTC m=+600.952149487"
Sep 15 11:35:21.505259 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:21.505218    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-9fb85669f-gspbg" podStartSLOduration=1.7830202929999999 podStartE2EDuration="4.505202055s" totalImagesPullingTime="2.722181762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:35:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:35:21.504488076 +0000 UTC m=+600.966354155" watchObservedRunningTime="2026-09-15 11:35:21.505202055 +0000 UTC m=+600.967068101"
Sep 15 11:35:27.484370 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:27.484339    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-9fb85669f-gspbg"
Sep 15 11:35:32.480641 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:32.480611    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-7frsd"
Sep 15 11:35:45.665766 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:45.665682    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vxz2r"]
Sep 15 11:35:45.668615 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:45.668594    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxz2r"
Sep 15 11:35:45.670944 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:45.670921    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 15 11:35:45.671080 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:45.670995    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 15 11:35:45.671819 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:45.671803    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 15 11:35:45.671908 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:45.671801    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-p4bfm\""
Sep 15 11:35:45.680693 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:45.680669    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vxz2r"]
Sep 15 11:35:45.793922 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:45.793892    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de3ba2c5-3af3-47c6-aed7-11e625f21117-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxz2r\" (UID: \"de3ba2c5-3af3-47c6-aed7-11e625f21117\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxz2r"
Sep 15 11:35:45.794106 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:45.793929    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnjv4\" (UniqueName: \"kubernetes.io/projected/de3ba2c5-3af3-47c6-aed7-11e625f21117-kube-api-access-gnjv4\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxz2r\" (UID: \"de3ba2c5-3af3-47c6-aed7-11e625f21117\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxz2r"
Sep 15 11:35:45.794106 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:45.794035    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de3ba2c5-3af3-47c6-aed7-11e625f21117-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxz2r\" (UID: \"de3ba2c5-3af3-47c6-aed7-11e625f21117\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxz2r"
Sep 15 11:35:45.794106 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:45.794081    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de3ba2c5-3af3-47c6-aed7-11e625f21117-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxz2r\" (UID: \"de3ba2c5-3af3-47c6-aed7-11e625f21117\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxz2r"
Sep 15 11:35:45.794244 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:45.794124    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de3ba2c5-3af3-47c6-aed7-11e625f21117-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxz2r\" (UID: \"de3ba2c5-3af3-47c6-aed7-11e625f21117\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxz2r"
Sep 15 11:35:45.794244 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:45.794139    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de3ba2c5-3af3-47c6-aed7-11e625f21117-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxz2r\" (UID: \"de3ba2c5-3af3-47c6-aed7-11e625f21117\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxz2r"
Sep 15 11:35:45.894898 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:45.894867    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de3ba2c5-3af3-47c6-aed7-11e625f21117-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxz2r\" (UID: \"de3ba2c5-3af3-47c6-aed7-11e625f21117\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxz2r"
Sep 15 11:35:45.894898 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:45.894895    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de3ba2c5-3af3-47c6-aed7-11e625f21117-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxz2r\" (UID: \"de3ba2c5-3af3-47c6-aed7-11e625f21117\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxz2r"
Sep 15 11:35:45.895128 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:45.894929    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de3ba2c5-3af3-47c6-aed7-11e625f21117-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxz2r\" (UID: \"de3ba2c5-3af3-47c6-aed7-11e625f21117\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxz2r"
Sep 15 11:35:45.895128 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:45.894947    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnjv4\" (UniqueName: \"kubernetes.io/projected/de3ba2c5-3af3-47c6-aed7-11e625f21117-kube-api-access-gnjv4\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxz2r\" (UID: \"de3ba2c5-3af3-47c6-aed7-11e625f21117\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxz2r"
Sep 15 11:35:45.895128 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:45.894987    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de3ba2c5-3af3-47c6-aed7-11e625f21117-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxz2r\" (UID: \"de3ba2c5-3af3-47c6-aed7-11e625f21117\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxz2r"
Sep 15 11:35:45.895128 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:45.895027    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de3ba2c5-3af3-47c6-aed7-11e625f21117-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxz2r\" (UID: \"de3ba2c5-3af3-47c6-aed7-11e625f21117\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxz2r"
Sep 15 11:35:45.895354 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:45.895279    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de3ba2c5-3af3-47c6-aed7-11e625f21117-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxz2r\" (UID: \"de3ba2c5-3af3-47c6-aed7-11e625f21117\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxz2r"
Sep 15 11:35:45.895396 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:45.895379    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de3ba2c5-3af3-47c6-aed7-11e625f21117-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxz2r\" (UID: \"de3ba2c5-3af3-47c6-aed7-11e625f21117\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxz2r"
Sep 15 11:35:45.895455 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:45.895434    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de3ba2c5-3af3-47c6-aed7-11e625f21117-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxz2r\" (UID: \"de3ba2c5-3af3-47c6-aed7-11e625f21117\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxz2r"
Sep 15 11:35:45.897381 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:45.897356    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de3ba2c5-3af3-47c6-aed7-11e625f21117-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxz2r\" (UID: \"de3ba2c5-3af3-47c6-aed7-11e625f21117\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxz2r"
Sep 15 11:35:45.897486 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:45.897461    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de3ba2c5-3af3-47c6-aed7-11e625f21117-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxz2r\" (UID: \"de3ba2c5-3af3-47c6-aed7-11e625f21117\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxz2r"
Sep 15 11:35:45.904233 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:45.904166    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnjv4\" (UniqueName: \"kubernetes.io/projected/de3ba2c5-3af3-47c6-aed7-11e625f21117-kube-api-access-gnjv4\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxz2r\" (UID: \"de3ba2c5-3af3-47c6-aed7-11e625f21117\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxz2r"
Sep 15 11:35:45.981836 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:45.981761    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxz2r"
Sep 15 11:35:46.258691 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:46.258618    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vxz2r"]
Sep 15 11:35:46.262139 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:35:46.262110    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde3ba2c5_3af3_47c6_aed7_11e625f21117.slice/crio-d29c5faa88ee6031efa17ec2dbdc15b8db2761e73b77c4d140ea7e9df5ec05bc WatchSource:0}: Error finding container d29c5faa88ee6031efa17ec2dbdc15b8db2761e73b77c4d140ea7e9df5ec05bc: Status 404 returned error can't find the container with id d29c5faa88ee6031efa17ec2dbdc15b8db2761e73b77c4d140ea7e9df5ec05bc
Sep 15 11:35:46.584725 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:46.584637    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxz2r" event={"ID":"de3ba2c5-3af3-47c6-aed7-11e625f21117","Type":"ContainerStarted","Data":"d29c5faa88ee6031efa17ec2dbdc15b8db2761e73b77c4d140ea7e9df5ec05bc"}
Sep 15 11:35:47.590808 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:47.590726    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxz2r" event={"ID":"de3ba2c5-3af3-47c6-aed7-11e625f21117","Type":"ContainerStarted","Data":"8382977d5ee9d391487432490f2bc99bac7f2464130cd1b8b90c519f68d3a7a8"}
Sep 15 11:35:47.609934 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:47.609878    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxz2r" podStartSLOduration=1.647586159 podStartE2EDuration="2.609860706s" totalImagesPullingTime="962.274547ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:35:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:35:47.607824585 +0000 UTC m=+627.069690638" watchObservedRunningTime="2026-09-15 11:35:47.609860706 +0000 UTC m=+627.071726758"
Sep 15 11:35:55.982634 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:55.982600    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxz2r"
Sep 15 11:35:55.983116 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:55.982689    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxz2r"
Sep 15 11:35:55.994862 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:55.994836    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxz2r"
Sep 15 11:35:56.647797 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:35:56.647767    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxz2r"
Sep 15 11:36:28.374447 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:36:28.374409    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-jj6s2"]
Sep 15 11:36:28.377084 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:36:28.377061    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jj6s2"
Sep 15 11:36:28.379811 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:36:28.379788    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 15 11:36:28.388435 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:36:28.388415    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-jj6s2"]
Sep 15 11:36:28.457420 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:36:28.457383    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62ff724c-414c-408c-9872-92e9a9346a0a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jj6s2\" (UID: \"62ff724c-414c-408c-9872-92e9a9346a0a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jj6s2"
Sep 15 11:36:28.457600 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:36:28.457436    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62ff724c-414c-408c-9872-92e9a9346a0a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jj6s2\" (UID: \"62ff724c-414c-408c-9872-92e9a9346a0a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jj6s2"
Sep 15 11:36:28.457600 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:36:28.457512    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k7s5\" (UniqueName: \"kubernetes.io/projected/62ff724c-414c-408c-9872-92e9a9346a0a-kube-api-access-4k7s5\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jj6s2\" (UID: \"62ff724c-414c-408c-9872-92e9a9346a0a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jj6s2"
Sep 15 11:36:28.457600 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:36:28.457554    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62ff724c-414c-408c-9872-92e9a9346a0a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jj6s2\" (UID: \"62ff724c-414c-408c-9872-92e9a9346a0a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jj6s2"
Sep 15 11:36:28.457600 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:36:28.457575    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62ff724c-414c-408c-9872-92e9a9346a0a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jj6s2\" (UID: \"62ff724c-414c-408c-9872-92e9a9346a0a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jj6s2"
Sep 15 11:36:28.457769 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:36:28.457621    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62ff724c-414c-408c-9872-92e9a9346a0a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jj6s2\" (UID: \"62ff724c-414c-408c-9872-92e9a9346a0a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jj6s2"
Sep 15 11:36:28.558783 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:36:28.558734    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62ff724c-414c-408c-9872-92e9a9346a0a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jj6s2\" (UID: \"62ff724c-414c-408c-9872-92e9a9346a0a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jj6s2"
Sep 15 11:36:28.558783 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:36:28.558786    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62ff724c-414c-408c-9872-92e9a9346a0a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jj6s2\" (UID: \"62ff724c-414c-408c-9872-92e9a9346a0a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jj6s2"
Sep 15 11:36:28.559027 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:36:28.558815    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62ff724c-414c-408c-9872-92e9a9346a0a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jj6s2\" (UID: \"62ff724c-414c-408c-9872-92e9a9346a0a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jj6s2"
Sep 15 11:36:28.559027 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:36:28.558859    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62ff724c-414c-408c-9872-92e9a9346a0a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jj6s2\" (UID: \"62ff724c-414c-408c-9872-92e9a9346a0a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jj6s2"
Sep 15 11:36:28.559027 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:36:28.558906    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62ff724c-414c-408c-9872-92e9a9346a0a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jj6s2\" (UID: \"62ff724c-414c-408c-9872-92e9a9346a0a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jj6s2"
Sep 15 11:36:28.559027 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:36:28.558976    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k7s5\" (UniqueName: \"kubernetes.io/projected/62ff724c-414c-408c-9872-92e9a9346a0a-kube-api-access-4k7s5\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jj6s2\" (UID: \"62ff724c-414c-408c-9872-92e9a9346a0a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jj6s2"
Sep 15 11:36:28.559332 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:36:28.559305    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62ff724c-414c-408c-9872-92e9a9346a0a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jj6s2\" (UID: \"62ff724c-414c-408c-9872-92e9a9346a0a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jj6s2"
Sep 15 11:36:28.559466 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:36:28.559442    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62ff724c-414c-408c-9872-92e9a9346a0a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jj6s2\" (UID: \"62ff724c-414c-408c-9872-92e9a9346a0a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jj6s2"
Sep 15 11:36:28.559759 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:36:28.559740    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62ff724c-414c-408c-9872-92e9a9346a0a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jj6s2\" (UID: \"62ff724c-414c-408c-9872-92e9a9346a0a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jj6s2"
Sep 15 11:36:28.561226 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:36:28.561202    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62ff724c-414c-408c-9872-92e9a9346a0a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jj6s2\" (UID: \"62ff724c-414c-408c-9872-92e9a9346a0a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jj6s2"
Sep 15 11:36:28.561495 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:36:28.561475    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62ff724c-414c-408c-9872-92e9a9346a0a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jj6s2\" (UID: \"62ff724c-414c-408c-9872-92e9a9346a0a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jj6s2"
Sep 15 11:36:28.574647 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:36:28.574588    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k7s5\" (UniqueName: \"kubernetes.io/projected/62ff724c-414c-408c-9872-92e9a9346a0a-kube-api-access-4k7s5\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jj6s2\" (UID: \"62ff724c-414c-408c-9872-92e9a9346a0a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jj6s2"
Sep 15 11:36:28.687509 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:36:28.687468    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jj6s2"
Sep 15 11:36:28.964554 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:36:28.964531    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-jj6s2"]
Sep 15 11:36:28.967119 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:36:28.967092    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62ff724c_414c_408c_9872_92e9a9346a0a.slice/crio-70c80e20b495521b580bd57b81496b635ad59e087972d268f9c0c1868580c32f WatchSource:0}: Error finding container 70c80e20b495521b580bd57b81496b635ad59e087972d268f9c0c1868580c32f: Status 404 returned error can't find the container with id 70c80e20b495521b580bd57b81496b635ad59e087972d268f9c0c1868580c32f
Sep 15 11:36:28.968489 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:36:28.968472    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 11:36:29.785808 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:36:29.785775    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jj6s2" event={"ID":"62ff724c-414c-408c-9872-92e9a9346a0a","Type":"ContainerStarted","Data":"3fa30b2345336fc6527d7b3ac0436f761d5409916babb08aa95ddefab065b49a"}
Sep 15 11:36:29.786248 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:36:29.785826    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jj6s2" event={"ID":"62ff724c-414c-408c-9872-92e9a9346a0a","Type":"ContainerStarted","Data":"70c80e20b495521b580bd57b81496b635ad59e087972d268f9c0c1868580c32f"}
Sep 15 11:36:29.804474 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:36:29.804423    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jj6s2" podStartSLOduration=1.6322420260000001 podStartE2EDuration="1.804405616s" totalImagesPullingTime="172.16359ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:36:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:36:29.803634168 +0000 UTC m=+669.265500222" watchObservedRunningTime="2026-09-15 11:36:29.804405616 +0000 UTC m=+669.266271668"
Sep 15 11:36:38.687738 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:36:38.687710    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jj6s2"
Sep 15 11:36:38.688206 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:36:38.687766    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jj6s2"
Sep 15 11:36:38.700395 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:36:38.700374    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jj6s2"
Sep 15 11:36:38.837015 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:36:38.836987    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jj6s2"
Sep 15 11:38:42.311227 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:42.311112    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp"]
Sep 15 11:38:42.314880 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:42.314855    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp"
Sep 15 11:38:42.317907 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:42.317883    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-2fab1f-serving-cert\""
Sep 15 11:38:42.331751 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:42.331730    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp"]
Sep 15 11:38:42.408350 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:42.408317    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3974675-5456-411d-9c30-8ac97e9268ca-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp\" (UID: \"f3974675-5456-411d-9c30-8ac97e9268ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp"
Sep 15 11:38:42.408518 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:42.408382    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3974675-5456-411d-9c30-8ac97e9268ca-maas-api-tls\") pod \"maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp\" (UID: \"f3974675-5456-411d-9c30-8ac97e9268ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp"
Sep 15 11:38:42.408518 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:42.408408    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3974675-5456-411d-9c30-8ac97e9268ca-metrics-certs\") pod \"maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp\" (UID: \"f3974675-5456-411d-9c30-8ac97e9268ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp"
Sep 15 11:38:42.408518 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:42.408433    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtmfv\" (UniqueName: \"kubernetes.io/projected/f3974675-5456-411d-9c30-8ac97e9268ca-kube-api-access-gtmfv\") pod \"maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp\" (UID: \"f3974675-5456-411d-9c30-8ac97e9268ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp"
Sep 15 11:38:42.509880 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:42.509840    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3974675-5456-411d-9c30-8ac97e9268ca-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp\" (UID: \"f3974675-5456-411d-9c30-8ac97e9268ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp"
Sep 15 11:38:42.510051 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:42.509909    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3974675-5456-411d-9c30-8ac97e9268ca-maas-api-tls\") pod \"maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp\" (UID: \"f3974675-5456-411d-9c30-8ac97e9268ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp"
Sep 15 11:38:42.510051 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:42.509941    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3974675-5456-411d-9c30-8ac97e9268ca-metrics-certs\") pod \"maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp\" (UID: \"f3974675-5456-411d-9c30-8ac97e9268ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp"
Sep 15 11:38:42.510051 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:42.509973    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtmfv\" (UniqueName: \"kubernetes.io/projected/f3974675-5456-411d-9c30-8ac97e9268ca-kube-api-access-gtmfv\") pod \"maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp\" (UID: \"f3974675-5456-411d-9c30-8ac97e9268ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp"
Sep 15 11:38:42.510329 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:38:42.510071    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w4-2fab1f-serving-cert: secret "maas-api-e2e-worker-w4-2fab1f-serving-cert" not found
Sep 15 11:38:42.510329 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:38:42.510156    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3974675-5456-411d-9c30-8ac97e9268ca-maas-api-tls podName:f3974675-5456-411d-9c30-8ac97e9268ca nodeName:}" failed. No retries permitted until 2026-09-15 11:38:43.010137154 +0000 UTC m=+802.472003199 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f3974675-5456-411d-9c30-8ac97e9268ca-maas-api-tls") pod "maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp" (UID: "f3974675-5456-411d-9c30-8ac97e9268ca") : secret "maas-api-e2e-worker-w4-2fab1f-serving-cert" not found
Sep 15 11:38:42.510620 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:42.510600    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3974675-5456-411d-9c30-8ac97e9268ca-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp\" (UID: \"f3974675-5456-411d-9c30-8ac97e9268ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp"
Sep 15 11:38:42.512704 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:42.512675    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3974675-5456-411d-9c30-8ac97e9268ca-metrics-certs\") pod \"maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp\" (UID: \"f3974675-5456-411d-9c30-8ac97e9268ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp"
Sep 15 11:38:42.527596 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:42.527566    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtmfv\" (UniqueName: \"kubernetes.io/projected/f3974675-5456-411d-9c30-8ac97e9268ca-kube-api-access-gtmfv\") pod \"maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp\" (UID: \"f3974675-5456-411d-9c30-8ac97e9268ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp"
Sep 15 11:38:43.014167 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.014126    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3974675-5456-411d-9c30-8ac97e9268ca-maas-api-tls\") pod \"maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp\" (UID: \"f3974675-5456-411d-9c30-8ac97e9268ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp"
Sep 15 11:38:43.016770 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.016741    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3974675-5456-411d-9c30-8ac97e9268ca-maas-api-tls\") pod \"maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp\" (UID: \"f3974675-5456-411d-9c30-8ac97e9268ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp"
Sep 15 11:38:43.203136 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.203099    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd-slfsh"]
Sep 15 11:38:43.206486 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.206462    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd-slfsh"
Sep 15 11:38:43.208701 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.208674    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-2fab1f\""
Sep 15 11:38:43.220104 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.220080    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd-slfsh"]
Sep 15 11:38:43.224905 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.224886    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp"
Sep 15 11:38:43.231844 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.231820    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c-qgvnp"]
Sep 15 11:38:43.235156 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.235139    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c-qgvnp"
Sep 15 11:38:43.238715 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.238695    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-2fab1f-dockercfg-z7lrw\""
Sep 15 11:38:43.248629 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.248602    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c-qgvnp"]
Sep 15 11:38:43.316843 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.316812    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jzm9\" (UniqueName: \"kubernetes.io/projected/1fdb0221-ff8d-4fd0-a87d-c9f32e2041b5-kube-api-access-5jzm9\") pod \"payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd-slfsh\" (UID: \"1fdb0221-ff8d-4fd0-a87d-c9f32e2041b5\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd-slfsh"
Sep 15 11:38:43.317250 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.316892    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f18e0f20-d7e5-46e7-ac0f-640e28178581-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c-qgvnp\" (UID: \"f18e0f20-d7e5-46e7-ac0f-640e28178581\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c-qgvnp"
Sep 15 11:38:43.317250 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.316911    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmvg6\" (UniqueName: \"kubernetes.io/projected/f18e0f20-d7e5-46e7-ac0f-640e28178581-kube-api-access-lmvg6\") pod \"payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c-qgvnp\" (UID: \"f18e0f20-d7e5-46e7-ac0f-640e28178581\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c-qgvnp"
Sep 15 11:38:43.317250 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.316928    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fdb0221-ff8d-4fd0-a87d-c9f32e2041b5-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd-slfsh\" (UID: \"1fdb0221-ff8d-4fd0-a87d-c9f32e2041b5\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd-slfsh"
Sep 15 11:38:43.417519 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.417481    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f18e0f20-d7e5-46e7-ac0f-640e28178581-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c-qgvnp\" (UID: \"f18e0f20-d7e5-46e7-ac0f-640e28178581\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c-qgvnp"
Sep 15 11:38:43.417519 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.417518    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmvg6\" (UniqueName: \"kubernetes.io/projected/f18e0f20-d7e5-46e7-ac0f-640e28178581-kube-api-access-lmvg6\") pod \"payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c-qgvnp\" (UID: \"f18e0f20-d7e5-46e7-ac0f-640e28178581\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c-qgvnp"
Sep 15 11:38:43.417768 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.417535    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fdb0221-ff8d-4fd0-a87d-c9f32e2041b5-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd-slfsh\" (UID: \"1fdb0221-ff8d-4fd0-a87d-c9f32e2041b5\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd-slfsh"
Sep 15 11:38:43.417768 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.417568    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jzm9\" (UniqueName: \"kubernetes.io/projected/1fdb0221-ff8d-4fd0-a87d-c9f32e2041b5-kube-api-access-5jzm9\") pod \"payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd-slfsh\" (UID: \"1fdb0221-ff8d-4fd0-a87d-c9f32e2041b5\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd-slfsh"
Sep 15 11:38:43.418286 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.418263    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fdb0221-ff8d-4fd0-a87d-c9f32e2041b5-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd-slfsh\" (UID: \"1fdb0221-ff8d-4fd0-a87d-c9f32e2041b5\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd-slfsh"
Sep 15 11:38:43.418396 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.418322    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f18e0f20-d7e5-46e7-ac0f-640e28178581-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c-qgvnp\" (UID: \"f18e0f20-d7e5-46e7-ac0f-640e28178581\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c-qgvnp"
Sep 15 11:38:43.427909 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.427889    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmvg6\" (UniqueName: \"kubernetes.io/projected/f18e0f20-d7e5-46e7-ac0f-640e28178581-kube-api-access-lmvg6\") pod \"payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c-qgvnp\" (UID: \"f18e0f20-d7e5-46e7-ac0f-640e28178581\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c-qgvnp"
Sep 15 11:38:43.432434 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.432410    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jzm9\" (UniqueName: \"kubernetes.io/projected/1fdb0221-ff8d-4fd0-a87d-c9f32e2041b5-kube-api-access-5jzm9\") pod \"payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd-slfsh\" (UID: \"1fdb0221-ff8d-4fd0-a87d-c9f32e2041b5\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd-slfsh"
Sep 15 11:38:43.509717 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.509686    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4"]
Sep 15 11:38:43.514348 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.514319    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4"
Sep 15 11:38:43.516916 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.516838    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-9bd868-serving-cert\""
Sep 15 11:38:43.519391 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.519369    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp"]
Sep 15 11:38:43.519487 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.519437    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd-slfsh"
Sep 15 11:38:43.523085 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:38:43.522896    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3974675_5456_411d_9c30_8ac97e9268ca.slice/crio-0f7dfe9070141850e326b77ecb60f292d6459be4e1a4138f30867cd58635f0a2 WatchSource:0}: Error finding container 0f7dfe9070141850e326b77ecb60f292d6459be4e1a4138f30867cd58635f0a2: Status 404 returned error can't find the container with id 0f7dfe9070141850e326b77ecb60f292d6459be4e1a4138f30867cd58635f0a2
Sep 15 11:38:43.529803 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.529735    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4"]
Sep 15 11:38:43.559688 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.559662    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c-qgvnp"
Sep 15 11:38:43.619474 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.619425    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfdzw\" (UniqueName: \"kubernetes.io/projected/f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f-kube-api-access-wfdzw\") pod \"maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4\" (UID: \"f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4"
Sep 15 11:38:43.619474 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.619509    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f-metrics-certs\") pod \"maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4\" (UID: \"f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4"
Sep 15 11:38:43.619474 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.619588    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f-maas-api-tls\") pod \"maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4\" (UID: \"f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4"
Sep 15 11:38:43.620003 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.619617    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4\" (UID: \"f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4"
Sep 15 11:38:43.720505 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.720476    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f-maas-api-tls\") pod \"maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4\" (UID: \"f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4"
Sep 15 11:38:43.720667 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.720516    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4\" (UID: \"f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4"
Sep 15 11:38:43.720667 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.720578    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfdzw\" (UniqueName: \"kubernetes.io/projected/f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f-kube-api-access-wfdzw\") pod \"maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4\" (UID: \"f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4"
Sep 15 11:38:43.720667 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.720625    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f-metrics-certs\") pod \"maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4\" (UID: \"f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4"
Sep 15 11:38:43.720667 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:38:43.720653    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-9bd868-serving-cert: secret "maas-api-e2e-worker-w0-9bd868-serving-cert" not found
Sep 15 11:38:43.720798 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:38:43.720720    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f-maas-api-tls podName:f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f nodeName:}" failed. No retries permitted until 2026-09-15 11:38:44.220698336 +0000 UTC m=+803.682564371 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f-maas-api-tls") pod "maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4" (UID: "f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f") : secret "maas-api-e2e-worker-w0-9bd868-serving-cert" not found
Sep 15 11:38:43.721277 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.721261    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4\" (UID: \"f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4"
Sep 15 11:38:43.723232 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.723215    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f-metrics-certs\") pod \"maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4\" (UID: \"f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4"
Sep 15 11:38:43.732475 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.732455    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfdzw\" (UniqueName: \"kubernetes.io/projected/f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f-kube-api-access-wfdzw\") pod \"maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4\" (UID: \"f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4"
Sep 15 11:38:43.804202 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.804160    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd-slfsh"]
Sep 15 11:38:43.806270 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:38:43.806247    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fdb0221_ff8d_4fd0_a87d_c9f32e2041b5.slice/crio-7da15ee77b096820d4835db6406e461fa2130cdc8f0d9343d83812f6377bdf55 WatchSource:0}: Error finding container 7da15ee77b096820d4835db6406e461fa2130cdc8f0d9343d83812f6377bdf55: Status 404 returned error can't find the container with id 7da15ee77b096820d4835db6406e461fa2130cdc8f0d9343d83812f6377bdf55
Sep 15 11:38:43.849127 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:43.849102    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c-qgvnp"]
Sep 15 11:38:43.851302 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:38:43.851274    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf18e0f20_d7e5_46e7_ac0f_640e28178581.slice/crio-6bf58720015cac57eb1afa2d6dda766067964604ff3a482cc942b6a531edb0e4 WatchSource:0}: Error finding container 6bf58720015cac57eb1afa2d6dda766067964604ff3a482cc942b6a531edb0e4: Status 404 returned error can't find the container with id 6bf58720015cac57eb1afa2d6dda766067964604ff3a482cc942b6a531edb0e4
Sep 15 11:38:44.225550 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:44.225517    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f-maas-api-tls\") pod \"maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4\" (UID: \"f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4"
Sep 15 11:38:44.228595 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:44.228569    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f-maas-api-tls\") pod \"maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4\" (UID: \"f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4"
Sep 15 11:38:44.375199 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:44.375132    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c-qgvnp" event={"ID":"f18e0f20-d7e5-46e7-ac0f-640e28178581","Type":"ContainerStarted","Data":"1d0bd03e647cb7fc7302494e93dbf05a801ce988974482c0ab7b8a469fb163f5"}
Sep 15 11:38:44.375673 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:44.375215    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c-qgvnp"
Sep 15 11:38:44.375673 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:44.375243    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c-qgvnp" event={"ID":"f18e0f20-d7e5-46e7-ac0f-640e28178581","Type":"ContainerStarted","Data":"6bf58720015cac57eb1afa2d6dda766067964604ff3a482cc942b6a531edb0e4"}
Sep 15 11:38:44.377129 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:44.377100    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd-slfsh" event={"ID":"1fdb0221-ff8d-4fd0-a87d-c9f32e2041b5","Type":"ContainerStarted","Data":"e006fbec1f6ec80a13f2e57a1e8e088250ae9177c2e1c7d3ce8916df4cdcafbe"}
Sep 15 11:38:44.377276 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:44.377164    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd-slfsh" event={"ID":"1fdb0221-ff8d-4fd0-a87d-c9f32e2041b5","Type":"ContainerStarted","Data":"7da15ee77b096820d4835db6406e461fa2130cdc8f0d9343d83812f6377bdf55"}
Sep 15 11:38:44.377276 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:44.377216    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd-slfsh"
Sep 15 11:38:44.381731 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:44.381703    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp" event={"ID":"f3974675-5456-411d-9c30-8ac97e9268ca","Type":"ContainerStarted","Data":"1e86c930a2ad740df780204d880a6e21c7a3ac0243db3963139091ccbcbdb828"}
Sep 15 11:38:44.381856 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:44.381755    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp" event={"ID":"f3974675-5456-411d-9c30-8ac97e9268ca","Type":"ContainerStarted","Data":"0f7dfe9070141850e326b77ecb60f292d6459be4e1a4138f30867cd58635f0a2"}
Sep 15 11:38:44.381856 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:44.381797    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp"
Sep 15 11:38:44.458704 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:44.458649    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c-qgvnp" podStartSLOduration=1.458629016 podStartE2EDuration="1.458629016s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:44.45644323 +0000 UTC m=+803.918309284" watchObservedRunningTime="2026-09-15 11:38:44.458629016 +0000 UTC m=+803.920495072"
Sep 15 11:38:44.464035 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:44.464005    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4"
Sep 15 11:38:44.483111 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:44.483005    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd-slfsh" podStartSLOduration=1.4829844589999999 podStartE2EDuration="1.482984459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:44.480068145 +0000 UTC m=+803.941934238" watchObservedRunningTime="2026-09-15 11:38:44.482984459 +0000 UTC m=+803.944850513"
Sep 15 11:38:44.513975 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:44.513830    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp" podStartSLOduration=2.085843099 podStartE2EDuration="2.513806174s" totalImagesPullingTime="427.963075ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:44.510736909 +0000 UTC m=+803.972602963" watchObservedRunningTime="2026-09-15 11:38:44.513806174 +0000 UTC m=+803.975672229"
Sep 15 11:38:44.755783 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:44.755711    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4"]
Sep 15 11:38:44.759292 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:38:44.759257    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6d24b13_2c34_4ec8_8938_ce5a7fd65e9f.slice/crio-214b100ee31ffed6900daa1f87e56ff8546c70673e8db5432135a6834d05a282 WatchSource:0}: Error finding container 214b100ee31ffed6900daa1f87e56ff8546c70673e8db5432135a6834d05a282: Status 404 returned error can't find the container with id 214b100ee31ffed6900daa1f87e56ff8546c70673e8db5432135a6834d05a282
Sep 15 11:38:44.787714 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:44.787679    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c"]
Sep 15 11:38:44.792545 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:44.792516    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c"
Sep 15 11:38:44.794714 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:44.794692    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-0eb0ef-serving-cert\""
Sep 15 11:38:44.803525 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:44.803501    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c"]
Sep 15 11:38:44.831739 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:44.831702    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhsnc\" (UniqueName: \"kubernetes.io/projected/b5c779d0-3c94-463d-87c3-7af27630162b-kube-api-access-lhsnc\") pod \"maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c\" (UID: \"b5c779d0-3c94-463d-87c3-7af27630162b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c"
Sep 15 11:38:44.831739 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:44.831747    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5c779d0-3c94-463d-87c3-7af27630162b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c\" (UID: \"b5c779d0-3c94-463d-87c3-7af27630162b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c"
Sep 15 11:38:44.831972 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:44.831763    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5c779d0-3c94-463d-87c3-7af27630162b-metrics-certs\") pod \"maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c\" (UID: \"b5c779d0-3c94-463d-87c3-7af27630162b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c"
Sep 15 11:38:44.831972 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:44.831901    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5c779d0-3c94-463d-87c3-7af27630162b-maas-api-tls\") pod \"maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c\" (UID: \"b5c779d0-3c94-463d-87c3-7af27630162b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c"
Sep 15 11:38:44.932405 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:44.932363    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhsnc\" (UniqueName: \"kubernetes.io/projected/b5c779d0-3c94-463d-87c3-7af27630162b-kube-api-access-lhsnc\") pod \"maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c\" (UID: \"b5c779d0-3c94-463d-87c3-7af27630162b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c"
Sep 15 11:38:44.932573 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:44.932427    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5c779d0-3c94-463d-87c3-7af27630162b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c\" (UID: \"b5c779d0-3c94-463d-87c3-7af27630162b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c"
Sep 15 11:38:44.932573 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:44.932458    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5c779d0-3c94-463d-87c3-7af27630162b-metrics-certs\") pod \"maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c\" (UID: \"b5c779d0-3c94-463d-87c3-7af27630162b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c"
Sep 15 11:38:44.932573 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:44.932566    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5c779d0-3c94-463d-87c3-7af27630162b-maas-api-tls\") pod \"maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c\" (UID: \"b5c779d0-3c94-463d-87c3-7af27630162b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c"
Sep 15 11:38:44.932703 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:38:44.932670    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-0eb0ef-serving-cert: secret "maas-api-e2e-inf-a-0eb0ef-serving-cert" not found
Sep 15 11:38:44.932741 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:38:44.932730    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5c779d0-3c94-463d-87c3-7af27630162b-maas-api-tls podName:b5c779d0-3c94-463d-87c3-7af27630162b nodeName:}" failed. No retries permitted until 2026-09-15 11:38:45.43270911 +0000 UTC m=+804.894575147 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b5c779d0-3c94-463d-87c3-7af27630162b-maas-api-tls") pod "maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c" (UID: "b5c779d0-3c94-463d-87c3-7af27630162b") : secret "maas-api-e2e-inf-a-0eb0ef-serving-cert" not found
Sep 15 11:38:44.933389 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:44.933312    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5c779d0-3c94-463d-87c3-7af27630162b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c\" (UID: \"b5c779d0-3c94-463d-87c3-7af27630162b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c"
Sep 15 11:38:44.935647 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:44.935621    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5c779d0-3c94-463d-87c3-7af27630162b-metrics-certs\") pod \"maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c\" (UID: \"b5c779d0-3c94-463d-87c3-7af27630162b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c"
Sep 15 11:38:44.942926 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:44.942892    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhsnc\" (UniqueName: \"kubernetes.io/projected/b5c779d0-3c94-463d-87c3-7af27630162b-kube-api-access-lhsnc\") pod \"maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c\" (UID: \"b5c779d0-3c94-463d-87c3-7af27630162b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c"
Sep 15 11:38:45.389231 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:45.389190    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4" event={"ID":"f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f","Type":"ContainerStarted","Data":"f42653594a9ce18c6f6580481b16eaec597d1f1b8f510fe3491622feb4f28b9f"}
Sep 15 11:38:45.389736 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:45.389254    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4" event={"ID":"f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f","Type":"ContainerStarted","Data":"214b100ee31ffed6900daa1f87e56ff8546c70673e8db5432135a6834d05a282"}
Sep 15 11:38:45.389736 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:45.389726    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4"
Sep 15 11:38:45.414305 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:45.414169    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4" podStartSLOduration=2.03350842 podStartE2EDuration="2.414150806s" totalImagesPullingTime="380.642386ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:45.409824073 +0000 UTC m=+804.871690125" watchObservedRunningTime="2026-09-15 11:38:45.414150806 +0000 UTC m=+804.876016877"
Sep 15 11:38:45.437027 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:45.436996    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5c779d0-3c94-463d-87c3-7af27630162b-maas-api-tls\") pod \"maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c\" (UID: \"b5c779d0-3c94-463d-87c3-7af27630162b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c"
Sep 15 11:38:45.440232 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:45.440209    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5c779d0-3c94-463d-87c3-7af27630162b-maas-api-tls\") pod \"maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c\" (UID: \"b5c779d0-3c94-463d-87c3-7af27630162b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c"
Sep 15 11:38:45.705567 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:45.705476    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c"
Sep 15 11:38:45.997216 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:45.997072    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c"]
Sep 15 11:38:46.000526 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:38:46.000485    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5c779d0_3c94_463d_87c3_7af27630162b.slice/crio-e2e5405ea91c66066d8b12db6f9451c8b8b3bedf720802265009287ae546854d WatchSource:0}: Error finding container e2e5405ea91c66066d8b12db6f9451c8b8b3bedf720802265009287ae546854d: Status 404 returned error can't find the container with id e2e5405ea91c66066d8b12db6f9451c8b8b3bedf720802265009287ae546854d
Sep 15 11:38:46.396004 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:46.395967    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c" event={"ID":"b5c779d0-3c94-463d-87c3-7af27630162b","Type":"ContainerStarted","Data":"e2e5405ea91c66066d8b12db6f9451c8b8b3bedf720802265009287ae546854d"}
Sep 15 11:38:47.401834 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:47.401799    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c" event={"ID":"b5c779d0-3c94-463d-87c3-7af27630162b","Type":"ContainerStarted","Data":"7c6dd9bcd6ab40dd5e111205a7434ec787542c250c97363b80953d9b85421089"}
Sep 15 11:38:47.402346 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:47.401961    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c"
Sep 15 11:38:47.435830 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:47.435784    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c" podStartSLOduration=2.892523219 podStartE2EDuration="3.435768035s" totalImagesPullingTime="543.244816ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:47.434708576 +0000 UTC m=+806.896574626" watchObservedRunningTime="2026-09-15 11:38:47.435768035 +0000 UTC m=+806.897634088"
Sep 15 11:38:50.395753 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:50.395720    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp"
Sep 15 11:38:51.402485 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:51.402459    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4"
Sep 15 11:38:53.413013 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:53.412986    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c"
Sep 15 11:38:54.163386 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:54.163347    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp"]
Sep 15 11:38:54.168016 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:54.167987    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp"
Sep 15 11:38:54.170254 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:54.170228    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-9f77ab79-serving-cert\""
Sep 15 11:38:54.181320 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:54.181295    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp"]
Sep 15 11:38:54.319997 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:54.319965    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6j7j\" (UniqueName: \"kubernetes.io/projected/0b64fe56-4c45-4e36-b029-5a635ddcce18-kube-api-access-x6j7j\") pod \"maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp\" (UID: \"0b64fe56-4c45-4e36-b029-5a635ddcce18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp"
Sep 15 11:38:54.320228 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:54.320092    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b64fe56-4c45-4e36-b029-5a635ddcce18-openshift-service-ca\") pod \"maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp\" (UID: \"0b64fe56-4c45-4e36-b029-5a635ddcce18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp"
Sep 15 11:38:54.320228 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:54.320123    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b64fe56-4c45-4e36-b029-5a635ddcce18-metrics-certs\") pod \"maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp\" (UID: \"0b64fe56-4c45-4e36-b029-5a635ddcce18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp"
Sep 15 11:38:54.320228 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:54.320150    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b64fe56-4c45-4e36-b029-5a635ddcce18-maas-api-tls\") pod \"maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp\" (UID: \"0b64fe56-4c45-4e36-b029-5a635ddcce18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp"
Sep 15 11:38:54.421403 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:54.421299    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b64fe56-4c45-4e36-b029-5a635ddcce18-openshift-service-ca\") pod \"maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp\" (UID: \"0b64fe56-4c45-4e36-b029-5a635ddcce18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp"
Sep 15 11:38:54.421403 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:54.421349    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b64fe56-4c45-4e36-b029-5a635ddcce18-metrics-certs\") pod \"maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp\" (UID: \"0b64fe56-4c45-4e36-b029-5a635ddcce18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp"
Sep 15 11:38:54.421934 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:54.421469    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b64fe56-4c45-4e36-b029-5a635ddcce18-maas-api-tls\") pod \"maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp\" (UID: \"0b64fe56-4c45-4e36-b029-5a635ddcce18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp"
Sep 15 11:38:54.421934 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:54.421584    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6j7j\" (UniqueName: \"kubernetes.io/projected/0b64fe56-4c45-4e36-b029-5a635ddcce18-kube-api-access-x6j7j\") pod \"maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp\" (UID: \"0b64fe56-4c45-4e36-b029-5a635ddcce18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp"
Sep 15 11:38:54.421934 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:38:54.421595    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-9f77ab79-serving-cert: secret "maas-api-e2e-ait-9f77ab79-serving-cert" not found
Sep 15 11:38:54.421934 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:38:54.421682    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b64fe56-4c45-4e36-b029-5a635ddcce18-maas-api-tls podName:0b64fe56-4c45-4e36-b029-5a635ddcce18 nodeName:}" failed. No retries permitted until 2026-09-15 11:38:54.92165866 +0000 UTC m=+814.383524694 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0b64fe56-4c45-4e36-b029-5a635ddcce18-maas-api-tls") pod "maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp" (UID: "0b64fe56-4c45-4e36-b029-5a635ddcce18") : secret "maas-api-e2e-ait-9f77ab79-serving-cert" not found
Sep 15 11:38:54.422100 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:54.422033    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b64fe56-4c45-4e36-b029-5a635ddcce18-openshift-service-ca\") pod \"maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp\" (UID: \"0b64fe56-4c45-4e36-b029-5a635ddcce18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp"
Sep 15 11:38:54.424222 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:54.424167    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b64fe56-4c45-4e36-b029-5a635ddcce18-metrics-certs\") pod \"maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp\" (UID: \"0b64fe56-4c45-4e36-b029-5a635ddcce18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp"
Sep 15 11:38:54.432167 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:54.432139    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6j7j\" (UniqueName: \"kubernetes.io/projected/0b64fe56-4c45-4e36-b029-5a635ddcce18-kube-api-access-x6j7j\") pod \"maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp\" (UID: \"0b64fe56-4c45-4e36-b029-5a635ddcce18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp"
Sep 15 11:38:54.925977 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:54.925939    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b64fe56-4c45-4e36-b029-5a635ddcce18-maas-api-tls\") pod \"maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp\" (UID: \"0b64fe56-4c45-4e36-b029-5a635ddcce18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp"
Sep 15 11:38:54.928758 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:54.928726    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b64fe56-4c45-4e36-b029-5a635ddcce18-maas-api-tls\") pod \"maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp\" (UID: \"0b64fe56-4c45-4e36-b029-5a635ddcce18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp"
Sep 15 11:38:55.079278 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:55.079241    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp"
Sep 15 11:38:55.364997 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:55.364973    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp"]
Sep 15 11:38:55.366840 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:38:55.366815    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b64fe56_4c45_4e36_b029_5a635ddcce18.slice/crio-d1561a959ff4d2c601ca3fc978ff35c7fd7e4786992c5ce76f07b63f92ba2a72 WatchSource:0}: Error finding container d1561a959ff4d2c601ca3fc978ff35c7fd7e4786992c5ce76f07b63f92ba2a72: Status 404 returned error can't find the container with id d1561a959ff4d2c601ca3fc978ff35c7fd7e4786992c5ce76f07b63f92ba2a72
Sep 15 11:38:55.391835 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:55.391808    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c-qgvnp"
Sep 15 11:38:55.392117 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:55.392097    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd-slfsh"
Sep 15 11:38:55.444632 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:55.444548    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp" event={"ID":"0b64fe56-4c45-4e36-b029-5a635ddcce18","Type":"ContainerStarted","Data":"d1561a959ff4d2c601ca3fc978ff35c7fd7e4786992c5ce76f07b63f92ba2a72"}
Sep 15 11:38:56.450690 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:56.450656    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp" event={"ID":"0b64fe56-4c45-4e36-b029-5a635ddcce18","Type":"ContainerStarted","Data":"f39f324f4d9c45b4536e1cdf82f660cc544da0194fea3bf01423133e2a879c69"}
Sep 15 11:38:56.451091 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:56.450789    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp"
Sep 15 11:38:56.485095 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:56.485044    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp" podStartSLOduration=2.102747562 podStartE2EDuration="2.485027399s" totalImagesPullingTime="382.279837ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:56.482512692 +0000 UTC m=+815.944378760" watchObservedRunningTime="2026-09-15 11:38:56.485027399 +0000 UTC m=+815.946893453"
Sep 15 11:38:59.675499 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:59.675464    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl"]
Sep 15 11:38:59.680530 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:59.680508    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl"
Sep 15 11:38:59.683083 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:59.683063    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-e114ba-serving-cert\""
Sep 15 11:38:59.696219 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:59.696171    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl"]
Sep 15 11:38:59.769403 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:59.769373    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgwmk\" (UniqueName: \"kubernetes.io/projected/a6718cfd-aa18-4859-acf6-58f41da89d99-kube-api-access-rgwmk\") pod \"maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl\" (UID: \"a6718cfd-aa18-4859-acf6-58f41da89d99\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl"
Sep 15 11:38:59.769564 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:59.769414    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6718cfd-aa18-4859-acf6-58f41da89d99-maas-api-tls\") pod \"maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl\" (UID: \"a6718cfd-aa18-4859-acf6-58f41da89d99\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl"
Sep 15 11:38:59.769564 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:59.769531    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6718cfd-aa18-4859-acf6-58f41da89d99-openshift-service-ca\") pod \"maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl\" (UID: \"a6718cfd-aa18-4859-acf6-58f41da89d99\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl"
Sep 15 11:38:59.769684 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:59.769607    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6718cfd-aa18-4859-acf6-58f41da89d99-metrics-certs\") pod \"maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl\" (UID: \"a6718cfd-aa18-4859-acf6-58f41da89d99\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl"
Sep 15 11:38:59.870137 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:59.870091    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6718cfd-aa18-4859-acf6-58f41da89d99-openshift-service-ca\") pod \"maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl\" (UID: \"a6718cfd-aa18-4859-acf6-58f41da89d99\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl"
Sep 15 11:38:59.870356 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:59.870166    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6718cfd-aa18-4859-acf6-58f41da89d99-metrics-certs\") pod \"maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl\" (UID: \"a6718cfd-aa18-4859-acf6-58f41da89d99\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl"
Sep 15 11:38:59.870356 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:59.870221    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgwmk\" (UniqueName: \"kubernetes.io/projected/a6718cfd-aa18-4859-acf6-58f41da89d99-kube-api-access-rgwmk\") pod \"maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl\" (UID: \"a6718cfd-aa18-4859-acf6-58f41da89d99\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl"
Sep 15 11:38:59.870356 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:59.870252    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6718cfd-aa18-4859-acf6-58f41da89d99-maas-api-tls\") pod \"maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl\" (UID: \"a6718cfd-aa18-4859-acf6-58f41da89d99\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl"
Sep 15 11:38:59.870737 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:59.870714    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6718cfd-aa18-4859-acf6-58f41da89d99-openshift-service-ca\") pod \"maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl\" (UID: \"a6718cfd-aa18-4859-acf6-58f41da89d99\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl"
Sep 15 11:38:59.872696 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:59.872671    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6718cfd-aa18-4859-acf6-58f41da89d99-metrics-certs\") pod \"maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl\" (UID: \"a6718cfd-aa18-4859-acf6-58f41da89d99\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl"
Sep 15 11:38:59.872790 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:59.872773    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6718cfd-aa18-4859-acf6-58f41da89d99-maas-api-tls\") pod \"maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl\" (UID: \"a6718cfd-aa18-4859-acf6-58f41da89d99\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl"
Sep 15 11:38:59.878579 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:59.878560    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgwmk\" (UniqueName: \"kubernetes.io/projected/a6718cfd-aa18-4859-acf6-58f41da89d99-kube-api-access-rgwmk\") pod \"maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl\" (UID: \"a6718cfd-aa18-4859-acf6-58f41da89d99\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl"
Sep 15 11:38:59.990876 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:38:59.990792    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl"
Sep 15 11:39:00.286345 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:00.286319    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl"]
Sep 15 11:39:00.288072 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:39:00.288043    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6718cfd_aa18_4859_acf6_58f41da89d99.slice/crio-1ff9dc6936335b0e22df10f1113d121ca5c5c74257f7165265e0af01f9e5a9fe WatchSource:0}: Error finding container 1ff9dc6936335b0e22df10f1113d121ca5c5c74257f7165265e0af01f9e5a9fe: Status 404 returned error can't find the container with id 1ff9dc6936335b0e22df10f1113d121ca5c5c74257f7165265e0af01f9e5a9fe
Sep 15 11:39:00.470764 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:00.470725    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl" event={"ID":"a6718cfd-aa18-4859-acf6-58f41da89d99","Type":"ContainerStarted","Data":"1ff9dc6936335b0e22df10f1113d121ca5c5c74257f7165265e0af01f9e5a9fe"}
Sep 15 11:39:00.501730 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:00.501696    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-e114ba-65c4b7655d-cpblh"]
Sep 15 11:39:00.506462 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:00.506445    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-e114ba-65c4b7655d-cpblh"
Sep 15 11:39:00.510405 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:00.510382    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-e114ba\""
Sep 15 11:39:00.510996 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:00.510964    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-e114ba-dockercfg-jv4bm\""
Sep 15 11:39:00.520402 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:00.520375    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-e114ba-65c4b7655d-cpblh"]
Sep 15 11:39:00.678453 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:00.678422    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50175cdb-acb0-4632-b65e-261377c81a5e-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-e114ba-65c4b7655d-cpblh\" (UID: \"50175cdb-acb0-4632-b65e-261377c81a5e\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-e114ba-65c4b7655d-cpblh"
Sep 15 11:39:00.678734 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:00.678523    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcx8v\" (UniqueName: \"kubernetes.io/projected/50175cdb-acb0-4632-b65e-261377c81a5e-kube-api-access-fcx8v\") pod \"payload-pre-processing-e2e-autores-e114ba-65c4b7655d-cpblh\" (UID: \"50175cdb-acb0-4632-b65e-261377c81a5e\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-e114ba-65c4b7655d-cpblh"
Sep 15 11:39:00.779866 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:00.779831    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50175cdb-acb0-4632-b65e-261377c81a5e-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-e114ba-65c4b7655d-cpblh\" (UID: \"50175cdb-acb0-4632-b65e-261377c81a5e\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-e114ba-65c4b7655d-cpblh"
Sep 15 11:39:00.780039 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:00.779886    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcx8v\" (UniqueName: \"kubernetes.io/projected/50175cdb-acb0-4632-b65e-261377c81a5e-kube-api-access-fcx8v\") pod \"payload-pre-processing-e2e-autores-e114ba-65c4b7655d-cpblh\" (UID: \"50175cdb-acb0-4632-b65e-261377c81a5e\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-e114ba-65c4b7655d-cpblh"
Sep 15 11:39:00.780666 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:00.780645    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50175cdb-acb0-4632-b65e-261377c81a5e-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-e114ba-65c4b7655d-cpblh\" (UID: \"50175cdb-acb0-4632-b65e-261377c81a5e\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-e114ba-65c4b7655d-cpblh"
Sep 15 11:39:00.788480 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:00.788454    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcx8v\" (UniqueName: \"kubernetes.io/projected/50175cdb-acb0-4632-b65e-261377c81a5e-kube-api-access-fcx8v\") pod \"payload-pre-processing-e2e-autores-e114ba-65c4b7655d-cpblh\" (UID: \"50175cdb-acb0-4632-b65e-261377c81a5e\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-e114ba-65c4b7655d-cpblh"
Sep 15 11:39:00.817624 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:00.817593    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-e114ba-65c4b7655d-cpblh"
Sep 15 11:39:01.093806 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:01.093779    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-e114ba-65c4b7655d-cpblh"]
Sep 15 11:39:01.094969 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:39:01.094942    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50175cdb_acb0_4632_b65e_261377c81a5e.slice/crio-f508b11a8eeef29c2af7ffcffa96489be2f743a4aa7ad546c4a6251b46a37292 WatchSource:0}: Error finding container f508b11a8eeef29c2af7ffcffa96489be2f743a4aa7ad546c4a6251b46a37292: Status 404 returned error can't find the container with id f508b11a8eeef29c2af7ffcffa96489be2f743a4aa7ad546c4a6251b46a37292
Sep 15 11:39:01.476921 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:01.476880    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl" event={"ID":"a6718cfd-aa18-4859-acf6-58f41da89d99","Type":"ContainerStarted","Data":"634143b33e3b89642e6dc41d2584ac5d981266e6febf79057d18fb050afb4e11"}
Sep 15 11:39:01.477135 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:01.476996    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl"
Sep 15 11:39:01.478605 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:01.478578    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-e114ba-65c4b7655d-cpblh" event={"ID":"50175cdb-acb0-4632-b65e-261377c81a5e","Type":"ContainerStarted","Data":"a0fc68f2c45745c87b44e2f3da8529d37920a1dbf133537c366db7d85c03a65e"}
Sep 15 11:39:01.478709 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:01.478626    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-e114ba-65c4b7655d-cpblh" event={"ID":"50175cdb-acb0-4632-b65e-261377c81a5e","Type":"ContainerStarted","Data":"f508b11a8eeef29c2af7ffcffa96489be2f743a4aa7ad546c4a6251b46a37292"}
Sep 15 11:39:01.478709 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:01.478663    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-e114ba-65c4b7655d-cpblh"
Sep 15 11:39:01.503641 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:01.503573    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl" podStartSLOduration=2.146488425 podStartE2EDuration="2.503554982s" totalImagesPullingTime="357.066557ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:39:01.502909647 +0000 UTC m=+820.964775701" watchObservedRunningTime="2026-09-15 11:39:01.503554982 +0000 UTC m=+820.965421032"
Sep 15 11:39:01.524211 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:01.524141    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-e114ba-65c4b7655d-cpblh" podStartSLOduration=1.5241153490000001 podStartE2EDuration="1.524115349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:39:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:39:01.522414348 +0000 UTC m=+820.984280401" watchObservedRunningTime="2026-09-15 11:39:01.524115349 +0000 UTC m=+820.985981404"
Sep 15 11:39:01.980662 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:01.980631    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp"]
Sep 15 11:39:01.984418 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:01.984389    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp"
Sep 15 11:39:01.987189 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:01.987153    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-1358dc-serving-cert\""
Sep 15 11:39:01.995748 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:01.995724    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp"]
Sep 15 11:39:02.097910 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:02.097524    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f53bd48-7c43-4180-886d-a5bce17765a9-metrics-certs\") pod \"maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp\" (UID: \"3f53bd48-7c43-4180-886d-a5bce17765a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp"
Sep 15 11:39:02.097910 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:02.097664    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f53bd48-7c43-4180-886d-a5bce17765a9-openshift-service-ca\") pod \"maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp\" (UID: \"3f53bd48-7c43-4180-886d-a5bce17765a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp"
Sep 15 11:39:02.097910 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:02.097712    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsmh2\" (UniqueName: \"kubernetes.io/projected/3f53bd48-7c43-4180-886d-a5bce17765a9-kube-api-access-lsmh2\") pod \"maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp\" (UID: \"3f53bd48-7c43-4180-886d-a5bce17765a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp"
Sep 15 11:39:02.097910 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:02.097752    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f53bd48-7c43-4180-886d-a5bce17765a9-maas-api-tls\") pod \"maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp\" (UID: \"3f53bd48-7c43-4180-886d-a5bce17765a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp"
Sep 15 11:39:02.198366 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:02.198333    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsmh2\" (UniqueName: \"kubernetes.io/projected/3f53bd48-7c43-4180-886d-a5bce17765a9-kube-api-access-lsmh2\") pod \"maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp\" (UID: \"3f53bd48-7c43-4180-886d-a5bce17765a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp"
Sep 15 11:39:02.198573 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:02.198378    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f53bd48-7c43-4180-886d-a5bce17765a9-maas-api-tls\") pod \"maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp\" (UID: \"3f53bd48-7c43-4180-886d-a5bce17765a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp"
Sep 15 11:39:02.198573 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:02.198402    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f53bd48-7c43-4180-886d-a5bce17765a9-metrics-certs\") pod \"maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp\" (UID: \"3f53bd48-7c43-4180-886d-a5bce17765a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp"
Sep 15 11:39:02.198573 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:02.198481    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f53bd48-7c43-4180-886d-a5bce17765a9-openshift-service-ca\") pod \"maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp\" (UID: \"3f53bd48-7c43-4180-886d-a5bce17765a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp"
Sep 15 11:39:02.198573 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:39:02.198516    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-1358dc-serving-cert: secret "maas-api-e2e-inf-b-1358dc-serving-cert" not found
Sep 15 11:39:02.198770 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:39:02.198595    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f53bd48-7c43-4180-886d-a5bce17765a9-maas-api-tls podName:3f53bd48-7c43-4180-886d-a5bce17765a9 nodeName:}" failed. No retries permitted until 2026-09-15 11:39:02.698573182 +0000 UTC m=+822.160439229 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3f53bd48-7c43-4180-886d-a5bce17765a9-maas-api-tls") pod "maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp" (UID: "3f53bd48-7c43-4180-886d-a5bce17765a9") : secret "maas-api-e2e-inf-b-1358dc-serving-cert" not found
Sep 15 11:39:02.199244 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:02.199218    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f53bd48-7c43-4180-886d-a5bce17765a9-openshift-service-ca\") pod \"maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp\" (UID: \"3f53bd48-7c43-4180-886d-a5bce17765a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp"
Sep 15 11:39:02.201219 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:02.201193    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f53bd48-7c43-4180-886d-a5bce17765a9-metrics-certs\") pod \"maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp\" (UID: \"3f53bd48-7c43-4180-886d-a5bce17765a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp"
Sep 15 11:39:02.209887 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:02.209845    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsmh2\" (UniqueName: \"kubernetes.io/projected/3f53bd48-7c43-4180-886d-a5bce17765a9-kube-api-access-lsmh2\") pod \"maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp\" (UID: \"3f53bd48-7c43-4180-886d-a5bce17765a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp"
Sep 15 11:39:02.460740 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:02.460714    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp"
Sep 15 11:39:02.703681 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:02.703640    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f53bd48-7c43-4180-886d-a5bce17765a9-maas-api-tls\") pod \"maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp\" (UID: \"3f53bd48-7c43-4180-886d-a5bce17765a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp"
Sep 15 11:39:02.706372 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:02.706340    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f53bd48-7c43-4180-886d-a5bce17765a9-maas-api-tls\") pod \"maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp\" (UID: \"3f53bd48-7c43-4180-886d-a5bce17765a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp"
Sep 15 11:39:02.895163 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:02.895129    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp"
Sep 15 11:39:03.178565 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:03.178479    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp"]
Sep 15 11:39:03.182291 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:39:03.182257    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f53bd48_7c43_4180_886d_a5bce17765a9.slice/crio-c24010f9c9cff5b9390c8c1ff9343c87d627609cc9a92e6495428a4f65ec1a61 WatchSource:0}: Error finding container c24010f9c9cff5b9390c8c1ff9343c87d627609cc9a92e6495428a4f65ec1a61: Status 404 returned error can't find the container with id c24010f9c9cff5b9390c8c1ff9343c87d627609cc9a92e6495428a4f65ec1a61
Sep 15 11:39:03.491539 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:03.491450    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp" event={"ID":"3f53bd48-7c43-4180-886d-a5bce17765a9","Type":"ContainerStarted","Data":"c24010f9c9cff5b9390c8c1ff9343c87d627609cc9a92e6495428a4f65ec1a61"}
Sep 15 11:39:04.498333 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:04.498290    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp" event={"ID":"3f53bd48-7c43-4180-886d-a5bce17765a9","Type":"ContainerStarted","Data":"2f626565a20b61e9cd3af3fedafaa66527e676023e583b683fe6fdcd425a8e89"}
Sep 15 11:39:04.498694 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:04.498419    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp"
Sep 15 11:39:04.518045 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:04.517989    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp" podStartSLOduration=2.840892234 podStartE2EDuration="3.51796873s" totalImagesPullingTime="677.076496ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:39:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:39:04.517410784 +0000 UTC m=+823.979276841" watchObservedRunningTime="2026-09-15 11:39:04.51796873 +0000 UTC m=+823.979834783"
Sep 15 11:39:07.489615 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:07.489585    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl"
Sep 15 11:39:10.508642 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:10.508612    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp"
Sep 15 11:39:12.487015 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:12.486987    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-e114ba-65c4b7655d-cpblh"
Sep 15 11:39:32.217162 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:32.217131    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp"]
Sep 15 11:39:32.217621 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:32.217417    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp" podUID="0b64fe56-4c45-4e36-b029-5a635ddcce18" containerName="maas-api" containerID="cri-o://f39f324f4d9c45b4536e1cdf82f660cc544da0194fea3bf01423133e2a879c69" gracePeriod=30
Sep 15 11:39:32.481867 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:32.481805    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp"
Sep 15 11:39:32.582088 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:32.582058    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b64fe56-4c45-4e36-b029-5a635ddcce18-maas-api-tls\") pod \"0b64fe56-4c45-4e36-b029-5a635ddcce18\" (UID: \"0b64fe56-4c45-4e36-b029-5a635ddcce18\") "
Sep 15 11:39:32.582324 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:32.582113    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6j7j\" (UniqueName: \"kubernetes.io/projected/0b64fe56-4c45-4e36-b029-5a635ddcce18-kube-api-access-x6j7j\") pod \"0b64fe56-4c45-4e36-b029-5a635ddcce18\" (UID: \"0b64fe56-4c45-4e36-b029-5a635ddcce18\") "
Sep 15 11:39:32.582324 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:32.582131    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b64fe56-4c45-4e36-b029-5a635ddcce18-metrics-certs\") pod \"0b64fe56-4c45-4e36-b029-5a635ddcce18\" (UID: \"0b64fe56-4c45-4e36-b029-5a635ddcce18\") "
Sep 15 11:39:32.582324 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:32.582252    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b64fe56-4c45-4e36-b029-5a635ddcce18-openshift-service-ca\") pod \"0b64fe56-4c45-4e36-b029-5a635ddcce18\" (UID: \"0b64fe56-4c45-4e36-b029-5a635ddcce18\") "
Sep 15 11:39:32.582590 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:32.582559    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b64fe56-4c45-4e36-b029-5a635ddcce18-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0b64fe56-4c45-4e36-b029-5a635ddcce18" (UID: "0b64fe56-4c45-4e36-b029-5a635ddcce18"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:39:32.582676 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:32.582658    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b64fe56-4c45-4e36-b029-5a635ddcce18-openshift-service-ca\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:39:32.584923 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:32.584885    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b64fe56-4c45-4e36-b029-5a635ddcce18-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0b64fe56-4c45-4e36-b029-5a635ddcce18" (UID: "0b64fe56-4c45-4e36-b029-5a635ddcce18"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:39:32.584923 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:32.584907    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b64fe56-4c45-4e36-b029-5a635ddcce18-kube-api-access-x6j7j" (OuterVolumeSpecName: "kube-api-access-x6j7j") pod "0b64fe56-4c45-4e36-b029-5a635ddcce18" (UID: "0b64fe56-4c45-4e36-b029-5a635ddcce18"). InnerVolumeSpecName "kube-api-access-x6j7j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:39:32.585148 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:32.585111    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b64fe56-4c45-4e36-b029-5a635ddcce18-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0b64fe56-4c45-4e36-b029-5a635ddcce18" (UID: "0b64fe56-4c45-4e36-b029-5a635ddcce18"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:39:32.636876 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:32.636845    2582 generic.go:356] "Generic (PLEG): container finished" podID="0b64fe56-4c45-4e36-b029-5a635ddcce18" containerID="f39f324f4d9c45b4536e1cdf82f660cc544da0194fea3bf01423133e2a879c69" exitCode=0
Sep 15 11:39:32.637056 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:32.636898    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp"
Sep 15 11:39:32.637056 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:32.636920    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp" event={"ID":"0b64fe56-4c45-4e36-b029-5a635ddcce18","Type":"ContainerDied","Data":"f39f324f4d9c45b4536e1cdf82f660cc544da0194fea3bf01423133e2a879c69"}
Sep 15 11:39:32.637056 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:32.636976    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp" event={"ID":"0b64fe56-4c45-4e36-b029-5a635ddcce18","Type":"ContainerDied","Data":"d1561a959ff4d2c601ca3fc978ff35c7fd7e4786992c5ce76f07b63f92ba2a72"}
Sep 15 11:39:32.637056 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:32.636998    2582 scope.go:117] "RemoveContainer" containerID="f39f324f4d9c45b4536e1cdf82f660cc544da0194fea3bf01423133e2a879c69"
Sep 15 11:39:32.647152 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:32.647131    2582 scope.go:117] "RemoveContainer" containerID="f39f324f4d9c45b4536e1cdf82f660cc544da0194fea3bf01423133e2a879c69"
Sep 15 11:39:32.647541 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:39:32.647511    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f39f324f4d9c45b4536e1cdf82f660cc544da0194fea3bf01423133e2a879c69\": container with ID starting with f39f324f4d9c45b4536e1cdf82f660cc544da0194fea3bf01423133e2a879c69 not found: ID does not exist" containerID="f39f324f4d9c45b4536e1cdf82f660cc544da0194fea3bf01423133e2a879c69"
Sep 15 11:39:32.647658 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:32.647553    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f39f324f4d9c45b4536e1cdf82f660cc544da0194fea3bf01423133e2a879c69"} err="failed to get container status \"f39f324f4d9c45b4536e1cdf82f660cc544da0194fea3bf01423133e2a879c69\": rpc error: code = NotFound desc = could not find container \"f39f324f4d9c45b4536e1cdf82f660cc544da0194fea3bf01423133e2a879c69\": container with ID starting with f39f324f4d9c45b4536e1cdf82f660cc544da0194fea3bf01423133e2a879c69 not found: ID does not exist"
Sep 15 11:39:32.668824 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:32.668793    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp"]
Sep 15 11:39:32.676868 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:32.676839    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp"]
Sep 15 11:39:32.683643 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:32.683617    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b64fe56-4c45-4e36-b029-5a635ddcce18-maas-api-tls\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:39:32.683643 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:32.683640    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6j7j\" (UniqueName: \"kubernetes.io/projected/0b64fe56-4c45-4e36-b029-5a635ddcce18-kube-api-access-x6j7j\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:39:32.683844 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:32.683652    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b64fe56-4c45-4e36-b029-5a635ddcce18-metrics-certs\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:39:33.046346 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:33.046314    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b64fe56-4c45-4e36-b029-5a635ddcce18" path="/var/lib/kubelet/pods/0b64fe56-4c45-4e36-b029-5a635ddcce18/volumes"
Sep 15 11:39:35.456095 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:35.456044    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f77ab79-6ccb44b9b4-psrrp" podUID="0b64fe56-4c45-4e36-b029-5a635ddcce18" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.36:8443/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 15 11:39:38.478938 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:38.478896    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc"]
Sep 15 11:39:38.479608 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:38.479586    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b64fe56-4c45-4e36-b029-5a635ddcce18" containerName="maas-api"
Sep 15 11:39:38.479653 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:38.479614    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b64fe56-4c45-4e36-b029-5a635ddcce18" containerName="maas-api"
Sep 15 11:39:38.479728 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:38.479714    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b64fe56-4c45-4e36-b029-5a635ddcce18" containerName="maas-api"
Sep 15 11:39:38.484792 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:38.484770    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc"
Sep 15 11:39:38.487358 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:38.487337    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-fc7a9035-serving-cert\""
Sep 15 11:39:38.493905 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:38.493882    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc"]
Sep 15 11:39:38.636720 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:38.636685    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/085c17bf-8b68-4083-b845-2123d3a7d8e6-openshift-service-ca\") pod \"maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc\" (UID: \"085c17bf-8b68-4083-b845-2123d3a7d8e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc"
Sep 15 11:39:38.636888 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:38.636763    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/085c17bf-8b68-4083-b845-2123d3a7d8e6-maas-api-tls\") pod \"maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc\" (UID: \"085c17bf-8b68-4083-b845-2123d3a7d8e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc"
Sep 15 11:39:38.636888 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:38.636787    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/085c17bf-8b68-4083-b845-2123d3a7d8e6-metrics-certs\") pod \"maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc\" (UID: \"085c17bf-8b68-4083-b845-2123d3a7d8e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc"
Sep 15 11:39:38.636888 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:38.636821    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb2cz\" (UniqueName: \"kubernetes.io/projected/085c17bf-8b68-4083-b845-2123d3a7d8e6-kube-api-access-gb2cz\") pod \"maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc\" (UID: \"085c17bf-8b68-4083-b845-2123d3a7d8e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc"
Sep 15 11:39:38.738123 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:38.738029    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/085c17bf-8b68-4083-b845-2123d3a7d8e6-maas-api-tls\") pod \"maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc\" (UID: \"085c17bf-8b68-4083-b845-2123d3a7d8e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc"
Sep 15 11:39:38.738123 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:38.738062    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/085c17bf-8b68-4083-b845-2123d3a7d8e6-metrics-certs\") pod \"maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc\" (UID: \"085c17bf-8b68-4083-b845-2123d3a7d8e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc"
Sep 15 11:39:38.738123 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:38.738113    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb2cz\" (UniqueName: \"kubernetes.io/projected/085c17bf-8b68-4083-b845-2123d3a7d8e6-kube-api-access-gb2cz\") pod \"maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc\" (UID: \"085c17bf-8b68-4083-b845-2123d3a7d8e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc"
Sep 15 11:39:38.738480 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:38.738157    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/085c17bf-8b68-4083-b845-2123d3a7d8e6-openshift-service-ca\") pod \"maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc\" (UID: \"085c17bf-8b68-4083-b845-2123d3a7d8e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc"
Sep 15 11:39:38.738480 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:39:38.738217    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-fc7a9035-serving-cert: secret "maas-api-e2e-migrate-fc7a9035-serving-cert" not found
Sep 15 11:39:38.738480 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:39:38.738303    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/085c17bf-8b68-4083-b845-2123d3a7d8e6-maas-api-tls podName:085c17bf-8b68-4083-b845-2123d3a7d8e6 nodeName:}" failed. No retries permitted until 2026-09-15 11:39:39.238282478 +0000 UTC m=+858.700148522 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/085c17bf-8b68-4083-b845-2123d3a7d8e6-maas-api-tls") pod "maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc" (UID: "085c17bf-8b68-4083-b845-2123d3a7d8e6") : secret "maas-api-e2e-migrate-fc7a9035-serving-cert" not found
Sep 15 11:39:38.738846 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:38.738823    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/085c17bf-8b68-4083-b845-2123d3a7d8e6-openshift-service-ca\") pod \"maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc\" (UID: \"085c17bf-8b68-4083-b845-2123d3a7d8e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc"
Sep 15 11:39:38.740787 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:38.740769    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/085c17bf-8b68-4083-b845-2123d3a7d8e6-metrics-certs\") pod \"maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc\" (UID: \"085c17bf-8b68-4083-b845-2123d3a7d8e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc"
Sep 15 11:39:38.754450 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:38.754426    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb2cz\" (UniqueName: \"kubernetes.io/projected/085c17bf-8b68-4083-b845-2123d3a7d8e6-kube-api-access-gb2cz\") pod \"maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc\" (UID: \"085c17bf-8b68-4083-b845-2123d3a7d8e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc"
Sep 15 11:39:39.138547 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:39.138513    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-fc7a9035-6b57977598-w79n4"]
Sep 15 11:39:39.142492 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:39.142477    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-fc7a9035-6b57977598-w79n4"
Sep 15 11:39:39.144781 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:39.144762    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-fc7a9035\""
Sep 15 11:39:39.145160 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:39.145146    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-fc7a9035-dockercfg-wm9w6\""
Sep 15 11:39:39.157557 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:39.157537    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-fc7a9035-6b57977598-w79n4"]
Sep 15 11:39:39.242076 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:39.242035    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g8xf\" (UniqueName: \"kubernetes.io/projected/6037bc30-0bc5-413f-b829-c151c7db6c0d-kube-api-access-6g8xf\") pod \"payload-pre-processing-e2e-migrate-fc7a9035-6b57977598-w79n4\" (UID: \"6037bc30-0bc5-413f-b829-c151c7db6c0d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-fc7a9035-6b57977598-w79n4"
Sep 15 11:39:39.242439 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:39.242400    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6037bc30-0bc5-413f-b829-c151c7db6c0d-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-fc7a9035-6b57977598-w79n4\" (UID: \"6037bc30-0bc5-413f-b829-c151c7db6c0d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-fc7a9035-6b57977598-w79n4"
Sep 15 11:39:39.242538 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:39.242458    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/085c17bf-8b68-4083-b845-2123d3a7d8e6-maas-api-tls\") pod \"maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc\" (UID: \"085c17bf-8b68-4083-b845-2123d3a7d8e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc"
Sep 15 11:39:39.245081 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:39.245059    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/085c17bf-8b68-4083-b845-2123d3a7d8e6-maas-api-tls\") pod \"maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc\" (UID: \"085c17bf-8b68-4083-b845-2123d3a7d8e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc"
Sep 15 11:39:39.343587 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:39.343547    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g8xf\" (UniqueName: \"kubernetes.io/projected/6037bc30-0bc5-413f-b829-c151c7db6c0d-kube-api-access-6g8xf\") pod \"payload-pre-processing-e2e-migrate-fc7a9035-6b57977598-w79n4\" (UID: \"6037bc30-0bc5-413f-b829-c151c7db6c0d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-fc7a9035-6b57977598-w79n4"
Sep 15 11:39:39.343783 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:39.343621    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6037bc30-0bc5-413f-b829-c151c7db6c0d-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-fc7a9035-6b57977598-w79n4\" (UID: \"6037bc30-0bc5-413f-b829-c151c7db6c0d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-fc7a9035-6b57977598-w79n4"
Sep 15 11:39:39.344353 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:39.344328    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6037bc30-0bc5-413f-b829-c151c7db6c0d-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-fc7a9035-6b57977598-w79n4\" (UID: \"6037bc30-0bc5-413f-b829-c151c7db6c0d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-fc7a9035-6b57977598-w79n4"
Sep 15 11:39:39.352954 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:39.352923    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g8xf\" (UniqueName: \"kubernetes.io/projected/6037bc30-0bc5-413f-b829-c151c7db6c0d-kube-api-access-6g8xf\") pod \"payload-pre-processing-e2e-migrate-fc7a9035-6b57977598-w79n4\" (UID: \"6037bc30-0bc5-413f-b829-c151c7db6c0d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-fc7a9035-6b57977598-w79n4"
Sep 15 11:39:39.396889 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:39.396808    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc"
Sep 15 11:39:39.454381 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:39.454346    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-fc7a9035-6b57977598-w79n4"
Sep 15 11:39:39.671767 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:39.671745    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc"]
Sep 15 11:39:39.741289 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:39.741262    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-fc7a9035-6b57977598-w79n4"]
Sep 15 11:39:39.744119 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:39:39.744091    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6037bc30_0bc5_413f_b829_c151c7db6c0d.slice/crio-69643b8126d38fd02363a78246e568c36e2abec062588cc26fb6152f541279cc WatchSource:0}: Error finding container 69643b8126d38fd02363a78246e568c36e2abec062588cc26fb6152f541279cc: Status 404 returned error can't find the container with id 69643b8126d38fd02363a78246e568c36e2abec062588cc26fb6152f541279cc
Sep 15 11:39:40.689355 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:40.689321    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc" event={"ID":"085c17bf-8b68-4083-b845-2123d3a7d8e6","Type":"ContainerStarted","Data":"d7d5e32e42fdeaebd238312005ba83a747806dd2226ed16a5f8c852f23682d24"}
Sep 15 11:39:40.689788 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:40.689374    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc" event={"ID":"085c17bf-8b68-4083-b845-2123d3a7d8e6","Type":"ContainerStarted","Data":"1c9768e11319d6f7e322d379bedcad46388ba4424d30e44eefebdf2b83318922"}
Sep 15 11:39:40.689788 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:40.689450    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc"
Sep 15 11:39:40.690948 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:40.690924    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-fc7a9035-6b57977598-w79n4" event={"ID":"6037bc30-0bc5-413f-b829-c151c7db6c0d","Type":"ContainerStarted","Data":"440ffc25f4f5359dde8e23e66334996383f76bc707f17255c9ecc77ef3f83e3c"}
Sep 15 11:39:40.691088 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:40.690964    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-fc7a9035-6b57977598-w79n4" event={"ID":"6037bc30-0bc5-413f-b829-c151c7db6c0d","Type":"ContainerStarted","Data":"69643b8126d38fd02363a78246e568c36e2abec062588cc26fb6152f541279cc"}
Sep 15 11:39:40.691088 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:40.690986    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-fc7a9035-6b57977598-w79n4"
Sep 15 11:39:40.710807 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:40.710767    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc" podStartSLOduration=2.279601333 podStartE2EDuration="2.710751782s" totalImagesPullingTime="431.150449ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:39:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:39:40.708799187 +0000 UTC m=+860.170665240" watchObservedRunningTime="2026-09-15 11:39:40.710751782 +0000 UTC m=+860.172617835"
Sep 15 11:39:40.730055 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:40.730010    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-fc7a9035-6b57977598-w79n4" podStartSLOduration=1.729996638 podStartE2EDuration="1.729996638s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:39:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:39:40.728756141 +0000 UTC m=+860.190622196" watchObservedRunningTime="2026-09-15 11:39:40.729996638 +0000 UTC m=+860.191862691"
Sep 15 11:39:46.702162 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:46.702134    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc"
Sep 15 11:39:51.699371 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:39:51.699335    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-fc7a9035-6b57977598-w79n4"
Sep 15 11:40:07.630503 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:07.630466    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc"]
Sep 15 11:40:07.631048 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:07.630722    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc" podUID="085c17bf-8b68-4083-b845-2123d3a7d8e6" containerName="maas-api" containerID="cri-o://d7d5e32e42fdeaebd238312005ba83a747806dd2226ed16a5f8c852f23682d24" gracePeriod=30
Sep 15 11:40:07.718491 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:07.718451    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-fc7a9035-6b57977598-w79n4"]
Sep 15 11:40:07.718731 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:07.718704    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-fc7a9035-6b57977598-w79n4" podUID="6037bc30-0bc5-413f-b829-c151c7db6c0d" containerName="payload-pre-processing" containerID="cri-o://440ffc25f4f5359dde8e23e66334996383f76bc707f17255c9ecc77ef3f83e3c" gracePeriod=30
Sep 15 11:40:07.827722 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:07.827677    2582 generic.go:356] "Generic (PLEG): container finished" podID="085c17bf-8b68-4083-b845-2123d3a7d8e6" containerID="d7d5e32e42fdeaebd238312005ba83a747806dd2226ed16a5f8c852f23682d24" exitCode=0
Sep 15 11:40:07.827858 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:07.827757    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc" event={"ID":"085c17bf-8b68-4083-b845-2123d3a7d8e6","Type":"ContainerDied","Data":"d7d5e32e42fdeaebd238312005ba83a747806dd2226ed16a5f8c852f23682d24"}
Sep 15 11:40:07.980282 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:07.980253    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc"
Sep 15 11:40:08.016626 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:08.016592    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-fc7a9035-6b57977598-w79n4"
Sep 15 11:40:08.101640 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:08.101583    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6037bc30-0bc5-413f-b829-c151c7db6c0d-plugins-config-volume\") pod \"6037bc30-0bc5-413f-b829-c151c7db6c0d\" (UID: \"6037bc30-0bc5-413f-b829-c151c7db6c0d\") "
Sep 15 11:40:08.101640 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:08.101644    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6g8xf\" (UniqueName: \"kubernetes.io/projected/6037bc30-0bc5-413f-b829-c151c7db6c0d-kube-api-access-6g8xf\") pod \"6037bc30-0bc5-413f-b829-c151c7db6c0d\" (UID: \"6037bc30-0bc5-413f-b829-c151c7db6c0d\") "
Sep 15 11:40:08.101892 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:08.101755    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gb2cz\" (UniqueName: \"kubernetes.io/projected/085c17bf-8b68-4083-b845-2123d3a7d8e6-kube-api-access-gb2cz\") pod \"085c17bf-8b68-4083-b845-2123d3a7d8e6\" (UID: \"085c17bf-8b68-4083-b845-2123d3a7d8e6\") "
Sep 15 11:40:08.101953 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:08.101908    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/085c17bf-8b68-4083-b845-2123d3a7d8e6-openshift-service-ca\") pod \"085c17bf-8b68-4083-b845-2123d3a7d8e6\" (UID: \"085c17bf-8b68-4083-b845-2123d3a7d8e6\") "
Sep 15 11:40:08.102038 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:08.102018    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6037bc30-0bc5-413f-b829-c151c7db6c0d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6037bc30-0bc5-413f-b829-c151c7db6c0d" (UID: "6037bc30-0bc5-413f-b829-c151c7db6c0d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:40:08.102355 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:08.102318    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/085c17bf-8b68-4083-b845-2123d3a7d8e6-maas-api-tls\") pod \"085c17bf-8b68-4083-b845-2123d3a7d8e6\" (UID: \"085c17bf-8b68-4083-b845-2123d3a7d8e6\") "
Sep 15 11:40:08.102474 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:08.102371    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/085c17bf-8b68-4083-b845-2123d3a7d8e6-metrics-certs\") pod \"085c17bf-8b68-4083-b845-2123d3a7d8e6\" (UID: \"085c17bf-8b68-4083-b845-2123d3a7d8e6\") "
Sep 15 11:40:08.102737 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:08.102686    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6037bc30-0bc5-413f-b829-c151c7db6c0d-plugins-config-volume\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:40:08.102925 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:08.102866    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/085c17bf-8b68-4083-b845-2123d3a7d8e6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "085c17bf-8b68-4083-b845-2123d3a7d8e6" (UID: "085c17bf-8b68-4083-b845-2123d3a7d8e6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:40:08.104851 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:08.104668    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/085c17bf-8b68-4083-b845-2123d3a7d8e6-kube-api-access-gb2cz" (OuterVolumeSpecName: "kube-api-access-gb2cz") pod "085c17bf-8b68-4083-b845-2123d3a7d8e6" (UID: "085c17bf-8b68-4083-b845-2123d3a7d8e6"). InnerVolumeSpecName "kube-api-access-gb2cz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:40:08.105025 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:08.104949    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/085c17bf-8b68-4083-b845-2123d3a7d8e6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "085c17bf-8b68-4083-b845-2123d3a7d8e6" (UID: "085c17bf-8b68-4083-b845-2123d3a7d8e6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:40:08.105404 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:08.105368    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6037bc30-0bc5-413f-b829-c151c7db6c0d-kube-api-access-6g8xf" (OuterVolumeSpecName: "kube-api-access-6g8xf") pod "6037bc30-0bc5-413f-b829-c151c7db6c0d" (UID: "6037bc30-0bc5-413f-b829-c151c7db6c0d"). InnerVolumeSpecName "kube-api-access-6g8xf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:40:08.105618 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:08.105599    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/085c17bf-8b68-4083-b845-2123d3a7d8e6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "085c17bf-8b68-4083-b845-2123d3a7d8e6" (UID: "085c17bf-8b68-4083-b845-2123d3a7d8e6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:40:08.203971 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:08.203889    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gb2cz\" (UniqueName: \"kubernetes.io/projected/085c17bf-8b68-4083-b845-2123d3a7d8e6-kube-api-access-gb2cz\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:40:08.203971 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:08.203924    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/085c17bf-8b68-4083-b845-2123d3a7d8e6-openshift-service-ca\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:40:08.203971 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:08.203941    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/085c17bf-8b68-4083-b845-2123d3a7d8e6-maas-api-tls\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:40:08.203971 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:08.203956    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/085c17bf-8b68-4083-b845-2123d3a7d8e6-metrics-certs\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:40:08.203971 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:08.203969    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6g8xf\" (UniqueName: \"kubernetes.io/projected/6037bc30-0bc5-413f-b829-c151c7db6c0d-kube-api-access-6g8xf\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:40:08.835988 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:08.835945    2582 generic.go:356] "Generic (PLEG): container finished" podID="6037bc30-0bc5-413f-b829-c151c7db6c0d" containerID="440ffc25f4f5359dde8e23e66334996383f76bc707f17255c9ecc77ef3f83e3c" exitCode=0
Sep 15 11:40:08.836491 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:08.836024    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-fc7a9035-6b57977598-w79n4"
Sep 15 11:40:08.836491 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:08.836032    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-fc7a9035-6b57977598-w79n4" event={"ID":"6037bc30-0bc5-413f-b829-c151c7db6c0d","Type":"ContainerDied","Data":"440ffc25f4f5359dde8e23e66334996383f76bc707f17255c9ecc77ef3f83e3c"}
Sep 15 11:40:08.836491 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:08.836131    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-fc7a9035-6b57977598-w79n4" event={"ID":"6037bc30-0bc5-413f-b829-c151c7db6c0d","Type":"ContainerDied","Data":"69643b8126d38fd02363a78246e568c36e2abec062588cc26fb6152f541279cc"}
Sep 15 11:40:08.836491 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:08.836161    2582 scope.go:117] "RemoveContainer" containerID="440ffc25f4f5359dde8e23e66334996383f76bc707f17255c9ecc77ef3f83e3c"
Sep 15 11:40:08.838536 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:08.838510    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc" event={"ID":"085c17bf-8b68-4083-b845-2123d3a7d8e6","Type":"ContainerDied","Data":"1c9768e11319d6f7e322d379bedcad46388ba4424d30e44eefebdf2b83318922"}
Sep 15 11:40:08.838692 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:08.838667    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc"
Sep 15 11:40:08.848411 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:08.848384    2582 scope.go:117] "RemoveContainer" containerID="440ffc25f4f5359dde8e23e66334996383f76bc707f17255c9ecc77ef3f83e3c"
Sep 15 11:40:08.848840 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:40:08.848813    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"440ffc25f4f5359dde8e23e66334996383f76bc707f17255c9ecc77ef3f83e3c\": container with ID starting with 440ffc25f4f5359dde8e23e66334996383f76bc707f17255c9ecc77ef3f83e3c not found: ID does not exist" containerID="440ffc25f4f5359dde8e23e66334996383f76bc707f17255c9ecc77ef3f83e3c"
Sep 15 11:40:08.848909 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:08.848854    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"440ffc25f4f5359dde8e23e66334996383f76bc707f17255c9ecc77ef3f83e3c"} err="failed to get container status \"440ffc25f4f5359dde8e23e66334996383f76bc707f17255c9ecc77ef3f83e3c\": rpc error: code = NotFound desc = could not find container \"440ffc25f4f5359dde8e23e66334996383f76bc707f17255c9ecc77ef3f83e3c\": container with ID starting with 440ffc25f4f5359dde8e23e66334996383f76bc707f17255c9ecc77ef3f83e3c not found: ID does not exist"
Sep 15 11:40:08.848909 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:08.848881    2582 scope.go:117] "RemoveContainer" containerID="d7d5e32e42fdeaebd238312005ba83a747806dd2226ed16a5f8c852f23682d24"
Sep 15 11:40:08.870765 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:08.870732    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-fc7a9035-6b57977598-w79n4"]
Sep 15 11:40:08.875962 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:08.875934    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-fc7a9035-6b57977598-w79n4"]
Sep 15 11:40:08.890511 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:08.890477    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc"]
Sep 15 11:40:08.897732 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:08.897653    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-fc7a9035-5df454d977-d4hgc"]
Sep 15 11:40:09.045699 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:09.045668    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="085c17bf-8b68-4083-b845-2123d3a7d8e6" path="/var/lib/kubelet/pods/085c17bf-8b68-4083-b845-2123d3a7d8e6/volumes"
Sep 15 11:40:09.046034 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:09.046022    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6037bc30-0bc5-413f-b829-c151c7db6c0d" path="/var/lib/kubelet/pods/6037bc30-0bc5-413f-b829-c151c7db6c0d/volumes"
Sep 15 11:40:13.581727 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:13.581646    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99"]
Sep 15 11:40:13.582266 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:13.582203    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6037bc30-0bc5-413f-b829-c151c7db6c0d" containerName="payload-pre-processing"
Sep 15 11:40:13.582266 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:13.582223    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6037bc30-0bc5-413f-b829-c151c7db6c0d" containerName="payload-pre-processing"
Sep 15 11:40:13.582266 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:13.582258    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="085c17bf-8b68-4083-b845-2123d3a7d8e6" containerName="maas-api"
Sep 15 11:40:13.582266 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:13.582267    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="085c17bf-8b68-4083-b845-2123d3a7d8e6" containerName="maas-api"
Sep 15 11:40:13.582512 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:13.582363    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6037bc30-0bc5-413f-b829-c151c7db6c0d" containerName="payload-pre-processing"
Sep 15 11:40:13.582512 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:13.582413    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="085c17bf-8b68-4083-b845-2123d3a7d8e6" containerName="maas-api"
Sep 15 11:40:13.587292 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:13.587268    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99"
Sep 15 11:40:13.590891 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:13.590865    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-2b418982-serving-cert\""
Sep 15 11:40:13.596961 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:13.596935    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99"]
Sep 15 11:40:13.653669 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:13.653634    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd-openshift-service-ca\") pod \"maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99\" (UID: \"f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99"
Sep 15 11:40:13.653849 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:13.653704    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9rm2\" (UniqueName: \"kubernetes.io/projected/f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd-kube-api-access-f9rm2\") pod \"maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99\" (UID: \"f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99"
Sep 15 11:40:13.653849 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:13.653725    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd-metrics-certs\") pod \"maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99\" (UID: \"f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99"
Sep 15 11:40:13.653849 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:13.653755    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd-maas-api-tls\") pod \"maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99\" (UID: \"f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99"
Sep 15 11:40:13.754577 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:13.754543    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9rm2\" (UniqueName: \"kubernetes.io/projected/f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd-kube-api-access-f9rm2\") pod \"maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99\" (UID: \"f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99"
Sep 15 11:40:13.754577 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:13.754579    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd-metrics-certs\") pod \"maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99\" (UID: \"f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99"
Sep 15 11:40:13.754794 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:13.754627    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd-maas-api-tls\") pod \"maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99\" (UID: \"f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99"
Sep 15 11:40:13.754794 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:13.754694    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd-openshift-service-ca\") pod \"maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99\" (UID: \"f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99"
Sep 15 11:40:13.754894 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:40:13.754793    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-2b418982-serving-cert: secret "maas-api-e2e-ait-2b418982-serving-cert" not found
Sep 15 11:40:13.754894 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:40:13.754864    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd-maas-api-tls podName:f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd nodeName:}" failed. No retries permitted until 2026-09-15 11:40:14.254847964 +0000 UTC m=+893.716713999 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd-maas-api-tls") pod "maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99" (UID: "f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd") : secret "maas-api-e2e-ait-2b418982-serving-cert" not found
Sep 15 11:40:13.755456 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:13.755430    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd-openshift-service-ca\") pod \"maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99\" (UID: \"f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99"
Sep 15 11:40:13.757394 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:13.757371    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd-metrics-certs\") pod \"maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99\" (UID: \"f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99"
Sep 15 11:40:13.767931 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:13.767903    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9rm2\" (UniqueName: \"kubernetes.io/projected/f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd-kube-api-access-f9rm2\") pod \"maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99\" (UID: \"f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99"
Sep 15 11:40:14.258426 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:14.258391    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-2b418982-98c6875cf-d446h"]
Sep 15 11:40:14.259757 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:14.259726    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd-maas-api-tls\") pod \"maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99\" (UID: \"f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99"
Sep 15 11:40:14.262308 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:14.262281    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd-maas-api-tls\") pod \"maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99\" (UID: \"f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99"
Sep 15 11:40:14.262559 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:14.262544    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-2b418982-98c6875cf-d446h"
Sep 15 11:40:14.266023 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:14.266003    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-2b418982-dockercfg-jt5wm\""
Sep 15 11:40:14.266160 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:14.266097    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-2b418982\""
Sep 15 11:40:14.273476 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:14.273455    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-2b418982-98c6875cf-d446h"]
Sep 15 11:40:14.361324 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:14.361289    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddlq7\" (UniqueName: \"kubernetes.io/projected/ad212ef2-92c3-413f-9624-9eb076f6358b-kube-api-access-ddlq7\") pod \"payload-processing-e2e-ait-2b418982-98c6875cf-d446h\" (UID: \"ad212ef2-92c3-413f-9624-9eb076f6358b\") " pod="openshift-ingress/payload-processing-e2e-ait-2b418982-98c6875cf-d446h"
Sep 15 11:40:14.361501 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:14.361411    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad212ef2-92c3-413f-9624-9eb076f6358b-plugins-config-volume\") pod \"payload-processing-e2e-ait-2b418982-98c6875cf-d446h\" (UID: \"ad212ef2-92c3-413f-9624-9eb076f6358b\") " pod="openshift-ingress/payload-processing-e2e-ait-2b418982-98c6875cf-d446h"
Sep 15 11:40:14.461945 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:14.461898    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad212ef2-92c3-413f-9624-9eb076f6358b-plugins-config-volume\") pod \"payload-processing-e2e-ait-2b418982-98c6875cf-d446h\" (UID: \"ad212ef2-92c3-413f-9624-9eb076f6358b\") " pod="openshift-ingress/payload-processing-e2e-ait-2b418982-98c6875cf-d446h"
Sep 15 11:40:14.462161 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:14.461987    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddlq7\" (UniqueName: \"kubernetes.io/projected/ad212ef2-92c3-413f-9624-9eb076f6358b-kube-api-access-ddlq7\") pod \"payload-processing-e2e-ait-2b418982-98c6875cf-d446h\" (UID: \"ad212ef2-92c3-413f-9624-9eb076f6358b\") " pod="openshift-ingress/payload-processing-e2e-ait-2b418982-98c6875cf-d446h"
Sep 15 11:40:14.462699 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:14.462677    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad212ef2-92c3-413f-9624-9eb076f6358b-plugins-config-volume\") pod \"payload-processing-e2e-ait-2b418982-98c6875cf-d446h\" (UID: \"ad212ef2-92c3-413f-9624-9eb076f6358b\") " pod="openshift-ingress/payload-processing-e2e-ait-2b418982-98c6875cf-d446h"
Sep 15 11:40:14.471062 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:14.471030    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddlq7\" (UniqueName: \"kubernetes.io/projected/ad212ef2-92c3-413f-9624-9eb076f6358b-kube-api-access-ddlq7\") pod \"payload-processing-e2e-ait-2b418982-98c6875cf-d446h\" (UID: \"ad212ef2-92c3-413f-9624-9eb076f6358b\") " pod="openshift-ingress/payload-processing-e2e-ait-2b418982-98c6875cf-d446h"
Sep 15 11:40:14.500547 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:14.500509    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99"
Sep 15 11:40:14.581528 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:14.581498    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-2b418982-98c6875cf-d446h"
Sep 15 11:40:14.775584 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:14.775557    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99"]
Sep 15 11:40:14.777379 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:40:14.777351    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1aae53d_b3d1_4e9d_89e1_08cfd5fa19bd.slice/crio-5199cb581cc3be9a01bed75c4389faa333f9f06b0d8babc909854d76ee34bd90 WatchSource:0}: Error finding container 5199cb581cc3be9a01bed75c4389faa333f9f06b0d8babc909854d76ee34bd90: Status 404 returned error can't find the container with id 5199cb581cc3be9a01bed75c4389faa333f9f06b0d8babc909854d76ee34bd90
Sep 15 11:40:14.865777 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:14.865746    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-2b418982-98c6875cf-d446h"]
Sep 15 11:40:14.867407 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:40:14.867380    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad212ef2_92c3_413f_9624_9eb076f6358b.slice/crio-f64c2da4f77fa03f9a567653a85abc67e4be7155aa08e5f1ec805bf67cdcd56e WatchSource:0}: Error finding container f64c2da4f77fa03f9a567653a85abc67e4be7155aa08e5f1ec805bf67cdcd56e: Status 404 returned error can't find the container with id f64c2da4f77fa03f9a567653a85abc67e4be7155aa08e5f1ec805bf67cdcd56e
Sep 15 11:40:14.874231 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:14.874205    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99" event={"ID":"f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd","Type":"ContainerStarted","Data":"5199cb581cc3be9a01bed75c4389faa333f9f06b0d8babc909854d76ee34bd90"}
Sep 15 11:40:14.875603 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:14.875581    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-2b418982-98c6875cf-d446h" event={"ID":"ad212ef2-92c3-413f-9624-9eb076f6358b","Type":"ContainerStarted","Data":"f64c2da4f77fa03f9a567653a85abc67e4be7155aa08e5f1ec805bf67cdcd56e"}
Sep 15 11:40:15.883010 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:15.882970    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99" event={"ID":"f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd","Type":"ContainerStarted","Data":"e0ef97ae74cdcf558a49435e1f30da3291663dd64a517d5e1a08b9eb4dd8de14"}
Sep 15 11:40:15.883516 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:15.883059    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99"
Sep 15 11:40:15.884959 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:15.884934    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-2b418982-98c6875cf-d446h" event={"ID":"ad212ef2-92c3-413f-9624-9eb076f6358b","Type":"ContainerStarted","Data":"65e80573736d7f758889010aad013dd5ac789554baba21f4cf397b19786a5e76"}
Sep 15 11:40:15.885089 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:15.885061    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-2b418982-98c6875cf-d446h"
Sep 15 11:40:15.902451 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:15.902401    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99" podStartSLOduration=2.273425125 podStartE2EDuration="2.902384887s" totalImagesPullingTime="628.959762ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:40:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:40:15.900404622 +0000 UTC m=+895.362270676" watchObservedRunningTime="2026-09-15 11:40:15.902384887 +0000 UTC m=+895.364250979"
Sep 15 11:40:15.923985 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:15.923934    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-2b418982-98c6875cf-d446h" podStartSLOduration=1.923917686 podStartE2EDuration="1.923917686s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:40:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:40:15.922259323 +0000 UTC m=+895.384125376" watchObservedRunningTime="2026-09-15 11:40:15.923917686 +0000 UTC m=+895.385783739"
Sep 15 11:40:21.895489 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:21.895461    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99"
Sep 15 11:40:26.893265 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:26.893231    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-2b418982-98c6875cf-d446h"
Sep 15 11:40:42.416272 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:42.416240    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99"]
Sep 15 11:40:42.416725 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:42.416459    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99" podUID="f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd" containerName="maas-api" containerID="cri-o://e0ef97ae74cdcf558a49435e1f30da3291663dd64a517d5e1a08b9eb4dd8de14" gracePeriod=30
Sep 15 11:40:42.470418 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:42.470380    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-2b418982-98c6875cf-d446h"]
Sep 15 11:40:42.470709 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:42.470658    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-2b418982-98c6875cf-d446h" podUID="ad212ef2-92c3-413f-9624-9eb076f6358b" containerName="payload-processing" containerID="cri-o://65e80573736d7f758889010aad013dd5ac789554baba21f4cf397b19786a5e76" gracePeriod=30
Sep 15 11:40:42.727621 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:42.727596    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99"
Sep 15 11:40:42.735935 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:42.735784    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd-maas-api-tls\") pod \"f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd\" (UID: \"f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd\") "
Sep 15 11:40:42.735935 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:42.735822    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd-metrics-certs\") pod \"f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd\" (UID: \"f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd\") "
Sep 15 11:40:42.735935 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:42.735905    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9rm2\" (UniqueName: \"kubernetes.io/projected/f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd-kube-api-access-f9rm2\") pod \"f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd\" (UID: \"f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd\") "
Sep 15 11:40:42.736199 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:42.735978    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd-openshift-service-ca\") pod \"f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd\" (UID: \"f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd\") "
Sep 15 11:40:42.736887 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:42.736854    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd" (UID: "f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:40:42.739389 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:42.739342    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd" (UID: "f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:40:42.739475 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:42.739444    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd" (UID: "f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:40:42.739756 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:42.739721    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd-kube-api-access-f9rm2" (OuterVolumeSpecName: "kube-api-access-f9rm2") pod "f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd" (UID: "f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd"). InnerVolumeSpecName "kube-api-access-f9rm2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:40:42.765693 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:42.765665    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-2b418982-98c6875cf-d446h"
Sep 15 11:40:42.836788 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:42.836758    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad212ef2-92c3-413f-9624-9eb076f6358b-plugins-config-volume\") pod \"ad212ef2-92c3-413f-9624-9eb076f6358b\" (UID: \"ad212ef2-92c3-413f-9624-9eb076f6358b\") "
Sep 15 11:40:42.836948 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:42.836812    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddlq7\" (UniqueName: \"kubernetes.io/projected/ad212ef2-92c3-413f-9624-9eb076f6358b-kube-api-access-ddlq7\") pod \"ad212ef2-92c3-413f-9624-9eb076f6358b\" (UID: \"ad212ef2-92c3-413f-9624-9eb076f6358b\") "
Sep 15 11:40:42.837027 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:42.837014    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd-openshift-service-ca\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:40:42.837065 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:42.837029    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd-maas-api-tls\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:40:42.837065 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:42.837042    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd-metrics-certs\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:40:42.837065 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:42.837054    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9rm2\" (UniqueName: \"kubernetes.io/projected/f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd-kube-api-access-f9rm2\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:40:42.837236 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:42.837208    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad212ef2-92c3-413f-9624-9eb076f6358b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ad212ef2-92c3-413f-9624-9eb076f6358b" (UID: "ad212ef2-92c3-413f-9624-9eb076f6358b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:40:42.838976 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:42.838955    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad212ef2-92c3-413f-9624-9eb076f6358b-kube-api-access-ddlq7" (OuterVolumeSpecName: "kube-api-access-ddlq7") pod "ad212ef2-92c3-413f-9624-9eb076f6358b" (UID: "ad212ef2-92c3-413f-9624-9eb076f6358b"). InnerVolumeSpecName "kube-api-access-ddlq7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:40:42.938487 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:42.938405    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddlq7\" (UniqueName: \"kubernetes.io/projected/ad212ef2-92c3-413f-9624-9eb076f6358b-kube-api-access-ddlq7\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:40:42.938487 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:42.938430    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad212ef2-92c3-413f-9624-9eb076f6358b-plugins-config-volume\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:40:43.020762 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:43.020731    2582 generic.go:356] "Generic (PLEG): container finished" podID="f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd" containerID="e0ef97ae74cdcf558a49435e1f30da3291663dd64a517d5e1a08b9eb4dd8de14" exitCode=0
Sep 15 11:40:43.020953 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:43.020793    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99"
Sep 15 11:40:43.020953 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:43.020802    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99" event={"ID":"f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd","Type":"ContainerDied","Data":"e0ef97ae74cdcf558a49435e1f30da3291663dd64a517d5e1a08b9eb4dd8de14"}
Sep 15 11:40:43.020953 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:43.020870    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99" event={"ID":"f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd","Type":"ContainerDied","Data":"5199cb581cc3be9a01bed75c4389faa333f9f06b0d8babc909854d76ee34bd90"}
Sep 15 11:40:43.020953 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:43.020903    2582 scope.go:117] "RemoveContainer" containerID="e0ef97ae74cdcf558a49435e1f30da3291663dd64a517d5e1a08b9eb4dd8de14"
Sep 15 11:40:43.022501 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:43.022477    2582 generic.go:356] "Generic (PLEG): container finished" podID="ad212ef2-92c3-413f-9624-9eb076f6358b" containerID="65e80573736d7f758889010aad013dd5ac789554baba21f4cf397b19786a5e76" exitCode=0
Sep 15 11:40:43.022600 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:43.022515    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-2b418982-98c6875cf-d446h"
Sep 15 11:40:43.022600 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:43.022526    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-2b418982-98c6875cf-d446h" event={"ID":"ad212ef2-92c3-413f-9624-9eb076f6358b","Type":"ContainerDied","Data":"65e80573736d7f758889010aad013dd5ac789554baba21f4cf397b19786a5e76"}
Sep 15 11:40:43.022600 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:43.022566    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-2b418982-98c6875cf-d446h" event={"ID":"ad212ef2-92c3-413f-9624-9eb076f6358b","Type":"ContainerDied","Data":"f64c2da4f77fa03f9a567653a85abc67e4be7155aa08e5f1ec805bf67cdcd56e"}
Sep 15 11:40:43.033322 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:43.033262    2582 scope.go:117] "RemoveContainer" containerID="e0ef97ae74cdcf558a49435e1f30da3291663dd64a517d5e1a08b9eb4dd8de14"
Sep 15 11:40:43.033636 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:40:43.033595    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0ef97ae74cdcf558a49435e1f30da3291663dd64a517d5e1a08b9eb4dd8de14\": container with ID starting with e0ef97ae74cdcf558a49435e1f30da3291663dd64a517d5e1a08b9eb4dd8de14 not found: ID does not exist" containerID="e0ef97ae74cdcf558a49435e1f30da3291663dd64a517d5e1a08b9eb4dd8de14"
Sep 15 11:40:43.033704 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:43.033632    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0ef97ae74cdcf558a49435e1f30da3291663dd64a517d5e1a08b9eb4dd8de14"} err="failed to get container status \"e0ef97ae74cdcf558a49435e1f30da3291663dd64a517d5e1a08b9eb4dd8de14\": rpc error: code = NotFound desc = could not find container \"e0ef97ae74cdcf558a49435e1f30da3291663dd64a517d5e1a08b9eb4dd8de14\": container with ID starting with e0ef97ae74cdcf558a49435e1f30da3291663dd64a517d5e1a08b9eb4dd8de14 not found: ID does not exist"
Sep 15 11:40:43.033704 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:43.033655    2582 scope.go:117] "RemoveContainer" containerID="65e80573736d7f758889010aad013dd5ac789554baba21f4cf397b19786a5e76"
Sep 15 11:40:43.042310 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:43.042294    2582 scope.go:117] "RemoveContainer" containerID="65e80573736d7f758889010aad013dd5ac789554baba21f4cf397b19786a5e76"
Sep 15 11:40:43.042581 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:40:43.042565    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65e80573736d7f758889010aad013dd5ac789554baba21f4cf397b19786a5e76\": container with ID starting with 65e80573736d7f758889010aad013dd5ac789554baba21f4cf397b19786a5e76 not found: ID does not exist" containerID="65e80573736d7f758889010aad013dd5ac789554baba21f4cf397b19786a5e76"
Sep 15 11:40:43.042638 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:43.042586    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65e80573736d7f758889010aad013dd5ac789554baba21f4cf397b19786a5e76"} err="failed to get container status \"65e80573736d7f758889010aad013dd5ac789554baba21f4cf397b19786a5e76\": rpc error: code = NotFound desc = could not find container \"65e80573736d7f758889010aad013dd5ac789554baba21f4cf397b19786a5e76\": container with ID starting with 65e80573736d7f758889010aad013dd5ac789554baba21f4cf397b19786a5e76 not found: ID does not exist"
Sep 15 11:40:43.045788 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:43.045767    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-2b418982-98c6875cf-d446h"]
Sep 15 11:40:43.050353 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:43.050334    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-2b418982-98c6875cf-d446h"]
Sep 15 11:40:43.061314 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:43.061290    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99"]
Sep 15 11:40:43.067730 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:43.067705    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2b418982-7fd4947fdd-kpg99"]
Sep 15 11:40:45.044894 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:45.044860    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad212ef2-92c3-413f-9624-9eb076f6358b" path="/var/lib/kubelet/pods/ad212ef2-92c3-413f-9624-9eb076f6358b/volumes"
Sep 15 11:40:45.045391 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:45.045295    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd" path="/var/lib/kubelet/pods/f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd/volumes"
Sep 15 11:40:51.490470 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:51.490432    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg"]
Sep 15 11:40:51.491034 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:51.491014    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad212ef2-92c3-413f-9624-9eb076f6358b" containerName="payload-processing"
Sep 15 11:40:51.491079 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:51.491040    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad212ef2-92c3-413f-9624-9eb076f6358b" containerName="payload-processing"
Sep 15 11:40:51.491079 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:51.491054    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd" containerName="maas-api"
Sep 15 11:40:51.491079 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:51.491063    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd" containerName="maas-api"
Sep 15 11:40:51.491223 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:51.491210    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad212ef2-92c3-413f-9624-9eb076f6358b" containerName="payload-processing"
Sep 15 11:40:51.491268 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:51.491226    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1aae53d-b3d1-4e9d-89e1-08cfd5fa19bd" containerName="maas-api"
Sep 15 11:40:51.494710 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:51.494689    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg"
Sep 15 11:40:51.497146 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:51.497112    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-ed7d9f67-serving-cert\""
Sep 15 11:40:51.505690 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:51.505663    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg"]
Sep 15 11:40:51.617507 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:51.617078    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/355fcee9-1680-4932-ba81-d8fc7d53564f-maas-api-tls\") pod \"maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg\" (UID: \"355fcee9-1680-4932-ba81-d8fc7d53564f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg"
Sep 15 11:40:51.617507 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:51.617161    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/355fcee9-1680-4932-ba81-d8fc7d53564f-openshift-service-ca\") pod \"maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg\" (UID: \"355fcee9-1680-4932-ba81-d8fc7d53564f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg"
Sep 15 11:40:51.617507 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:51.617270    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/355fcee9-1680-4932-ba81-d8fc7d53564f-metrics-certs\") pod \"maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg\" (UID: \"355fcee9-1680-4932-ba81-d8fc7d53564f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg"
Sep 15 11:40:51.617507 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:51.617339    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x22qj\" (UniqueName: \"kubernetes.io/projected/355fcee9-1680-4932-ba81-d8fc7d53564f-kube-api-access-x22qj\") pod \"maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg\" (UID: \"355fcee9-1680-4932-ba81-d8fc7d53564f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg"
Sep 15 11:40:51.718440 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:51.718410    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/355fcee9-1680-4932-ba81-d8fc7d53564f-maas-api-tls\") pod \"maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg\" (UID: \"355fcee9-1680-4932-ba81-d8fc7d53564f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg"
Sep 15 11:40:51.718635 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:51.718471    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/355fcee9-1680-4932-ba81-d8fc7d53564f-openshift-service-ca\") pod \"maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg\" (UID: \"355fcee9-1680-4932-ba81-d8fc7d53564f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg"
Sep 15 11:40:51.718635 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:51.718532    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/355fcee9-1680-4932-ba81-d8fc7d53564f-metrics-certs\") pod \"maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg\" (UID: \"355fcee9-1680-4932-ba81-d8fc7d53564f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg"
Sep 15 11:40:51.718635 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:51.718556    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x22qj\" (UniqueName: \"kubernetes.io/projected/355fcee9-1680-4932-ba81-d8fc7d53564f-kube-api-access-x22qj\") pod \"maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg\" (UID: \"355fcee9-1680-4932-ba81-d8fc7d53564f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg"
Sep 15 11:40:51.719135 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:51.719114    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/355fcee9-1680-4932-ba81-d8fc7d53564f-openshift-service-ca\") pod \"maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg\" (UID: \"355fcee9-1680-4932-ba81-d8fc7d53564f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg"
Sep 15 11:40:51.720908 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:51.720885    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/355fcee9-1680-4932-ba81-d8fc7d53564f-maas-api-tls\") pod \"maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg\" (UID: \"355fcee9-1680-4932-ba81-d8fc7d53564f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg"
Sep 15 11:40:51.721006 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:51.720920    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/355fcee9-1680-4932-ba81-d8fc7d53564f-metrics-certs\") pod \"maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg\" (UID: \"355fcee9-1680-4932-ba81-d8fc7d53564f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg"
Sep 15 11:40:51.726606 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:51.726585    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x22qj\" (UniqueName: \"kubernetes.io/projected/355fcee9-1680-4932-ba81-d8fc7d53564f-kube-api-access-x22qj\") pod \"maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg\" (UID: \"355fcee9-1680-4932-ba81-d8fc7d53564f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg"
Sep 15 11:40:51.807945 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:51.807862    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg"
Sep 15 11:40:52.087886 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:52.087860    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg"]
Sep 15 11:40:52.090569 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:40:52.090498    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod355fcee9_1680_4932_ba81_d8fc7d53564f.slice/crio-8f974374a063c4b291002ba441edcc9cd652473c2dc568bb0b7707aa5c23cfce WatchSource:0}: Error finding container 8f974374a063c4b291002ba441edcc9cd652473c2dc568bb0b7707aa5c23cfce: Status 404 returned error can't find the container with id 8f974374a063c4b291002ba441edcc9cd652473c2dc568bb0b7707aa5c23cfce
Sep 15 11:40:52.228029 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:52.227997    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-ed7d9f67-54c759486b-gw99c"]
Sep 15 11:40:52.232863 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:52.232836    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-ed7d9f67-54c759486b-gw99c"
Sep 15 11:40:52.235555 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:52.235525    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-ed7d9f67\""
Sep 15 11:40:52.235738 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:52.235591    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-ed7d9f67-dockercfg-4n9t9\""
Sep 15 11:40:52.243314 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:52.243280    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-ed7d9f67-54c759486b-gw99c"]
Sep 15 11:40:52.324855 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:52.324815    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4stbq\" (UniqueName: \"kubernetes.io/projected/723b41ab-21fa-4fe3-978f-2090837d0557-kube-api-access-4stbq\") pod \"payload-pre-processing-e2e-derive-ed7d9f67-54c759486b-gw99c\" (UID: \"723b41ab-21fa-4fe3-978f-2090837d0557\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-ed7d9f67-54c759486b-gw99c"
Sep 15 11:40:52.325018 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:52.324882    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/723b41ab-21fa-4fe3-978f-2090837d0557-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-ed7d9f67-54c759486b-gw99c\" (UID: \"723b41ab-21fa-4fe3-978f-2090837d0557\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-ed7d9f67-54c759486b-gw99c"
Sep 15 11:40:52.426373 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:52.426329    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/723b41ab-21fa-4fe3-978f-2090837d0557-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-ed7d9f67-54c759486b-gw99c\" (UID: \"723b41ab-21fa-4fe3-978f-2090837d0557\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-ed7d9f67-54c759486b-gw99c"
Sep 15 11:40:52.426583 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:52.426489    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4stbq\" (UniqueName: \"kubernetes.io/projected/723b41ab-21fa-4fe3-978f-2090837d0557-kube-api-access-4stbq\") pod \"payload-pre-processing-e2e-derive-ed7d9f67-54c759486b-gw99c\" (UID: \"723b41ab-21fa-4fe3-978f-2090837d0557\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-ed7d9f67-54c759486b-gw99c"
Sep 15 11:40:52.427106 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:52.427080    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/723b41ab-21fa-4fe3-978f-2090837d0557-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-ed7d9f67-54c759486b-gw99c\" (UID: \"723b41ab-21fa-4fe3-978f-2090837d0557\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-ed7d9f67-54c759486b-gw99c"
Sep 15 11:40:52.435497 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:52.435470    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4stbq\" (UniqueName: \"kubernetes.io/projected/723b41ab-21fa-4fe3-978f-2090837d0557-kube-api-access-4stbq\") pod \"payload-pre-processing-e2e-derive-ed7d9f67-54c759486b-gw99c\" (UID: \"723b41ab-21fa-4fe3-978f-2090837d0557\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-ed7d9f67-54c759486b-gw99c"
Sep 15 11:40:52.545260 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:52.545220    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-ed7d9f67-54c759486b-gw99c"
Sep 15 11:40:52.820407 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:52.820381    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-ed7d9f67-54c759486b-gw99c"]
Sep 15 11:40:52.822915 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:40:52.822887    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod723b41ab_21fa_4fe3_978f_2090837d0557.slice/crio-3027a83d5399c87d0b0e2939087935b94a0057745bd0b8fe90e75a39ec8e04b7 WatchSource:0}: Error finding container 3027a83d5399c87d0b0e2939087935b94a0057745bd0b8fe90e75a39ec8e04b7: Status 404 returned error can't find the container with id 3027a83d5399c87d0b0e2939087935b94a0057745bd0b8fe90e75a39ec8e04b7
Sep 15 11:40:53.078731 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:53.078645    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg" event={"ID":"355fcee9-1680-4932-ba81-d8fc7d53564f","Type":"ContainerStarted","Data":"97c5dfd40dc282c6e91435dfb12019d1bdd1c7b2d6d1b6a55d4cca717666e92d"}
Sep 15 11:40:53.078731 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:53.078706    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg" event={"ID":"355fcee9-1680-4932-ba81-d8fc7d53564f","Type":"ContainerStarted","Data":"8f974374a063c4b291002ba441edcc9cd652473c2dc568bb0b7707aa5c23cfce"}
Sep 15 11:40:53.078949 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:53.078828    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg"
Sep 15 11:40:53.080321 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:53.080296    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-ed7d9f67-54c759486b-gw99c" event={"ID":"723b41ab-21fa-4fe3-978f-2090837d0557","Type":"ContainerStarted","Data":"eaa3783fa108c20820ff2e956c207c49fb55cbbf54a568f765e8763627e3a34c"}
Sep 15 11:40:53.080413 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:53.080340    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-ed7d9f67-54c759486b-gw99c" event={"ID":"723b41ab-21fa-4fe3-978f-2090837d0557","Type":"ContainerStarted","Data":"3027a83d5399c87d0b0e2939087935b94a0057745bd0b8fe90e75a39ec8e04b7"}
Sep 15 11:40:53.080413 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:53.080371    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-ed7d9f67-54c759486b-gw99c"
Sep 15 11:40:53.097235 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:53.097188    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg" podStartSLOduration=1.386610072 podStartE2EDuration="2.097162429s" totalImagesPullingTime="710.552357ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:40:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:40:53.095068195 +0000 UTC m=+932.556934248" watchObservedRunningTime="2026-09-15 11:40:53.097162429 +0000 UTC m=+932.559028508"
Sep 15 11:40:53.113346 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:53.113304    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-ed7d9f67-54c759486b-gw99c" podStartSLOduration=1.113291057 podStartE2EDuration="1.113291057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:40:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:40:53.111089499 +0000 UTC m=+932.572955551" watchObservedRunningTime="2026-09-15 11:40:53.113291057 +0000 UTC m=+932.575157109"
Sep 15 11:40:59.095654 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:40:59.095625    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg"
Sep 15 11:41:04.092728 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:04.092696    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-ed7d9f67-54c759486b-gw99c"
Sep 15 11:41:17.137632 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:17.137598    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl"]
Sep 15 11:41:17.138159 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:17.137814    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl" podUID="a6718cfd-aa18-4859-acf6-58f41da89d99" containerName="maas-api" containerID="cri-o://634143b33e3b89642e6dc41d2584ac5d981266e6febf79057d18fb050afb4e11" gracePeriod=30
Sep 15 11:41:17.203988 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:17.203943    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-e114ba-65c4b7655d-cpblh"]
Sep 15 11:41:17.204222 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:17.204160    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-e114ba-65c4b7655d-cpblh" podUID="50175cdb-acb0-4632-b65e-261377c81a5e" containerName="payload-pre-processing" containerID="cri-o://a0fc68f2c45745c87b44e2f3da8529d37920a1dbf133537c366db7d85c03a65e" gracePeriod=30
Sep 15 11:41:17.469473 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:17.469449    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl"
Sep 15 11:41:17.503363 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:17.503328    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-e114ba-65c4b7655d-cpblh"
Sep 15 11:41:17.569404 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:17.569373    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rgwmk\" (UniqueName: \"kubernetes.io/projected/a6718cfd-aa18-4859-acf6-58f41da89d99-kube-api-access-rgwmk\") pod \"a6718cfd-aa18-4859-acf6-58f41da89d99\" (UID: \"a6718cfd-aa18-4859-acf6-58f41da89d99\") "
Sep 15 11:41:17.569404 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:17.569411    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6718cfd-aa18-4859-acf6-58f41da89d99-metrics-certs\") pod \"a6718cfd-aa18-4859-acf6-58f41da89d99\" (UID: \"a6718cfd-aa18-4859-acf6-58f41da89d99\") "
Sep 15 11:41:17.569631 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:17.569461    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6718cfd-aa18-4859-acf6-58f41da89d99-openshift-service-ca\") pod \"a6718cfd-aa18-4859-acf6-58f41da89d99\" (UID: \"a6718cfd-aa18-4859-acf6-58f41da89d99\") "
Sep 15 11:41:17.569631 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:17.569494    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6718cfd-aa18-4859-acf6-58f41da89d99-maas-api-tls\") pod \"a6718cfd-aa18-4859-acf6-58f41da89d99\" (UID: \"a6718cfd-aa18-4859-acf6-58f41da89d99\") "
Sep 15 11:41:17.569889 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:17.569856    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6718cfd-aa18-4859-acf6-58f41da89d99-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a6718cfd-aa18-4859-acf6-58f41da89d99" (UID: "a6718cfd-aa18-4859-acf6-58f41da89d99"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:41:17.571790 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:17.571764    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6718cfd-aa18-4859-acf6-58f41da89d99-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a6718cfd-aa18-4859-acf6-58f41da89d99" (UID: "a6718cfd-aa18-4859-acf6-58f41da89d99"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:41:17.571885 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:17.571783    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6718cfd-aa18-4859-acf6-58f41da89d99-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a6718cfd-aa18-4859-acf6-58f41da89d99" (UID: "a6718cfd-aa18-4859-acf6-58f41da89d99"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:41:17.571885 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:17.571840    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6718cfd-aa18-4859-acf6-58f41da89d99-kube-api-access-rgwmk" (OuterVolumeSpecName: "kube-api-access-rgwmk") pod "a6718cfd-aa18-4859-acf6-58f41da89d99" (UID: "a6718cfd-aa18-4859-acf6-58f41da89d99"). InnerVolumeSpecName "kube-api-access-rgwmk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:41:17.670734 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:17.670701    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50175cdb-acb0-4632-b65e-261377c81a5e-plugins-config-volume\") pod \"50175cdb-acb0-4632-b65e-261377c81a5e\" (UID: \"50175cdb-acb0-4632-b65e-261377c81a5e\") "
Sep 15 11:41:17.670919 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:17.670771    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fcx8v\" (UniqueName: \"kubernetes.io/projected/50175cdb-acb0-4632-b65e-261377c81a5e-kube-api-access-fcx8v\") pod \"50175cdb-acb0-4632-b65e-261377c81a5e\" (UID: \"50175cdb-acb0-4632-b65e-261377c81a5e\") "
Sep 15 11:41:17.671061 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:17.671043    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rgwmk\" (UniqueName: \"kubernetes.io/projected/a6718cfd-aa18-4859-acf6-58f41da89d99-kube-api-access-rgwmk\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:41:17.671098 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:17.671060    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50175cdb-acb0-4632-b65e-261377c81a5e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "50175cdb-acb0-4632-b65e-261377c81a5e" (UID: "50175cdb-acb0-4632-b65e-261377c81a5e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:41:17.671098 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:17.671067    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6718cfd-aa18-4859-acf6-58f41da89d99-metrics-certs\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:41:17.671209 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:17.671110    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6718cfd-aa18-4859-acf6-58f41da89d99-openshift-service-ca\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:41:17.671209 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:17.671122    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6718cfd-aa18-4859-acf6-58f41da89d99-maas-api-tls\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:41:17.673117 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:17.673042    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50175cdb-acb0-4632-b65e-261377c81a5e-kube-api-access-fcx8v" (OuterVolumeSpecName: "kube-api-access-fcx8v") pod "50175cdb-acb0-4632-b65e-261377c81a5e" (UID: "50175cdb-acb0-4632-b65e-261377c81a5e"). InnerVolumeSpecName "kube-api-access-fcx8v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:41:17.772372 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:17.772331    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fcx8v\" (UniqueName: \"kubernetes.io/projected/50175cdb-acb0-4632-b65e-261377c81a5e-kube-api-access-fcx8v\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:41:17.772372 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:17.772364    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50175cdb-acb0-4632-b65e-261377c81a5e-plugins-config-volume\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:41:18.214890 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:18.214854    2582 generic.go:356] "Generic (PLEG): container finished" podID="a6718cfd-aa18-4859-acf6-58f41da89d99" containerID="634143b33e3b89642e6dc41d2584ac5d981266e6febf79057d18fb050afb4e11" exitCode=0
Sep 15 11:41:18.215359 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:18.214904    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl"
Sep 15 11:41:18.215359 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:18.214940    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl" event={"ID":"a6718cfd-aa18-4859-acf6-58f41da89d99","Type":"ContainerDied","Data":"634143b33e3b89642e6dc41d2584ac5d981266e6febf79057d18fb050afb4e11"}
Sep 15 11:41:18.215359 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:18.215004    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl" event={"ID":"a6718cfd-aa18-4859-acf6-58f41da89d99","Type":"ContainerDied","Data":"1ff9dc6936335b0e22df10f1113d121ca5c5c74257f7165265e0af01f9e5a9fe"}
Sep 15 11:41:18.215359 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:18.215038    2582 scope.go:117] "RemoveContainer" containerID="634143b33e3b89642e6dc41d2584ac5d981266e6febf79057d18fb050afb4e11"
Sep 15 11:41:18.216501 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:18.216394    2582 generic.go:356] "Generic (PLEG): container finished" podID="50175cdb-acb0-4632-b65e-261377c81a5e" containerID="a0fc68f2c45745c87b44e2f3da8529d37920a1dbf133537c366db7d85c03a65e" exitCode=0
Sep 15 11:41:18.216501 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:18.216449    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-e114ba-65c4b7655d-cpblh" event={"ID":"50175cdb-acb0-4632-b65e-261377c81a5e","Type":"ContainerDied","Data":"a0fc68f2c45745c87b44e2f3da8529d37920a1dbf133537c366db7d85c03a65e"}
Sep 15 11:41:18.216501 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:18.216464    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-e114ba-65c4b7655d-cpblh"
Sep 15 11:41:18.216501 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:18.216482    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-e114ba-65c4b7655d-cpblh" event={"ID":"50175cdb-acb0-4632-b65e-261377c81a5e","Type":"ContainerDied","Data":"f508b11a8eeef29c2af7ffcffa96489be2f743a4aa7ad546c4a6251b46a37292"}
Sep 15 11:41:18.225909 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:18.225868    2582 scope.go:117] "RemoveContainer" containerID="634143b33e3b89642e6dc41d2584ac5d981266e6febf79057d18fb050afb4e11"
Sep 15 11:41:18.226271 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:41:18.226244    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"634143b33e3b89642e6dc41d2584ac5d981266e6febf79057d18fb050afb4e11\": container with ID starting with 634143b33e3b89642e6dc41d2584ac5d981266e6febf79057d18fb050afb4e11 not found: ID does not exist" containerID="634143b33e3b89642e6dc41d2584ac5d981266e6febf79057d18fb050afb4e11"
Sep 15 11:41:18.226361 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:18.226279    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"634143b33e3b89642e6dc41d2584ac5d981266e6febf79057d18fb050afb4e11"} err="failed to get container status \"634143b33e3b89642e6dc41d2584ac5d981266e6febf79057d18fb050afb4e11\": rpc error: code = NotFound desc = could not find container \"634143b33e3b89642e6dc41d2584ac5d981266e6febf79057d18fb050afb4e11\": container with ID starting with 634143b33e3b89642e6dc41d2584ac5d981266e6febf79057d18fb050afb4e11 not found: ID does not exist"
Sep 15 11:41:18.226361 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:18.226296    2582 scope.go:117] "RemoveContainer" containerID="a0fc68f2c45745c87b44e2f3da8529d37920a1dbf133537c366db7d85c03a65e"
Sep 15 11:41:18.234622 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:18.234605    2582 scope.go:117] "RemoveContainer" containerID="a0fc68f2c45745c87b44e2f3da8529d37920a1dbf133537c366db7d85c03a65e"
Sep 15 11:41:18.234889 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:41:18.234873    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0fc68f2c45745c87b44e2f3da8529d37920a1dbf133537c366db7d85c03a65e\": container with ID starting with a0fc68f2c45745c87b44e2f3da8529d37920a1dbf133537c366db7d85c03a65e not found: ID does not exist" containerID="a0fc68f2c45745c87b44e2f3da8529d37920a1dbf133537c366db7d85c03a65e"
Sep 15 11:41:18.234931 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:18.234895    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0fc68f2c45745c87b44e2f3da8529d37920a1dbf133537c366db7d85c03a65e"} err="failed to get container status \"a0fc68f2c45745c87b44e2f3da8529d37920a1dbf133537c366db7d85c03a65e\": rpc error: code = NotFound desc = could not find container \"a0fc68f2c45745c87b44e2f3da8529d37920a1dbf133537c366db7d85c03a65e\": container with ID starting with a0fc68f2c45745c87b44e2f3da8529d37920a1dbf133537c366db7d85c03a65e not found: ID does not exist"
Sep 15 11:41:18.241340 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:18.241315    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl"]
Sep 15 11:41:18.247367 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:18.247346    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-e114ba-76cb8bf45-5vqzl"]
Sep 15 11:41:18.265349 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:18.265318    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-e114ba-65c4b7655d-cpblh"]
Sep 15 11:41:18.268831 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:18.268806    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-e114ba-65c4b7655d-cpblh"]
Sep 15 11:41:19.050590 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:19.050556    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50175cdb-acb0-4632-b65e-261377c81a5e" path="/var/lib/kubelet/pods/50175cdb-acb0-4632-b65e-261377c81a5e/volumes"
Sep 15 11:41:19.050936 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:19.050924    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6718cfd-aa18-4859-acf6-58f41da89d99" path="/var/lib/kubelet/pods/a6718cfd-aa18-4859-acf6-58f41da89d99/volumes"
Sep 15 11:41:19.258899 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:19.258862    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg"]
Sep 15 11:41:19.259382 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:19.259158    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg" podUID="355fcee9-1680-4932-ba81-d8fc7d53564f" containerName="maas-api" containerID="cri-o://97c5dfd40dc282c6e91435dfb12019d1bdd1c7b2d6d1b6a55d4cca717666e92d" gracePeriod=30
Sep 15 11:41:19.350849 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:19.350771    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-ed7d9f67-54c759486b-gw99c"]
Sep 15 11:41:19.351012 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:19.350988    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-ed7d9f67-54c759486b-gw99c" podUID="723b41ab-21fa-4fe3-978f-2090837d0557" containerName="payload-pre-processing" containerID="cri-o://eaa3783fa108c20820ff2e956c207c49fb55cbbf54a568f765e8763627e3a34c" gracePeriod=30
Sep 15 11:41:19.618507 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:19.618443    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg"
Sep 15 11:41:19.652909 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:19.652884    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-ed7d9f67-54c759486b-gw99c"
Sep 15 11:41:19.688317 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:19.688283    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/355fcee9-1680-4932-ba81-d8fc7d53564f-openshift-service-ca\") pod \"355fcee9-1680-4932-ba81-d8fc7d53564f\" (UID: \"355fcee9-1680-4932-ba81-d8fc7d53564f\") "
Sep 15 11:41:19.688317 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:19.688320    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/355fcee9-1680-4932-ba81-d8fc7d53564f-maas-api-tls\") pod \"355fcee9-1680-4932-ba81-d8fc7d53564f\" (UID: \"355fcee9-1680-4932-ba81-d8fc7d53564f\") "
Sep 15 11:41:19.688547 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:19.688341    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x22qj\" (UniqueName: \"kubernetes.io/projected/355fcee9-1680-4932-ba81-d8fc7d53564f-kube-api-access-x22qj\") pod \"355fcee9-1680-4932-ba81-d8fc7d53564f\" (UID: \"355fcee9-1680-4932-ba81-d8fc7d53564f\") "
Sep 15 11:41:19.688547 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:19.688383    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/723b41ab-21fa-4fe3-978f-2090837d0557-plugins-config-volume\") pod \"723b41ab-21fa-4fe3-978f-2090837d0557\" (UID: \"723b41ab-21fa-4fe3-978f-2090837d0557\") "
Sep 15 11:41:19.688761 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:19.688730    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/355fcee9-1680-4932-ba81-d8fc7d53564f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "355fcee9-1680-4932-ba81-d8fc7d53564f" (UID: "355fcee9-1680-4932-ba81-d8fc7d53564f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:41:19.688831 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:19.688814    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/723b41ab-21fa-4fe3-978f-2090837d0557-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "723b41ab-21fa-4fe3-978f-2090837d0557" (UID: "723b41ab-21fa-4fe3-978f-2090837d0557"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:41:19.690701 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:19.690677    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/355fcee9-1680-4932-ba81-d8fc7d53564f-kube-api-access-x22qj" (OuterVolumeSpecName: "kube-api-access-x22qj") pod "355fcee9-1680-4932-ba81-d8fc7d53564f" (UID: "355fcee9-1680-4932-ba81-d8fc7d53564f"). InnerVolumeSpecName "kube-api-access-x22qj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:41:19.690798 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:19.690720    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/355fcee9-1680-4932-ba81-d8fc7d53564f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "355fcee9-1680-4932-ba81-d8fc7d53564f" (UID: "355fcee9-1680-4932-ba81-d8fc7d53564f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:41:19.789338 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:19.789305    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/355fcee9-1680-4932-ba81-d8fc7d53564f-metrics-certs\") pod \"355fcee9-1680-4932-ba81-d8fc7d53564f\" (UID: \"355fcee9-1680-4932-ba81-d8fc7d53564f\") "
Sep 15 11:41:19.789534 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:19.789355    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4stbq\" (UniqueName: \"kubernetes.io/projected/723b41ab-21fa-4fe3-978f-2090837d0557-kube-api-access-4stbq\") pod \"723b41ab-21fa-4fe3-978f-2090837d0557\" (UID: \"723b41ab-21fa-4fe3-978f-2090837d0557\") "
Sep 15 11:41:19.789605 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:19.789546    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/355fcee9-1680-4932-ba81-d8fc7d53564f-openshift-service-ca\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:41:19.789605 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:19.789566    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/355fcee9-1680-4932-ba81-d8fc7d53564f-maas-api-tls\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:41:19.789605 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:19.789575    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x22qj\" (UniqueName: \"kubernetes.io/projected/355fcee9-1680-4932-ba81-d8fc7d53564f-kube-api-access-x22qj\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:41:19.789605 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:19.789584    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/723b41ab-21fa-4fe3-978f-2090837d0557-plugins-config-volume\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:41:19.791592 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:19.791556    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/355fcee9-1680-4932-ba81-d8fc7d53564f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "355fcee9-1680-4932-ba81-d8fc7d53564f" (UID: "355fcee9-1680-4932-ba81-d8fc7d53564f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:41:19.791700 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:19.791616    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/723b41ab-21fa-4fe3-978f-2090837d0557-kube-api-access-4stbq" (OuterVolumeSpecName: "kube-api-access-4stbq") pod "723b41ab-21fa-4fe3-978f-2090837d0557" (UID: "723b41ab-21fa-4fe3-978f-2090837d0557"). InnerVolumeSpecName "kube-api-access-4stbq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:41:19.890135 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:19.890090    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4stbq\" (UniqueName: \"kubernetes.io/projected/723b41ab-21fa-4fe3-978f-2090837d0557-kube-api-access-4stbq\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:41:19.890135 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:19.890136    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/355fcee9-1680-4932-ba81-d8fc7d53564f-metrics-certs\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:41:20.230729 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.230646    2582 generic.go:356] "Generic (PLEG): container finished" podID="355fcee9-1680-4932-ba81-d8fc7d53564f" containerID="97c5dfd40dc282c6e91435dfb12019d1bdd1c7b2d6d1b6a55d4cca717666e92d" exitCode=0
Sep 15 11:41:20.230729 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.230701    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg"
Sep 15 11:41:20.230949 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.230729    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg" event={"ID":"355fcee9-1680-4932-ba81-d8fc7d53564f","Type":"ContainerDied","Data":"97c5dfd40dc282c6e91435dfb12019d1bdd1c7b2d6d1b6a55d4cca717666e92d"}
Sep 15 11:41:20.230949 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.230789    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg" event={"ID":"355fcee9-1680-4932-ba81-d8fc7d53564f","Type":"ContainerDied","Data":"8f974374a063c4b291002ba441edcc9cd652473c2dc568bb0b7707aa5c23cfce"}
Sep 15 11:41:20.230949 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.230819    2582 scope.go:117] "RemoveContainer" containerID="97c5dfd40dc282c6e91435dfb12019d1bdd1c7b2d6d1b6a55d4cca717666e92d"
Sep 15 11:41:20.232163 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.232136    2582 generic.go:356] "Generic (PLEG): container finished" podID="723b41ab-21fa-4fe3-978f-2090837d0557" containerID="eaa3783fa108c20820ff2e956c207c49fb55cbbf54a568f765e8763627e3a34c" exitCode=0
Sep 15 11:41:20.232331 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.232211    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-ed7d9f67-54c759486b-gw99c"
Sep 15 11:41:20.232331 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.232219    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-ed7d9f67-54c759486b-gw99c" event={"ID":"723b41ab-21fa-4fe3-978f-2090837d0557","Type":"ContainerDied","Data":"eaa3783fa108c20820ff2e956c207c49fb55cbbf54a568f765e8763627e3a34c"}
Sep 15 11:41:20.232331 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.232276    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-ed7d9f67-54c759486b-gw99c" event={"ID":"723b41ab-21fa-4fe3-978f-2090837d0557","Type":"ContainerDied","Data":"3027a83d5399c87d0b0e2939087935b94a0057745bd0b8fe90e75a39ec8e04b7"}
Sep 15 11:41:20.241604 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.241576    2582 scope.go:117] "RemoveContainer" containerID="97c5dfd40dc282c6e91435dfb12019d1bdd1c7b2d6d1b6a55d4cca717666e92d"
Sep 15 11:41:20.241973 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:41:20.241937    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97c5dfd40dc282c6e91435dfb12019d1bdd1c7b2d6d1b6a55d4cca717666e92d\": container with ID starting with 97c5dfd40dc282c6e91435dfb12019d1bdd1c7b2d6d1b6a55d4cca717666e92d not found: ID does not exist" containerID="97c5dfd40dc282c6e91435dfb12019d1bdd1c7b2d6d1b6a55d4cca717666e92d"
Sep 15 11:41:20.242055 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.241977    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97c5dfd40dc282c6e91435dfb12019d1bdd1c7b2d6d1b6a55d4cca717666e92d"} err="failed to get container status \"97c5dfd40dc282c6e91435dfb12019d1bdd1c7b2d6d1b6a55d4cca717666e92d\": rpc error: code = NotFound desc = could not find container \"97c5dfd40dc282c6e91435dfb12019d1bdd1c7b2d6d1b6a55d4cca717666e92d\": container with ID starting with 97c5dfd40dc282c6e91435dfb12019d1bdd1c7b2d6d1b6a55d4cca717666e92d not found: ID does not exist"
Sep 15 11:41:20.242055 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.242002    2582 scope.go:117] "RemoveContainer" containerID="eaa3783fa108c20820ff2e956c207c49fb55cbbf54a568f765e8763627e3a34c"
Sep 15 11:41:20.250530 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.250508    2582 scope.go:117] "RemoveContainer" containerID="eaa3783fa108c20820ff2e956c207c49fb55cbbf54a568f765e8763627e3a34c"
Sep 15 11:41:20.250841 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:41:20.250823    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eaa3783fa108c20820ff2e956c207c49fb55cbbf54a568f765e8763627e3a34c\": container with ID starting with eaa3783fa108c20820ff2e956c207c49fb55cbbf54a568f765e8763627e3a34c not found: ID does not exist" containerID="eaa3783fa108c20820ff2e956c207c49fb55cbbf54a568f765e8763627e3a34c"
Sep 15 11:41:20.250888 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.250848    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaa3783fa108c20820ff2e956c207c49fb55cbbf54a568f765e8763627e3a34c"} err="failed to get container status \"eaa3783fa108c20820ff2e956c207c49fb55cbbf54a568f765e8763627e3a34c\": rpc error: code = NotFound desc = could not find container \"eaa3783fa108c20820ff2e956c207c49fb55cbbf54a568f765e8763627e3a34c\": container with ID starting with eaa3783fa108c20820ff2e956c207c49fb55cbbf54a568f765e8763627e3a34c not found: ID does not exist"
Sep 15 11:41:20.254007 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.253982    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg"]
Sep 15 11:41:20.257542 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.257516    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ed7d9f67-78cc988559-8ksrg"]
Sep 15 11:41:20.267656 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.267628    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-ed7d9f67-54c759486b-gw99c"]
Sep 15 11:41:20.271238 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.271211    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-ed7d9f67-54c759486b-gw99c"]
Sep 15 11:41:20.788756 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.788720    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-9bd868/premium-w0-9bd868-kserve-855494d7c5-7tqxc"]
Sep 15 11:41:20.789117 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.789105    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6718cfd-aa18-4859-acf6-58f41da89d99" containerName="maas-api"
Sep 15 11:41:20.789198 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.789120    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6718cfd-aa18-4859-acf6-58f41da89d99" containerName="maas-api"
Sep 15 11:41:20.789198 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.789128    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="355fcee9-1680-4932-ba81-d8fc7d53564f" containerName="maas-api"
Sep 15 11:41:20.789198 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.789132    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="355fcee9-1680-4932-ba81-d8fc7d53564f" containerName="maas-api"
Sep 15 11:41:20.789198 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.789141    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50175cdb-acb0-4632-b65e-261377c81a5e" containerName="payload-pre-processing"
Sep 15 11:41:20.789198 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.789147    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="50175cdb-acb0-4632-b65e-261377c81a5e" containerName="payload-pre-processing"
Sep 15 11:41:20.789198 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.789154    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="723b41ab-21fa-4fe3-978f-2090837d0557" containerName="payload-pre-processing"
Sep 15 11:41:20.789198 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.789159    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="723b41ab-21fa-4fe3-978f-2090837d0557" containerName="payload-pre-processing"
Sep 15 11:41:20.789407 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.789246    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="355fcee9-1680-4932-ba81-d8fc7d53564f" containerName="maas-api"
Sep 15 11:41:20.789407 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.789255    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="723b41ab-21fa-4fe3-978f-2090837d0557" containerName="payload-pre-processing"
Sep 15 11:41:20.789407 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.789263    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="50175cdb-acb0-4632-b65e-261377c81a5e" containerName="payload-pre-processing"
Sep 15 11:41:20.789407 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.789271    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6718cfd-aa18-4859-acf6-58f41da89d99" containerName="maas-api"
Sep 15 11:41:20.793663 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.793643    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-9bd868/premium-w0-9bd868-kserve-855494d7c5-7tqxc"
Sep 15 11:41:20.795286 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.795265    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/986147f2-accd-4bdd-a8df-c7e77b95251d-tls-certs\") pod \"premium-w0-9bd868-kserve-855494d7c5-7tqxc\" (UID: \"986147f2-accd-4bdd-a8df-c7e77b95251d\") " pod="e2e-models-e2e-worker-w0-9bd868/premium-w0-9bd868-kserve-855494d7c5-7tqxc"
Sep 15 11:41:20.795378 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.795293    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5927\" (UniqueName: \"kubernetes.io/projected/986147f2-accd-4bdd-a8df-c7e77b95251d-kube-api-access-c5927\") pod \"premium-w0-9bd868-kserve-855494d7c5-7tqxc\" (UID: \"986147f2-accd-4bdd-a8df-c7e77b95251d\") " pod="e2e-models-e2e-worker-w0-9bd868/premium-w0-9bd868-kserve-855494d7c5-7tqxc"
Sep 15 11:41:20.795378 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.795317    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/986147f2-accd-4bdd-a8df-c7e77b95251d-home\") pod \"premium-w0-9bd868-kserve-855494d7c5-7tqxc\" (UID: \"986147f2-accd-4bdd-a8df-c7e77b95251d\") " pod="e2e-models-e2e-worker-w0-9bd868/premium-w0-9bd868-kserve-855494d7c5-7tqxc"
Sep 15 11:41:20.795378 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.795337    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/986147f2-accd-4bdd-a8df-c7e77b95251d-dshm\") pod \"premium-w0-9bd868-kserve-855494d7c5-7tqxc\" (UID: \"986147f2-accd-4bdd-a8df-c7e77b95251d\") " pod="e2e-models-e2e-worker-w0-9bd868/premium-w0-9bd868-kserve-855494d7c5-7tqxc"
Sep 15 11:41:20.795491 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.795399    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/986147f2-accd-4bdd-a8df-c7e77b95251d-model-cache\") pod \"premium-w0-9bd868-kserve-855494d7c5-7tqxc\" (UID: \"986147f2-accd-4bdd-a8df-c7e77b95251d\") " pod="e2e-models-e2e-worker-w0-9bd868/premium-w0-9bd868-kserve-855494d7c5-7tqxc"
Sep 15 11:41:20.795491 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.795430    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/986147f2-accd-4bdd-a8df-c7e77b95251d-tmp-dir\") pod \"premium-w0-9bd868-kserve-855494d7c5-7tqxc\" (UID: \"986147f2-accd-4bdd-a8df-c7e77b95251d\") " pod="e2e-models-e2e-worker-w0-9bd868/premium-w0-9bd868-kserve-855494d7c5-7tqxc"
Sep 15 11:41:20.796545 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.796517    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-9bd868\"/\"openshift-service-ca.crt\""
Sep 15 11:41:20.796635 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.796603    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-9bd868\"/\"default-dockercfg-d7rvg\""
Sep 15 11:41:20.797311 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.797290    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-9bd868\"/\"premium-w0-9bd868-kserve-self-signed-certs\""
Sep 15 11:41:20.797372 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.797299    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-9bd868\"/\"kube-root-ca.crt\""
Sep 15 11:41:20.803629 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.803610    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-9bd868/premium-w0-9bd868-kserve-855494d7c5-7tqxc"]
Sep 15 11:41:20.895937 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.895905    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/986147f2-accd-4bdd-a8df-c7e77b95251d-tls-certs\") pod \"premium-w0-9bd868-kserve-855494d7c5-7tqxc\" (UID: \"986147f2-accd-4bdd-a8df-c7e77b95251d\") " pod="e2e-models-e2e-worker-w0-9bd868/premium-w0-9bd868-kserve-855494d7c5-7tqxc"
Sep 15 11:41:20.895937 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.895939    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5927\" (UniqueName: \"kubernetes.io/projected/986147f2-accd-4bdd-a8df-c7e77b95251d-kube-api-access-c5927\") pod \"premium-w0-9bd868-kserve-855494d7c5-7tqxc\" (UID: \"986147f2-accd-4bdd-a8df-c7e77b95251d\") " pod="e2e-models-e2e-worker-w0-9bd868/premium-w0-9bd868-kserve-855494d7c5-7tqxc"
Sep 15 11:41:20.896234 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.895962    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/986147f2-accd-4bdd-a8df-c7e77b95251d-home\") pod \"premium-w0-9bd868-kserve-855494d7c5-7tqxc\" (UID: \"986147f2-accd-4bdd-a8df-c7e77b95251d\") " pod="e2e-models-e2e-worker-w0-9bd868/premium-w0-9bd868-kserve-855494d7c5-7tqxc"
Sep 15 11:41:20.896234 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.896009    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/986147f2-accd-4bdd-a8df-c7e77b95251d-dshm\") pod \"premium-w0-9bd868-kserve-855494d7c5-7tqxc\" (UID: \"986147f2-accd-4bdd-a8df-c7e77b95251d\") " pod="e2e-models-e2e-worker-w0-9bd868/premium-w0-9bd868-kserve-855494d7c5-7tqxc"
Sep 15 11:41:20.896234 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.896052    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/986147f2-accd-4bdd-a8df-c7e77b95251d-model-cache\") pod \"premium-w0-9bd868-kserve-855494d7c5-7tqxc\" (UID: \"986147f2-accd-4bdd-a8df-c7e77b95251d\") " pod="e2e-models-e2e-worker-w0-9bd868/premium-w0-9bd868-kserve-855494d7c5-7tqxc"
Sep 15 11:41:20.896234 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.896085    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/986147f2-accd-4bdd-a8df-c7e77b95251d-tmp-dir\") pod \"premium-w0-9bd868-kserve-855494d7c5-7tqxc\" (UID: \"986147f2-accd-4bdd-a8df-c7e77b95251d\") " pod="e2e-models-e2e-worker-w0-9bd868/premium-w0-9bd868-kserve-855494d7c5-7tqxc"
Sep 15 11:41:20.896545 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.896517    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/986147f2-accd-4bdd-a8df-c7e77b95251d-home\") pod \"premium-w0-9bd868-kserve-855494d7c5-7tqxc\" (UID: \"986147f2-accd-4bdd-a8df-c7e77b95251d\") " pod="e2e-models-e2e-worker-w0-9bd868/premium-w0-9bd868-kserve-855494d7c5-7tqxc"
Sep 15 11:41:20.896545 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.896536    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/986147f2-accd-4bdd-a8df-c7e77b95251d-model-cache\") pod \"premium-w0-9bd868-kserve-855494d7c5-7tqxc\" (UID: \"986147f2-accd-4bdd-a8df-c7e77b95251d\") " pod="e2e-models-e2e-worker-w0-9bd868/premium-w0-9bd868-kserve-855494d7c5-7tqxc"
Sep 15 11:41:20.896703 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.896576    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/986147f2-accd-4bdd-a8df-c7e77b95251d-tmp-dir\") pod \"premium-w0-9bd868-kserve-855494d7c5-7tqxc\" (UID: \"986147f2-accd-4bdd-a8df-c7e77b95251d\") " pod="e2e-models-e2e-worker-w0-9bd868/premium-w0-9bd868-kserve-855494d7c5-7tqxc"
Sep 15 11:41:20.898461 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.898440    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/986147f2-accd-4bdd-a8df-c7e77b95251d-dshm\") pod \"premium-w0-9bd868-kserve-855494d7c5-7tqxc\" (UID: \"986147f2-accd-4bdd-a8df-c7e77b95251d\") " pod="e2e-models-e2e-worker-w0-9bd868/premium-w0-9bd868-kserve-855494d7c5-7tqxc"
Sep 15 11:41:20.898948 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.898930    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-9bd868\"/\"premium-w0-9bd868-kserve-self-signed-certs\""
Sep 15 11:41:20.908767 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.908736    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/986147f2-accd-4bdd-a8df-c7e77b95251d-tls-certs\") pod \"premium-w0-9bd868-kserve-855494d7c5-7tqxc\" (UID: \"986147f2-accd-4bdd-a8df-c7e77b95251d\") " pod="e2e-models-e2e-worker-w0-9bd868/premium-w0-9bd868-kserve-855494d7c5-7tqxc"
Sep 15 11:41:20.909060 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.909042    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-9bd868\"/\"kube-root-ca.crt\""
Sep 15 11:41:20.919783 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.919755    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-9bd868\"/\"openshift-service-ca.crt\""
Sep 15 11:41:20.930565 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:20.930533    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5927\" (UniqueName: \"kubernetes.io/projected/986147f2-accd-4bdd-a8df-c7e77b95251d-kube-api-access-c5927\") pod \"premium-w0-9bd868-kserve-855494d7c5-7tqxc\" (UID: \"986147f2-accd-4bdd-a8df-c7e77b95251d\") " pod="e2e-models-e2e-worker-w0-9bd868/premium-w0-9bd868-kserve-855494d7c5-7tqxc"
Sep 15 11:41:21.051667 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:21.051588    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="355fcee9-1680-4932-ba81-d8fc7d53564f" path="/var/lib/kubelet/pods/355fcee9-1680-4932-ba81-d8fc7d53564f/volumes"
Sep 15 11:41:21.052022 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:21.052004    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="723b41ab-21fa-4fe3-978f-2090837d0557" path="/var/lib/kubelet/pods/723b41ab-21fa-4fe3-978f-2090837d0557/volumes"
Sep 15 11:41:21.106156 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:21.106124    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-9bd868\"/\"default-dockercfg-d7rvg\""
Sep 15 11:41:21.114039 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:21.114012    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-9bd868/premium-w0-9bd868-kserve-855494d7c5-7tqxc"
Sep 15 11:41:21.395745 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:21.395721    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-9bd868/premium-w0-9bd868-kserve-855494d7c5-7tqxc"]
Sep 15 11:41:21.398145 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:41:21.398110    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod986147f2_accd_4bdd_a8df_c7e77b95251d.slice/crio-0077724edf464d0fee957df1a4421f5dff517afa46f36d556dcde83213f5fe8a WatchSource:0}: Error finding container 0077724edf464d0fee957df1a4421f5dff517afa46f36d556dcde83213f5fe8a: Status 404 returned error can't find the container with id 0077724edf464d0fee957df1a4421f5dff517afa46f36d556dcde83213f5fe8a
Sep 15 11:41:22.244577 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:22.244536    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-9bd868/premium-w0-9bd868-kserve-855494d7c5-7tqxc" event={"ID":"986147f2-accd-4bdd-a8df-c7e77b95251d","Type":"ContainerStarted","Data":"a55af05f4338caac31258a1e7ef4bbace1ded090bc1e9c5dc9269a1e17a0d683"}
Sep 15 11:41:22.244790 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:22.244588    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-9bd868/premium-w0-9bd868-kserve-855494d7c5-7tqxc" event={"ID":"986147f2-accd-4bdd-a8df-c7e77b95251d","Type":"ContainerStarted","Data":"0077724edf464d0fee957df1a4421f5dff517afa46f36d556dcde83213f5fe8a"}
Sep 15 11:41:22.262153 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:22.262093    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-9bd868/premium-w0-9bd868-kserve-855494d7c5-7tqxc" podStartSLOduration=2.262071792 podStartE2EDuration="2.262071792s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:41:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:41:22.261973986 +0000 UTC m=+961.723840040" watchObservedRunningTime="2026-09-15 11:41:22.262071792 +0000 UTC m=+961.723937846"
Sep 15 11:41:31.114447 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:31.114405    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-9bd868/premium-w0-9bd868-kserve-855494d7c5-7tqxc"
Sep 15 11:41:31.114856 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:31.114465    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-9bd868/premium-w0-9bd868-kserve-855494d7c5-7tqxc"
Sep 15 11:41:31.126958 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:31.126933    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-9bd868/premium-w0-9bd868-kserve-855494d7c5-7tqxc"
Sep 15 11:41:31.301075 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:31.301047    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-9bd868/premium-w0-9bd868-kserve-855494d7c5-7tqxc"
Sep 15 11:41:31.878755 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:31.878724    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd"]
Sep 15 11:41:31.882811 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:31.882785    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd"
Sep 15 11:41:31.886098 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:31.886070    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-a1c362-serving-cert\""
Sep 15 11:41:31.897928 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:31.897903    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd"]
Sep 15 11:41:31.986565 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:31.986526    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcw9t\" (UniqueName: \"kubernetes.io/projected/4620745e-d5cc-4238-a6ba-f12028629636-kube-api-access-rcw9t\") pod \"maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd\" (UID: \"4620745e-d5cc-4238-a6ba-f12028629636\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd"
Sep 15 11:41:31.986781 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:31.986753    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4620745e-d5cc-4238-a6ba-f12028629636-metrics-certs\") pod \"maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd\" (UID: \"4620745e-d5cc-4238-a6ba-f12028629636\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd"
Sep 15 11:41:31.986857 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:31.986811    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4620745e-d5cc-4238-a6ba-f12028629636-openshift-service-ca\") pod \"maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd\" (UID: \"4620745e-d5cc-4238-a6ba-f12028629636\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd"
Sep 15 11:41:31.986978 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:31.986953    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4620745e-d5cc-4238-a6ba-f12028629636-maas-api-tls\") pod \"maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd\" (UID: \"4620745e-d5cc-4238-a6ba-f12028629636\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd"
Sep 15 11:41:32.088086 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:32.087986    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4620745e-d5cc-4238-a6ba-f12028629636-openshift-service-ca\") pod \"maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd\" (UID: \"4620745e-d5cc-4238-a6ba-f12028629636\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd"
Sep 15 11:41:32.088306 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:32.088204    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4620745e-d5cc-4238-a6ba-f12028629636-maas-api-tls\") pod \"maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd\" (UID: \"4620745e-d5cc-4238-a6ba-f12028629636\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd"
Sep 15 11:41:32.088306 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:32.088281    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcw9t\" (UniqueName: \"kubernetes.io/projected/4620745e-d5cc-4238-a6ba-f12028629636-kube-api-access-rcw9t\") pod \"maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd\" (UID: \"4620745e-d5cc-4238-a6ba-f12028629636\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd"
Sep 15 11:41:32.088422 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:32.088315    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4620745e-d5cc-4238-a6ba-f12028629636-metrics-certs\") pod \"maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd\" (UID: \"4620745e-d5cc-4238-a6ba-f12028629636\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd"
Sep 15 11:41:32.088422 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:41:32.088386    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-a1c362-serving-cert: secret "maas-api-e2e-explicit-a1c362-serving-cert" not found
Sep 15 11:41:32.088524 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:41:32.088474    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4620745e-d5cc-4238-a6ba-f12028629636-maas-api-tls podName:4620745e-d5cc-4238-a6ba-f12028629636 nodeName:}" failed. No retries permitted until 2026-09-15 11:41:32.588452009 +0000 UTC m=+972.050318043 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4620745e-d5cc-4238-a6ba-f12028629636-maas-api-tls") pod "maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd" (UID: "4620745e-d5cc-4238-a6ba-f12028629636") : secret "maas-api-e2e-explicit-a1c362-serving-cert" not found
Sep 15 11:41:32.088644 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:32.088624    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4620745e-d5cc-4238-a6ba-f12028629636-openshift-service-ca\") pod \"maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd\" (UID: \"4620745e-d5cc-4238-a6ba-f12028629636\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd"
Sep 15 11:41:32.091308 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:32.091278    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4620745e-d5cc-4238-a6ba-f12028629636-metrics-certs\") pod \"maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd\" (UID: \"4620745e-d5cc-4238-a6ba-f12028629636\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd"
Sep 15 11:41:32.097544 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:32.097518    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcw9t\" (UniqueName: \"kubernetes.io/projected/4620745e-d5cc-4238-a6ba-f12028629636-kube-api-access-rcw9t\") pod \"maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd\" (UID: \"4620745e-d5cc-4238-a6ba-f12028629636\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd"
Sep 15 11:41:32.593596 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:32.593564    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4620745e-d5cc-4238-a6ba-f12028629636-maas-api-tls\") pod \"maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd\" (UID: \"4620745e-d5cc-4238-a6ba-f12028629636\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd"
Sep 15 11:41:32.596170 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:32.596146    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4620745e-d5cc-4238-a6ba-f12028629636-maas-api-tls\") pod \"maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd\" (UID: \"4620745e-d5cc-4238-a6ba-f12028629636\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd"
Sep 15 11:41:32.608045 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:32.608022    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a1c362-58f59c57c4-ftxv7"]
Sep 15 11:41:32.611882 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:32.611859    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a1c362-58f59c57c4-ftxv7"
Sep 15 11:41:32.618013 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:32.617992    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-a1c362\""
Sep 15 11:41:32.618221 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:32.618098    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-a1c362-dockercfg-8xpr6\""
Sep 15 11:41:32.629938 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:32.629918    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a1c362-58f59c57c4-ftxv7"]
Sep 15 11:41:32.694347 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:32.694314    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5990631c-6619-4518-8343-dae1067c0fd4-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-a1c362-58f59c57c4-ftxv7\" (UID: \"5990631c-6619-4518-8343-dae1067c0fd4\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a1c362-58f59c57c4-ftxv7"
Sep 15 11:41:32.694522 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:32.694457    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bszh\" (UniqueName: \"kubernetes.io/projected/5990631c-6619-4518-8343-dae1067c0fd4-kube-api-access-6bszh\") pod \"payload-pre-processing-e2e-explicit-a1c362-58f59c57c4-ftxv7\" (UID: \"5990631c-6619-4518-8343-dae1067c0fd4\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a1c362-58f59c57c4-ftxv7"
Sep 15 11:41:32.794169 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:32.794127    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd"
Sep 15 11:41:32.795380 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:32.795356    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bszh\" (UniqueName: \"kubernetes.io/projected/5990631c-6619-4518-8343-dae1067c0fd4-kube-api-access-6bszh\") pod \"payload-pre-processing-e2e-explicit-a1c362-58f59c57c4-ftxv7\" (UID: \"5990631c-6619-4518-8343-dae1067c0fd4\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a1c362-58f59c57c4-ftxv7"
Sep 15 11:41:32.795495 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:32.795455    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5990631c-6619-4518-8343-dae1067c0fd4-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-a1c362-58f59c57c4-ftxv7\" (UID: \"5990631c-6619-4518-8343-dae1067c0fd4\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a1c362-58f59c57c4-ftxv7"
Sep 15 11:41:32.796076 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:32.796057    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5990631c-6619-4518-8343-dae1067c0fd4-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-a1c362-58f59c57c4-ftxv7\" (UID: \"5990631c-6619-4518-8343-dae1067c0fd4\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a1c362-58f59c57c4-ftxv7"
Sep 15 11:41:32.803310 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:32.803289    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bszh\" (UniqueName: \"kubernetes.io/projected/5990631c-6619-4518-8343-dae1067c0fd4-kube-api-access-6bszh\") pod \"payload-pre-processing-e2e-explicit-a1c362-58f59c57c4-ftxv7\" (UID: \"5990631c-6619-4518-8343-dae1067c0fd4\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a1c362-58f59c57c4-ftxv7"
Sep 15 11:41:32.922622 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:32.922584    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a1c362-58f59c57c4-ftxv7"
Sep 15 11:41:33.070297 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:33.070273    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd"]
Sep 15 11:41:33.072310 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:41:33.072288    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4620745e_d5cc_4238_a6ba_f12028629636.slice/crio-de5c06972a6dd5ba3364f07a47d89adeb99277554a8e45140b3430917b7d33a9 WatchSource:0}: Error finding container de5c06972a6dd5ba3364f07a47d89adeb99277554a8e45140b3430917b7d33a9: Status 404 returned error can't find the container with id de5c06972a6dd5ba3364f07a47d89adeb99277554a8e45140b3430917b7d33a9
Sep 15 11:41:33.073559 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:33.073541    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 11:41:33.196279 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:33.196246    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a1c362-58f59c57c4-ftxv7"]
Sep 15 11:41:33.200360 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:41:33.200332    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5990631c_6619_4518_8343_dae1067c0fd4.slice/crio-23b5a1f91a42f71bb3b92386fe2fec7b24542c383de4e9423058081015898d4d WatchSource:0}: Error finding container 23b5a1f91a42f71bb3b92386fe2fec7b24542c383de4e9423058081015898d4d: Status 404 returned error can't find the container with id 23b5a1f91a42f71bb3b92386fe2fec7b24542c383de4e9423058081015898d4d
Sep 15 11:41:33.302302 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:33.302271    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a1c362-58f59c57c4-ftxv7" event={"ID":"5990631c-6619-4518-8343-dae1067c0fd4","Type":"ContainerStarted","Data":"1c17867a5edff906f294a5253b661ec932b1efc7501ada67663803cdb695b0c2"}
Sep 15 11:41:33.302455 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:33.302321    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a1c362-58f59c57c4-ftxv7" event={"ID":"5990631c-6619-4518-8343-dae1067c0fd4","Type":"ContainerStarted","Data":"23b5a1f91a42f71bb3b92386fe2fec7b24542c383de4e9423058081015898d4d"}
Sep 15 11:41:33.302455 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:33.302365    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a1c362-58f59c57c4-ftxv7"
Sep 15 11:41:33.303624 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:33.303588    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd" event={"ID":"4620745e-d5cc-4238-a6ba-f12028629636","Type":"ContainerStarted","Data":"de5c06972a6dd5ba3364f07a47d89adeb99277554a8e45140b3430917b7d33a9"}
Sep 15 11:41:33.320810 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:33.320767    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a1c362-58f59c57c4-ftxv7" podStartSLOduration=1.32075256 podStartE2EDuration="1.32075256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:41:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:41:33.318193926 +0000 UTC m=+972.780059981" watchObservedRunningTime="2026-09-15 11:41:33.32075256 +0000 UTC m=+972.782618687"
Sep 15 11:41:34.310108 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:34.310072    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd" event={"ID":"4620745e-d5cc-4238-a6ba-f12028629636","Type":"ContainerStarted","Data":"80c226222ce0fccecf5a2dd417eb50656c2db20cd8a479f56f90ba07282c81ec"}
Sep 15 11:41:34.310586 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:34.310164    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd"
Sep 15 11:41:34.327043 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:34.326990    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd" podStartSLOduration=2.820045464 podStartE2EDuration="3.326974911s" totalImagesPullingTime="506.929447ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:41:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:41:34.326013751 +0000 UTC m=+973.787879815" watchObservedRunningTime="2026-09-15 11:41:34.326974911 +0000 UTC m=+973.788840965"
Sep 15 11:41:40.322005 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:40.321969    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd"
Sep 15 11:41:44.312623 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:41:44.312533    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a1c362-58f59c57c4-ftxv7"
Sep 15 11:42:31.255651 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:42:31.255607    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-a1c362/explicit-model-a1c362-kserve-7c54fb759c-mcrvc"]
Sep 15 11:42:31.259444 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:42:31.259422    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-a1c362/explicit-model-a1c362-kserve-7c54fb759c-mcrvc"
Sep 15 11:42:31.263822 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:42:31.263757    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-a1c362\"/\"kube-root-ca.crt\""
Sep 15 11:42:31.263971 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:42:31.263874    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-a1c362\"/\"openshift-service-ca.crt\""
Sep 15 11:42:31.264063 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:42:31.264005    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-a1c362\"/\"default-dockercfg-kkhwb\""
Sep 15 11:42:31.264133 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:42:31.263765    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-a1c362\"/\"explicit-model-a1c362-kserve-self-signed-certs\""
Sep 15 11:42:31.268791 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:42:31.268762    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-a1c362/explicit-model-a1c362-kserve-7c54fb759c-mcrvc"]
Sep 15 11:42:31.335350 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:42:31.335309    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4524087-cf8d-45b9-b2cf-5aa3d824ff10-home\") pod \"explicit-model-a1c362-kserve-7c54fb759c-mcrvc\" (UID: \"d4524087-cf8d-45b9-b2cf-5aa3d824ff10\") " pod="ai-tenant-e2e-explicit-a1c362/explicit-model-a1c362-kserve-7c54fb759c-mcrvc"
Sep 15 11:42:31.335550 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:42:31.335418    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4524087-cf8d-45b9-b2cf-5aa3d824ff10-tmp-dir\") pod \"explicit-model-a1c362-kserve-7c54fb759c-mcrvc\" (UID: \"d4524087-cf8d-45b9-b2cf-5aa3d824ff10\") " pod="ai-tenant-e2e-explicit-a1c362/explicit-model-a1c362-kserve-7c54fb759c-mcrvc"
Sep 15 11:42:31.335550 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:42:31.335445    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4524087-cf8d-45b9-b2cf-5aa3d824ff10-dshm\") pod \"explicit-model-a1c362-kserve-7c54fb759c-mcrvc\" (UID: \"d4524087-cf8d-45b9-b2cf-5aa3d824ff10\") " pod="ai-tenant-e2e-explicit-a1c362/explicit-model-a1c362-kserve-7c54fb759c-mcrvc"
Sep 15 11:42:31.335676 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:42:31.335567    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4524087-cf8d-45b9-b2cf-5aa3d824ff10-model-cache\") pod \"explicit-model-a1c362-kserve-7c54fb759c-mcrvc\" (UID: \"d4524087-cf8d-45b9-b2cf-5aa3d824ff10\") " pod="ai-tenant-e2e-explicit-a1c362/explicit-model-a1c362-kserve-7c54fb759c-mcrvc"
Sep 15 11:42:31.335676 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:42:31.335601    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4524087-cf8d-45b9-b2cf-5aa3d824ff10-tls-certs\") pod \"explicit-model-a1c362-kserve-7c54fb759c-mcrvc\" (UID: \"d4524087-cf8d-45b9-b2cf-5aa3d824ff10\") " pod="ai-tenant-e2e-explicit-a1c362/explicit-model-a1c362-kserve-7c54fb759c-mcrvc"
Sep 15 11:42:31.335676 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:42:31.335637    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5htdj\" (UniqueName: \"kubernetes.io/projected/d4524087-cf8d-45b9-b2cf-5aa3d824ff10-kube-api-access-5htdj\") pod \"explicit-model-a1c362-kserve-7c54fb759c-mcrvc\" (UID: \"d4524087-cf8d-45b9-b2cf-5aa3d824ff10\") " pod="ai-tenant-e2e-explicit-a1c362/explicit-model-a1c362-kserve-7c54fb759c-mcrvc"
Sep 15 11:42:31.436211 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:42:31.436154    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4524087-cf8d-45b9-b2cf-5aa3d824ff10-tmp-dir\") pod \"explicit-model-a1c362-kserve-7c54fb759c-mcrvc\" (UID: \"d4524087-cf8d-45b9-b2cf-5aa3d824ff10\") " pod="ai-tenant-e2e-explicit-a1c362/explicit-model-a1c362-kserve-7c54fb759c-mcrvc"
Sep 15 11:42:31.436402 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:42:31.436221    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4524087-cf8d-45b9-b2cf-5aa3d824ff10-dshm\") pod \"explicit-model-a1c362-kserve-7c54fb759c-mcrvc\" (UID: \"d4524087-cf8d-45b9-b2cf-5aa3d824ff10\") " pod="ai-tenant-e2e-explicit-a1c362/explicit-model-a1c362-kserve-7c54fb759c-mcrvc"
Sep 15 11:42:31.436402 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:42:31.436286    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4524087-cf8d-45b9-b2cf-5aa3d824ff10-model-cache\") pod \"explicit-model-a1c362-kserve-7c54fb759c-mcrvc\" (UID: \"d4524087-cf8d-45b9-b2cf-5aa3d824ff10\") " pod="ai-tenant-e2e-explicit-a1c362/explicit-model-a1c362-kserve-7c54fb759c-mcrvc"
Sep 15 11:42:31.436402 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:42:31.436309    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4524087-cf8d-45b9-b2cf-5aa3d824ff10-tls-certs\") pod \"explicit-model-a1c362-kserve-7c54fb759c-mcrvc\" (UID: \"d4524087-cf8d-45b9-b2cf-5aa3d824ff10\") " pod="ai-tenant-e2e-explicit-a1c362/explicit-model-a1c362-kserve-7c54fb759c-mcrvc"
Sep 15 11:42:31.436402 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:42:31.436338    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5htdj\" (UniqueName: \"kubernetes.io/projected/d4524087-cf8d-45b9-b2cf-5aa3d824ff10-kube-api-access-5htdj\") pod \"explicit-model-a1c362-kserve-7c54fb759c-mcrvc\" (UID: \"d4524087-cf8d-45b9-b2cf-5aa3d824ff10\") " pod="ai-tenant-e2e-explicit-a1c362/explicit-model-a1c362-kserve-7c54fb759c-mcrvc"
Sep 15 11:42:31.436402 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:42:31.436376    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4524087-cf8d-45b9-b2cf-5aa3d824ff10-home\") pod \"explicit-model-a1c362-kserve-7c54fb759c-mcrvc\" (UID: \"d4524087-cf8d-45b9-b2cf-5aa3d824ff10\") " pod="ai-tenant-e2e-explicit-a1c362/explicit-model-a1c362-kserve-7c54fb759c-mcrvc"
Sep 15 11:42:31.436633 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:42:31.436580    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4524087-cf8d-45b9-b2cf-5aa3d824ff10-tmp-dir\") pod \"explicit-model-a1c362-kserve-7c54fb759c-mcrvc\" (UID: \"d4524087-cf8d-45b9-b2cf-5aa3d824ff10\") " pod="ai-tenant-e2e-explicit-a1c362/explicit-model-a1c362-kserve-7c54fb759c-mcrvc"
Sep 15 11:42:31.436697 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:42:31.436658    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4524087-cf8d-45b9-b2cf-5aa3d824ff10-model-cache\") pod \"explicit-model-a1c362-kserve-7c54fb759c-mcrvc\" (UID: \"d4524087-cf8d-45b9-b2cf-5aa3d824ff10\") " pod="ai-tenant-e2e-explicit-a1c362/explicit-model-a1c362-kserve-7c54fb759c-mcrvc"
Sep 15 11:42:31.436774 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:42:31.436753    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4524087-cf8d-45b9-b2cf-5aa3d824ff10-home\") pod \"explicit-model-a1c362-kserve-7c54fb759c-mcrvc\" (UID: \"d4524087-cf8d-45b9-b2cf-5aa3d824ff10\") " pod="ai-tenant-e2e-explicit-a1c362/explicit-model-a1c362-kserve-7c54fb759c-mcrvc"
Sep 15 11:42:31.438632 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:42:31.438601    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4524087-cf8d-45b9-b2cf-5aa3d824ff10-dshm\") pod \"explicit-model-a1c362-kserve-7c54fb759c-mcrvc\" (UID: \"d4524087-cf8d-45b9-b2cf-5aa3d824ff10\") " pod="ai-tenant-e2e-explicit-a1c362/explicit-model-a1c362-kserve-7c54fb759c-mcrvc"
Sep 15 11:42:31.438923 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:42:31.438903    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4524087-cf8d-45b9-b2cf-5aa3d824ff10-tls-certs\") pod \"explicit-model-a1c362-kserve-7c54fb759c-mcrvc\" (UID: \"d4524087-cf8d-45b9-b2cf-5aa3d824ff10\") " pod="ai-tenant-e2e-explicit-a1c362/explicit-model-a1c362-kserve-7c54fb759c-mcrvc"
Sep 15 11:42:31.446797 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:42:31.446766    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5htdj\" (UniqueName: \"kubernetes.io/projected/d4524087-cf8d-45b9-b2cf-5aa3d824ff10-kube-api-access-5htdj\") pod \"explicit-model-a1c362-kserve-7c54fb759c-mcrvc\" (UID: \"d4524087-cf8d-45b9-b2cf-5aa3d824ff10\") " pod="ai-tenant-e2e-explicit-a1c362/explicit-model-a1c362-kserve-7c54fb759c-mcrvc"
Sep 15 11:42:31.572350 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:42:31.572252    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-a1c362/explicit-model-a1c362-kserve-7c54fb759c-mcrvc"
Sep 15 11:42:31.845077 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:42:31.845050    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-a1c362/explicit-model-a1c362-kserve-7c54fb759c-mcrvc"]
Sep 15 11:42:31.847303 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:42:31.847267    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd4524087_cf8d_45b9_b2cf_5aa3d824ff10.slice/crio-cd7e35f331549fb0c3a051071a9f67e914814cbb3cc8a8f8202e86315eefa58c WatchSource:0}: Error finding container cd7e35f331549fb0c3a051071a9f67e914814cbb3cc8a8f8202e86315eefa58c: Status 404 returned error can't find the container with id cd7e35f331549fb0c3a051071a9f67e914814cbb3cc8a8f8202e86315eefa58c
Sep 15 11:42:32.611951 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:42:32.611914    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-a1c362/explicit-model-a1c362-kserve-7c54fb759c-mcrvc" event={"ID":"d4524087-cf8d-45b9-b2cf-5aa3d824ff10","Type":"ContainerStarted","Data":"6460a89e1f6a74896974ca0ec8f7f8a03dfa54ea62ae35daf19fc0caae72ddfc"}
Sep 15 11:42:32.611951 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:42:32.611954    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-a1c362/explicit-model-a1c362-kserve-7c54fb759c-mcrvc" event={"ID":"d4524087-cf8d-45b9-b2cf-5aa3d824ff10","Type":"ContainerStarted","Data":"cd7e35f331549fb0c3a051071a9f67e914814cbb3cc8a8f8202e86315eefa58c"}
Sep 15 11:42:32.630932 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:42:32.630854    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-a1c362/explicit-model-a1c362-kserve-7c54fb759c-mcrvc" podStartSLOduration=1.630833602 podStartE2EDuration="1.630833602s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:42:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:42:32.629988722 +0000 UTC m=+1032.091854775" watchObservedRunningTime="2026-09-15 11:42:32.630833602 +0000 UTC m=+1032.092699655"
Sep 15 11:42:41.573281 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:42:41.573233    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-a1c362/explicit-model-a1c362-kserve-7c54fb759c-mcrvc"
Sep 15 11:42:41.573757 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:42:41.573488    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-explicit-a1c362/explicit-model-a1c362-kserve-7c54fb759c-mcrvc"
Sep 15 11:42:41.586067 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:42:41.586042    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-explicit-a1c362/explicit-model-a1c362-kserve-7c54fb759c-mcrvc"
Sep 15 11:42:41.676366 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:42:41.676332    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-explicit-a1c362/explicit-model-a1c362-kserve-7c54fb759c-mcrvc"
Sep 15 11:42:53.153796 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:42:53.153755    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-a1c362/explicit-model-a1c362-kserve-7c54fb759c-mcrvc"]
Sep 15 11:43:04.357364 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:04.357322    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd"]
Sep 15 11:43:04.357998 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:04.357538    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd" podUID="4620745e-d5cc-4238-a6ba-f12028629636" containerName="maas-api" containerID="cri-o://80c226222ce0fccecf5a2dd417eb50656c2db20cd8a479f56f90ba07282c81ec" gracePeriod=30
Sep 15 11:43:04.441877 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:04.441843    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a1c362-58f59c57c4-ftxv7"]
Sep 15 11:43:04.442074 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:04.442049    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a1c362-58f59c57c4-ftxv7" podUID="5990631c-6619-4518-8343-dae1067c0fd4" containerName="payload-pre-processing" containerID="cri-o://1c17867a5edff906f294a5253b661ec932b1efc7501ada67663803cdb695b0c2" gracePeriod=30
Sep 15 11:43:04.697680 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:04.697652    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd"
Sep 15 11:43:04.735254 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:04.735230    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a1c362-58f59c57c4-ftxv7"
Sep 15 11:43:04.757596 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:04.757563    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcw9t\" (UniqueName: \"kubernetes.io/projected/4620745e-d5cc-4238-a6ba-f12028629636-kube-api-access-rcw9t\") pod \"4620745e-d5cc-4238-a6ba-f12028629636\" (UID: \"4620745e-d5cc-4238-a6ba-f12028629636\") "
Sep 15 11:43:04.757768 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:04.757625    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4620745e-d5cc-4238-a6ba-f12028629636-metrics-certs\") pod \"4620745e-d5cc-4238-a6ba-f12028629636\" (UID: \"4620745e-d5cc-4238-a6ba-f12028629636\") "
Sep 15 11:43:04.757768 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:04.757665    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4620745e-d5cc-4238-a6ba-f12028629636-maas-api-tls\") pod \"4620745e-d5cc-4238-a6ba-f12028629636\" (UID: \"4620745e-d5cc-4238-a6ba-f12028629636\") "
Sep 15 11:43:04.757884 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:04.757799    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4620745e-d5cc-4238-a6ba-f12028629636-openshift-service-ca\") pod \"4620745e-d5cc-4238-a6ba-f12028629636\" (UID: \"4620745e-d5cc-4238-a6ba-f12028629636\") "
Sep 15 11:43:04.758543 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:04.758458    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4620745e-d5cc-4238-a6ba-f12028629636-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4620745e-d5cc-4238-a6ba-f12028629636" (UID: "4620745e-d5cc-4238-a6ba-f12028629636"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:43:04.759892 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:04.759854    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4620745e-d5cc-4238-a6ba-f12028629636-kube-api-access-rcw9t" (OuterVolumeSpecName: "kube-api-access-rcw9t") pod "4620745e-d5cc-4238-a6ba-f12028629636" (UID: "4620745e-d5cc-4238-a6ba-f12028629636"). InnerVolumeSpecName "kube-api-access-rcw9t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:43:04.760013 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:04.759941    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4620745e-d5cc-4238-a6ba-f12028629636-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4620745e-d5cc-4238-a6ba-f12028629636" (UID: "4620745e-d5cc-4238-a6ba-f12028629636"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:43:04.760013 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:04.759979    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4620745e-d5cc-4238-a6ba-f12028629636-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4620745e-d5cc-4238-a6ba-f12028629636" (UID: "4620745e-d5cc-4238-a6ba-f12028629636"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:43:04.784098 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:04.784066    2582 generic.go:356] "Generic (PLEG): container finished" podID="4620745e-d5cc-4238-a6ba-f12028629636" containerID="80c226222ce0fccecf5a2dd417eb50656c2db20cd8a479f56f90ba07282c81ec" exitCode=0
Sep 15 11:43:04.784256 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:04.784111    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd"
Sep 15 11:43:04.784256 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:04.784134    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd" event={"ID":"4620745e-d5cc-4238-a6ba-f12028629636","Type":"ContainerDied","Data":"80c226222ce0fccecf5a2dd417eb50656c2db20cd8a479f56f90ba07282c81ec"}
Sep 15 11:43:04.784256 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:04.784217    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd" event={"ID":"4620745e-d5cc-4238-a6ba-f12028629636","Type":"ContainerDied","Data":"de5c06972a6dd5ba3364f07a47d89adeb99277554a8e45140b3430917b7d33a9"}
Sep 15 11:43:04.784256 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:04.784248    2582 scope.go:117] "RemoveContainer" containerID="80c226222ce0fccecf5a2dd417eb50656c2db20cd8a479f56f90ba07282c81ec"
Sep 15 11:43:04.785810 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:04.785784    2582 generic.go:356] "Generic (PLEG): container finished" podID="5990631c-6619-4518-8343-dae1067c0fd4" containerID="1c17867a5edff906f294a5253b661ec932b1efc7501ada67663803cdb695b0c2" exitCode=0
Sep 15 11:43:04.785904 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:04.785824    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a1c362-58f59c57c4-ftxv7" event={"ID":"5990631c-6619-4518-8343-dae1067c0fd4","Type":"ContainerDied","Data":"1c17867a5edff906f294a5253b661ec932b1efc7501ada67663803cdb695b0c2"}
Sep 15 11:43:04.785904 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:04.785838    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a1c362-58f59c57c4-ftxv7"
Sep 15 11:43:04.785904 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:04.785872    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a1c362-58f59c57c4-ftxv7" event={"ID":"5990631c-6619-4518-8343-dae1067c0fd4","Type":"ContainerDied","Data":"23b5a1f91a42f71bb3b92386fe2fec7b24542c383de4e9423058081015898d4d"}
Sep 15 11:43:04.794251 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:04.794235    2582 scope.go:117] "RemoveContainer" containerID="80c226222ce0fccecf5a2dd417eb50656c2db20cd8a479f56f90ba07282c81ec"
Sep 15 11:43:04.794547 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:43:04.794530    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80c226222ce0fccecf5a2dd417eb50656c2db20cd8a479f56f90ba07282c81ec\": container with ID starting with 80c226222ce0fccecf5a2dd417eb50656c2db20cd8a479f56f90ba07282c81ec not found: ID does not exist" containerID="80c226222ce0fccecf5a2dd417eb50656c2db20cd8a479f56f90ba07282c81ec"
Sep 15 11:43:04.794614 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:04.794555    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80c226222ce0fccecf5a2dd417eb50656c2db20cd8a479f56f90ba07282c81ec"} err="failed to get container status \"80c226222ce0fccecf5a2dd417eb50656c2db20cd8a479f56f90ba07282c81ec\": rpc error: code = NotFound desc = could not find container \"80c226222ce0fccecf5a2dd417eb50656c2db20cd8a479f56f90ba07282c81ec\": container with ID starting with 80c226222ce0fccecf5a2dd417eb50656c2db20cd8a479f56f90ba07282c81ec not found: ID does not exist"
Sep 15 11:43:04.794614 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:04.794569    2582 scope.go:117] "RemoveContainer" containerID="1c17867a5edff906f294a5253b661ec932b1efc7501ada67663803cdb695b0c2"
Sep 15 11:43:04.802334 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:04.802225    2582 scope.go:117] "RemoveContainer" containerID="1c17867a5edff906f294a5253b661ec932b1efc7501ada67663803cdb695b0c2"
Sep 15 11:43:04.802498 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:43:04.802481    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c17867a5edff906f294a5253b661ec932b1efc7501ada67663803cdb695b0c2\": container with ID starting with 1c17867a5edff906f294a5253b661ec932b1efc7501ada67663803cdb695b0c2 not found: ID does not exist" containerID="1c17867a5edff906f294a5253b661ec932b1efc7501ada67663803cdb695b0c2"
Sep 15 11:43:04.802542 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:04.802504    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c17867a5edff906f294a5253b661ec932b1efc7501ada67663803cdb695b0c2"} err="failed to get container status \"1c17867a5edff906f294a5253b661ec932b1efc7501ada67663803cdb695b0c2\": rpc error: code = NotFound desc = could not find container \"1c17867a5edff906f294a5253b661ec932b1efc7501ada67663803cdb695b0c2\": container with ID starting with 1c17867a5edff906f294a5253b661ec932b1efc7501ada67663803cdb695b0c2 not found: ID does not exist"
Sep 15 11:43:04.822201 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:04.822150    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd"]
Sep 15 11:43:04.828377 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:04.828356    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a1c362-6bb5d8f58-sxlwd"]
Sep 15 11:43:04.858577 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:04.858549    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5990631c-6619-4518-8343-dae1067c0fd4-plugins-config-volume\") pod \"5990631c-6619-4518-8343-dae1067c0fd4\" (UID: \"5990631c-6619-4518-8343-dae1067c0fd4\") "
Sep 15 11:43:04.858722 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:04.858579    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bszh\" (UniqueName: \"kubernetes.io/projected/5990631c-6619-4518-8343-dae1067c0fd4-kube-api-access-6bszh\") pod \"5990631c-6619-4518-8343-dae1067c0fd4\" (UID: \"5990631c-6619-4518-8343-dae1067c0fd4\") "
Sep 15 11:43:04.858992 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:04.858953    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4620745e-d5cc-4238-a6ba-f12028629636-metrics-certs\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:43:04.858992 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:04.858981    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4620745e-d5cc-4238-a6ba-f12028629636-maas-api-tls\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:43:04.859200 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:04.858995    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4620745e-d5cc-4238-a6ba-f12028629636-openshift-service-ca\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:43:04.859200 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:04.859010    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcw9t\" (UniqueName: \"kubernetes.io/projected/4620745e-d5cc-4238-a6ba-f12028629636-kube-api-access-rcw9t\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:43:04.859200 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:04.859103    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5990631c-6619-4518-8343-dae1067c0fd4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5990631c-6619-4518-8343-dae1067c0fd4" (UID: "5990631c-6619-4518-8343-dae1067c0fd4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:43:04.860884 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:04.860860    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5990631c-6619-4518-8343-dae1067c0fd4-kube-api-access-6bszh" (OuterVolumeSpecName: "kube-api-access-6bszh") pod "5990631c-6619-4518-8343-dae1067c0fd4" (UID: "5990631c-6619-4518-8343-dae1067c0fd4"). InnerVolumeSpecName "kube-api-access-6bszh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:43:04.960267 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:04.960148    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5990631c-6619-4518-8343-dae1067c0fd4-plugins-config-volume\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:43:04.960267 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:04.960218    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bszh\" (UniqueName: \"kubernetes.io/projected/5990631c-6619-4518-8343-dae1067c0fd4-kube-api-access-6bszh\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:43:05.045086 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:05.045056    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4620745e-d5cc-4238-a6ba-f12028629636" path="/var/lib/kubelet/pods/4620745e-d5cc-4238-a6ba-f12028629636/volumes"
Sep 15 11:43:05.108921 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:05.108882    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a1c362-58f59c57c4-ftxv7"]
Sep 15 11:43:05.114019 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:05.113990    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a1c362-58f59c57c4-ftxv7"]
Sep 15 11:43:05.529991 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:05.529956    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb"]
Sep 15 11:43:05.530419 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:05.530382    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5990631c-6619-4518-8343-dae1067c0fd4" containerName="payload-pre-processing"
Sep 15 11:43:05.530419 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:05.530394    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5990631c-6619-4518-8343-dae1067c0fd4" containerName="payload-pre-processing"
Sep 15 11:43:05.530419 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:05.530402    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4620745e-d5cc-4238-a6ba-f12028629636" containerName="maas-api"
Sep 15 11:43:05.530419 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:05.530408    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4620745e-d5cc-4238-a6ba-f12028629636" containerName="maas-api"
Sep 15 11:43:05.530624 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:05.530469    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4620745e-d5cc-4238-a6ba-f12028629636" containerName="maas-api"
Sep 15 11:43:05.530624 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:05.530478    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5990631c-6619-4518-8343-dae1067c0fd4" containerName="payload-pre-processing"
Sep 15 11:43:05.535486 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:05.535463    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb"
Sep 15 11:43:05.537733 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:05.537702    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-53d3db96-serving-cert\""
Sep 15 11:43:05.553989 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:05.547947    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb"]
Sep 15 11:43:05.667435 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:05.667400    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e849f52-adc5-4f05-8355-8522aa2f1e48-openshift-service-ca\") pod \"maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb\" (UID: \"5e849f52-adc5-4f05-8355-8522aa2f1e48\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb"
Sep 15 11:43:05.667608 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:05.667450    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpslc\" (UniqueName: \"kubernetes.io/projected/5e849f52-adc5-4f05-8355-8522aa2f1e48-kube-api-access-rpslc\") pod \"maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb\" (UID: \"5e849f52-adc5-4f05-8355-8522aa2f1e48\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb"
Sep 15 11:43:05.667608 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:05.667521    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e849f52-adc5-4f05-8355-8522aa2f1e48-maas-api-tls\") pod \"maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb\" (UID: \"5e849f52-adc5-4f05-8355-8522aa2f1e48\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb"
Sep 15 11:43:05.667692 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:05.667610    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e849f52-adc5-4f05-8355-8522aa2f1e48-metrics-certs\") pod \"maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb\" (UID: \"5e849f52-adc5-4f05-8355-8522aa2f1e48\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb"
Sep 15 11:43:05.769022 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:05.768994    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpslc\" (UniqueName: \"kubernetes.io/projected/5e849f52-adc5-4f05-8355-8522aa2f1e48-kube-api-access-rpslc\") pod \"maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb\" (UID: \"5e849f52-adc5-4f05-8355-8522aa2f1e48\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb"
Sep 15 11:43:05.769228 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:05.769052    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e849f52-adc5-4f05-8355-8522aa2f1e48-maas-api-tls\") pod \"maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb\" (UID: \"5e849f52-adc5-4f05-8355-8522aa2f1e48\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb"
Sep 15 11:43:05.769228 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:05.769097    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e849f52-adc5-4f05-8355-8522aa2f1e48-metrics-certs\") pod \"maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb\" (UID: \"5e849f52-adc5-4f05-8355-8522aa2f1e48\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb"
Sep 15 11:43:05.769228 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:05.769115    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e849f52-adc5-4f05-8355-8522aa2f1e48-openshift-service-ca\") pod \"maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb\" (UID: \"5e849f52-adc5-4f05-8355-8522aa2f1e48\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb"
Sep 15 11:43:05.769776 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:05.769744    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e849f52-adc5-4f05-8355-8522aa2f1e48-openshift-service-ca\") pod \"maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb\" (UID: \"5e849f52-adc5-4f05-8355-8522aa2f1e48\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb"
Sep 15 11:43:05.771767 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:05.771741    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e849f52-adc5-4f05-8355-8522aa2f1e48-metrics-certs\") pod \"maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb\" (UID: \"5e849f52-adc5-4f05-8355-8522aa2f1e48\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb"
Sep 15 11:43:05.771865 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:05.771748    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e849f52-adc5-4f05-8355-8522aa2f1e48-maas-api-tls\") pod \"maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb\" (UID: \"5e849f52-adc5-4f05-8355-8522aa2f1e48\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb"
Sep 15 11:43:05.780835 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:05.780815    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpslc\" (UniqueName: \"kubernetes.io/projected/5e849f52-adc5-4f05-8355-8522aa2f1e48-kube-api-access-rpslc\") pod \"maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb\" (UID: \"5e849f52-adc5-4f05-8355-8522aa2f1e48\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb"
Sep 15 11:43:05.847299 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:05.847264    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb"
Sep 15 11:43:06.128075 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:06.128047    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb"]
Sep 15 11:43:06.130336 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:43:06.130311    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e849f52_adc5_4f05_8355_8522aa2f1e48.slice/crio-07c3be90d9b61514c96ab6f72ed55a524bc910cd0a117abf91611f3c9d98029d WatchSource:0}: Error finding container 07c3be90d9b61514c96ab6f72ed55a524bc910cd0a117abf91611f3c9d98029d: Status 404 returned error can't find the container with id 07c3be90d9b61514c96ab6f72ed55a524bc910cd0a117abf91611f3c9d98029d
Sep 15 11:43:06.798252 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:06.798210    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb" event={"ID":"5e849f52-adc5-4f05-8355-8522aa2f1e48","Type":"ContainerStarted","Data":"07c3be90d9b61514c96ab6f72ed55a524bc910cd0a117abf91611f3c9d98029d"}
Sep 15 11:43:07.046284 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:07.046249    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5990631c-6619-4518-8343-dae1067c0fd4" path="/var/lib/kubelet/pods/5990631c-6619-4518-8343-dae1067c0fd4/volumes"
Sep 15 11:43:07.804737 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:07.804644    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb" event={"ID":"5e849f52-adc5-4f05-8355-8522aa2f1e48","Type":"ContainerStarted","Data":"dd21b1caa863aa2c640ce6e4fe88dc2efa86fc84fc0d64435d45cf346448f91a"}
Sep 15 11:43:07.805102 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:07.804779    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb"
Sep 15 11:43:07.836309 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:07.836250    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb" podStartSLOduration=1.466884493 podStartE2EDuration="2.836233429s" totalImagesPullingTime="1.369348936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:43:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:43:07.83335831 +0000 UTC m=+1067.295224363" watchObservedRunningTime="2026-09-15 11:43:07.836233429 +0000 UTC m=+1067.298099481"
Sep 15 11:43:08.175395 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:08.175347    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-a1c362/explicit-model-a1c362-kserve-7c54fb759c-mcrvc" podUID="d4524087-cf8d-45b9-b2cf-5aa3d824ff10" containerName="main" containerID="cri-o://6460a89e1f6a74896974ca0ec8f7f8a03dfa54ea62ae35daf19fc0caae72ddfc" gracePeriod=45
Sep 15 11:43:08.443290 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:08.443264    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-a1c362/explicit-model-a1c362-kserve-7c54fb759c-mcrvc"
Sep 15 11:43:08.596457 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:08.596423    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4524087-cf8d-45b9-b2cf-5aa3d824ff10-model-cache\") pod \"d4524087-cf8d-45b9-b2cf-5aa3d824ff10\" (UID: \"d4524087-cf8d-45b9-b2cf-5aa3d824ff10\") "
Sep 15 11:43:08.596671 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:08.596483    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4524087-cf8d-45b9-b2cf-5aa3d824ff10-tls-certs\") pod \"d4524087-cf8d-45b9-b2cf-5aa3d824ff10\" (UID: \"d4524087-cf8d-45b9-b2cf-5aa3d824ff10\") "
Sep 15 11:43:08.596671 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:08.596509    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4524087-cf8d-45b9-b2cf-5aa3d824ff10-tmp-dir\") pod \"d4524087-cf8d-45b9-b2cf-5aa3d824ff10\" (UID: \"d4524087-cf8d-45b9-b2cf-5aa3d824ff10\") "
Sep 15 11:43:08.596671 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:08.596539    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4524087-cf8d-45b9-b2cf-5aa3d824ff10-home\") pod \"d4524087-cf8d-45b9-b2cf-5aa3d824ff10\" (UID: \"d4524087-cf8d-45b9-b2cf-5aa3d824ff10\") "
Sep 15 11:43:08.596671 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:08.596555    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4524087-cf8d-45b9-b2cf-5aa3d824ff10-dshm\") pod \"d4524087-cf8d-45b9-b2cf-5aa3d824ff10\" (UID: \"d4524087-cf8d-45b9-b2cf-5aa3d824ff10\") "
Sep 15 11:43:08.596671 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:08.596590    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5htdj\" (UniqueName: \"kubernetes.io/projected/d4524087-cf8d-45b9-b2cf-5aa3d824ff10-kube-api-access-5htdj\") pod \"d4524087-cf8d-45b9-b2cf-5aa3d824ff10\" (UID: \"d4524087-cf8d-45b9-b2cf-5aa3d824ff10\") "
Sep 15 11:43:08.596671 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:08.596659    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4524087-cf8d-45b9-b2cf-5aa3d824ff10-model-cache" (OuterVolumeSpecName: "model-cache") pod "d4524087-cf8d-45b9-b2cf-5aa3d824ff10" (UID: "d4524087-cf8d-45b9-b2cf-5aa3d824ff10"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:43:08.596954 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:08.596781    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4524087-cf8d-45b9-b2cf-5aa3d824ff10-home" (OuterVolumeSpecName: "home") pod "d4524087-cf8d-45b9-b2cf-5aa3d824ff10" (UID: "d4524087-cf8d-45b9-b2cf-5aa3d824ff10"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:43:08.596954 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:08.596795    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4524087-cf8d-45b9-b2cf-5aa3d824ff10-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d4524087-cf8d-45b9-b2cf-5aa3d824ff10" (UID: "d4524087-cf8d-45b9-b2cf-5aa3d824ff10"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:43:08.596954 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:08.596940    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4524087-cf8d-45b9-b2cf-5aa3d824ff10-tmp-dir\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:43:08.597053 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:08.596958    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4524087-cf8d-45b9-b2cf-5aa3d824ff10-home\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:43:08.597053 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:08.596966    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4524087-cf8d-45b9-b2cf-5aa3d824ff10-model-cache\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:43:08.598962 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:08.598939    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4524087-cf8d-45b9-b2cf-5aa3d824ff10-dshm" (OuterVolumeSpecName: "dshm") pod "d4524087-cf8d-45b9-b2cf-5aa3d824ff10" (UID: "d4524087-cf8d-45b9-b2cf-5aa3d824ff10"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:43:08.599052 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:08.598983    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4524087-cf8d-45b9-b2cf-5aa3d824ff10-kube-api-access-5htdj" (OuterVolumeSpecName: "kube-api-access-5htdj") pod "d4524087-cf8d-45b9-b2cf-5aa3d824ff10" (UID: "d4524087-cf8d-45b9-b2cf-5aa3d824ff10"). InnerVolumeSpecName "kube-api-access-5htdj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:43:08.599052 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:08.598998    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4524087-cf8d-45b9-b2cf-5aa3d824ff10-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d4524087-cf8d-45b9-b2cf-5aa3d824ff10" (UID: "d4524087-cf8d-45b9-b2cf-5aa3d824ff10"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:43:08.698017 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:08.697925    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4524087-cf8d-45b9-b2cf-5aa3d824ff10-tls-certs\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:43:08.698017 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:08.697956    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4524087-cf8d-45b9-b2cf-5aa3d824ff10-dshm\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:43:08.698017 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:08.697969    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5htdj\" (UniqueName: \"kubernetes.io/projected/d4524087-cf8d-45b9-b2cf-5aa3d824ff10-kube-api-access-5htdj\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:43:08.811250 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:08.811206    2582 generic.go:356] "Generic (PLEG): container finished" podID="d4524087-cf8d-45b9-b2cf-5aa3d824ff10" containerID="6460a89e1f6a74896974ca0ec8f7f8a03dfa54ea62ae35daf19fc0caae72ddfc" exitCode=0
Sep 15 11:43:08.811250 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:08.811232    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-a1c362/explicit-model-a1c362-kserve-7c54fb759c-mcrvc"
Sep 15 11:43:08.811752 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:08.811275    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-a1c362/explicit-model-a1c362-kserve-7c54fb759c-mcrvc" event={"ID":"d4524087-cf8d-45b9-b2cf-5aa3d824ff10","Type":"ContainerDied","Data":"6460a89e1f6a74896974ca0ec8f7f8a03dfa54ea62ae35daf19fc0caae72ddfc"}
Sep 15 11:43:08.811752 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:08.811317    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-a1c362/explicit-model-a1c362-kserve-7c54fb759c-mcrvc" event={"ID":"d4524087-cf8d-45b9-b2cf-5aa3d824ff10","Type":"ContainerDied","Data":"cd7e35f331549fb0c3a051071a9f67e914814cbb3cc8a8f8202e86315eefa58c"}
Sep 15 11:43:08.811752 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:08.811334    2582 scope.go:117] "RemoveContainer" containerID="6460a89e1f6a74896974ca0ec8f7f8a03dfa54ea62ae35daf19fc0caae72ddfc"
Sep 15 11:43:08.821353 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:08.821331    2582 scope.go:117] "RemoveContainer" containerID="6460a89e1f6a74896974ca0ec8f7f8a03dfa54ea62ae35daf19fc0caae72ddfc"
Sep 15 11:43:08.821649 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:43:08.821628    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6460a89e1f6a74896974ca0ec8f7f8a03dfa54ea62ae35daf19fc0caae72ddfc\": container with ID starting with 6460a89e1f6a74896974ca0ec8f7f8a03dfa54ea62ae35daf19fc0caae72ddfc not found: ID does not exist" containerID="6460a89e1f6a74896974ca0ec8f7f8a03dfa54ea62ae35daf19fc0caae72ddfc"
Sep 15 11:43:08.821719 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:08.821662    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6460a89e1f6a74896974ca0ec8f7f8a03dfa54ea62ae35daf19fc0caae72ddfc"} err="failed to get container status \"6460a89e1f6a74896974ca0ec8f7f8a03dfa54ea62ae35daf19fc0caae72ddfc\": rpc error: code = NotFound desc = could not find container \"6460a89e1f6a74896974ca0ec8f7f8a03dfa54ea62ae35daf19fc0caae72ddfc\": container with ID starting with 6460a89e1f6a74896974ca0ec8f7f8a03dfa54ea62ae35daf19fc0caae72ddfc not found: ID does not exist"
Sep 15 11:43:08.849170 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:08.849134    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-a1c362/explicit-model-a1c362-kserve-7c54fb759c-mcrvc"]
Sep 15 11:43:08.853521 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:08.853496    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-a1c362/explicit-model-a1c362-kserve-7c54fb759c-mcrvc"]
Sep 15 11:43:09.045506 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:09.045424    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4524087-cf8d-45b9-b2cf-5aa3d824ff10" path="/var/lib/kubelet/pods/d4524087-cf8d-45b9-b2cf-5aa3d824ff10/volumes"
Sep 15 11:43:13.817637 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:13.817547    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb"
Sep 15 11:43:28.055540 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:28.055500    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-9bd868/distinct-w0-9bd868-kserve-55775549cd-tk79v"]
Sep 15 11:43:28.056809 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:28.056774    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4524087-cf8d-45b9-b2cf-5aa3d824ff10" containerName="main"
Sep 15 11:43:28.056999 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:28.056986    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4524087-cf8d-45b9-b2cf-5aa3d824ff10" containerName="main"
Sep 15 11:43:28.057385 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:28.057368    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4524087-cf8d-45b9-b2cf-5aa3d824ff10" containerName="main"
Sep 15 11:43:28.062986 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:28.062958    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-9bd868/distinct-w0-9bd868-kserve-55775549cd-tk79v"
Sep 15 11:43:28.065760 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:28.065740    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-9bd868\"/\"distinct-w0-9bd868-kserve-self-signed-certs\""
Sep 15 11:43:28.070648 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:28.070372    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/420c9a8c-59ed-498d-870f-66c92b9e3988-model-cache\") pod \"distinct-w0-9bd868-kserve-55775549cd-tk79v\" (UID: \"420c9a8c-59ed-498d-870f-66c92b9e3988\") " pod="e2e-models-e2e-worker-w0-9bd868/distinct-w0-9bd868-kserve-55775549cd-tk79v"
Sep 15 11:43:28.070648 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:28.070425    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/420c9a8c-59ed-498d-870f-66c92b9e3988-tls-certs\") pod \"distinct-w0-9bd868-kserve-55775549cd-tk79v\" (UID: \"420c9a8c-59ed-498d-870f-66c92b9e3988\") " pod="e2e-models-e2e-worker-w0-9bd868/distinct-w0-9bd868-kserve-55775549cd-tk79v"
Sep 15 11:43:28.070648 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:28.070479    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/420c9a8c-59ed-498d-870f-66c92b9e3988-tmp-dir\") pod \"distinct-w0-9bd868-kserve-55775549cd-tk79v\" (UID: \"420c9a8c-59ed-498d-870f-66c92b9e3988\") " pod="e2e-models-e2e-worker-w0-9bd868/distinct-w0-9bd868-kserve-55775549cd-tk79v"
Sep 15 11:43:28.070648 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:28.070526    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/420c9a8c-59ed-498d-870f-66c92b9e3988-dshm\") pod \"distinct-w0-9bd868-kserve-55775549cd-tk79v\" (UID: \"420c9a8c-59ed-498d-870f-66c92b9e3988\") " pod="e2e-models-e2e-worker-w0-9bd868/distinct-w0-9bd868-kserve-55775549cd-tk79v"
Sep 15 11:43:28.070648 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:28.070555    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh7nx\" (UniqueName: \"kubernetes.io/projected/420c9a8c-59ed-498d-870f-66c92b9e3988-kube-api-access-jh7nx\") pod \"distinct-w0-9bd868-kserve-55775549cd-tk79v\" (UID: \"420c9a8c-59ed-498d-870f-66c92b9e3988\") " pod="e2e-models-e2e-worker-w0-9bd868/distinct-w0-9bd868-kserve-55775549cd-tk79v"
Sep 15 11:43:28.070928 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:28.070664    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/420c9a8c-59ed-498d-870f-66c92b9e3988-home\") pod \"distinct-w0-9bd868-kserve-55775549cd-tk79v\" (UID: \"420c9a8c-59ed-498d-870f-66c92b9e3988\") " pod="e2e-models-e2e-worker-w0-9bd868/distinct-w0-9bd868-kserve-55775549cd-tk79v"
Sep 15 11:43:28.072426 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:28.072399    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-9bd868/distinct-w0-9bd868-kserve-55775549cd-tk79v"]
Sep 15 11:43:28.171235 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:28.171196    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/420c9a8c-59ed-498d-870f-66c92b9e3988-home\") pod \"distinct-w0-9bd868-kserve-55775549cd-tk79v\" (UID: \"420c9a8c-59ed-498d-870f-66c92b9e3988\") " pod="e2e-models-e2e-worker-w0-9bd868/distinct-w0-9bd868-kserve-55775549cd-tk79v"
Sep 15 11:43:28.171446 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:28.171245    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/420c9a8c-59ed-498d-870f-66c92b9e3988-model-cache\") pod \"distinct-w0-9bd868-kserve-55775549cd-tk79v\" (UID: \"420c9a8c-59ed-498d-870f-66c92b9e3988\") " pod="e2e-models-e2e-worker-w0-9bd868/distinct-w0-9bd868-kserve-55775549cd-tk79v"
Sep 15 11:43:28.171446 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:28.171267    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/420c9a8c-59ed-498d-870f-66c92b9e3988-tls-certs\") pod \"distinct-w0-9bd868-kserve-55775549cd-tk79v\" (UID: \"420c9a8c-59ed-498d-870f-66c92b9e3988\") " pod="e2e-models-e2e-worker-w0-9bd868/distinct-w0-9bd868-kserve-55775549cd-tk79v"
Sep 15 11:43:28.171446 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:28.171291    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/420c9a8c-59ed-498d-870f-66c92b9e3988-tmp-dir\") pod \"distinct-w0-9bd868-kserve-55775549cd-tk79v\" (UID: \"420c9a8c-59ed-498d-870f-66c92b9e3988\") " pod="e2e-models-e2e-worker-w0-9bd868/distinct-w0-9bd868-kserve-55775549cd-tk79v"
Sep 15 11:43:28.171446 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:28.171320    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/420c9a8c-59ed-498d-870f-66c92b9e3988-dshm\") pod \"distinct-w0-9bd868-kserve-55775549cd-tk79v\" (UID: \"420c9a8c-59ed-498d-870f-66c92b9e3988\") " pod="e2e-models-e2e-worker-w0-9bd868/distinct-w0-9bd868-kserve-55775549cd-tk79v"
Sep 15 11:43:28.171446 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:28.171346    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh7nx\" (UniqueName: \"kubernetes.io/projected/420c9a8c-59ed-498d-870f-66c92b9e3988-kube-api-access-jh7nx\") pod \"distinct-w0-9bd868-kserve-55775549cd-tk79v\" (UID: \"420c9a8c-59ed-498d-870f-66c92b9e3988\") " pod="e2e-models-e2e-worker-w0-9bd868/distinct-w0-9bd868-kserve-55775549cd-tk79v"
Sep 15 11:43:28.171696 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:28.171680    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/420c9a8c-59ed-498d-870f-66c92b9e3988-home\") pod \"distinct-w0-9bd868-kserve-55775549cd-tk79v\" (UID: \"420c9a8c-59ed-498d-870f-66c92b9e3988\") " pod="e2e-models-e2e-worker-w0-9bd868/distinct-w0-9bd868-kserve-55775549cd-tk79v"
Sep 15 11:43:28.171751 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:28.171697    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/420c9a8c-59ed-498d-870f-66c92b9e3988-tmp-dir\") pod \"distinct-w0-9bd868-kserve-55775549cd-tk79v\" (UID: \"420c9a8c-59ed-498d-870f-66c92b9e3988\") " pod="e2e-models-e2e-worker-w0-9bd868/distinct-w0-9bd868-kserve-55775549cd-tk79v"
Sep 15 11:43:28.171751 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:28.171724    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/420c9a8c-59ed-498d-870f-66c92b9e3988-model-cache\") pod \"distinct-w0-9bd868-kserve-55775549cd-tk79v\" (UID: \"420c9a8c-59ed-498d-870f-66c92b9e3988\") " pod="e2e-models-e2e-worker-w0-9bd868/distinct-w0-9bd868-kserve-55775549cd-tk79v"
Sep 15 11:43:28.173721 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:28.173697    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/420c9a8c-59ed-498d-870f-66c92b9e3988-dshm\") pod \"distinct-w0-9bd868-kserve-55775549cd-tk79v\" (UID: \"420c9a8c-59ed-498d-870f-66c92b9e3988\") " pod="e2e-models-e2e-worker-w0-9bd868/distinct-w0-9bd868-kserve-55775549cd-tk79v"
Sep 15 11:43:28.174010 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:28.173994    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/420c9a8c-59ed-498d-870f-66c92b9e3988-tls-certs\") pod \"distinct-w0-9bd868-kserve-55775549cd-tk79v\" (UID: \"420c9a8c-59ed-498d-870f-66c92b9e3988\") " pod="e2e-models-e2e-worker-w0-9bd868/distinct-w0-9bd868-kserve-55775549cd-tk79v"
Sep 15 11:43:28.179891 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:28.179869    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh7nx\" (UniqueName: \"kubernetes.io/projected/420c9a8c-59ed-498d-870f-66c92b9e3988-kube-api-access-jh7nx\") pod \"distinct-w0-9bd868-kserve-55775549cd-tk79v\" (UID: \"420c9a8c-59ed-498d-870f-66c92b9e3988\") " pod="e2e-models-e2e-worker-w0-9bd868/distinct-w0-9bd868-kserve-55775549cd-tk79v"
Sep 15 11:43:28.372956 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:28.372867    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-9bd868/distinct-w0-9bd868-kserve-55775549cd-tk79v"
Sep 15 11:43:28.650194 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:28.650139    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-9bd868/distinct-w0-9bd868-kserve-55775549cd-tk79v"]
Sep 15 11:43:28.653365 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:43:28.653331    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod420c9a8c_59ed_498d_870f_66c92b9e3988.slice/crio-b3c5d6f9069158e458f6ec5539dd0aca3611ce04391f2318c0bbeb222f67db6a WatchSource:0}: Error finding container b3c5d6f9069158e458f6ec5539dd0aca3611ce04391f2318c0bbeb222f67db6a: Status 404 returned error can't find the container with id b3c5d6f9069158e458f6ec5539dd0aca3611ce04391f2318c0bbeb222f67db6a
Sep 15 11:43:28.913724 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:28.913627    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-9bd868/distinct-w0-9bd868-kserve-55775549cd-tk79v" event={"ID":"420c9a8c-59ed-498d-870f-66c92b9e3988","Type":"ContainerStarted","Data":"6a6ccc2b555308f309fe57f72e1b96d399e7327b45fa7ff4f1d8268465187bbc"}
Sep 15 11:43:28.913724 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:28.913675    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-9bd868/distinct-w0-9bd868-kserve-55775549cd-tk79v" event={"ID":"420c9a8c-59ed-498d-870f-66c92b9e3988","Type":"ContainerStarted","Data":"b3c5d6f9069158e458f6ec5539dd0aca3611ce04391f2318c0bbeb222f67db6a"}
Sep 15 11:43:28.940550 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:28.940490    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-9bd868/distinct-w0-9bd868-kserve-55775549cd-tk79v" podStartSLOduration=0.940472503 podStartE2EDuration="940.472503ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:43:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:43:28.938938232 +0000 UTC m=+1088.400804286" watchObservedRunningTime="2026-09-15 11:43:28.940472503 +0000 UTC m=+1088.402338597"
Sep 15 11:43:38.373698 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:38.373654    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-9bd868/distinct-w0-9bd868-kserve-55775549cd-tk79v"
Sep 15 11:43:38.374260 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:38.373718    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-9bd868/distinct-w0-9bd868-kserve-55775549cd-tk79v"
Sep 15 11:43:38.386393 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:38.386366    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-9bd868/distinct-w0-9bd868-kserve-55775549cd-tk79v"
Sep 15 11:43:38.973338 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:38.973307    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-9bd868/distinct-w0-9bd868-kserve-55775549cd-tk79v"
Sep 15 11:43:49.941745 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:49.941704    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb"]
Sep 15 11:43:49.942155 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:49.941928    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb" podUID="5e849f52-adc5-4f05-8355-8522aa2f1e48" containerName="maas-api" containerID="cri-o://dd21b1caa863aa2c640ce6e4fe88dc2efa86fc84fc0d64435d45cf346448f91a" gracePeriod=30
Sep 15 11:43:50.200838 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:50.200779    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb"
Sep 15 11:43:50.273496 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:50.273464    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e849f52-adc5-4f05-8355-8522aa2f1e48-maas-api-tls\") pod \"5e849f52-adc5-4f05-8355-8522aa2f1e48\" (UID: \"5e849f52-adc5-4f05-8355-8522aa2f1e48\") "
Sep 15 11:43:50.273650 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:50.273524    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e849f52-adc5-4f05-8355-8522aa2f1e48-openshift-service-ca\") pod \"5e849f52-adc5-4f05-8355-8522aa2f1e48\" (UID: \"5e849f52-adc5-4f05-8355-8522aa2f1e48\") "
Sep 15 11:43:50.273650 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:50.273639    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e849f52-adc5-4f05-8355-8522aa2f1e48-metrics-certs\") pod \"5e849f52-adc5-4f05-8355-8522aa2f1e48\" (UID: \"5e849f52-adc5-4f05-8355-8522aa2f1e48\") "
Sep 15 11:43:50.273739 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:50.273667    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rpslc\" (UniqueName: \"kubernetes.io/projected/5e849f52-adc5-4f05-8355-8522aa2f1e48-kube-api-access-rpslc\") pod \"5e849f52-adc5-4f05-8355-8522aa2f1e48\" (UID: \"5e849f52-adc5-4f05-8355-8522aa2f1e48\") "
Sep 15 11:43:50.274015 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:50.273984    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e849f52-adc5-4f05-8355-8522aa2f1e48-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5e849f52-adc5-4f05-8355-8522aa2f1e48" (UID: "5e849f52-adc5-4f05-8355-8522aa2f1e48"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:43:50.276101 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:50.276072    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e849f52-adc5-4f05-8355-8522aa2f1e48-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5e849f52-adc5-4f05-8355-8522aa2f1e48" (UID: "5e849f52-adc5-4f05-8355-8522aa2f1e48"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:43:50.276319 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:50.276283    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e849f52-adc5-4f05-8355-8522aa2f1e48-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5e849f52-adc5-4f05-8355-8522aa2f1e48" (UID: "5e849f52-adc5-4f05-8355-8522aa2f1e48"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:43:50.276477 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:50.276457    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e849f52-adc5-4f05-8355-8522aa2f1e48-kube-api-access-rpslc" (OuterVolumeSpecName: "kube-api-access-rpslc") pod "5e849f52-adc5-4f05-8355-8522aa2f1e48" (UID: "5e849f52-adc5-4f05-8355-8522aa2f1e48"). InnerVolumeSpecName "kube-api-access-rpslc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:43:50.375138 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:50.375038    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e849f52-adc5-4f05-8355-8522aa2f1e48-maas-api-tls\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:43:50.375138 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:50.375077    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e849f52-adc5-4f05-8355-8522aa2f1e48-openshift-service-ca\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:43:50.375138 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:50.375092    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e849f52-adc5-4f05-8355-8522aa2f1e48-metrics-certs\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:43:50.375138 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:50.375109    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rpslc\" (UniqueName: \"kubernetes.io/projected/5e849f52-adc5-4f05-8355-8522aa2f1e48-kube-api-access-rpslc\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:43:51.026516 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:51.026476    2582 generic.go:356] "Generic (PLEG): container finished" podID="5e849f52-adc5-4f05-8355-8522aa2f1e48" containerID="dd21b1caa863aa2c640ce6e4fe88dc2efa86fc84fc0d64435d45cf346448f91a" exitCode=0
Sep 15 11:43:51.026976 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:51.026531    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb"
Sep 15 11:43:51.026976 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:51.026560    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb" event={"ID":"5e849f52-adc5-4f05-8355-8522aa2f1e48","Type":"ContainerDied","Data":"dd21b1caa863aa2c640ce6e4fe88dc2efa86fc84fc0d64435d45cf346448f91a"}
Sep 15 11:43:51.026976 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:51.026647    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb" event={"ID":"5e849f52-adc5-4f05-8355-8522aa2f1e48","Type":"ContainerDied","Data":"07c3be90d9b61514c96ab6f72ed55a524bc910cd0a117abf91611f3c9d98029d"}
Sep 15 11:43:51.026976 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:51.026671    2582 scope.go:117] "RemoveContainer" containerID="dd21b1caa863aa2c640ce6e4fe88dc2efa86fc84fc0d64435d45cf346448f91a"
Sep 15 11:43:51.035984 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:51.035967    2582 scope.go:117] "RemoveContainer" containerID="dd21b1caa863aa2c640ce6e4fe88dc2efa86fc84fc0d64435d45cf346448f91a"
Sep 15 11:43:51.036306 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:43:51.036284    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd21b1caa863aa2c640ce6e4fe88dc2efa86fc84fc0d64435d45cf346448f91a\": container with ID starting with dd21b1caa863aa2c640ce6e4fe88dc2efa86fc84fc0d64435d45cf346448f91a not found: ID does not exist" containerID="dd21b1caa863aa2c640ce6e4fe88dc2efa86fc84fc0d64435d45cf346448f91a"
Sep 15 11:43:51.036404 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:51.036313    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd21b1caa863aa2c640ce6e4fe88dc2efa86fc84fc0d64435d45cf346448f91a"} err="failed to get container status \"dd21b1caa863aa2c640ce6e4fe88dc2efa86fc84fc0d64435d45cf346448f91a\": rpc error: code = NotFound desc = could not find container \"dd21b1caa863aa2c640ce6e4fe88dc2efa86fc84fc0d64435d45cf346448f91a\": container with ID starting with dd21b1caa863aa2c640ce6e4fe88dc2efa86fc84fc0d64435d45cf346448f91a not found: ID does not exist"
Sep 15 11:43:51.048311 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:51.048289    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb"]
Sep 15 11:43:51.057612 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:51.057591    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-53d3db96-6f8567bc67-wgxqb"]
Sep 15 11:43:53.045300 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:43:53.045269    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e849f52-adc5-4f05-8355-8522aa2f1e48" path="/var/lib/kubelet/pods/5e849f52-adc5-4f05-8355-8522aa2f1e48/volumes"
Sep 15 11:44:16.613319 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:16.613288    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8"]
Sep 15 11:44:16.613762 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:16.613670    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e849f52-adc5-4f05-8355-8522aa2f1e48" containerName="maas-api"
Sep 15 11:44:16.613762 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:16.613681    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e849f52-adc5-4f05-8355-8522aa2f1e48" containerName="maas-api"
Sep 15 11:44:16.613762 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:16.613750    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e849f52-adc5-4f05-8355-8522aa2f1e48" containerName="maas-api"
Sep 15 11:44:16.618141 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:16.618121    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8"
Sep 15 11:44:16.620718 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:16.620695    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-01611d-serving-cert\""
Sep 15 11:44:16.629740 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:16.629716    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8"]
Sep 15 11:44:16.716193 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:16.716150    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da1f59af-2436-4093-b837-e1300e06e4d5-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8\" (UID: \"da1f59af-2436-4093-b837-e1300e06e4d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8"
Sep 15 11:44:16.716377 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:16.716228    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da1f59af-2436-4093-b837-e1300e06e4d5-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8\" (UID: \"da1f59af-2436-4093-b837-e1300e06e4d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8"
Sep 15 11:44:16.716377 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:16.716321    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da1f59af-2436-4093-b837-e1300e06e4d5-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8\" (UID: \"da1f59af-2436-4093-b837-e1300e06e4d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8"
Sep 15 11:44:16.716377 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:16.716370    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22wmb\" (UniqueName: \"kubernetes.io/projected/da1f59af-2436-4093-b837-e1300e06e4d5-kube-api-access-22wmb\") pod \"maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8\" (UID: \"da1f59af-2436-4093-b837-e1300e06e4d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8"
Sep 15 11:44:16.817451 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:16.817411    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da1f59af-2436-4093-b837-e1300e06e4d5-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8\" (UID: \"da1f59af-2436-4093-b837-e1300e06e4d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8"
Sep 15 11:44:16.817623 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:16.817462    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22wmb\" (UniqueName: \"kubernetes.io/projected/da1f59af-2436-4093-b837-e1300e06e4d5-kube-api-access-22wmb\") pod \"maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8\" (UID: \"da1f59af-2436-4093-b837-e1300e06e4d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8"
Sep 15 11:44:16.817623 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:16.817500    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da1f59af-2436-4093-b837-e1300e06e4d5-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8\" (UID: \"da1f59af-2436-4093-b837-e1300e06e4d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8"
Sep 15 11:44:16.817623 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:16.817532    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da1f59af-2436-4093-b837-e1300e06e4d5-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8\" (UID: \"da1f59af-2436-4093-b837-e1300e06e4d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8"
Sep 15 11:44:16.817623 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:44:16.817567    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-01611d-serving-cert: secret "maas-api-e2e-shared-a-w2-01611d-serving-cert" not found
Sep 15 11:44:16.817799 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:44:16.817632    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da1f59af-2436-4093-b837-e1300e06e4d5-maas-api-tls podName:da1f59af-2436-4093-b837-e1300e06e4d5 nodeName:}" failed. No retries permitted until 2026-09-15 11:44:17.31761665 +0000 UTC m=+1136.779482681 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/da1f59af-2436-4093-b837-e1300e06e4d5-maas-api-tls") pod "maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8" (UID: "da1f59af-2436-4093-b837-e1300e06e4d5") : secret "maas-api-e2e-shared-a-w2-01611d-serving-cert" not found
Sep 15 11:44:16.818312 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:16.818285    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da1f59af-2436-4093-b837-e1300e06e4d5-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8\" (UID: \"da1f59af-2436-4093-b837-e1300e06e4d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8"
Sep 15 11:44:16.820137 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:16.820111    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da1f59af-2436-4093-b837-e1300e06e4d5-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8\" (UID: \"da1f59af-2436-4093-b837-e1300e06e4d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8"
Sep 15 11:44:16.826248 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:16.826226    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22wmb\" (UniqueName: \"kubernetes.io/projected/da1f59af-2436-4093-b837-e1300e06e4d5-kube-api-access-22wmb\") pod \"maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8\" (UID: \"da1f59af-2436-4093-b837-e1300e06e4d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8"
Sep 15 11:44:17.279528 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:17.279492    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4-5khg8"]
Sep 15 11:44:17.283289 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:17.283262    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4-5khg8"
Sep 15 11:44:17.285504 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:17.285481    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-01611d\""
Sep 15 11:44:17.286268 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:17.286251    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-01611d-dockercfg-rldth\""
Sep 15 11:44:17.306235 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:17.306209    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4-5khg8"]
Sep 15 11:44:17.322517 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:17.322484    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d882ee84-8869-4f98-9271-e19884db2937-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4-5khg8\" (UID: \"d882ee84-8869-4f98-9271-e19884db2937\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4-5khg8"
Sep 15 11:44:17.322662 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:17.322534    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j6kb\" (UniqueName: \"kubernetes.io/projected/d882ee84-8869-4f98-9271-e19884db2937-kube-api-access-2j6kb\") pod \"payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4-5khg8\" (UID: \"d882ee84-8869-4f98-9271-e19884db2937\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4-5khg8"
Sep 15 11:44:17.322757 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:17.322722    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da1f59af-2436-4093-b837-e1300e06e4d5-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8\" (UID: \"da1f59af-2436-4093-b837-e1300e06e4d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8"
Sep 15 11:44:17.326020 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:17.325997    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da1f59af-2436-4093-b837-e1300e06e4d5-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8\" (UID: \"da1f59af-2436-4093-b837-e1300e06e4d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8"
Sep 15 11:44:17.423634 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:17.423601    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d882ee84-8869-4f98-9271-e19884db2937-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4-5khg8\" (UID: \"d882ee84-8869-4f98-9271-e19884db2937\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4-5khg8"
Sep 15 11:44:17.423856 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:17.423659    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j6kb\" (UniqueName: \"kubernetes.io/projected/d882ee84-8869-4f98-9271-e19884db2937-kube-api-access-2j6kb\") pod \"payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4-5khg8\" (UID: \"d882ee84-8869-4f98-9271-e19884db2937\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4-5khg8"
Sep 15 11:44:17.424549 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:17.424518    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d882ee84-8869-4f98-9271-e19884db2937-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4-5khg8\" (UID: \"d882ee84-8869-4f98-9271-e19884db2937\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4-5khg8"
Sep 15 11:44:17.432132 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:17.432101    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j6kb\" (UniqueName: \"kubernetes.io/projected/d882ee84-8869-4f98-9271-e19884db2937-kube-api-access-2j6kb\") pod \"payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4-5khg8\" (UID: \"d882ee84-8869-4f98-9271-e19884db2937\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4-5khg8"
Sep 15 11:44:17.530569 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:17.530486    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8"
Sep 15 11:44:17.593576 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:17.593548    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4-5khg8"
Sep 15 11:44:17.803925 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:17.803890    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8"]
Sep 15 11:44:17.806471 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:44:17.806443    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda1f59af_2436_4093_b837_e1300e06e4d5.slice/crio-b191873b3ca058e7bb7e1144db80bdeccd4eeae30be4063efac65f6b09e351a1 WatchSource:0}: Error finding container b191873b3ca058e7bb7e1144db80bdeccd4eeae30be4063efac65f6b09e351a1: Status 404 returned error can't find the container with id b191873b3ca058e7bb7e1144db80bdeccd4eeae30be4063efac65f6b09e351a1
Sep 15 11:44:17.876846 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:17.876809    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4-5khg8"]
Sep 15 11:44:17.879050 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:44:17.879016    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd882ee84_8869_4f98_9271_e19884db2937.slice/crio-596a189e185a1a57ccf649f6fb75fb8870535ea65797e82bc890b847c47f2a60 WatchSource:0}: Error finding container 596a189e185a1a57ccf649f6fb75fb8870535ea65797e82bc890b847c47f2a60: Status 404 returned error can't find the container with id 596a189e185a1a57ccf649f6fb75fb8870535ea65797e82bc890b847c47f2a60
Sep 15 11:44:18.161324 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:18.161291    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4-5khg8" event={"ID":"d882ee84-8869-4f98-9271-e19884db2937","Type":"ContainerStarted","Data":"9057befbc88d90d07f07ce4c8435eb20a293370469838958f169e4205ee5a775"}
Sep 15 11:44:18.161525 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:18.161342    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4-5khg8" event={"ID":"d882ee84-8869-4f98-9271-e19884db2937","Type":"ContainerStarted","Data":"596a189e185a1a57ccf649f6fb75fb8870535ea65797e82bc890b847c47f2a60"}
Sep 15 11:44:18.161525 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:18.161387    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4-5khg8"
Sep 15 11:44:18.162628 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:18.162600    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8" event={"ID":"da1f59af-2436-4093-b837-e1300e06e4d5","Type":"ContainerStarted","Data":"b191873b3ca058e7bb7e1144db80bdeccd4eeae30be4063efac65f6b09e351a1"}
Sep 15 11:44:18.181550 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:18.181503    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4-5khg8" podStartSLOduration=1.181486253 podStartE2EDuration="1.181486253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:44:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:44:18.18041332 +0000 UTC m=+1137.642279372" watchObservedRunningTime="2026-09-15 11:44:18.181486253 +0000 UTC m=+1137.643352305"
Sep 15 11:44:19.168785 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:19.168748    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8" event={"ID":"da1f59af-2436-4093-b837-e1300e06e4d5","Type":"ContainerStarted","Data":"a4ebe3b277deae12b7c4c96040c86993fb1927ebc4bea7d6760d9bd2aae79530"}
Sep 15 11:44:19.169267 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:19.168885    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8"
Sep 15 11:44:19.187854 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:19.187808    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8" podStartSLOduration=2.8250106539999997 podStartE2EDuration="3.187792334s" totalImagesPullingTime="362.78168ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:44:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:44:19.186795899 +0000 UTC m=+1138.648661952" watchObservedRunningTime="2026-09-15 11:44:19.187792334 +0000 UTC m=+1138.649658390"
Sep 15 11:44:25.178317 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:25.178286    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8"
Sep 15 11:44:29.171366 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:29.171333    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4-5khg8"
Sep 15 11:44:33.084810 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:33.084767    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c"]
Sep 15 11:44:33.085309 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:33.085034    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c" podUID="b5c779d0-3c94-463d-87c3-7af27630162b" containerName="maas-api" containerID="cri-o://7c6dd9bcd6ab40dd5e111205a7434ec787542c250c97363b80953d9b85421089" gracePeriod=30
Sep 15 11:44:33.245693 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:33.245654    2582 generic.go:356] "Generic (PLEG): container finished" podID="b5c779d0-3c94-463d-87c3-7af27630162b" containerID="7c6dd9bcd6ab40dd5e111205a7434ec787542c250c97363b80953d9b85421089" exitCode=0
Sep 15 11:44:33.245885 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:33.245778    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c" event={"ID":"b5c779d0-3c94-463d-87c3-7af27630162b","Type":"ContainerDied","Data":"7c6dd9bcd6ab40dd5e111205a7434ec787542c250c97363b80953d9b85421089"}
Sep 15 11:44:33.343750 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:33.343685    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c"
Sep 15 11:44:33.477837 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:33.477805    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhsnc\" (UniqueName: \"kubernetes.io/projected/b5c779d0-3c94-463d-87c3-7af27630162b-kube-api-access-lhsnc\") pod \"b5c779d0-3c94-463d-87c3-7af27630162b\" (UID: \"b5c779d0-3c94-463d-87c3-7af27630162b\") "
Sep 15 11:44:33.478002 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:33.477853    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5c779d0-3c94-463d-87c3-7af27630162b-maas-api-tls\") pod \"b5c779d0-3c94-463d-87c3-7af27630162b\" (UID: \"b5c779d0-3c94-463d-87c3-7af27630162b\") "
Sep 15 11:44:33.478002 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:33.477943    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5c779d0-3c94-463d-87c3-7af27630162b-openshift-service-ca\") pod \"b5c779d0-3c94-463d-87c3-7af27630162b\" (UID: \"b5c779d0-3c94-463d-87c3-7af27630162b\") "
Sep 15 11:44:33.478002 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:33.477977    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5c779d0-3c94-463d-87c3-7af27630162b-metrics-certs\") pod \"b5c779d0-3c94-463d-87c3-7af27630162b\" (UID: \"b5c779d0-3c94-463d-87c3-7af27630162b\") "
Sep 15 11:44:33.478391 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:33.478358    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5c779d0-3c94-463d-87c3-7af27630162b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b5c779d0-3c94-463d-87c3-7af27630162b" (UID: "b5c779d0-3c94-463d-87c3-7af27630162b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:44:33.480357 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:33.480316    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5c779d0-3c94-463d-87c3-7af27630162b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b5c779d0-3c94-463d-87c3-7af27630162b" (UID: "b5c779d0-3c94-463d-87c3-7af27630162b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:44:33.480482 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:33.480368    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5c779d0-3c94-463d-87c3-7af27630162b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b5c779d0-3c94-463d-87c3-7af27630162b" (UID: "b5c779d0-3c94-463d-87c3-7af27630162b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:44:33.480544 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:33.480519    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5c779d0-3c94-463d-87c3-7af27630162b-kube-api-access-lhsnc" (OuterVolumeSpecName: "kube-api-access-lhsnc") pod "b5c779d0-3c94-463d-87c3-7af27630162b" (UID: "b5c779d0-3c94-463d-87c3-7af27630162b"). InnerVolumeSpecName "kube-api-access-lhsnc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:44:33.579726 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:33.579690    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhsnc\" (UniqueName: \"kubernetes.io/projected/b5c779d0-3c94-463d-87c3-7af27630162b-kube-api-access-lhsnc\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:44:33.579726 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:33.579722    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5c779d0-3c94-463d-87c3-7af27630162b-maas-api-tls\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:44:33.579726 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:33.579731    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5c779d0-3c94-463d-87c3-7af27630162b-openshift-service-ca\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:44:33.579961 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:33.579742    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5c779d0-3c94-463d-87c3-7af27630162b-metrics-certs\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:44:34.255643 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:34.255616    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c"
Sep 15 11:44:34.256052 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:34.255654    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c" event={"ID":"b5c779d0-3c94-463d-87c3-7af27630162b","Type":"ContainerDied","Data":"e2e5405ea91c66066d8b12db6f9451c8b8b3bedf720802265009287ae546854d"}
Sep 15 11:44:34.256052 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:34.255714    2582 scope.go:117] "RemoveContainer" containerID="7c6dd9bcd6ab40dd5e111205a7434ec787542c250c97363b80953d9b85421089"
Sep 15 11:44:34.277870 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:34.277846    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c"]
Sep 15 11:44:34.279622 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:34.279601    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0eb0ef-7f8bfd7475-w5v9c"]
Sep 15 11:44:35.045403 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:35.045373    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5c779d0-3c94-463d-87c3-7af27630162b" path="/var/lib/kubelet/pods/b5c779d0-3c94-463d-87c3-7af27630162b/volumes"
Sep 15 11:44:35.170921 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:35.170876    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm"]
Sep 15 11:44:35.171318 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:35.171300    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5c779d0-3c94-463d-87c3-7af27630162b" containerName="maas-api"
Sep 15 11:44:35.171318 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:35.171316    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5c779d0-3c94-463d-87c3-7af27630162b" containerName="maas-api"
Sep 15 11:44:35.171501 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:35.171382    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5c779d0-3c94-463d-87c3-7af27630162b" containerName="maas-api"
Sep 15 11:44:35.176108 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:35.176012    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm"
Sep 15 11:44:35.179099 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:35.179077    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-4dbbbf-serving-cert\""
Sep 15 11:44:35.182943 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:35.182919    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm"]
Sep 15 11:44:35.295487 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:35.295396    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbf2755a-fff4-449f-b9c3-718febae5f0a-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm\" (UID: \"bbf2755a-fff4-449f-b9c3-718febae5f0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm"
Sep 15 11:44:35.295487 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:35.295455    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7hl6\" (UniqueName: \"kubernetes.io/projected/bbf2755a-fff4-449f-b9c3-718febae5f0a-kube-api-access-z7hl6\") pod \"maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm\" (UID: \"bbf2755a-fff4-449f-b9c3-718febae5f0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm"
Sep 15 11:44:35.295878 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:35.295540    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbf2755a-fff4-449f-b9c3-718febae5f0a-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm\" (UID: \"bbf2755a-fff4-449f-b9c3-718febae5f0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm"
Sep 15 11:44:35.295878 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:35.295573    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbf2755a-fff4-449f-b9c3-718febae5f0a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm\" (UID: \"bbf2755a-fff4-449f-b9c3-718febae5f0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm"
Sep 15 11:44:35.396145 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:35.396114    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbf2755a-fff4-449f-b9c3-718febae5f0a-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm\" (UID: \"bbf2755a-fff4-449f-b9c3-718febae5f0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm"
Sep 15 11:44:35.396145 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:35.396149    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbf2755a-fff4-449f-b9c3-718febae5f0a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm\" (UID: \"bbf2755a-fff4-449f-b9c3-718febae5f0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm"
Sep 15 11:44:35.396422 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:35.396260    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbf2755a-fff4-449f-b9c3-718febae5f0a-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm\" (UID: \"bbf2755a-fff4-449f-b9c3-718febae5f0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm"
Sep 15 11:44:35.396422 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:35.396323    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7hl6\" (UniqueName: \"kubernetes.io/projected/bbf2755a-fff4-449f-b9c3-718febae5f0a-kube-api-access-z7hl6\") pod \"maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm\" (UID: \"bbf2755a-fff4-449f-b9c3-718febae5f0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm"
Sep 15 11:44:35.396855 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:35.396832    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbf2755a-fff4-449f-b9c3-718febae5f0a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm\" (UID: \"bbf2755a-fff4-449f-b9c3-718febae5f0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm"
Sep 15 11:44:35.398730 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:35.398696    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbf2755a-fff4-449f-b9c3-718febae5f0a-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm\" (UID: \"bbf2755a-fff4-449f-b9c3-718febae5f0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm"
Sep 15 11:44:35.398851 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:35.398830    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbf2755a-fff4-449f-b9c3-718febae5f0a-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm\" (UID: \"bbf2755a-fff4-449f-b9c3-718febae5f0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm"
Sep 15 11:44:35.405074 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:35.405051    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7hl6\" (UniqueName: \"kubernetes.io/projected/bbf2755a-fff4-449f-b9c3-718febae5f0a-kube-api-access-z7hl6\") pod \"maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm\" (UID: \"bbf2755a-fff4-449f-b9c3-718febae5f0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm"
Sep 15 11:44:35.490543 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:35.490512    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm"
Sep 15 11:44:35.771057 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:35.771031    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm"]
Sep 15 11:44:35.773494 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:44:35.773464    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbf2755a_fff4_449f_b9c3_718febae5f0a.slice/crio-d69f86bc9b595ef208d5c70cffa9db62871c6b829e3c5e297be91745814a5e36 WatchSource:0}: Error finding container d69f86bc9b595ef208d5c70cffa9db62871c6b829e3c5e297be91745814a5e36: Status 404 returned error can't find the container with id d69f86bc9b595ef208d5c70cffa9db62871c6b829e3c5e297be91745814a5e36
Sep 15 11:44:35.821990 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:35.821898    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675-fsnq5"]
Sep 15 11:44:35.828228 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:35.828195    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675-fsnq5"
Sep 15 11:44:35.830695 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:35.830660    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-4dbbbf\""
Sep 15 11:44:35.830846 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:35.830701    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-4dbbbf-dockercfg-bmgxs\""
Sep 15 11:44:35.838677 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:35.838654    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675-fsnq5"]
Sep 15 11:44:35.901205 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:35.901144    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f9cfa29-2d35-437c-81b8-d4ec64fed1f4-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675-fsnq5\" (UID: \"1f9cfa29-2d35-437c-81b8-d4ec64fed1f4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675-fsnq5"
Sep 15 11:44:35.901444 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:35.901425    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4mtd\" (UniqueName: \"kubernetes.io/projected/1f9cfa29-2d35-437c-81b8-d4ec64fed1f4-kube-api-access-q4mtd\") pod \"payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675-fsnq5\" (UID: \"1f9cfa29-2d35-437c-81b8-d4ec64fed1f4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675-fsnq5"
Sep 15 11:44:36.002367 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:36.002329    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f9cfa29-2d35-437c-81b8-d4ec64fed1f4-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675-fsnq5\" (UID: \"1f9cfa29-2d35-437c-81b8-d4ec64fed1f4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675-fsnq5"
Sep 15 11:44:36.002367 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:36.002365    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4mtd\" (UniqueName: \"kubernetes.io/projected/1f9cfa29-2d35-437c-81b8-d4ec64fed1f4-kube-api-access-q4mtd\") pod \"payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675-fsnq5\" (UID: \"1f9cfa29-2d35-437c-81b8-d4ec64fed1f4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675-fsnq5"
Sep 15 11:44:36.003072 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:36.003046    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f9cfa29-2d35-437c-81b8-d4ec64fed1f4-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675-fsnq5\" (UID: \"1f9cfa29-2d35-437c-81b8-d4ec64fed1f4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675-fsnq5"
Sep 15 11:44:36.011764 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:36.011726    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4mtd\" (UniqueName: \"kubernetes.io/projected/1f9cfa29-2d35-437c-81b8-d4ec64fed1f4-kube-api-access-q4mtd\") pod \"payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675-fsnq5\" (UID: \"1f9cfa29-2d35-437c-81b8-d4ec64fed1f4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675-fsnq5"
Sep 15 11:44:36.140010 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:36.139981    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675-fsnq5"
Sep 15 11:44:36.269379 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:36.269337    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm" event={"ID":"bbf2755a-fff4-449f-b9c3-718febae5f0a","Type":"ContainerStarted","Data":"a2895cf0bee05bb86cf8aa469bb21db542ae4574a3528c7215cfd43b9de3da8b"}
Sep 15 11:44:36.269596 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:36.269399    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm" event={"ID":"bbf2755a-fff4-449f-b9c3-718febae5f0a","Type":"ContainerStarted","Data":"d69f86bc9b595ef208d5c70cffa9db62871c6b829e3c5e297be91745814a5e36"}
Sep 15 11:44:36.269596 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:36.269463    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm"
Sep 15 11:44:36.288942 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:36.288885    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm" podStartSLOduration=0.981088334 podStartE2EDuration="1.288867694s" totalImagesPullingTime="307.77936ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:44:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:44:36.286021522 +0000 UTC m=+1155.747887575" watchObservedRunningTime="2026-09-15 11:44:36.288867694 +0000 UTC m=+1155.750733793"
Sep 15 11:44:36.422862 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:36.422840    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675-fsnq5"]
Sep 15 11:44:36.424905 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:44:36.424872    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f9cfa29_2d35_437c_81b8_d4ec64fed1f4.slice/crio-ccc414104d5bf1e05649d196a18c5381031f8213daf561ce11a983239e384e82 WatchSource:0}: Error finding container ccc414104d5bf1e05649d196a18c5381031f8213daf561ce11a983239e384e82: Status 404 returned error can't find the container with id ccc414104d5bf1e05649d196a18c5381031f8213daf561ce11a983239e384e82
Sep 15 11:44:37.275666 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:37.275632    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675-fsnq5" event={"ID":"1f9cfa29-2d35-437c-81b8-d4ec64fed1f4","Type":"ContainerStarted","Data":"b4668644816a215a81ae44ee0d0244a36ff1168d2b27fc52b69508f2bf3b6a0e"}
Sep 15 11:44:37.275849 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:37.275693    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675-fsnq5" event={"ID":"1f9cfa29-2d35-437c-81b8-d4ec64fed1f4","Type":"ContainerStarted","Data":"ccc414104d5bf1e05649d196a18c5381031f8213daf561ce11a983239e384e82"}
Sep 15 11:44:37.275849 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:37.275723    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675-fsnq5"
Sep 15 11:44:37.292031 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:37.291981    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675-fsnq5" podStartSLOduration=2.291967947 podStartE2EDuration="2.291967947s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:44:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:44:37.290784355 +0000 UTC m=+1156.752650409" watchObservedRunningTime="2026-09-15 11:44:37.291967947 +0000 UTC m=+1156.753833999"
Sep 15 11:44:42.281379 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:42.281297    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm"
Sep 15 11:44:48.283428 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:44:48.283399    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675-fsnq5"
Sep 15 11:45:18.962315 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:18.962277    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-944c275f-5fcd476d4c-v4src"]
Sep 15 11:45:18.966941 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:18.966916    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-944c275f-5fcd476d4c-v4src"
Sep 15 11:45:18.969419 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:18.969395    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-944c275f-serving-cert\""
Sep 15 11:45:18.980647 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:18.980621    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-944c275f-5fcd476d4c-v4src"]
Sep 15 11:45:19.083468 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:19.083427    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c49e2af2-3cfc-44c0-bf35-27ee7e7c4856-metrics-certs\") pod \"maas-api-e2e-mt-944c275f-5fcd476d4c-v4src\" (UID: \"c49e2af2-3cfc-44c0-bf35-27ee7e7c4856\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-944c275f-5fcd476d4c-v4src"
Sep 15 11:45:19.083667 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:19.083522    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c49e2af2-3cfc-44c0-bf35-27ee7e7c4856-maas-api-tls\") pod \"maas-api-e2e-mt-944c275f-5fcd476d4c-v4src\" (UID: \"c49e2af2-3cfc-44c0-bf35-27ee7e7c4856\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-944c275f-5fcd476d4c-v4src"
Sep 15 11:45:19.083667 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:19.083571    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c49e2af2-3cfc-44c0-bf35-27ee7e7c4856-openshift-service-ca\") pod \"maas-api-e2e-mt-944c275f-5fcd476d4c-v4src\" (UID: \"c49e2af2-3cfc-44c0-bf35-27ee7e7c4856\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-944c275f-5fcd476d4c-v4src"
Sep 15 11:45:19.083667 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:19.083607    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klnss\" (UniqueName: \"kubernetes.io/projected/c49e2af2-3cfc-44c0-bf35-27ee7e7c4856-kube-api-access-klnss\") pod \"maas-api-e2e-mt-944c275f-5fcd476d4c-v4src\" (UID: \"c49e2af2-3cfc-44c0-bf35-27ee7e7c4856\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-944c275f-5fcd476d4c-v4src"
Sep 15 11:45:19.184964 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:19.184929    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c49e2af2-3cfc-44c0-bf35-27ee7e7c4856-maas-api-tls\") pod \"maas-api-e2e-mt-944c275f-5fcd476d4c-v4src\" (UID: \"c49e2af2-3cfc-44c0-bf35-27ee7e7c4856\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-944c275f-5fcd476d4c-v4src"
Sep 15 11:45:19.184964 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:19.184969    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c49e2af2-3cfc-44c0-bf35-27ee7e7c4856-openshift-service-ca\") pod \"maas-api-e2e-mt-944c275f-5fcd476d4c-v4src\" (UID: \"c49e2af2-3cfc-44c0-bf35-27ee7e7c4856\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-944c275f-5fcd476d4c-v4src"
Sep 15 11:45:19.185264 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:19.184990    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klnss\" (UniqueName: \"kubernetes.io/projected/c49e2af2-3cfc-44c0-bf35-27ee7e7c4856-kube-api-access-klnss\") pod \"maas-api-e2e-mt-944c275f-5fcd476d4c-v4src\" (UID: \"c49e2af2-3cfc-44c0-bf35-27ee7e7c4856\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-944c275f-5fcd476d4c-v4src"
Sep 15 11:45:19.185264 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:19.185069    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c49e2af2-3cfc-44c0-bf35-27ee7e7c4856-metrics-certs\") pod \"maas-api-e2e-mt-944c275f-5fcd476d4c-v4src\" (UID: \"c49e2af2-3cfc-44c0-bf35-27ee7e7c4856\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-944c275f-5fcd476d4c-v4src"
Sep 15 11:45:19.185264 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:45:19.185097    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-944c275f-serving-cert: secret "maas-api-e2e-mt-944c275f-serving-cert" not found
Sep 15 11:45:19.185264 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:45:19.185209    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c49e2af2-3cfc-44c0-bf35-27ee7e7c4856-maas-api-tls podName:c49e2af2-3cfc-44c0-bf35-27ee7e7c4856 nodeName:}" failed. No retries permitted until 2026-09-15 11:45:19.685160254 +0000 UTC m=+1199.147026288 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c49e2af2-3cfc-44c0-bf35-27ee7e7c4856-maas-api-tls") pod "maas-api-e2e-mt-944c275f-5fcd476d4c-v4src" (UID: "c49e2af2-3cfc-44c0-bf35-27ee7e7c4856") : secret "maas-api-e2e-mt-944c275f-serving-cert" not found
Sep 15 11:45:19.185755 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:19.185729    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c49e2af2-3cfc-44c0-bf35-27ee7e7c4856-openshift-service-ca\") pod \"maas-api-e2e-mt-944c275f-5fcd476d4c-v4src\" (UID: \"c49e2af2-3cfc-44c0-bf35-27ee7e7c4856\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-944c275f-5fcd476d4c-v4src"
Sep 15 11:45:19.187654 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:19.187636    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c49e2af2-3cfc-44c0-bf35-27ee7e7c4856-metrics-certs\") pod \"maas-api-e2e-mt-944c275f-5fcd476d4c-v4src\" (UID: \"c49e2af2-3cfc-44c0-bf35-27ee7e7c4856\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-944c275f-5fcd476d4c-v4src"
Sep 15 11:45:19.194501 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:19.194472    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klnss\" (UniqueName: \"kubernetes.io/projected/c49e2af2-3cfc-44c0-bf35-27ee7e7c4856-kube-api-access-klnss\") pod \"maas-api-e2e-mt-944c275f-5fcd476d4c-v4src\" (UID: \"c49e2af2-3cfc-44c0-bf35-27ee7e7c4856\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-944c275f-5fcd476d4c-v4src"
Sep 15 11:45:19.690445 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:19.690397    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c49e2af2-3cfc-44c0-bf35-27ee7e7c4856-maas-api-tls\") pod \"maas-api-e2e-mt-944c275f-5fcd476d4c-v4src\" (UID: \"c49e2af2-3cfc-44c0-bf35-27ee7e7c4856\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-944c275f-5fcd476d4c-v4src"
Sep 15 11:45:19.693266 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:19.693233    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c49e2af2-3cfc-44c0-bf35-27ee7e7c4856-maas-api-tls\") pod \"maas-api-e2e-mt-944c275f-5fcd476d4c-v4src\" (UID: \"c49e2af2-3cfc-44c0-bf35-27ee7e7c4856\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-944c275f-5fcd476d4c-v4src"
Sep 15 11:45:19.879438 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:19.879393    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-944c275f-5fcd476d4c-v4src"
Sep 15 11:45:20.151782 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:20.151751    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-944c275f-5fcd476d4c-v4src"]
Sep 15 11:45:20.154392 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:45:20.154362    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc49e2af2_3cfc_44c0_bf35_27ee7e7c4856.slice/crio-c08a03063920f690281e68080ddec86bd51bbaefd47fdc4eab03eac9daf35d51 WatchSource:0}: Error finding container c08a03063920f690281e68080ddec86bd51bbaefd47fdc4eab03eac9daf35d51: Status 404 returned error can't find the container with id c08a03063920f690281e68080ddec86bd51bbaefd47fdc4eab03eac9daf35d51
Sep 15 11:45:20.494134 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:20.494040    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-944c275f-5fcd476d4c-v4src" event={"ID":"c49e2af2-3cfc-44c0-bf35-27ee7e7c4856","Type":"ContainerStarted","Data":"c08a03063920f690281e68080ddec86bd51bbaefd47fdc4eab03eac9daf35d51"}
Sep 15 11:45:21.500849 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:21.500815    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-944c275f-5fcd476d4c-v4src" event={"ID":"c49e2af2-3cfc-44c0-bf35-27ee7e7c4856","Type":"ContainerStarted","Data":"06a5a91a6539c81a45d5c7ffff0dfff00af0f9245e6a760e065ad2c0d5b60f89"}
Sep 15 11:45:21.501275 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:21.500962    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-944c275f-5fcd476d4c-v4src"
Sep 15 11:45:21.519663 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:21.519605    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-944c275f-5fcd476d4c-v4src" podStartSLOduration=3.110245308 podStartE2EDuration="3.519585389s" totalImagesPullingTime="409.340081ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:45:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:45:21.519086807 +0000 UTC m=+1200.980952904" watchObservedRunningTime="2026-09-15 11:45:21.519585389 +0000 UTC m=+1200.981451443"
Sep 15 11:45:27.510518 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:27.510483    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-944c275f-5fcd476d4c-v4src"
Sep 15 11:45:27.572310 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:27.572275    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp"]
Sep 15 11:45:27.572571 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:27.572514    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp" podUID="3f53bd48-7c43-4180-886d-a5bce17765a9" containerName="maas-api" containerID="cri-o://2f626565a20b61e9cd3af3fedafaa66527e676023e583b683fe6fdcd425a8e89" gracePeriod=30
Sep 15 11:45:27.832336 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:27.832305    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp"
Sep 15 11:45:27.971622 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:27.971595    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f53bd48-7c43-4180-886d-a5bce17765a9-maas-api-tls\") pod \"3f53bd48-7c43-4180-886d-a5bce17765a9\" (UID: \"3f53bd48-7c43-4180-886d-a5bce17765a9\") "
Sep 15 11:45:27.971791 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:27.971639    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lsmh2\" (UniqueName: \"kubernetes.io/projected/3f53bd48-7c43-4180-886d-a5bce17765a9-kube-api-access-lsmh2\") pod \"3f53bd48-7c43-4180-886d-a5bce17765a9\" (UID: \"3f53bd48-7c43-4180-886d-a5bce17765a9\") "
Sep 15 11:45:27.971791 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:27.971683    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f53bd48-7c43-4180-886d-a5bce17765a9-metrics-certs\") pod \"3f53bd48-7c43-4180-886d-a5bce17765a9\" (UID: \"3f53bd48-7c43-4180-886d-a5bce17765a9\") "
Sep 15 11:45:27.971791 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:27.971700    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f53bd48-7c43-4180-886d-a5bce17765a9-openshift-service-ca\") pod \"3f53bd48-7c43-4180-886d-a5bce17765a9\" (UID: \"3f53bd48-7c43-4180-886d-a5bce17765a9\") "
Sep 15 11:45:27.972104 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:27.972078    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f53bd48-7c43-4180-886d-a5bce17765a9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3f53bd48-7c43-4180-886d-a5bce17765a9" (UID: "3f53bd48-7c43-4180-886d-a5bce17765a9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:45:27.973907 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:27.973874    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f53bd48-7c43-4180-886d-a5bce17765a9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3f53bd48-7c43-4180-886d-a5bce17765a9" (UID: "3f53bd48-7c43-4180-886d-a5bce17765a9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:45:27.974005 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:27.973929    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f53bd48-7c43-4180-886d-a5bce17765a9-kube-api-access-lsmh2" (OuterVolumeSpecName: "kube-api-access-lsmh2") pod "3f53bd48-7c43-4180-886d-a5bce17765a9" (UID: "3f53bd48-7c43-4180-886d-a5bce17765a9"). InnerVolumeSpecName "kube-api-access-lsmh2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:45:27.974005 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:27.973963    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f53bd48-7c43-4180-886d-a5bce17765a9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3f53bd48-7c43-4180-886d-a5bce17765a9" (UID: "3f53bd48-7c43-4180-886d-a5bce17765a9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:45:28.072811 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:28.072732    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f53bd48-7c43-4180-886d-a5bce17765a9-metrics-certs\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:45:28.072811 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:28.072759    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f53bd48-7c43-4180-886d-a5bce17765a9-openshift-service-ca\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:45:28.072811 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:28.072770    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f53bd48-7c43-4180-886d-a5bce17765a9-maas-api-tls\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:45:28.072811 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:28.072779    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsmh2\" (UniqueName: \"kubernetes.io/projected/3f53bd48-7c43-4180-886d-a5bce17765a9-kube-api-access-lsmh2\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:45:28.538652 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:28.538621    2582 generic.go:356] "Generic (PLEG): container finished" podID="3f53bd48-7c43-4180-886d-a5bce17765a9" containerID="2f626565a20b61e9cd3af3fedafaa66527e676023e583b683fe6fdcd425a8e89" exitCode=0
Sep 15 11:45:28.539057 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:28.538673    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp"
Sep 15 11:45:28.539057 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:28.538689    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp" event={"ID":"3f53bd48-7c43-4180-886d-a5bce17765a9","Type":"ContainerDied","Data":"2f626565a20b61e9cd3af3fedafaa66527e676023e583b683fe6fdcd425a8e89"}
Sep 15 11:45:28.539057 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:28.538730    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp" event={"ID":"3f53bd48-7c43-4180-886d-a5bce17765a9","Type":"ContainerDied","Data":"c24010f9c9cff5b9390c8c1ff9343c87d627609cc9a92e6495428a4f65ec1a61"}
Sep 15 11:45:28.539057 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:28.538753    2582 scope.go:117] "RemoveContainer" containerID="2f626565a20b61e9cd3af3fedafaa66527e676023e583b683fe6fdcd425a8e89"
Sep 15 11:45:28.547959 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:28.547938    2582 scope.go:117] "RemoveContainer" containerID="2f626565a20b61e9cd3af3fedafaa66527e676023e583b683fe6fdcd425a8e89"
Sep 15 11:45:28.548247 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:45:28.548229    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f626565a20b61e9cd3af3fedafaa66527e676023e583b683fe6fdcd425a8e89\": container with ID starting with 2f626565a20b61e9cd3af3fedafaa66527e676023e583b683fe6fdcd425a8e89 not found: ID does not exist" containerID="2f626565a20b61e9cd3af3fedafaa66527e676023e583b683fe6fdcd425a8e89"
Sep 15 11:45:28.548307 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:28.548257    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f626565a20b61e9cd3af3fedafaa66527e676023e583b683fe6fdcd425a8e89"} err="failed to get container status \"2f626565a20b61e9cd3af3fedafaa66527e676023e583b683fe6fdcd425a8e89\": rpc error: code = NotFound desc = could not find container \"2f626565a20b61e9cd3af3fedafaa66527e676023e583b683fe6fdcd425a8e89\": container with ID starting with 2f626565a20b61e9cd3af3fedafaa66527e676023e583b683fe6fdcd425a8e89 not found: ID does not exist"
Sep 15 11:45:28.559513 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:28.559488    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp"]
Sep 15 11:45:28.563413 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:28.563389    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1358dc-77dd8758d4-wczdp"]
Sep 15 11:45:29.046533 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:45:29.046498    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f53bd48-7c43-4180-886d-a5bce17765a9" path="/var/lib/kubelet/pods/3f53bd48-7c43-4180-886d-a5bce17765a9/volumes"
Sep 15 11:46:18.320517 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:18.320445    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242"]
Sep 15 11:46:18.322861 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:18.320882    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f53bd48-7c43-4180-886d-a5bce17765a9" containerName="maas-api"
Sep 15 11:46:18.322861 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:18.320912    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f53bd48-7c43-4180-886d-a5bce17765a9" containerName="maas-api"
Sep 15 11:46:18.322861 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:18.320984    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f53bd48-7c43-4180-886d-a5bce17765a9" containerName="maas-api"
Sep 15 11:46:18.323838 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:18.323824    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242"
Sep 15 11:46:18.326204 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:18.326159    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-26f1b0-serving-cert\""
Sep 15 11:46:18.333613 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:18.333591    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242"]
Sep 15 11:46:18.418257 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:18.418212    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7kz2\" (UniqueName: \"kubernetes.io/projected/3cac8de2-5d37-40f3-8043-9c609967a0ad-kube-api-access-v7kz2\") pod \"maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242\" (UID: \"3cac8de2-5d37-40f3-8043-9c609967a0ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242"
Sep 15 11:46:18.418456 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:18.418298    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3cac8de2-5d37-40f3-8043-9c609967a0ad-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242\" (UID: \"3cac8de2-5d37-40f3-8043-9c609967a0ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242"
Sep 15 11:46:18.418456 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:18.418336    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3cac8de2-5d37-40f3-8043-9c609967a0ad-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242\" (UID: \"3cac8de2-5d37-40f3-8043-9c609967a0ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242"
Sep 15 11:46:18.418578 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:18.418501    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3cac8de2-5d37-40f3-8043-9c609967a0ad-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242\" (UID: \"3cac8de2-5d37-40f3-8043-9c609967a0ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242"
Sep 15 11:46:18.520010 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:18.519968    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3cac8de2-5d37-40f3-8043-9c609967a0ad-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242\" (UID: \"3cac8de2-5d37-40f3-8043-9c609967a0ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242"
Sep 15 11:46:18.520212 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:18.520018    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7kz2\" (UniqueName: \"kubernetes.io/projected/3cac8de2-5d37-40f3-8043-9c609967a0ad-kube-api-access-v7kz2\") pod \"maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242\" (UID: \"3cac8de2-5d37-40f3-8043-9c609967a0ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242"
Sep 15 11:46:18.520212 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:18.520073    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3cac8de2-5d37-40f3-8043-9c609967a0ad-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242\" (UID: \"3cac8de2-5d37-40f3-8043-9c609967a0ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242"
Sep 15 11:46:18.520212 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:18.520105    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3cac8de2-5d37-40f3-8043-9c609967a0ad-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242\" (UID: \"3cac8de2-5d37-40f3-8043-9c609967a0ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242"
Sep 15 11:46:18.520823 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:18.520798    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3cac8de2-5d37-40f3-8043-9c609967a0ad-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242\" (UID: \"3cac8de2-5d37-40f3-8043-9c609967a0ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242"
Sep 15 11:46:18.522596 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:18.522570    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3cac8de2-5d37-40f3-8043-9c609967a0ad-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242\" (UID: \"3cac8de2-5d37-40f3-8043-9c609967a0ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242"
Sep 15 11:46:18.522701 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:18.522681    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3cac8de2-5d37-40f3-8043-9c609967a0ad-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242\" (UID: \"3cac8de2-5d37-40f3-8043-9c609967a0ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242"
Sep 15 11:46:18.528828 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:18.528811    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7kz2\" (UniqueName: \"kubernetes.io/projected/3cac8de2-5d37-40f3-8043-9c609967a0ad-kube-api-access-v7kz2\") pod \"maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242\" (UID: \"3cac8de2-5d37-40f3-8043-9c609967a0ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242"
Sep 15 11:46:18.634521 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:18.634489    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242"
Sep 15 11:46:18.919849 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:18.919759    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242"]
Sep 15 11:46:18.923584 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:46:18.923557    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cac8de2_5d37_40f3_8043_9c609967a0ad.slice/crio-5410654667a33229a247f1b47b0247d067107be86f2b4cd3d28970eb08405399 WatchSource:0}: Error finding container 5410654667a33229a247f1b47b0247d067107be86f2b4cd3d28970eb08405399: Status 404 returned error can't find the container with id 5410654667a33229a247f1b47b0247d067107be86f2b4cd3d28970eb08405399
Sep 15 11:46:19.793963 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:19.793868    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242" event={"ID":"3cac8de2-5d37-40f3-8043-9c609967a0ad","Type":"ContainerStarted","Data":"2f7fee961ac1b33e46f0ab7b708eedcb8c05389061d829906c0143d914afa6e4"}
Sep 15 11:46:19.793963 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:19.793923    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242" event={"ID":"3cac8de2-5d37-40f3-8043-9c609967a0ad","Type":"ContainerStarted","Data":"5410654667a33229a247f1b47b0247d067107be86f2b4cd3d28970eb08405399"}
Sep 15 11:46:19.794421 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:19.793986    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242"
Sep 15 11:46:19.812990 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:19.812943    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242" podStartSLOduration=1.3298844029999999 podStartE2EDuration="1.812926464s" totalImagesPullingTime="483.042061ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:46:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:46:19.810786559 +0000 UTC m=+1259.272652608" watchObservedRunningTime="2026-09-15 11:46:19.812926464 +0000 UTC m=+1259.274792517"
Sep 15 11:46:25.805195 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:25.805155    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242"
Sep 15 11:46:53.717453 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:53.717416    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c-7dzcq"]
Sep 15 11:46:53.721027 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:53.721010    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c-7dzcq"
Sep 15 11:46:53.723748 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:53.723723    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-dd6959-dockercfg-4hdrh\""
Sep 15 11:46:53.724248 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:53.724229    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-dd6959\""
Sep 15 11:46:53.745477 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:53.745451    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c-7dzcq"]
Sep 15 11:46:53.771260 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:53.771228    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/694f893f-8150-4906-8bed-889fab8516b5-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c-7dzcq\" (UID: \"694f893f-8150-4906-8bed-889fab8516b5\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c-7dzcq"
Sep 15 11:46:53.771407 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:53.771268    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9z6x\" (UniqueName: \"kubernetes.io/projected/694f893f-8150-4906-8bed-889fab8516b5-kube-api-access-t9z6x\") pod \"payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c-7dzcq\" (UID: \"694f893f-8150-4906-8bed-889fab8516b5\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c-7dzcq"
Sep 15 11:46:53.872221 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:53.872139    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/694f893f-8150-4906-8bed-889fab8516b5-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c-7dzcq\" (UID: \"694f893f-8150-4906-8bed-889fab8516b5\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c-7dzcq"
Sep 15 11:46:53.872221 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:53.872195    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9z6x\" (UniqueName: \"kubernetes.io/projected/694f893f-8150-4906-8bed-889fab8516b5-kube-api-access-t9z6x\") pod \"payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c-7dzcq\" (UID: \"694f893f-8150-4906-8bed-889fab8516b5\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c-7dzcq"
Sep 15 11:46:53.872931 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:53.872905    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/694f893f-8150-4906-8bed-889fab8516b5-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c-7dzcq\" (UID: \"694f893f-8150-4906-8bed-889fab8516b5\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c-7dzcq"
Sep 15 11:46:53.880550 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:53.880523    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9z6x\" (UniqueName: \"kubernetes.io/projected/694f893f-8150-4906-8bed-889fab8516b5-kube-api-access-t9z6x\") pod \"payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c-7dzcq\" (UID: \"694f893f-8150-4906-8bed-889fab8516b5\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c-7dzcq"
Sep 15 11:46:54.032072 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:54.031992    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c-7dzcq"
Sep 15 11:46:54.307013 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:54.306984    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c-7dzcq"]
Sep 15 11:46:54.309236 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:46:54.309202    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod694f893f_8150_4906_8bed_889fab8516b5.slice/crio-41fd901fb3ac20b1dd2986c95e3619d3ae4506eb48f2359de1983365c4211cdc WatchSource:0}: Error finding container 41fd901fb3ac20b1dd2986c95e3619d3ae4506eb48f2359de1983365c4211cdc: Status 404 returned error can't find the container with id 41fd901fb3ac20b1dd2986c95e3619d3ae4506eb48f2359de1983365c4211cdc
Sep 15 11:46:54.974195 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:54.974141    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c-7dzcq" event={"ID":"694f893f-8150-4906-8bed-889fab8516b5","Type":"ContainerStarted","Data":"ff6703543eac2aa83a02343e48bbf6d482c1ce71407d328a8e0268dd825bb12d"}
Sep 15 11:46:54.974663 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:54.974223    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c-7dzcq" event={"ID":"694f893f-8150-4906-8bed-889fab8516b5","Type":"ContainerStarted","Data":"41fd901fb3ac20b1dd2986c95e3619d3ae4506eb48f2359de1983365c4211cdc"}
Sep 15 11:46:54.974663 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:54.974314    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c-7dzcq"
Sep 15 11:46:54.992287 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:46:54.992234    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c-7dzcq" podStartSLOduration=1.992218218 podStartE2EDuration="1.992218218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:46:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:46:54.989887646 +0000 UTC m=+1294.451753700" watchObservedRunningTime="2026-09-15 11:46:54.992218218 +0000 UTC m=+1294.454084270"
Sep 15 11:47:05.982587 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:47:05.982550    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c-7dzcq"
Sep 15 11:47:36.574976 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:47:36.574162    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-944c275f-5fcd476d4c-v4src"]
Sep 15 11:47:36.575601 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:47:36.575287    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-944c275f-5fcd476d4c-v4src" podUID="c49e2af2-3cfc-44c0-bf35-27ee7e7c4856" containerName="maas-api" containerID="cri-o://06a5a91a6539c81a45d5c7ffff0dfff00af0f9245e6a760e065ad2c0d5b60f89" gracePeriod=30
Sep 15 11:47:36.825269 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:47:36.825204    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-944c275f-5fcd476d4c-v4src"
Sep 15 11:47:36.886555 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:47:36.886518    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c49e2af2-3cfc-44c0-bf35-27ee7e7c4856-maas-api-tls\") pod \"c49e2af2-3cfc-44c0-bf35-27ee7e7c4856\" (UID: \"c49e2af2-3cfc-44c0-bf35-27ee7e7c4856\") "
Sep 15 11:47:36.886746 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:47:36.886571    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c49e2af2-3cfc-44c0-bf35-27ee7e7c4856-openshift-service-ca\") pod \"c49e2af2-3cfc-44c0-bf35-27ee7e7c4856\" (UID: \"c49e2af2-3cfc-44c0-bf35-27ee7e7c4856\") "
Sep 15 11:47:36.886746 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:47:36.886630    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c49e2af2-3cfc-44c0-bf35-27ee7e7c4856-metrics-certs\") pod \"c49e2af2-3cfc-44c0-bf35-27ee7e7c4856\" (UID: \"c49e2af2-3cfc-44c0-bf35-27ee7e7c4856\") "
Sep 15 11:47:36.886746 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:47:36.886672    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klnss\" (UniqueName: \"kubernetes.io/projected/c49e2af2-3cfc-44c0-bf35-27ee7e7c4856-kube-api-access-klnss\") pod \"c49e2af2-3cfc-44c0-bf35-27ee7e7c4856\" (UID: \"c49e2af2-3cfc-44c0-bf35-27ee7e7c4856\") "
Sep 15 11:47:36.887063 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:47:36.887030    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c49e2af2-3cfc-44c0-bf35-27ee7e7c4856-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c49e2af2-3cfc-44c0-bf35-27ee7e7c4856" (UID: "c49e2af2-3cfc-44c0-bf35-27ee7e7c4856"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:47:36.889012 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:47:36.888980    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c49e2af2-3cfc-44c0-bf35-27ee7e7c4856-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c49e2af2-3cfc-44c0-bf35-27ee7e7c4856" (UID: "c49e2af2-3cfc-44c0-bf35-27ee7e7c4856"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:47:36.889122 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:47:36.888990    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c49e2af2-3cfc-44c0-bf35-27ee7e7c4856-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c49e2af2-3cfc-44c0-bf35-27ee7e7c4856" (UID: "c49e2af2-3cfc-44c0-bf35-27ee7e7c4856"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:47:36.889226 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:47:36.889209    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c49e2af2-3cfc-44c0-bf35-27ee7e7c4856-kube-api-access-klnss" (OuterVolumeSpecName: "kube-api-access-klnss") pod "c49e2af2-3cfc-44c0-bf35-27ee7e7c4856" (UID: "c49e2af2-3cfc-44c0-bf35-27ee7e7c4856"). InnerVolumeSpecName "kube-api-access-klnss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:47:36.987784 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:47:36.987735    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klnss\" (UniqueName: \"kubernetes.io/projected/c49e2af2-3cfc-44c0-bf35-27ee7e7c4856-kube-api-access-klnss\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:47:36.987784 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:47:36.987767    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c49e2af2-3cfc-44c0-bf35-27ee7e7c4856-maas-api-tls\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:47:36.987784 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:47:36.987785    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c49e2af2-3cfc-44c0-bf35-27ee7e7c4856-openshift-service-ca\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:47:36.988037 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:47:36.987797    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c49e2af2-3cfc-44c0-bf35-27ee7e7c4856-metrics-certs\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:47:37.183470 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:47:37.183428    2582 generic.go:356] "Generic (PLEG): container finished" podID="c49e2af2-3cfc-44c0-bf35-27ee7e7c4856" containerID="06a5a91a6539c81a45d5c7ffff0dfff00af0f9245e6a760e065ad2c0d5b60f89" exitCode=0
Sep 15 11:47:37.183660 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:47:37.183482    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-944c275f-5fcd476d4c-v4src"
Sep 15 11:47:37.183660 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:47:37.183490    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-944c275f-5fcd476d4c-v4src" event={"ID":"c49e2af2-3cfc-44c0-bf35-27ee7e7c4856","Type":"ContainerDied","Data":"06a5a91a6539c81a45d5c7ffff0dfff00af0f9245e6a760e065ad2c0d5b60f89"}
Sep 15 11:47:37.183660 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:47:37.183543    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-944c275f-5fcd476d4c-v4src" event={"ID":"c49e2af2-3cfc-44c0-bf35-27ee7e7c4856","Type":"ContainerDied","Data":"c08a03063920f690281e68080ddec86bd51bbaefd47fdc4eab03eac9daf35d51"}
Sep 15 11:47:37.183660 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:47:37.183574    2582 scope.go:117] "RemoveContainer" containerID="06a5a91a6539c81a45d5c7ffff0dfff00af0f9245e6a760e065ad2c0d5b60f89"
Sep 15 11:47:37.192881 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:47:37.192861    2582 scope.go:117] "RemoveContainer" containerID="06a5a91a6539c81a45d5c7ffff0dfff00af0f9245e6a760e065ad2c0d5b60f89"
Sep 15 11:47:37.193198 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:47:37.193157    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06a5a91a6539c81a45d5c7ffff0dfff00af0f9245e6a760e065ad2c0d5b60f89\": container with ID starting with 06a5a91a6539c81a45d5c7ffff0dfff00af0f9245e6a760e065ad2c0d5b60f89 not found: ID does not exist" containerID="06a5a91a6539c81a45d5c7ffff0dfff00af0f9245e6a760e065ad2c0d5b60f89"
Sep 15 11:47:37.193293 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:47:37.193201    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06a5a91a6539c81a45d5c7ffff0dfff00af0f9245e6a760e065ad2c0d5b60f89"} err="failed to get container status \"06a5a91a6539c81a45d5c7ffff0dfff00af0f9245e6a760e065ad2c0d5b60f89\": rpc error: code = NotFound desc = could not find container \"06a5a91a6539c81a45d5c7ffff0dfff00af0f9245e6a760e065ad2c0d5b60f89\": container with ID starting with 06a5a91a6539c81a45d5c7ffff0dfff00af0f9245e6a760e065ad2c0d5b60f89 not found: ID does not exist"
Sep 15 11:47:37.199296 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:47:37.199275    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-944c275f-5fcd476d4c-v4src"]
Sep 15 11:47:37.203426 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:47:37.203405    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-944c275f-5fcd476d4c-v4src"]
Sep 15 11:47:39.046314 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:47:39.046278    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c49e2af2-3cfc-44c0-bf35-27ee7e7c4856" path="/var/lib/kubelet/pods/c49e2af2-3cfc-44c0-bf35-27ee7e7c4856/volumes"
Sep 15 11:49:45.830977 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:49:45.830898    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4-fqss7"]
Sep 15 11:49:45.831512 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:49:45.831366    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c49e2af2-3cfc-44c0-bf35-27ee7e7c4856" containerName="maas-api"
Sep 15 11:49:45.831512 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:49:45.831381    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c49e2af2-3cfc-44c0-bf35-27ee7e7c4856" containerName="maas-api"
Sep 15 11:49:45.831512 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:49:45.831462    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c49e2af2-3cfc-44c0-bf35-27ee7e7c4856" containerName="maas-api"
Sep 15 11:49:45.834756 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:49:45.834738    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4-fqss7"
Sep 15 11:49:45.837369 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:49:45.837346    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-01df46\""
Sep 15 11:49:45.837856 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:49:45.837840    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-01df46-dockercfg-zfr5v\""
Sep 15 11:49:45.849297 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:49:45.849271    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4-fqss7"]
Sep 15 11:49:45.883046 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:49:45.883012    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f0af390-0021-4847-ae80-e475ffb9a708-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4-fqss7\" (UID: \"0f0af390-0021-4847-ae80-e475ffb9a708\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4-fqss7"
Sep 15 11:49:45.883046 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:49:45.883061    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4srx8\" (UniqueName: \"kubernetes.io/projected/0f0af390-0021-4847-ae80-e475ffb9a708-kube-api-access-4srx8\") pod \"payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4-fqss7\" (UID: \"0f0af390-0021-4847-ae80-e475ffb9a708\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4-fqss7"
Sep 15 11:49:45.983640 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:49:45.983592    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4srx8\" (UniqueName: \"kubernetes.io/projected/0f0af390-0021-4847-ae80-e475ffb9a708-kube-api-access-4srx8\") pod \"payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4-fqss7\" (UID: \"0f0af390-0021-4847-ae80-e475ffb9a708\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4-fqss7"
Sep 15 11:49:45.983841 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:49:45.983753    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f0af390-0021-4847-ae80-e475ffb9a708-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4-fqss7\" (UID: \"0f0af390-0021-4847-ae80-e475ffb9a708\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4-fqss7"
Sep 15 11:49:45.984933 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:49:45.984838    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f0af390-0021-4847-ae80-e475ffb9a708-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4-fqss7\" (UID: \"0f0af390-0021-4847-ae80-e475ffb9a708\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4-fqss7"
Sep 15 11:49:45.993392 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:49:45.993362    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4srx8\" (UniqueName: \"kubernetes.io/projected/0f0af390-0021-4847-ae80-e475ffb9a708-kube-api-access-4srx8\") pod \"payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4-fqss7\" (UID: \"0f0af390-0021-4847-ae80-e475ffb9a708\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4-fqss7"
Sep 15 11:49:46.145299 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:49:46.145263    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4-fqss7"
Sep 15 11:49:46.426615 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:49:46.426590    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4-fqss7"]
Sep 15 11:49:46.428656 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:49:46.428629    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f0af390_0021_4847_ae80_e475ffb9a708.slice/crio-cd443d3d9695ae359c62e40025e0f42b2ddc01ea5c8f157032c04f9eb645da00 WatchSource:0}: Error finding container cd443d3d9695ae359c62e40025e0f42b2ddc01ea5c8f157032c04f9eb645da00: Status 404 returned error can't find the container with id cd443d3d9695ae359c62e40025e0f42b2ddc01ea5c8f157032c04f9eb645da00
Sep 15 11:49:46.832002 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:49:46.831900    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4-fqss7" event={"ID":"0f0af390-0021-4847-ae80-e475ffb9a708","Type":"ContainerStarted","Data":"b54be541c1c8bc455345e21b7245c92666dbb85e5760f8887537e7d28ebbba9e"}
Sep 15 11:49:46.832002 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:49:46.831965    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4-fqss7" event={"ID":"0f0af390-0021-4847-ae80-e475ffb9a708","Type":"ContainerStarted","Data":"cd443d3d9695ae359c62e40025e0f42b2ddc01ea5c8f157032c04f9eb645da00"}
Sep 15 11:49:46.832002 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:49:46.831993    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4-fqss7"
Sep 15 11:49:46.849988 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:49:46.849921    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4-fqss7" podStartSLOduration=1.849900052 podStartE2EDuration="1.849900052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:49:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:49:46.849239032 +0000 UTC m=+1466.311105086" watchObservedRunningTime="2026-09-15 11:49:46.849900052 +0000 UTC m=+1466.311766108"
Sep 15 11:49:57.839449 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:49:57.839404    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4-fqss7"
Sep 15 11:50:21.184912 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:50:21.184882    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8-t58kn"]
Sep 15 11:50:21.188479 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:50:21.188457    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8-t58kn"
Sep 15 11:50:21.191033 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:50:21.191006    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-f3e7da-5f4fbbfb57-fldzl"]
Sep 15 11:50:21.191268 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:50:21.191244    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-f3e7da-dockercfg-wwqbs\""
Sep 15 11:50:21.191395 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:50:21.191322    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-f3e7da\""
Sep 15 11:50:21.194601 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:50:21.194578    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-f3e7da-5f4fbbfb57-fldzl"
Sep 15 11:50:21.197495 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:50:21.197466    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8-t58kn"]
Sep 15 11:50:21.204782 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:50:21.204588    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-f3e7da-5f4fbbfb57-fldzl"]
Sep 15 11:50:21.227321 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:50:21.227286    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pspzs\" (UniqueName: \"kubernetes.io/projected/c8373dee-d5a0-44d7-aabb-c4f0251ff0a3-kube-api-access-pspzs\") pod \"payload-processing-e2e-api-b-f3e7da-5f4fbbfb57-fldzl\" (UID: \"c8373dee-d5a0-44d7-aabb-c4f0251ff0a3\") " pod="openshift-ingress/payload-processing-e2e-api-b-f3e7da-5f4fbbfb57-fldzl"
Sep 15 11:50:21.227579 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:50:21.227331    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8373dee-d5a0-44d7-aabb-c4f0251ff0a3-plugins-config-volume\") pod \"payload-processing-e2e-api-b-f3e7da-5f4fbbfb57-fldzl\" (UID: \"c8373dee-d5a0-44d7-aabb-c4f0251ff0a3\") " pod="openshift-ingress/payload-processing-e2e-api-b-f3e7da-5f4fbbfb57-fldzl"
Sep 15 11:50:21.227579 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:50:21.227439    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a015fe1e-797c-4727-b49f-913fa1678de3-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8-t58kn\" (UID: \"a015fe1e-797c-4727-b49f-913fa1678de3\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8-t58kn"
Sep 15 11:50:21.227579 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:50:21.227568    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw99w\" (UniqueName: \"kubernetes.io/projected/a015fe1e-797c-4727-b49f-913fa1678de3-kube-api-access-kw99w\") pod \"payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8-t58kn\" (UID: \"a015fe1e-797c-4727-b49f-913fa1678de3\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8-t58kn"
Sep 15 11:50:21.332020 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:50:21.331987    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw99w\" (UniqueName: \"kubernetes.io/projected/a015fe1e-797c-4727-b49f-913fa1678de3-kube-api-access-kw99w\") pod \"payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8-t58kn\" (UID: \"a015fe1e-797c-4727-b49f-913fa1678de3\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8-t58kn"
Sep 15 11:50:21.332253 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:50:21.332061    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pspzs\" (UniqueName: \"kubernetes.io/projected/c8373dee-d5a0-44d7-aabb-c4f0251ff0a3-kube-api-access-pspzs\") pod \"payload-processing-e2e-api-b-f3e7da-5f4fbbfb57-fldzl\" (UID: \"c8373dee-d5a0-44d7-aabb-c4f0251ff0a3\") " pod="openshift-ingress/payload-processing-e2e-api-b-f3e7da-5f4fbbfb57-fldzl"
Sep 15 11:50:21.332253 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:50:21.332089    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8373dee-d5a0-44d7-aabb-c4f0251ff0a3-plugins-config-volume\") pod \"payload-processing-e2e-api-b-f3e7da-5f4fbbfb57-fldzl\" (UID: \"c8373dee-d5a0-44d7-aabb-c4f0251ff0a3\") " pod="openshift-ingress/payload-processing-e2e-api-b-f3e7da-5f4fbbfb57-fldzl"
Sep 15 11:50:21.332253 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:50:21.332145    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a015fe1e-797c-4727-b49f-913fa1678de3-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8-t58kn\" (UID: \"a015fe1e-797c-4727-b49f-913fa1678de3\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8-t58kn"
Sep 15 11:50:21.333330 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:50:21.333303    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8373dee-d5a0-44d7-aabb-c4f0251ff0a3-plugins-config-volume\") pod \"payload-processing-e2e-api-b-f3e7da-5f4fbbfb57-fldzl\" (UID: \"c8373dee-d5a0-44d7-aabb-c4f0251ff0a3\") " pod="openshift-ingress/payload-processing-e2e-api-b-f3e7da-5f4fbbfb57-fldzl"
Sep 15 11:50:21.334226 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:50:21.333789    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a015fe1e-797c-4727-b49f-913fa1678de3-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8-t58kn\" (UID: \"a015fe1e-797c-4727-b49f-913fa1678de3\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8-t58kn"
Sep 15 11:50:21.342166 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:50:21.342140    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pspzs\" (UniqueName: \"kubernetes.io/projected/c8373dee-d5a0-44d7-aabb-c4f0251ff0a3-kube-api-access-pspzs\") pod \"payload-processing-e2e-api-b-f3e7da-5f4fbbfb57-fldzl\" (UID: \"c8373dee-d5a0-44d7-aabb-c4f0251ff0a3\") " pod="openshift-ingress/payload-processing-e2e-api-b-f3e7da-5f4fbbfb57-fldzl"
Sep 15 11:50:21.342343 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:50:21.342319    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw99w\" (UniqueName: \"kubernetes.io/projected/a015fe1e-797c-4727-b49f-913fa1678de3-kube-api-access-kw99w\") pod \"payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8-t58kn\" (UID: \"a015fe1e-797c-4727-b49f-913fa1678de3\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8-t58kn"
Sep 15 11:50:21.502543 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:50:21.502452    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8-t58kn"
Sep 15 11:50:21.510817 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:50:21.510789    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-f3e7da-5f4fbbfb57-fldzl"
Sep 15 11:50:21.781274 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:50:21.781233    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8-t58kn"]
Sep 15 11:50:21.784092 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:50:21.784061    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda015fe1e_797c_4727_b49f_913fa1678de3.slice/crio-c9ef17a1abdbf7fb82e139d011bbcc89d2a77a20b6b59594400fe69b0b9240f0 WatchSource:0}: Error finding container c9ef17a1abdbf7fb82e139d011bbcc89d2a77a20b6b59594400fe69b0b9240f0: Status 404 returned error can't find the container with id c9ef17a1abdbf7fb82e139d011bbcc89d2a77a20b6b59594400fe69b0b9240f0
Sep 15 11:50:21.799207 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:50:21.799145    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-f3e7da-5f4fbbfb57-fldzl"]
Sep 15 11:50:21.801202 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:50:21.801153    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8373dee_d5a0_44d7_aabb_c4f0251ff0a3.slice/crio-4a7054277878f82d8e8464efa56fddfb1eb7b12e27eb969016d0a247d7dcda52 WatchSource:0}: Error finding container 4a7054277878f82d8e8464efa56fddfb1eb7b12e27eb969016d0a247d7dcda52: Status 404 returned error can't find the container with id 4a7054277878f82d8e8464efa56fddfb1eb7b12e27eb969016d0a247d7dcda52
Sep 15 11:50:22.010578 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:50:22.010535    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-f3e7da-5f4fbbfb57-fldzl" event={"ID":"c8373dee-d5a0-44d7-aabb-c4f0251ff0a3","Type":"ContainerStarted","Data":"aca06bbac3de09c67eb47b262fc2a015832b4d6daaabd6e0262cf789c2841dfb"}
Sep 15 11:50:22.010787 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:50:22.010600    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-f3e7da-5f4fbbfb57-fldzl" event={"ID":"c8373dee-d5a0-44d7-aabb-c4f0251ff0a3","Type":"ContainerStarted","Data":"4a7054277878f82d8e8464efa56fddfb1eb7b12e27eb969016d0a247d7dcda52"}
Sep 15 11:50:22.010787 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:50:22.010680    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-f3e7da-5f4fbbfb57-fldzl"
Sep 15 11:50:22.012935 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:50:22.012903    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8-t58kn" event={"ID":"a015fe1e-797c-4727-b49f-913fa1678de3","Type":"ContainerStarted","Data":"274958d1f17eb837f4fabeda0c3ad629e4ade4e6a3d8cdc573da1d11871e0915"}
Sep 15 11:50:22.013100 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:50:22.012954    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8-t58kn" event={"ID":"a015fe1e-797c-4727-b49f-913fa1678de3","Type":"ContainerStarted","Data":"c9ef17a1abdbf7fb82e139d011bbcc89d2a77a20b6b59594400fe69b0b9240f0"}
Sep 15 11:50:22.013100 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:50:22.012985    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8-t58kn"
Sep 15 11:50:22.029657 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:50:22.029591    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-f3e7da-5f4fbbfb57-fldzl" podStartSLOduration=1.029559648 podStartE2EDuration="1.029559648s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:50:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:50:22.02882117 +0000 UTC m=+1501.490687224" watchObservedRunningTime="2026-09-15 11:50:22.029559648 +0000 UTC m=+1501.491425704"
Sep 15 11:50:22.047010 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:50:22.046919    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8-t58kn" podStartSLOduration=1.046901437 podStartE2EDuration="1.046901437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:50:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:50:22.044880462 +0000 UTC m=+1501.506746519" watchObservedRunningTime="2026-09-15 11:50:22.046901437 +0000 UTC m=+1501.508767487"
Sep 15 11:50:33.019835 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:50:33.019803    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8-t58kn"
Sep 15 11:50:33.020229 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:50:33.019952    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-f3e7da-5f4fbbfb57-fldzl"
Sep 15 11:51:04.098362 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:04.098322    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4-fqss7"]
Sep 15 11:51:04.098893 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:04.098542    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4-fqss7" podUID="0f0af390-0021-4847-ae80-e475ffb9a708" containerName="payload-pre-processing" containerID="cri-o://b54be541c1c8bc455345e21b7245c92666dbb85e5760f8887537e7d28ebbba9e" gracePeriod=30
Sep 15 11:51:04.231845 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:04.231775    2582 generic.go:356] "Generic (PLEG): container finished" podID="0f0af390-0021-4847-ae80-e475ffb9a708" containerID="b54be541c1c8bc455345e21b7245c92666dbb85e5760f8887537e7d28ebbba9e" exitCode=0
Sep 15 11:51:04.231845 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:04.231810    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4-fqss7" event={"ID":"0f0af390-0021-4847-ae80-e475ffb9a708","Type":"ContainerDied","Data":"b54be541c1c8bc455345e21b7245c92666dbb85e5760f8887537e7d28ebbba9e"}
Sep 15 11:51:04.369679 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:04.369653    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4-fqss7"
Sep 15 11:51:04.449123 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:04.449079    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f0af390-0021-4847-ae80-e475ffb9a708-plugins-config-volume\") pod \"0f0af390-0021-4847-ae80-e475ffb9a708\" (UID: \"0f0af390-0021-4847-ae80-e475ffb9a708\") "
Sep 15 11:51:04.449123 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:04.449123    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4srx8\" (UniqueName: \"kubernetes.io/projected/0f0af390-0021-4847-ae80-e475ffb9a708-kube-api-access-4srx8\") pod \"0f0af390-0021-4847-ae80-e475ffb9a708\" (UID: \"0f0af390-0021-4847-ae80-e475ffb9a708\") "
Sep 15 11:51:04.449485 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:04.449460    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f0af390-0021-4847-ae80-e475ffb9a708-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0f0af390-0021-4847-ae80-e475ffb9a708" (UID: "0f0af390-0021-4847-ae80-e475ffb9a708"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:51:04.451354 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:04.451333    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f0af390-0021-4847-ae80-e475ffb9a708-kube-api-access-4srx8" (OuterVolumeSpecName: "kube-api-access-4srx8") pod "0f0af390-0021-4847-ae80-e475ffb9a708" (UID: "0f0af390-0021-4847-ae80-e475ffb9a708"). InnerVolumeSpecName "kube-api-access-4srx8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:51:04.550836 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:04.550801    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f0af390-0021-4847-ae80-e475ffb9a708-plugins-config-volume\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:51:04.550836 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:04.550832    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4srx8\" (UniqueName: \"kubernetes.io/projected/0f0af390-0021-4847-ae80-e475ffb9a708-kube-api-access-4srx8\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:51:05.240513 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:05.240484    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4-fqss7"
Sep 15 11:51:05.240513 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:05.240497    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4-fqss7" event={"ID":"0f0af390-0021-4847-ae80-e475ffb9a708","Type":"ContainerDied","Data":"cd443d3d9695ae359c62e40025e0f42b2ddc01ea5c8f157032c04f9eb645da00"}
Sep 15 11:51:05.241012 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:05.240566    2582 scope.go:117] "RemoveContainer" containerID="b54be541c1c8bc455345e21b7245c92666dbb85e5760f8887537e7d28ebbba9e"
Sep 15 11:51:05.256694 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:05.256656    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4-fqss7"]
Sep 15 11:51:05.258943 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:05.258922    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4-fqss7"]
Sep 15 11:51:07.046520 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:07.046489    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f0af390-0021-4847-ae80-e475ffb9a708" path="/var/lib/kubelet/pods/0f0af390-0021-4847-ae80-e475ffb9a708/volumes"
Sep 15 11:51:13.592347 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:13.592310    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-9bd868/distinct-w0-9bd868-kserve-55775549cd-tk79v"]
Sep 15 11:51:13.611685 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:13.611652    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-9bd868/premium-w0-9bd868-kserve-855494d7c5-7tqxc"]
Sep 15 11:51:24.507971 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:24.507933    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4"]
Sep 15 11:51:24.508502 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:24.508208    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4" podUID="f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f" containerName="maas-api" containerID="cri-o://f42653594a9ce18c6f6580481b16eaec597d1f1b8f510fe3491622feb4f28b9f" gracePeriod=30
Sep 15 11:51:24.783890 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:24.783859    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4"
Sep 15 11:51:24.945347 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:24.945314    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f-maas-api-tls\") pod \"f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f\" (UID: \"f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f\") "
Sep 15 11:51:24.945529 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:24.945376    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f-metrics-certs\") pod \"f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f\" (UID: \"f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f\") "
Sep 15 11:51:24.945529 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:24.945420    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f-openshift-service-ca\") pod \"f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f\" (UID: \"f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f\") "
Sep 15 11:51:24.945529 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:24.945475    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfdzw\" (UniqueName: \"kubernetes.io/projected/f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f-kube-api-access-wfdzw\") pod \"f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f\" (UID: \"f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f\") "
Sep 15 11:51:24.945784 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:24.945760    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f" (UID: "f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:51:24.947507 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:24.947486    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f" (UID: "f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:51:24.947583 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:24.947528    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f-kube-api-access-wfdzw" (OuterVolumeSpecName: "kube-api-access-wfdzw") pod "f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f" (UID: "f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f"). InnerVolumeSpecName "kube-api-access-wfdzw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:51:24.947628 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:24.947613    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f" (UID: "f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:51:25.046315 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:25.046237    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f-maas-api-tls\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:51:25.046315 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:25.046261    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f-metrics-certs\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:51:25.046315 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:25.046269    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f-openshift-service-ca\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:51:25.046315 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:25.046279    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfdzw\" (UniqueName: \"kubernetes.io/projected/f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f-kube-api-access-wfdzw\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:51:25.343489 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:25.343410    2582 generic.go:356] "Generic (PLEG): container finished" podID="f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f" containerID="f42653594a9ce18c6f6580481b16eaec597d1f1b8f510fe3491622feb4f28b9f" exitCode=0
Sep 15 11:51:25.343489 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:25.343452    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4"
Sep 15 11:51:25.343670 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:25.343488    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4" event={"ID":"f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f","Type":"ContainerDied","Data":"f42653594a9ce18c6f6580481b16eaec597d1f1b8f510fe3491622feb4f28b9f"}
Sep 15 11:51:25.343670 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:25.343549    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4" event={"ID":"f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f","Type":"ContainerDied","Data":"214b100ee31ffed6900daa1f87e56ff8546c70673e8db5432135a6834d05a282"}
Sep 15 11:51:25.343670 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:25.343577    2582 scope.go:117] "RemoveContainer" containerID="f42653594a9ce18c6f6580481b16eaec597d1f1b8f510fe3491622feb4f28b9f"
Sep 15 11:51:25.352999 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:25.352978    2582 scope.go:117] "RemoveContainer" containerID="f42653594a9ce18c6f6580481b16eaec597d1f1b8f510fe3491622feb4f28b9f"
Sep 15 11:51:25.353425 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:51:25.353400    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f42653594a9ce18c6f6580481b16eaec597d1f1b8f510fe3491622feb4f28b9f\": container with ID starting with f42653594a9ce18c6f6580481b16eaec597d1f1b8f510fe3491622feb4f28b9f not found: ID does not exist" containerID="f42653594a9ce18c6f6580481b16eaec597d1f1b8f510fe3491622feb4f28b9f"
Sep 15 11:51:25.353514 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:25.353437    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f42653594a9ce18c6f6580481b16eaec597d1f1b8f510fe3491622feb4f28b9f"} err="failed to get container status \"f42653594a9ce18c6f6580481b16eaec597d1f1b8f510fe3491622feb4f28b9f\": rpc error: code = NotFound desc = could not find container \"f42653594a9ce18c6f6580481b16eaec597d1f1b8f510fe3491622feb4f28b9f\": container with ID starting with f42653594a9ce18c6f6580481b16eaec597d1f1b8f510fe3491622feb4f28b9f not found: ID does not exist"
Sep 15 11:51:25.359417 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:25.359396    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4"]
Sep 15 11:51:25.363399 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:25.363375    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-9bd868-5d58c889d5-nwxv4"]
Sep 15 11:51:27.045805 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:27.045771    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f" path="/var/lib/kubelet/pods/f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f/volumes"
Sep 15 11:51:27.987327 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:27.987294    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-f3e7da-5f4fbbfb57-fldzl"]
Sep 15 11:51:27.987566 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:27.987522    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-f3e7da-5f4fbbfb57-fldzl" podUID="c8373dee-d5a0-44d7-aabb-c4f0251ff0a3" containerName="payload-processing" containerID="cri-o://aca06bbac3de09c67eb47b262fc2a015832b4d6daaabd6e0262cf789c2841dfb" gracePeriod=30
Sep 15 11:51:27.996525 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:27.996494    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8-t58kn"]
Sep 15 11:51:27.996768 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:27.996740    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8-t58kn" podUID="a015fe1e-797c-4727-b49f-913fa1678de3" containerName="payload-pre-processing" containerID="cri-o://274958d1f17eb837f4fabeda0c3ad629e4ade4e6a3d8cdc573da1d11871e0915" gracePeriod=30
Sep 15 11:51:28.279381 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.279358    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-f3e7da-5f4fbbfb57-fldzl"
Sep 15 11:51:28.315230 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.315200    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8-t58kn"
Sep 15 11:51:28.360996 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.360955    2582 generic.go:356] "Generic (PLEG): container finished" podID="c8373dee-d5a0-44d7-aabb-c4f0251ff0a3" containerID="aca06bbac3de09c67eb47b262fc2a015832b4d6daaabd6e0262cf789c2841dfb" exitCode=0
Sep 15 11:51:28.361189 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.361081    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-f3e7da-5f4fbbfb57-fldzl" event={"ID":"c8373dee-d5a0-44d7-aabb-c4f0251ff0a3","Type":"ContainerDied","Data":"aca06bbac3de09c67eb47b262fc2a015832b4d6daaabd6e0262cf789c2841dfb"}
Sep 15 11:51:28.361259 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.361084    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-f3e7da-5f4fbbfb57-fldzl"
Sep 15 11:51:28.361259 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.361225    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-f3e7da-5f4fbbfb57-fldzl" event={"ID":"c8373dee-d5a0-44d7-aabb-c4f0251ff0a3","Type":"ContainerDied","Data":"4a7054277878f82d8e8464efa56fddfb1eb7b12e27eb969016d0a247d7dcda52"}
Sep 15 11:51:28.361360 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.361264    2582 scope.go:117] "RemoveContainer" containerID="aca06bbac3de09c67eb47b262fc2a015832b4d6daaabd6e0262cf789c2841dfb"
Sep 15 11:51:28.362750 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.362711    2582 generic.go:356] "Generic (PLEG): container finished" podID="a015fe1e-797c-4727-b49f-913fa1678de3" containerID="274958d1f17eb837f4fabeda0c3ad629e4ade4e6a3d8cdc573da1d11871e0915" exitCode=0
Sep 15 11:51:28.362870 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.362756    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8-t58kn"
Sep 15 11:51:28.362939 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.362872    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8-t58kn" event={"ID":"a015fe1e-797c-4727-b49f-913fa1678de3","Type":"ContainerDied","Data":"274958d1f17eb837f4fabeda0c3ad629e4ade4e6a3d8cdc573da1d11871e0915"}
Sep 15 11:51:28.362939 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.362912    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8-t58kn" event={"ID":"a015fe1e-797c-4727-b49f-913fa1678de3","Type":"ContainerDied","Data":"c9ef17a1abdbf7fb82e139d011bbcc89d2a77a20b6b59594400fe69b0b9240f0"}
Sep 15 11:51:28.371934 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.371910    2582 scope.go:117] "RemoveContainer" containerID="aca06bbac3de09c67eb47b262fc2a015832b4d6daaabd6e0262cf789c2841dfb"
Sep 15 11:51:28.372379 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:51:28.372345    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aca06bbac3de09c67eb47b262fc2a015832b4d6daaabd6e0262cf789c2841dfb\": container with ID starting with aca06bbac3de09c67eb47b262fc2a015832b4d6daaabd6e0262cf789c2841dfb not found: ID does not exist" containerID="aca06bbac3de09c67eb47b262fc2a015832b4d6daaabd6e0262cf789c2841dfb"
Sep 15 11:51:28.372498 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.372388    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aca06bbac3de09c67eb47b262fc2a015832b4d6daaabd6e0262cf789c2841dfb"} err="failed to get container status \"aca06bbac3de09c67eb47b262fc2a015832b4d6daaabd6e0262cf789c2841dfb\": rpc error: code = NotFound desc = could not find container \"aca06bbac3de09c67eb47b262fc2a015832b4d6daaabd6e0262cf789c2841dfb\": container with ID starting with aca06bbac3de09c67eb47b262fc2a015832b4d6daaabd6e0262cf789c2841dfb not found: ID does not exist"
Sep 15 11:51:28.372498 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.372415    2582 scope.go:117] "RemoveContainer" containerID="274958d1f17eb837f4fabeda0c3ad629e4ade4e6a3d8cdc573da1d11871e0915"
Sep 15 11:51:28.379706 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.379682    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pspzs\" (UniqueName: \"kubernetes.io/projected/c8373dee-d5a0-44d7-aabb-c4f0251ff0a3-kube-api-access-pspzs\") pod \"c8373dee-d5a0-44d7-aabb-c4f0251ff0a3\" (UID: \"c8373dee-d5a0-44d7-aabb-c4f0251ff0a3\") "
Sep 15 11:51:28.379829 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.379725    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8373dee-d5a0-44d7-aabb-c4f0251ff0a3-plugins-config-volume\") pod \"c8373dee-d5a0-44d7-aabb-c4f0251ff0a3\" (UID: \"c8373dee-d5a0-44d7-aabb-c4f0251ff0a3\") "
Sep 15 11:51:28.380169 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.380144    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8373dee-d5a0-44d7-aabb-c4f0251ff0a3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c8373dee-d5a0-44d7-aabb-c4f0251ff0a3" (UID: "c8373dee-d5a0-44d7-aabb-c4f0251ff0a3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:51:28.381918 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.381897    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8373dee-d5a0-44d7-aabb-c4f0251ff0a3-kube-api-access-pspzs" (OuterVolumeSpecName: "kube-api-access-pspzs") pod "c8373dee-d5a0-44d7-aabb-c4f0251ff0a3" (UID: "c8373dee-d5a0-44d7-aabb-c4f0251ff0a3"). InnerVolumeSpecName "kube-api-access-pspzs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:51:28.382342 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.382325    2582 scope.go:117] "RemoveContainer" containerID="274958d1f17eb837f4fabeda0c3ad629e4ade4e6a3d8cdc573da1d11871e0915"
Sep 15 11:51:28.382617 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:51:28.382596    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"274958d1f17eb837f4fabeda0c3ad629e4ade4e6a3d8cdc573da1d11871e0915\": container with ID starting with 274958d1f17eb837f4fabeda0c3ad629e4ade4e6a3d8cdc573da1d11871e0915 not found: ID does not exist" containerID="274958d1f17eb837f4fabeda0c3ad629e4ade4e6a3d8cdc573da1d11871e0915"
Sep 15 11:51:28.382669 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.382624    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"274958d1f17eb837f4fabeda0c3ad629e4ade4e6a3d8cdc573da1d11871e0915"} err="failed to get container status \"274958d1f17eb837f4fabeda0c3ad629e4ade4e6a3d8cdc573da1d11871e0915\": rpc error: code = NotFound desc = could not find container \"274958d1f17eb837f4fabeda0c3ad629e4ade4e6a3d8cdc573da1d11871e0915\": container with ID starting with 274958d1f17eb837f4fabeda0c3ad629e4ade4e6a3d8cdc573da1d11871e0915 not found: ID does not exist"
Sep 15 11:51:28.480723 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.480694    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kw99w\" (UniqueName: \"kubernetes.io/projected/a015fe1e-797c-4727-b49f-913fa1678de3-kube-api-access-kw99w\") pod \"a015fe1e-797c-4727-b49f-913fa1678de3\" (UID: \"a015fe1e-797c-4727-b49f-913fa1678de3\") "
Sep 15 11:51:28.480723 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.480736    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a015fe1e-797c-4727-b49f-913fa1678de3-plugins-config-volume\") pod \"a015fe1e-797c-4727-b49f-913fa1678de3\" (UID: \"a015fe1e-797c-4727-b49f-913fa1678de3\") "
Sep 15 11:51:28.481114 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.481092    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a015fe1e-797c-4727-b49f-913fa1678de3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a015fe1e-797c-4727-b49f-913fa1678de3" (UID: "a015fe1e-797c-4727-b49f-913fa1678de3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:51:28.481114 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.481105    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pspzs\" (UniqueName: \"kubernetes.io/projected/c8373dee-d5a0-44d7-aabb-c4f0251ff0a3-kube-api-access-pspzs\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:51:28.481236 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.481125    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8373dee-d5a0-44d7-aabb-c4f0251ff0a3-plugins-config-volume\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:51:28.483036 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.483016    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a015fe1e-797c-4727-b49f-913fa1678de3-kube-api-access-kw99w" (OuterVolumeSpecName: "kube-api-access-kw99w") pod "a015fe1e-797c-4727-b49f-913fa1678de3" (UID: "a015fe1e-797c-4727-b49f-913fa1678de3"). InnerVolumeSpecName "kube-api-access-kw99w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:51:28.581859 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.581775    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kw99w\" (UniqueName: \"kubernetes.io/projected/a015fe1e-797c-4727-b49f-913fa1678de3-kube-api-access-kw99w\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:51:28.581859 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.581803    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a015fe1e-797c-4727-b49f-913fa1678de3-plugins-config-volume\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:51:28.612933 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.612890    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-9bd868/distinct-w0-9bd868-kserve-55775549cd-tk79v" podUID="420c9a8c-59ed-498d-870f-66c92b9e3988" containerName="main" containerID="cri-o://6a6ccc2b555308f309fe57f72e1b96d399e7327b45fa7ff4f1d8268465187bbc" gracePeriod=45
Sep 15 11:51:28.632304 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.632275    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-9bd868/premium-w0-9bd868-kserve-855494d7c5-7tqxc" podUID="986147f2-accd-4bdd-a8df-c7e77b95251d" containerName="main" containerID="cri-o://a55af05f4338caac31258a1e7ef4bbace1ded090bc1e9c5dc9269a1e17a0d683" gracePeriod=45
Sep 15 11:51:28.755641 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.755610    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8-t58kn"]
Sep 15 11:51:28.759993 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.759968    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8-t58kn"]
Sep 15 11:51:28.771408 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.771353    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-f3e7da-5f4fbbfb57-fldzl"]
Sep 15 11:51:28.773275 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.773257    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-f3e7da-5f4fbbfb57-fldzl"]
Sep 15 11:51:28.894657 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.894630    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-9bd868/distinct-w0-9bd868-kserve-55775549cd-tk79v"
Sep 15 11:51:28.913794 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.911765    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-9bd868/premium-w0-9bd868-kserve-855494d7c5-7tqxc"
Sep 15 11:51:28.985885 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.985858    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jh7nx\" (UniqueName: \"kubernetes.io/projected/420c9a8c-59ed-498d-870f-66c92b9e3988-kube-api-access-jh7nx\") pod \"420c9a8c-59ed-498d-870f-66c92b9e3988\" (UID: \"420c9a8c-59ed-498d-870f-66c92b9e3988\") "
Sep 15 11:51:28.986038 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.985898    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/420c9a8c-59ed-498d-870f-66c92b9e3988-model-cache\") pod \"420c9a8c-59ed-498d-870f-66c92b9e3988\" (UID: \"420c9a8c-59ed-498d-870f-66c92b9e3988\") "
Sep 15 11:51:28.986038 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.986032    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/420c9a8c-59ed-498d-870f-66c92b9e3988-tmp-dir\") pod \"420c9a8c-59ed-498d-870f-66c92b9e3988\" (UID: \"420c9a8c-59ed-498d-870f-66c92b9e3988\") "
Sep 15 11:51:28.986149 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.986066    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/420c9a8c-59ed-498d-870f-66c92b9e3988-home\") pod \"420c9a8c-59ed-498d-870f-66c92b9e3988\" (UID: \"420c9a8c-59ed-498d-870f-66c92b9e3988\") "
Sep 15 11:51:28.986149 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.986107    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/420c9a8c-59ed-498d-870f-66c92b9e3988-tls-certs\") pod \"420c9a8c-59ed-498d-870f-66c92b9e3988\" (UID: \"420c9a8c-59ed-498d-870f-66c92b9e3988\") "
Sep 15 11:51:28.986149 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.986138    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/420c9a8c-59ed-498d-870f-66c92b9e3988-dshm\") pod \"420c9a8c-59ed-498d-870f-66c92b9e3988\" (UID: \"420c9a8c-59ed-498d-870f-66c92b9e3988\") "
Sep 15 11:51:28.986401 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.986244    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/420c9a8c-59ed-498d-870f-66c92b9e3988-model-cache" (OuterVolumeSpecName: "model-cache") pod "420c9a8c-59ed-498d-870f-66c92b9e3988" (UID: "420c9a8c-59ed-498d-870f-66c92b9e3988"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:28.986401 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.986250    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/420c9a8c-59ed-498d-870f-66c92b9e3988-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "420c9a8c-59ed-498d-870f-66c92b9e3988" (UID: "420c9a8c-59ed-498d-870f-66c92b9e3988"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:28.986401 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.986333    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/420c9a8c-59ed-498d-870f-66c92b9e3988-home" (OuterVolumeSpecName: "home") pod "420c9a8c-59ed-498d-870f-66c92b9e3988" (UID: "420c9a8c-59ed-498d-870f-66c92b9e3988"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:28.986563 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.986538    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/420c9a8c-59ed-498d-870f-66c92b9e3988-model-cache\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:51:28.986623 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.986588    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/420c9a8c-59ed-498d-870f-66c92b9e3988-tmp-dir\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:51:28.986623 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.986603    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/420c9a8c-59ed-498d-870f-66c92b9e3988-home\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:51:28.988378 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.988347    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/420c9a8c-59ed-498d-870f-66c92b9e3988-kube-api-access-jh7nx" (OuterVolumeSpecName: "kube-api-access-jh7nx") pod "420c9a8c-59ed-498d-870f-66c92b9e3988" (UID: "420c9a8c-59ed-498d-870f-66c92b9e3988"). InnerVolumeSpecName "kube-api-access-jh7nx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:51:28.988701 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.988680    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/420c9a8c-59ed-498d-870f-66c92b9e3988-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "420c9a8c-59ed-498d-870f-66c92b9e3988" (UID: "420c9a8c-59ed-498d-870f-66c92b9e3988"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:51:28.988778 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:28.988760    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/420c9a8c-59ed-498d-870f-66c92b9e3988-dshm" (OuterVolumeSpecName: "dshm") pod "420c9a8c-59ed-498d-870f-66c92b9e3988" (UID: "420c9a8c-59ed-498d-870f-66c92b9e3988"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:29.047765 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:29.047731    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a015fe1e-797c-4727-b49f-913fa1678de3" path="/var/lib/kubelet/pods/a015fe1e-797c-4727-b49f-913fa1678de3/volumes"
Sep 15 11:51:29.048095 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:29.048082    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8373dee-d5a0-44d7-aabb-c4f0251ff0a3" path="/var/lib/kubelet/pods/c8373dee-d5a0-44d7-aabb-c4f0251ff0a3/volumes"
Sep 15 11:51:29.086834 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:29.086807    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/986147f2-accd-4bdd-a8df-c7e77b95251d-tls-certs\") pod \"986147f2-accd-4bdd-a8df-c7e77b95251d\" (UID: \"986147f2-accd-4bdd-a8df-c7e77b95251d\") "
Sep 15 11:51:29.086974 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:29.086845    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5927\" (UniqueName: \"kubernetes.io/projected/986147f2-accd-4bdd-a8df-c7e77b95251d-kube-api-access-c5927\") pod \"986147f2-accd-4bdd-a8df-c7e77b95251d\" (UID: \"986147f2-accd-4bdd-a8df-c7e77b95251d\") "
Sep 15 11:51:29.086974 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:29.086869    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/986147f2-accd-4bdd-a8df-c7e77b95251d-model-cache\") pod \"986147f2-accd-4bdd-a8df-c7e77b95251d\" (UID: \"986147f2-accd-4bdd-a8df-c7e77b95251d\") "
Sep 15 11:51:29.086974 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:29.086935    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/986147f2-accd-4bdd-a8df-c7e77b95251d-tmp-dir\") pod \"986147f2-accd-4bdd-a8df-c7e77b95251d\" (UID: \"986147f2-accd-4bdd-a8df-c7e77b95251d\") "
Sep 15 11:51:29.087140 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:29.087021    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/986147f2-accd-4bdd-a8df-c7e77b95251d-home\") pod \"986147f2-accd-4bdd-a8df-c7e77b95251d\" (UID: \"986147f2-accd-4bdd-a8df-c7e77b95251d\") "
Sep 15 11:51:29.087140 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:29.087069    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/986147f2-accd-4bdd-a8df-c7e77b95251d-dshm\") pod \"986147f2-accd-4bdd-a8df-c7e77b95251d\" (UID: \"986147f2-accd-4bdd-a8df-c7e77b95251d\") "
Sep 15 11:51:29.087269 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:29.087215    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/986147f2-accd-4bdd-a8df-c7e77b95251d-model-cache" (OuterVolumeSpecName: "model-cache") pod "986147f2-accd-4bdd-a8df-c7e77b95251d" (UID: "986147f2-accd-4bdd-a8df-c7e77b95251d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:29.087269 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:29.087233    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/986147f2-accd-4bdd-a8df-c7e77b95251d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "986147f2-accd-4bdd-a8df-c7e77b95251d" (UID: "986147f2-accd-4bdd-a8df-c7e77b95251d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:29.087368 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:29.087300    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/986147f2-accd-4bdd-a8df-c7e77b95251d-home" (OuterVolumeSpecName: "home") pod "986147f2-accd-4bdd-a8df-c7e77b95251d" (UID: "986147f2-accd-4bdd-a8df-c7e77b95251d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:29.087412 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:29.087377    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/986147f2-accd-4bdd-a8df-c7e77b95251d-tmp-dir\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:51:29.087412 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:29.087392    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/986147f2-accd-4bdd-a8df-c7e77b95251d-home\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:51:29.087412 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:29.087404    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/420c9a8c-59ed-498d-870f-66c92b9e3988-tls-certs\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:51:29.087512 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:29.087416    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/420c9a8c-59ed-498d-870f-66c92b9e3988-dshm\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:51:29.087512 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:29.087424    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jh7nx\" (UniqueName: \"kubernetes.io/projected/420c9a8c-59ed-498d-870f-66c92b9e3988-kube-api-access-jh7nx\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:51:29.087512 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:29.087433    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/986147f2-accd-4bdd-a8df-c7e77b95251d-model-cache\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:51:29.089311 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:29.089288    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/986147f2-accd-4bdd-a8df-c7e77b95251d-dshm" (OuterVolumeSpecName: "dshm") pod "986147f2-accd-4bdd-a8df-c7e77b95251d" (UID: "986147f2-accd-4bdd-a8df-c7e77b95251d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:29.089572 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:29.089546    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/986147f2-accd-4bdd-a8df-c7e77b95251d-kube-api-access-c5927" (OuterVolumeSpecName: "kube-api-access-c5927") pod "986147f2-accd-4bdd-a8df-c7e77b95251d" (UID: "986147f2-accd-4bdd-a8df-c7e77b95251d"). InnerVolumeSpecName "kube-api-access-c5927". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:51:29.089662 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:29.089595    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/986147f2-accd-4bdd-a8df-c7e77b95251d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "986147f2-accd-4bdd-a8df-c7e77b95251d" (UID: "986147f2-accd-4bdd-a8df-c7e77b95251d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:51:29.188901 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:29.188873    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/986147f2-accd-4bdd-a8df-c7e77b95251d-tls-certs\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:51:29.188901 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:29.188899    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5927\" (UniqueName: \"kubernetes.io/projected/986147f2-accd-4bdd-a8df-c7e77b95251d-kube-api-access-c5927\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:51:29.188901 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:29.188908    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/986147f2-accd-4bdd-a8df-c7e77b95251d-dshm\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:51:29.370197 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:29.370095    2582 generic.go:356] "Generic (PLEG): container finished" podID="420c9a8c-59ed-498d-870f-66c92b9e3988" containerID="6a6ccc2b555308f309fe57f72e1b96d399e7327b45fa7ff4f1d8268465187bbc" exitCode=0
Sep 15 11:51:29.370197 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:29.370143    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-9bd868/distinct-w0-9bd868-kserve-55775549cd-tk79v"
Sep 15 11:51:29.370717 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:29.370197    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-9bd868/distinct-w0-9bd868-kserve-55775549cd-tk79v" event={"ID":"420c9a8c-59ed-498d-870f-66c92b9e3988","Type":"ContainerDied","Data":"6a6ccc2b555308f309fe57f72e1b96d399e7327b45fa7ff4f1d8268465187bbc"}
Sep 15 11:51:29.370717 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:29.370245    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-9bd868/distinct-w0-9bd868-kserve-55775549cd-tk79v" event={"ID":"420c9a8c-59ed-498d-870f-66c92b9e3988","Type":"ContainerDied","Data":"b3c5d6f9069158e458f6ec5539dd0aca3611ce04391f2318c0bbeb222f67db6a"}
Sep 15 11:51:29.370717 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:29.370266    2582 scope.go:117] "RemoveContainer" containerID="6a6ccc2b555308f309fe57f72e1b96d399e7327b45fa7ff4f1d8268465187bbc"
Sep 15 11:51:29.371718 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:29.371692    2582 generic.go:356] "Generic (PLEG): container finished" podID="986147f2-accd-4bdd-a8df-c7e77b95251d" containerID="a55af05f4338caac31258a1e7ef4bbace1ded090bc1e9c5dc9269a1e17a0d683" exitCode=0
Sep 15 11:51:29.371815 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:29.371737    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-9bd868/premium-w0-9bd868-kserve-855494d7c5-7tqxc"
Sep 15 11:51:29.371815 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:29.371757    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-9bd868/premium-w0-9bd868-kserve-855494d7c5-7tqxc" event={"ID":"986147f2-accd-4bdd-a8df-c7e77b95251d","Type":"ContainerDied","Data":"a55af05f4338caac31258a1e7ef4bbace1ded090bc1e9c5dc9269a1e17a0d683"}
Sep 15 11:51:29.371943 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:29.371847    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-9bd868/premium-w0-9bd868-kserve-855494d7c5-7tqxc" event={"ID":"986147f2-accd-4bdd-a8df-c7e77b95251d","Type":"ContainerDied","Data":"0077724edf464d0fee957df1a4421f5dff517afa46f36d556dcde83213f5fe8a"}
Sep 15 11:51:29.379788 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:29.379771    2582 scope.go:117] "RemoveContainer" containerID="6a6ccc2b555308f309fe57f72e1b96d399e7327b45fa7ff4f1d8268465187bbc"
Sep 15 11:51:29.380154 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:51:29.380085    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a6ccc2b555308f309fe57f72e1b96d399e7327b45fa7ff4f1d8268465187bbc\": container with ID starting with 6a6ccc2b555308f309fe57f72e1b96d399e7327b45fa7ff4f1d8268465187bbc not found: ID does not exist" containerID="6a6ccc2b555308f309fe57f72e1b96d399e7327b45fa7ff4f1d8268465187bbc"
Sep 15 11:51:29.380154 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:29.380117    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a6ccc2b555308f309fe57f72e1b96d399e7327b45fa7ff4f1d8268465187bbc"} err="failed to get container status \"6a6ccc2b555308f309fe57f72e1b96d399e7327b45fa7ff4f1d8268465187bbc\": rpc error: code = NotFound desc = could not find container \"6a6ccc2b555308f309fe57f72e1b96d399e7327b45fa7ff4f1d8268465187bbc\": container with ID starting with 6a6ccc2b555308f309fe57f72e1b96d399e7327b45fa7ff4f1d8268465187bbc not found: ID does not exist"
Sep 15 11:51:29.380154 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:29.380141    2582 scope.go:117] "RemoveContainer" containerID="a55af05f4338caac31258a1e7ef4bbace1ded090bc1e9c5dc9269a1e17a0d683"
Sep 15 11:51:29.388976 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:29.388953    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-9bd868/distinct-w0-9bd868-kserve-55775549cd-tk79v"]
Sep 15 11:51:29.389397 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:29.389375    2582 scope.go:117] "RemoveContainer" containerID="a55af05f4338caac31258a1e7ef4bbace1ded090bc1e9c5dc9269a1e17a0d683"
Sep 15 11:51:29.389650 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:51:29.389634    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a55af05f4338caac31258a1e7ef4bbace1ded090bc1e9c5dc9269a1e17a0d683\": container with ID starting with a55af05f4338caac31258a1e7ef4bbace1ded090bc1e9c5dc9269a1e17a0d683 not found: ID does not exist" containerID="a55af05f4338caac31258a1e7ef4bbace1ded090bc1e9c5dc9269a1e17a0d683"
Sep 15 11:51:29.389699 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:29.389655    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a55af05f4338caac31258a1e7ef4bbace1ded090bc1e9c5dc9269a1e17a0d683"} err="failed to get container status \"a55af05f4338caac31258a1e7ef4bbace1ded090bc1e9c5dc9269a1e17a0d683\": rpc error: code = NotFound desc = could not find container \"a55af05f4338caac31258a1e7ef4bbace1ded090bc1e9c5dc9269a1e17a0d683\": container with ID starting with a55af05f4338caac31258a1e7ef4bbace1ded090bc1e9c5dc9269a1e17a0d683 not found: ID does not exist"
Sep 15 11:51:29.395080 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:29.395056    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-9bd868/distinct-w0-9bd868-kserve-55775549cd-tk79v"]
Sep 15 11:51:29.407698 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:29.407676    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-9bd868/premium-w0-9bd868-kserve-855494d7c5-7tqxc"]
Sep 15 11:51:29.411683 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:29.411664    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-9bd868/premium-w0-9bd868-kserve-855494d7c5-7tqxc"]
Sep 15 11:51:31.047271 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:31.047236    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="420c9a8c-59ed-498d-870f-66c92b9e3988" path="/var/lib/kubelet/pods/420c9a8c-59ed-498d-870f-66c92b9e3988/volumes"
Sep 15 11:51:31.047809 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:31.047789    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="986147f2-accd-4bdd-a8df-c7e77b95251d" path="/var/lib/kubelet/pods/986147f2-accd-4bdd-a8df-c7e77b95251d/volumes"
Sep 15 11:51:46.366740 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:46.366693    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8"]
Sep 15 11:51:46.367233 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:46.366998    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8" podUID="da1f59af-2436-4093-b837-e1300e06e4d5" containerName="maas-api" containerID="cri-o://a4ebe3b277deae12b7c4c96040c86993fb1927ebc4bea7d6760d9bd2aae79530" gracePeriod=30
Sep 15 11:51:46.424796 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:46.424761    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4-5khg8"]
Sep 15 11:51:46.425073 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:46.425025    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4-5khg8" podUID="d882ee84-8869-4f98-9271-e19884db2937" containerName="payload-pre-processing" containerID="cri-o://9057befbc88d90d07f07ce4c8435eb20a293370469838958f169e4205ee5a775" gracePeriod=30
Sep 15 11:51:46.690677 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:46.690650    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8"
Sep 15 11:51:46.729731 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:46.729706    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4-5khg8"
Sep 15 11:51:46.744756 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:46.744730    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da1f59af-2436-4093-b837-e1300e06e4d5-metrics-certs\") pod \"da1f59af-2436-4093-b837-e1300e06e4d5\" (UID: \"da1f59af-2436-4093-b837-e1300e06e4d5\") "
Sep 15 11:51:46.744756 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:46.744756    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da1f59af-2436-4093-b837-e1300e06e4d5-maas-api-tls\") pod \"da1f59af-2436-4093-b837-e1300e06e4d5\" (UID: \"da1f59af-2436-4093-b837-e1300e06e4d5\") "
Sep 15 11:51:46.744928 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:46.744835    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da1f59af-2436-4093-b837-e1300e06e4d5-openshift-service-ca\") pod \"da1f59af-2436-4093-b837-e1300e06e4d5\" (UID: \"da1f59af-2436-4093-b837-e1300e06e4d5\") "
Sep 15 11:51:46.744928 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:46.744876    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22wmb\" (UniqueName: \"kubernetes.io/projected/da1f59af-2436-4093-b837-e1300e06e4d5-kube-api-access-22wmb\") pod \"da1f59af-2436-4093-b837-e1300e06e4d5\" (UID: \"da1f59af-2436-4093-b837-e1300e06e4d5\") "
Sep 15 11:51:46.745242 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:46.745215    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da1f59af-2436-4093-b837-e1300e06e4d5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "da1f59af-2436-4093-b837-e1300e06e4d5" (UID: "da1f59af-2436-4093-b837-e1300e06e4d5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:51:46.745431 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:46.745368    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da1f59af-2436-4093-b837-e1300e06e4d5-openshift-service-ca\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:51:46.747614 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:46.747576    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da1f59af-2436-4093-b837-e1300e06e4d5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "da1f59af-2436-4093-b837-e1300e06e4d5" (UID: "da1f59af-2436-4093-b837-e1300e06e4d5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:51:46.747934 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:46.747897    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da1f59af-2436-4093-b837-e1300e06e4d5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "da1f59af-2436-4093-b837-e1300e06e4d5" (UID: "da1f59af-2436-4093-b837-e1300e06e4d5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:51:46.748069 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:46.748045    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da1f59af-2436-4093-b837-e1300e06e4d5-kube-api-access-22wmb" (OuterVolumeSpecName: "kube-api-access-22wmb") pod "da1f59af-2436-4093-b837-e1300e06e4d5" (UID: "da1f59af-2436-4093-b837-e1300e06e4d5"). InnerVolumeSpecName "kube-api-access-22wmb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:51:46.846163 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:46.846128    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2j6kb\" (UniqueName: \"kubernetes.io/projected/d882ee84-8869-4f98-9271-e19884db2937-kube-api-access-2j6kb\") pod \"d882ee84-8869-4f98-9271-e19884db2937\" (UID: \"d882ee84-8869-4f98-9271-e19884db2937\") "
Sep 15 11:51:46.846163 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:46.846192    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d882ee84-8869-4f98-9271-e19884db2937-plugins-config-volume\") pod \"d882ee84-8869-4f98-9271-e19884db2937\" (UID: \"d882ee84-8869-4f98-9271-e19884db2937\") "
Sep 15 11:51:46.846449 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:46.846421    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22wmb\" (UniqueName: \"kubernetes.io/projected/da1f59af-2436-4093-b837-e1300e06e4d5-kube-api-access-22wmb\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:51:46.846449 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:46.846447    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da1f59af-2436-4093-b837-e1300e06e4d5-metrics-certs\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:51:46.846649 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:46.846461    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da1f59af-2436-4093-b837-e1300e06e4d5-maas-api-tls\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:51:46.846649 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:46.846568    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d882ee84-8869-4f98-9271-e19884db2937-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d882ee84-8869-4f98-9271-e19884db2937" (UID: "d882ee84-8869-4f98-9271-e19884db2937"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:51:46.848444 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:46.848421    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d882ee84-8869-4f98-9271-e19884db2937-kube-api-access-2j6kb" (OuterVolumeSpecName: "kube-api-access-2j6kb") pod "d882ee84-8869-4f98-9271-e19884db2937" (UID: "d882ee84-8869-4f98-9271-e19884db2937"). InnerVolumeSpecName "kube-api-access-2j6kb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:51:46.947246 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:46.947136    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2j6kb\" (UniqueName: \"kubernetes.io/projected/d882ee84-8869-4f98-9271-e19884db2937-kube-api-access-2j6kb\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:51:46.947246 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:46.947206    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d882ee84-8869-4f98-9271-e19884db2937-plugins-config-volume\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:51:47.475161 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:47.475123    2582 generic.go:356] "Generic (PLEG): container finished" podID="d882ee84-8869-4f98-9271-e19884db2937" containerID="9057befbc88d90d07f07ce4c8435eb20a293370469838958f169e4205ee5a775" exitCode=0
Sep 15 11:51:47.475622 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:47.475170    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4-5khg8"
Sep 15 11:51:47.475622 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:47.475211    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4-5khg8" event={"ID":"d882ee84-8869-4f98-9271-e19884db2937","Type":"ContainerDied","Data":"9057befbc88d90d07f07ce4c8435eb20a293370469838958f169e4205ee5a775"}
Sep 15 11:51:47.475622 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:47.475272    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4-5khg8" event={"ID":"d882ee84-8869-4f98-9271-e19884db2937","Type":"ContainerDied","Data":"596a189e185a1a57ccf649f6fb75fb8870535ea65797e82bc890b847c47f2a60"}
Sep 15 11:51:47.475622 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:47.475303    2582 scope.go:117] "RemoveContainer" containerID="9057befbc88d90d07f07ce4c8435eb20a293370469838958f169e4205ee5a775"
Sep 15 11:51:47.476863 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:47.476800    2582 generic.go:356] "Generic (PLEG): container finished" podID="da1f59af-2436-4093-b837-e1300e06e4d5" containerID="a4ebe3b277deae12b7c4c96040c86993fb1927ebc4bea7d6760d9bd2aae79530" exitCode=0
Sep 15 11:51:47.476863 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:47.476849    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8"
Sep 15 11:51:47.477008 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:47.476905    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8" event={"ID":"da1f59af-2436-4093-b837-e1300e06e4d5","Type":"ContainerDied","Data":"a4ebe3b277deae12b7c4c96040c86993fb1927ebc4bea7d6760d9bd2aae79530"}
Sep 15 11:51:47.477008 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:47.476959    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8" event={"ID":"da1f59af-2436-4093-b837-e1300e06e4d5","Type":"ContainerDied","Data":"b191873b3ca058e7bb7e1144db80bdeccd4eeae30be4063efac65f6b09e351a1"}
Sep 15 11:51:47.485254 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:47.485234    2582 scope.go:117] "RemoveContainer" containerID="9057befbc88d90d07f07ce4c8435eb20a293370469838958f169e4205ee5a775"
Sep 15 11:51:47.485543 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:51:47.485525    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9057befbc88d90d07f07ce4c8435eb20a293370469838958f169e4205ee5a775\": container with ID starting with 9057befbc88d90d07f07ce4c8435eb20a293370469838958f169e4205ee5a775 not found: ID does not exist" containerID="9057befbc88d90d07f07ce4c8435eb20a293370469838958f169e4205ee5a775"
Sep 15 11:51:47.485614 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:47.485550    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9057befbc88d90d07f07ce4c8435eb20a293370469838958f169e4205ee5a775"} err="failed to get container status \"9057befbc88d90d07f07ce4c8435eb20a293370469838958f169e4205ee5a775\": rpc error: code = NotFound desc = could not find container \"9057befbc88d90d07f07ce4c8435eb20a293370469838958f169e4205ee5a775\": container with ID starting with 9057befbc88d90d07f07ce4c8435eb20a293370469838958f169e4205ee5a775 not found: ID does not exist"
Sep 15 11:51:47.485614 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:47.485565    2582 scope.go:117] "RemoveContainer" containerID="a4ebe3b277deae12b7c4c96040c86993fb1927ebc4bea7d6760d9bd2aae79530"
Sep 15 11:51:47.493145 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:47.493124    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4-5khg8"]
Sep 15 11:51:47.495509 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:47.495475    2582 scope.go:117] "RemoveContainer" containerID="a4ebe3b277deae12b7c4c96040c86993fb1927ebc4bea7d6760d9bd2aae79530"
Sep 15 11:51:47.496291 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:51:47.496231    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4ebe3b277deae12b7c4c96040c86993fb1927ebc4bea7d6760d9bd2aae79530\": container with ID starting with a4ebe3b277deae12b7c4c96040c86993fb1927ebc4bea7d6760d9bd2aae79530 not found: ID does not exist" containerID="a4ebe3b277deae12b7c4c96040c86993fb1927ebc4bea7d6760d9bd2aae79530"
Sep 15 11:51:47.496405 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:47.496302    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4ebe3b277deae12b7c4c96040c86993fb1927ebc4bea7d6760d9bd2aae79530"} err="failed to get container status \"a4ebe3b277deae12b7c4c96040c86993fb1927ebc4bea7d6760d9bd2aae79530\": rpc error: code = NotFound desc = could not find container \"a4ebe3b277deae12b7c4c96040c86993fb1927ebc4bea7d6760d9bd2aae79530\": container with ID starting with a4ebe3b277deae12b7c4c96040c86993fb1927ebc4bea7d6760d9bd2aae79530 not found: ID does not exist"
Sep 15 11:51:47.498123 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:47.498104    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4-5khg8"]
Sep 15 11:51:47.534609 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:47.534579    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8"]
Sep 15 11:51:47.556078 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:47.556049    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-01611d-5f7cb46b-dw5t8"]
Sep 15 11:51:49.045657 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:49.045623    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d882ee84-8869-4f98-9271-e19884db2937" path="/var/lib/kubelet/pods/d882ee84-8869-4f98-9271-e19884db2937/volumes"
Sep 15 11:51:49.046039 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:51:49.045996    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da1f59af-2436-4093-b837-e1300e06e4d5" path="/var/lib/kubelet/pods/da1f59af-2436-4093-b837-e1300e06e4d5/volumes"
Sep 15 11:52:04.325388 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:04.325340    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm"]
Sep 15 11:52:04.325863 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:04.325583    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm" podUID="bbf2755a-fff4-449f-b9c3-718febae5f0a" containerName="maas-api" containerID="cri-o://a2895cf0bee05bb86cf8aa469bb21db542ae4574a3528c7215cfd43b9de3da8b" gracePeriod=30
Sep 15 11:52:04.383434 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:04.383396    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675-fsnq5"]
Sep 15 11:52:04.383672 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:04.383647    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675-fsnq5" podUID="1f9cfa29-2d35-437c-81b8-d4ec64fed1f4" containerName="payload-processing" containerID="cri-o://b4668644816a215a81ae44ee0d0244a36ff1168d2b27fc52b69508f2bf3b6a0e" gracePeriod=30
Sep 15 11:52:04.565364 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:04.565319    2582 generic.go:356] "Generic (PLEG): container finished" podID="1f9cfa29-2d35-437c-81b8-d4ec64fed1f4" containerID="b4668644816a215a81ae44ee0d0244a36ff1168d2b27fc52b69508f2bf3b6a0e" exitCode=0
Sep 15 11:52:04.565552 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:04.565478    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675-fsnq5" event={"ID":"1f9cfa29-2d35-437c-81b8-d4ec64fed1f4","Type":"ContainerDied","Data":"b4668644816a215a81ae44ee0d0244a36ff1168d2b27fc52b69508f2bf3b6a0e"}
Sep 15 11:52:04.567522 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:04.567444    2582 generic.go:356] "Generic (PLEG): container finished" podID="bbf2755a-fff4-449f-b9c3-718febae5f0a" containerID="a2895cf0bee05bb86cf8aa469bb21db542ae4574a3528c7215cfd43b9de3da8b" exitCode=0
Sep 15 11:52:04.567732 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:04.567624    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm" event={"ID":"bbf2755a-fff4-449f-b9c3-718febae5f0a","Type":"ContainerDied","Data":"a2895cf0bee05bb86cf8aa469bb21db542ae4574a3528c7215cfd43b9de3da8b"}
Sep 15 11:52:04.641443 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:04.638912    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm"
Sep 15 11:52:04.678251 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:04.678224    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675-fsnq5"
Sep 15 11:52:04.711010 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:04.710978    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbf2755a-fff4-449f-b9c3-718febae5f0a-metrics-certs\") pod \"bbf2755a-fff4-449f-b9c3-718febae5f0a\" (UID: \"bbf2755a-fff4-449f-b9c3-718febae5f0a\") "
Sep 15 11:52:04.711224 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:04.711029    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7hl6\" (UniqueName: \"kubernetes.io/projected/bbf2755a-fff4-449f-b9c3-718febae5f0a-kube-api-access-z7hl6\") pod \"bbf2755a-fff4-449f-b9c3-718febae5f0a\" (UID: \"bbf2755a-fff4-449f-b9c3-718febae5f0a\") "
Sep 15 11:52:04.711224 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:04.711137    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbf2755a-fff4-449f-b9c3-718febae5f0a-maas-api-tls\") pod \"bbf2755a-fff4-449f-b9c3-718febae5f0a\" (UID: \"bbf2755a-fff4-449f-b9c3-718febae5f0a\") "
Sep 15 11:52:04.711224 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:04.711165    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbf2755a-fff4-449f-b9c3-718febae5f0a-openshift-service-ca\") pod \"bbf2755a-fff4-449f-b9c3-718febae5f0a\" (UID: \"bbf2755a-fff4-449f-b9c3-718febae5f0a\") "
Sep 15 11:52:04.711892 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:04.711865    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbf2755a-fff4-449f-b9c3-718febae5f0a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bbf2755a-fff4-449f-b9c3-718febae5f0a" (UID: "bbf2755a-fff4-449f-b9c3-718febae5f0a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:52:04.714422 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:04.714399    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbf2755a-fff4-449f-b9c3-718febae5f0a-kube-api-access-z7hl6" (OuterVolumeSpecName: "kube-api-access-z7hl6") pod "bbf2755a-fff4-449f-b9c3-718febae5f0a" (UID: "bbf2755a-fff4-449f-b9c3-718febae5f0a"). InnerVolumeSpecName "kube-api-access-z7hl6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:52:04.714681 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:04.714662    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbf2755a-fff4-449f-b9c3-718febae5f0a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "bbf2755a-fff4-449f-b9c3-718febae5f0a" (UID: "bbf2755a-fff4-449f-b9c3-718febae5f0a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:52:04.714830 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:04.714805    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbf2755a-fff4-449f-b9c3-718febae5f0a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bbf2755a-fff4-449f-b9c3-718febae5f0a" (UID: "bbf2755a-fff4-449f-b9c3-718febae5f0a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:52:04.812385 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:04.812346    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4mtd\" (UniqueName: \"kubernetes.io/projected/1f9cfa29-2d35-437c-81b8-d4ec64fed1f4-kube-api-access-q4mtd\") pod \"1f9cfa29-2d35-437c-81b8-d4ec64fed1f4\" (UID: \"1f9cfa29-2d35-437c-81b8-d4ec64fed1f4\") "
Sep 15 11:52:04.812591 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:04.812507    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f9cfa29-2d35-437c-81b8-d4ec64fed1f4-plugins-config-volume\") pod \"1f9cfa29-2d35-437c-81b8-d4ec64fed1f4\" (UID: \"1f9cfa29-2d35-437c-81b8-d4ec64fed1f4\") "
Sep 15 11:52:04.812785 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:04.812767    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbf2755a-fff4-449f-b9c3-718febae5f0a-maas-api-tls\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:52:04.812854 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:04.812793    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbf2755a-fff4-449f-b9c3-718febae5f0a-openshift-service-ca\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:52:04.812854 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:04.812810    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbf2755a-fff4-449f-b9c3-718febae5f0a-metrics-certs\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:52:04.812854 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:04.812825    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7hl6\" (UniqueName: \"kubernetes.io/projected/bbf2755a-fff4-449f-b9c3-718febae5f0a-kube-api-access-z7hl6\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:52:04.813006 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:04.812904    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f9cfa29-2d35-437c-81b8-d4ec64fed1f4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1f9cfa29-2d35-437c-81b8-d4ec64fed1f4" (UID: "1f9cfa29-2d35-437c-81b8-d4ec64fed1f4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:52:04.814723 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:04.814695    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f9cfa29-2d35-437c-81b8-d4ec64fed1f4-kube-api-access-q4mtd" (OuterVolumeSpecName: "kube-api-access-q4mtd") pod "1f9cfa29-2d35-437c-81b8-d4ec64fed1f4" (UID: "1f9cfa29-2d35-437c-81b8-d4ec64fed1f4"). InnerVolumeSpecName "kube-api-access-q4mtd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:52:04.913422 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:04.913380    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4mtd\" (UniqueName: \"kubernetes.io/projected/1f9cfa29-2d35-437c-81b8-d4ec64fed1f4-kube-api-access-q4mtd\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:52:04.913422 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:04.913421    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f9cfa29-2d35-437c-81b8-d4ec64fed1f4-plugins-config-volume\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:52:05.574766 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:05.574729    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675-fsnq5"
Sep 15 11:52:05.574766 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:05.574752    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675-fsnq5" event={"ID":"1f9cfa29-2d35-437c-81b8-d4ec64fed1f4","Type":"ContainerDied","Data":"ccc414104d5bf1e05649d196a18c5381031f8213daf561ce11a983239e384e82"}
Sep 15 11:52:05.575313 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:05.574812    2582 scope.go:117] "RemoveContainer" containerID="b4668644816a215a81ae44ee0d0244a36ff1168d2b27fc52b69508f2bf3b6a0e"
Sep 15 11:52:05.576361 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:05.576338    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm" event={"ID":"bbf2755a-fff4-449f-b9c3-718febae5f0a","Type":"ContainerDied","Data":"d69f86bc9b595ef208d5c70cffa9db62871c6b829e3c5e297be91745814a5e36"}
Sep 15 11:52:05.576584 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:05.576487    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm"
Sep 15 11:52:05.584744 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:05.584724    2582 scope.go:117] "RemoveContainer" containerID="a2895cf0bee05bb86cf8aa469bb21db542ae4574a3528c7215cfd43b9de3da8b"
Sep 15 11:52:05.594471 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:05.594451    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675-fsnq5"]
Sep 15 11:52:05.598323 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:05.598303    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675-fsnq5"]
Sep 15 11:52:05.608322 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:05.608301    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm"]
Sep 15 11:52:05.614046 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:05.614023    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4dbbbf-6bc66c6b96-d4ltm"]
Sep 15 11:52:07.045890 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:07.045860    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f9cfa29-2d35-437c-81b8-d4ec64fed1f4" path="/var/lib/kubelet/pods/1f9cfa29-2d35-437c-81b8-d4ec64fed1f4/volumes"
Sep 15 11:52:07.046294 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:07.046259    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbf2755a-fff4-449f-b9c3-718febae5f0a" path="/var/lib/kubelet/pods/bbf2755a-fff4-449f-b9c3-718febae5f0a/volumes"
Sep 15 11:52:12.908589 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:12.908479    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp"]
Sep 15 11:52:12.909041 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:12.908738    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp" podUID="f3974675-5456-411d-9c30-8ac97e9268ca" containerName="maas-api" containerID="cri-o://1e86c930a2ad740df780204d880a6e21c7a3ac0243db3963139091ccbcbdb828" gracePeriod=30
Sep 15 11:52:12.961154 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:12.961124    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c-qgvnp"]
Sep 15 11:52:12.961352 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:12.961329    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c-qgvnp" podUID="f18e0f20-d7e5-46e7-ac0f-640e28178581" containerName="payload-processing" containerID="cri-o://1d0bd03e647cb7fc7302494e93dbf05a801ce988974482c0ab7b8a469fb163f5" gracePeriod=30
Sep 15 11:52:12.969790 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:12.969762    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd-slfsh"]
Sep 15 11:52:12.970554 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:12.970372    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd-slfsh" podUID="1fdb0221-ff8d-4fd0-a87d-c9f32e2041b5" containerName="payload-pre-processing" containerID="cri-o://e006fbec1f6ec80a13f2e57a1e8e088250ae9177c2e1c7d3ce8916df4cdcafbe" gracePeriod=30
Sep 15 11:52:13.271420 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.271392    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c-qgvnp"
Sep 15 11:52:13.273812 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.273786    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd-slfsh"
Sep 15 11:52:13.353947 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.353912    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp"
Sep 15 11:52:13.390277 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.390249    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmvg6\" (UniqueName: \"kubernetes.io/projected/f18e0f20-d7e5-46e7-ac0f-640e28178581-kube-api-access-lmvg6\") pod \"f18e0f20-d7e5-46e7-ac0f-640e28178581\" (UID: \"f18e0f20-d7e5-46e7-ac0f-640e28178581\") "
Sep 15 11:52:13.390447 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.390296    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f18e0f20-d7e5-46e7-ac0f-640e28178581-plugins-config-volume\") pod \"f18e0f20-d7e5-46e7-ac0f-640e28178581\" (UID: \"f18e0f20-d7e5-46e7-ac0f-640e28178581\") "
Sep 15 11:52:13.390447 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.390331    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jzm9\" (UniqueName: \"kubernetes.io/projected/1fdb0221-ff8d-4fd0-a87d-c9f32e2041b5-kube-api-access-5jzm9\") pod \"1fdb0221-ff8d-4fd0-a87d-c9f32e2041b5\" (UID: \"1fdb0221-ff8d-4fd0-a87d-c9f32e2041b5\") "
Sep 15 11:52:13.390447 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.390355    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fdb0221-ff8d-4fd0-a87d-c9f32e2041b5-plugins-config-volume\") pod \"1fdb0221-ff8d-4fd0-a87d-c9f32e2041b5\" (UID: \"1fdb0221-ff8d-4fd0-a87d-c9f32e2041b5\") "
Sep 15 11:52:13.390777 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.390751    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f18e0f20-d7e5-46e7-ac0f-640e28178581-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f18e0f20-d7e5-46e7-ac0f-640e28178581" (UID: "f18e0f20-d7e5-46e7-ac0f-640e28178581"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:52:13.390933 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.390769    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fdb0221-ff8d-4fd0-a87d-c9f32e2041b5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1fdb0221-ff8d-4fd0-a87d-c9f32e2041b5" (UID: "1fdb0221-ff8d-4fd0-a87d-c9f32e2041b5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:52:13.392566 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.392540    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fdb0221-ff8d-4fd0-a87d-c9f32e2041b5-kube-api-access-5jzm9" (OuterVolumeSpecName: "kube-api-access-5jzm9") pod "1fdb0221-ff8d-4fd0-a87d-c9f32e2041b5" (UID: "1fdb0221-ff8d-4fd0-a87d-c9f32e2041b5"). InnerVolumeSpecName "kube-api-access-5jzm9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:52:13.392712 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.392697    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f18e0f20-d7e5-46e7-ac0f-640e28178581-kube-api-access-lmvg6" (OuterVolumeSpecName: "kube-api-access-lmvg6") pod "f18e0f20-d7e5-46e7-ac0f-640e28178581" (UID: "f18e0f20-d7e5-46e7-ac0f-640e28178581"). InnerVolumeSpecName "kube-api-access-lmvg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:52:13.491216 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.491097    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtmfv\" (UniqueName: \"kubernetes.io/projected/f3974675-5456-411d-9c30-8ac97e9268ca-kube-api-access-gtmfv\") pod \"f3974675-5456-411d-9c30-8ac97e9268ca\" (UID: \"f3974675-5456-411d-9c30-8ac97e9268ca\") "
Sep 15 11:52:13.491216 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.491135    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3974675-5456-411d-9c30-8ac97e9268ca-metrics-certs\") pod \"f3974675-5456-411d-9c30-8ac97e9268ca\" (UID: \"f3974675-5456-411d-9c30-8ac97e9268ca\") "
Sep 15 11:52:13.491216 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.491158    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3974675-5456-411d-9c30-8ac97e9268ca-openshift-service-ca\") pod \"f3974675-5456-411d-9c30-8ac97e9268ca\" (UID: \"f3974675-5456-411d-9c30-8ac97e9268ca\") "
Sep 15 11:52:13.491505 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.491245    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3974675-5456-411d-9c30-8ac97e9268ca-maas-api-tls\") pod \"f3974675-5456-411d-9c30-8ac97e9268ca\" (UID: \"f3974675-5456-411d-9c30-8ac97e9268ca\") "
Sep 15 11:52:13.491657 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.491633    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jzm9\" (UniqueName: \"kubernetes.io/projected/1fdb0221-ff8d-4fd0-a87d-c9f32e2041b5-kube-api-access-5jzm9\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:52:13.491730 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.491643    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3974675-5456-411d-9c30-8ac97e9268ca-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f3974675-5456-411d-9c30-8ac97e9268ca" (UID: "f3974675-5456-411d-9c30-8ac97e9268ca"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:52:13.491730 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.491661    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fdb0221-ff8d-4fd0-a87d-c9f32e2041b5-plugins-config-volume\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:52:13.491730 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.491702    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmvg6\" (UniqueName: \"kubernetes.io/projected/f18e0f20-d7e5-46e7-ac0f-640e28178581-kube-api-access-lmvg6\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:52:13.491730 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.491718    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f18e0f20-d7e5-46e7-ac0f-640e28178581-plugins-config-volume\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:52:13.493498 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.493471    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3974675-5456-411d-9c30-8ac97e9268ca-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f3974675-5456-411d-9c30-8ac97e9268ca" (UID: "f3974675-5456-411d-9c30-8ac97e9268ca"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:52:13.493741 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.493726    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3974675-5456-411d-9c30-8ac97e9268ca-kube-api-access-gtmfv" (OuterVolumeSpecName: "kube-api-access-gtmfv") pod "f3974675-5456-411d-9c30-8ac97e9268ca" (UID: "f3974675-5456-411d-9c30-8ac97e9268ca"). InnerVolumeSpecName "kube-api-access-gtmfv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:52:13.494146 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.494121    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3974675-5456-411d-9c30-8ac97e9268ca-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f3974675-5456-411d-9c30-8ac97e9268ca" (UID: "f3974675-5456-411d-9c30-8ac97e9268ca"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:52:13.592845 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.592815    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3974675-5456-411d-9c30-8ac97e9268ca-maas-api-tls\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:52:13.592845 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.592842    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtmfv\" (UniqueName: \"kubernetes.io/projected/f3974675-5456-411d-9c30-8ac97e9268ca-kube-api-access-gtmfv\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:52:13.592845 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.592852    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3974675-5456-411d-9c30-8ac97e9268ca-metrics-certs\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:52:13.593090 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.592862    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3974675-5456-411d-9c30-8ac97e9268ca-openshift-service-ca\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:52:13.619598 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.619555    2582 generic.go:356] "Generic (PLEG): container finished" podID="1fdb0221-ff8d-4fd0-a87d-c9f32e2041b5" containerID="e006fbec1f6ec80a13f2e57a1e8e088250ae9177c2e1c7d3ce8916df4cdcafbe" exitCode=0
Sep 15 11:52:13.619598 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.619599    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd-slfsh"
Sep 15 11:52:13.619803 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.619616    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd-slfsh" event={"ID":"1fdb0221-ff8d-4fd0-a87d-c9f32e2041b5","Type":"ContainerDied","Data":"e006fbec1f6ec80a13f2e57a1e8e088250ae9177c2e1c7d3ce8916df4cdcafbe"}
Sep 15 11:52:13.619803 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.619685    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd-slfsh" event={"ID":"1fdb0221-ff8d-4fd0-a87d-c9f32e2041b5","Type":"ContainerDied","Data":"7da15ee77b096820d4835db6406e461fa2130cdc8f0d9343d83812f6377bdf55"}
Sep 15 11:52:13.619803 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.619715    2582 scope.go:117] "RemoveContainer" containerID="e006fbec1f6ec80a13f2e57a1e8e088250ae9177c2e1c7d3ce8916df4cdcafbe"
Sep 15 11:52:13.621170 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.621150    2582 generic.go:356] "Generic (PLEG): container finished" podID="f3974675-5456-411d-9c30-8ac97e9268ca" containerID="1e86c930a2ad740df780204d880a6e21c7a3ac0243db3963139091ccbcbdb828" exitCode=0
Sep 15 11:52:13.621267 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.621214    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp"
Sep 15 11:52:13.621267 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.621253    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp" event={"ID":"f3974675-5456-411d-9c30-8ac97e9268ca","Type":"ContainerDied","Data":"1e86c930a2ad740df780204d880a6e21c7a3ac0243db3963139091ccbcbdb828"}
Sep 15 11:52:13.621376 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.621294    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp" event={"ID":"f3974675-5456-411d-9c30-8ac97e9268ca","Type":"ContainerDied","Data":"0f7dfe9070141850e326b77ecb60f292d6459be4e1a4138f30867cd58635f0a2"}
Sep 15 11:52:13.623641 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.622872    2582 generic.go:356] "Generic (PLEG): container finished" podID="f18e0f20-d7e5-46e7-ac0f-640e28178581" containerID="1d0bd03e647cb7fc7302494e93dbf05a801ce988974482c0ab7b8a469fb163f5" exitCode=0
Sep 15 11:52:13.623641 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.622911    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c-qgvnp"
Sep 15 11:52:13.623641 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.622909    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c-qgvnp" event={"ID":"f18e0f20-d7e5-46e7-ac0f-640e28178581","Type":"ContainerDied","Data":"1d0bd03e647cb7fc7302494e93dbf05a801ce988974482c0ab7b8a469fb163f5"}
Sep 15 11:52:13.623641 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.623089    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c-qgvnp" event={"ID":"f18e0f20-d7e5-46e7-ac0f-640e28178581","Type":"ContainerDied","Data":"6bf58720015cac57eb1afa2d6dda766067964604ff3a482cc942b6a531edb0e4"}
Sep 15 11:52:13.629523 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.629503    2582 scope.go:117] "RemoveContainer" containerID="e006fbec1f6ec80a13f2e57a1e8e088250ae9177c2e1c7d3ce8916df4cdcafbe"
Sep 15 11:52:13.630249 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:52:13.629895    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e006fbec1f6ec80a13f2e57a1e8e088250ae9177c2e1c7d3ce8916df4cdcafbe\": container with ID starting with e006fbec1f6ec80a13f2e57a1e8e088250ae9177c2e1c7d3ce8916df4cdcafbe not found: ID does not exist" containerID="e006fbec1f6ec80a13f2e57a1e8e088250ae9177c2e1c7d3ce8916df4cdcafbe"
Sep 15 11:52:13.630249 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.629928    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e006fbec1f6ec80a13f2e57a1e8e088250ae9177c2e1c7d3ce8916df4cdcafbe"} err="failed to get container status \"e006fbec1f6ec80a13f2e57a1e8e088250ae9177c2e1c7d3ce8916df4cdcafbe\": rpc error: code = NotFound desc = could not find container \"e006fbec1f6ec80a13f2e57a1e8e088250ae9177c2e1c7d3ce8916df4cdcafbe\": container with ID starting with e006fbec1f6ec80a13f2e57a1e8e088250ae9177c2e1c7d3ce8916df4cdcafbe not found: ID does not exist"
Sep 15 11:52:13.630249 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.629949    2582 scope.go:117] "RemoveContainer" containerID="1e86c930a2ad740df780204d880a6e21c7a3ac0243db3963139091ccbcbdb828"
Sep 15 11:52:13.638742 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.638726    2582 scope.go:117] "RemoveContainer" containerID="1e86c930a2ad740df780204d880a6e21c7a3ac0243db3963139091ccbcbdb828"
Sep 15 11:52:13.638992 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:52:13.638975    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e86c930a2ad740df780204d880a6e21c7a3ac0243db3963139091ccbcbdb828\": container with ID starting with 1e86c930a2ad740df780204d880a6e21c7a3ac0243db3963139091ccbcbdb828 not found: ID does not exist" containerID="1e86c930a2ad740df780204d880a6e21c7a3ac0243db3963139091ccbcbdb828"
Sep 15 11:52:13.639057 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.639004    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e86c930a2ad740df780204d880a6e21c7a3ac0243db3963139091ccbcbdb828"} err="failed to get container status \"1e86c930a2ad740df780204d880a6e21c7a3ac0243db3963139091ccbcbdb828\": rpc error: code = NotFound desc = could not find container \"1e86c930a2ad740df780204d880a6e21c7a3ac0243db3963139091ccbcbdb828\": container with ID starting with 1e86c930a2ad740df780204d880a6e21c7a3ac0243db3963139091ccbcbdb828 not found: ID does not exist"
Sep 15 11:52:13.639057 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.639026    2582 scope.go:117] "RemoveContainer" containerID="1d0bd03e647cb7fc7302494e93dbf05a801ce988974482c0ab7b8a469fb163f5"
Sep 15 11:52:13.644650 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.644628    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd-slfsh"]
Sep 15 11:52:13.647462 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.647448    2582 scope.go:117] "RemoveContainer" containerID="1d0bd03e647cb7fc7302494e93dbf05a801ce988974482c0ab7b8a469fb163f5"
Sep 15 11:52:13.647708 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:52:13.647690    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d0bd03e647cb7fc7302494e93dbf05a801ce988974482c0ab7b8a469fb163f5\": container with ID starting with 1d0bd03e647cb7fc7302494e93dbf05a801ce988974482c0ab7b8a469fb163f5 not found: ID does not exist" containerID="1d0bd03e647cb7fc7302494e93dbf05a801ce988974482c0ab7b8a469fb163f5"
Sep 15 11:52:13.647773 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.647714    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d0bd03e647cb7fc7302494e93dbf05a801ce988974482c0ab7b8a469fb163f5"} err="failed to get container status \"1d0bd03e647cb7fc7302494e93dbf05a801ce988974482c0ab7b8a469fb163f5\": rpc error: code = NotFound desc = could not find container \"1d0bd03e647cb7fc7302494e93dbf05a801ce988974482c0ab7b8a469fb163f5\": container with ID starting with 1d0bd03e647cb7fc7302494e93dbf05a801ce988974482c0ab7b8a469fb163f5 not found: ID does not exist"
Sep 15 11:52:13.648302 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.648285    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd-slfsh"]
Sep 15 11:52:13.658746 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.658727    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp"]
Sep 15 11:52:13.665070 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.665041    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-2fab1f-7ffbb99f8b-htscp"]
Sep 15 11:52:13.677069 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.677015    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c-qgvnp"]
Sep 15 11:52:13.679797 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:13.679775    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c-qgvnp"]
Sep 15 11:52:15.044886 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:15.044851    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fdb0221-ff8d-4fd0-a87d-c9f32e2041b5" path="/var/lib/kubelet/pods/1fdb0221-ff8d-4fd0-a87d-c9f32e2041b5/volumes"
Sep 15 11:52:15.045288 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:15.045271    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f18e0f20-d7e5-46e7-ac0f-640e28178581" path="/var/lib/kubelet/pods/f18e0f20-d7e5-46e7-ac0f-640e28178581/volumes"
Sep 15 11:52:15.045637 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:52:15.045624    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3974675-5456-411d-9c30-8ac97e9268ca" path="/var/lib/kubelet/pods/f3974675-5456-411d-9c30-8ac97e9268ca/volumes"
Sep 15 11:53:15.174431 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.174393    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-26f1b0/sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx"]
Sep 15 11:53:15.174960 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.174893    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3974675-5456-411d-9c30-8ac97e9268ca" containerName="maas-api"
Sep 15 11:53:15.174960 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.174912    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3974675-5456-411d-9c30-8ac97e9268ca" containerName="maas-api"
Sep 15 11:53:15.174960 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.174930    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f18e0f20-d7e5-46e7-ac0f-640e28178581" containerName="payload-processing"
Sep 15 11:53:15.174960 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.174939    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f18e0f20-d7e5-46e7-ac0f-640e28178581" containerName="payload-processing"
Sep 15 11:53:15.174960 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.174951    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d882ee84-8869-4f98-9271-e19884db2937" containerName="payload-pre-processing"
Sep 15 11:53:15.174960 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.174959    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d882ee84-8869-4f98-9271-e19884db2937" containerName="payload-pre-processing"
Sep 15 11:53:15.175313 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.174969    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da1f59af-2436-4093-b837-e1300e06e4d5" containerName="maas-api"
Sep 15 11:53:15.175313 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.174978    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="da1f59af-2436-4093-b837-e1300e06e4d5" containerName="maas-api"
Sep 15 11:53:15.175313 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.174986    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbf2755a-fff4-449f-b9c3-718febae5f0a" containerName="maas-api"
Sep 15 11:53:15.175313 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.174995    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbf2755a-fff4-449f-b9c3-718febae5f0a" containerName="maas-api"
Sep 15 11:53:15.175313 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.175011    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="420c9a8c-59ed-498d-870f-66c92b9e3988" containerName="main"
Sep 15 11:53:15.175313 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.175020    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="420c9a8c-59ed-498d-870f-66c92b9e3988" containerName="main"
Sep 15 11:53:15.175313 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.175030    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f" containerName="maas-api"
Sep 15 11:53:15.175313 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.175038    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f" containerName="maas-api"
Sep 15 11:53:15.175313 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.175047    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8373dee-d5a0-44d7-aabb-c4f0251ff0a3" containerName="payload-processing"
Sep 15 11:53:15.175313 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.175056    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8373dee-d5a0-44d7-aabb-c4f0251ff0a3" containerName="payload-processing"
Sep 15 11:53:15.175313 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.175073    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f9cfa29-2d35-437c-81b8-d4ec64fed1f4" containerName="payload-processing"
Sep 15 11:53:15.175313 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.175081    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f9cfa29-2d35-437c-81b8-d4ec64fed1f4" containerName="payload-processing"
Sep 15 11:53:15.175313 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.175093    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f0af390-0021-4847-ae80-e475ffb9a708" containerName="payload-pre-processing"
Sep 15 11:53:15.175313 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.175103    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f0af390-0021-4847-ae80-e475ffb9a708" containerName="payload-pre-processing"
Sep 15 11:53:15.175313 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.175115    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fdb0221-ff8d-4fd0-a87d-c9f32e2041b5" containerName="payload-pre-processing"
Sep 15 11:53:15.175313 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.175124    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fdb0221-ff8d-4fd0-a87d-c9f32e2041b5" containerName="payload-pre-processing"
Sep 15 11:53:15.175313 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.175133    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="986147f2-accd-4bdd-a8df-c7e77b95251d" containerName="main"
Sep 15 11:53:15.175313 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.175141    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="986147f2-accd-4bdd-a8df-c7e77b95251d" containerName="main"
Sep 15 11:53:15.175313 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.175154    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a015fe1e-797c-4727-b49f-913fa1678de3" containerName="payload-pre-processing"
Sep 15 11:53:15.175313 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.175162    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a015fe1e-797c-4727-b49f-913fa1678de3" containerName="payload-pre-processing"
Sep 15 11:53:15.175313 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.175272    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8373dee-d5a0-44d7-aabb-c4f0251ff0a3" containerName="payload-processing"
Sep 15 11:53:15.175313 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.175284    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f18e0f20-d7e5-46e7-ac0f-640e28178581" containerName="payload-processing"
Sep 15 11:53:15.175313 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.175294    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="986147f2-accd-4bdd-a8df-c7e77b95251d" containerName="main"
Sep 15 11:53:15.175313 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.175304    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3974675-5456-411d-9c30-8ac97e9268ca" containerName="maas-api"
Sep 15 11:53:15.175313 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.175312    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f9cfa29-2d35-437c-81b8-d4ec64fed1f4" containerName="payload-processing"
Sep 15 11:53:15.175313 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.175320    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f0af390-0021-4847-ae80-e475ffb9a708" containerName="payload-pre-processing"
Sep 15 11:53:15.175313 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.175327    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="da1f59af-2436-4093-b837-e1300e06e4d5" containerName="maas-api"
Sep 15 11:53:15.176528 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.175336    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6d24b13-2c34-4ec8-8938-ce5a7fd65e9f" containerName="maas-api"
Sep 15 11:53:15.176528 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.175343    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="420c9a8c-59ed-498d-870f-66c92b9e3988" containerName="main"
Sep 15 11:53:15.176528 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.175351    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fdb0221-ff8d-4fd0-a87d-c9f32e2041b5" containerName="payload-pre-processing"
Sep 15 11:53:15.176528 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.175360    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a015fe1e-797c-4727-b49f-913fa1678de3" containerName="payload-pre-processing"
Sep 15 11:53:15.176528 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.175367    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d882ee84-8869-4f98-9271-e19884db2937" containerName="payload-pre-processing"
Sep 15 11:53:15.176528 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.175374    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbf2755a-fff4-449f-b9c3-718febae5f0a" containerName="maas-api"
Sep 15 11:53:15.178657 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.178636    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-26f1b0/sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx"
Sep 15 11:53:15.181798 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.181773    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-26f1b0\"/\"openshift-service-ca.crt\""
Sep 15 11:53:15.181928 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.181806    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-26f1b0\"/\"kube-root-ca.crt\""
Sep 15 11:53:15.181928 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.181777    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-26f1b0\"/\"sub-test-model-26f1b0-kserve-self-signed-certs\""
Sep 15 11:53:15.181928 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.181777    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-26f1b0\"/\"default-dockercfg-wm2v2\""
Sep 15 11:53:15.187078 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.187040    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-26f1b0/sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx"]
Sep 15 11:53:15.222371 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.222338    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a30f985d-e741-4912-a92f-12fada4c06ec-tmp-dir\") pod \"sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx\" (UID: \"a30f985d-e741-4912-a92f-12fada4c06ec\") " pod="ai-tenant-e2e-shared-a-w3-26f1b0/sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx"
Sep 15 11:53:15.222522 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.222383    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a30f985d-e741-4912-a92f-12fada4c06ec-dshm\") pod \"sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx\" (UID: \"a30f985d-e741-4912-a92f-12fada4c06ec\") " pod="ai-tenant-e2e-shared-a-w3-26f1b0/sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx"
Sep 15 11:53:15.222522 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.222412    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a30f985d-e741-4912-a92f-12fada4c06ec-home\") pod \"sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx\" (UID: \"a30f985d-e741-4912-a92f-12fada4c06ec\") " pod="ai-tenant-e2e-shared-a-w3-26f1b0/sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx"
Sep 15 11:53:15.222522 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.222505    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnqbh\" (UniqueName: \"kubernetes.io/projected/a30f985d-e741-4912-a92f-12fada4c06ec-kube-api-access-wnqbh\") pod \"sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx\" (UID: \"a30f985d-e741-4912-a92f-12fada4c06ec\") " pod="ai-tenant-e2e-shared-a-w3-26f1b0/sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx"
Sep 15 11:53:15.222692 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.222544    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a30f985d-e741-4912-a92f-12fada4c06ec-tls-certs\") pod \"sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx\" (UID: \"a30f985d-e741-4912-a92f-12fada4c06ec\") " pod="ai-tenant-e2e-shared-a-w3-26f1b0/sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx"
Sep 15 11:53:15.222692 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.222597    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a30f985d-e741-4912-a92f-12fada4c06ec-model-cache\") pod \"sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx\" (UID: \"a30f985d-e741-4912-a92f-12fada4c06ec\") " pod="ai-tenant-e2e-shared-a-w3-26f1b0/sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx"
Sep 15 11:53:15.323397 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.323360    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnqbh\" (UniqueName: \"kubernetes.io/projected/a30f985d-e741-4912-a92f-12fada4c06ec-kube-api-access-wnqbh\") pod \"sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx\" (UID: \"a30f985d-e741-4912-a92f-12fada4c06ec\") " pod="ai-tenant-e2e-shared-a-w3-26f1b0/sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx"
Sep 15 11:53:15.323397 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.323399    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a30f985d-e741-4912-a92f-12fada4c06ec-tls-certs\") pod \"sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx\" (UID: \"a30f985d-e741-4912-a92f-12fada4c06ec\") " pod="ai-tenant-e2e-shared-a-w3-26f1b0/sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx"
Sep 15 11:53:15.323661 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.323444    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a30f985d-e741-4912-a92f-12fada4c06ec-model-cache\") pod \"sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx\" (UID: \"a30f985d-e741-4912-a92f-12fada4c06ec\") " pod="ai-tenant-e2e-shared-a-w3-26f1b0/sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx"
Sep 15 11:53:15.323661 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.323485    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a30f985d-e741-4912-a92f-12fada4c06ec-tmp-dir\") pod \"sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx\" (UID: \"a30f985d-e741-4912-a92f-12fada4c06ec\") " pod="ai-tenant-e2e-shared-a-w3-26f1b0/sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx"
Sep 15 11:53:15.323661 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.323624    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a30f985d-e741-4912-a92f-12fada4c06ec-dshm\") pod \"sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx\" (UID: \"a30f985d-e741-4912-a92f-12fada4c06ec\") " pod="ai-tenant-e2e-shared-a-w3-26f1b0/sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx"
Sep 15 11:53:15.323817 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.323667    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a30f985d-e741-4912-a92f-12fada4c06ec-home\") pod \"sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx\" (UID: \"a30f985d-e741-4912-a92f-12fada4c06ec\") " pod="ai-tenant-e2e-shared-a-w3-26f1b0/sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx"
Sep 15 11:53:15.323895 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.323876    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a30f985d-e741-4912-a92f-12fada4c06ec-tmp-dir\") pod \"sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx\" (UID: \"a30f985d-e741-4912-a92f-12fada4c06ec\") " pod="ai-tenant-e2e-shared-a-w3-26f1b0/sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx"
Sep 15 11:53:15.323947 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.323916    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a30f985d-e741-4912-a92f-12fada4c06ec-model-cache\") pod \"sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx\" (UID: \"a30f985d-e741-4912-a92f-12fada4c06ec\") " pod="ai-tenant-e2e-shared-a-w3-26f1b0/sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx"
Sep 15 11:53:15.324006 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.323984    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a30f985d-e741-4912-a92f-12fada4c06ec-home\") pod \"sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx\" (UID: \"a30f985d-e741-4912-a92f-12fada4c06ec\") " pod="ai-tenant-e2e-shared-a-w3-26f1b0/sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx"
Sep 15 11:53:15.325850 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.325833    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a30f985d-e741-4912-a92f-12fada4c06ec-dshm\") pod \"sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx\" (UID: \"a30f985d-e741-4912-a92f-12fada4c06ec\") " pod="ai-tenant-e2e-shared-a-w3-26f1b0/sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx"
Sep 15 11:53:15.326126 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.326111    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a30f985d-e741-4912-a92f-12fada4c06ec-tls-certs\") pod \"sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx\" (UID: \"a30f985d-e741-4912-a92f-12fada4c06ec\") " pod="ai-tenant-e2e-shared-a-w3-26f1b0/sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx"
Sep 15 11:53:15.333797 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.333764    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnqbh\" (UniqueName: \"kubernetes.io/projected/a30f985d-e741-4912-a92f-12fada4c06ec-kube-api-access-wnqbh\") pod \"sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx\" (UID: \"a30f985d-e741-4912-a92f-12fada4c06ec\") " pod="ai-tenant-e2e-shared-a-w3-26f1b0/sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx"
Sep 15 11:53:15.490026 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.489937    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-26f1b0/sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx"
Sep 15 11:53:15.760608 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.760581    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-26f1b0/sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx"]
Sep 15 11:53:15.763433 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:53:15.763399    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda30f985d_e741_4912_a92f_12fada4c06ec.slice/crio-670673825b1c0e6473bba34cc50d8a0c3e3662a25f5b1cd2478f744054711cdc WatchSource:0}: Error finding container 670673825b1c0e6473bba34cc50d8a0c3e3662a25f5b1cd2478f744054711cdc: Status 404 returned error can't find the container with id 670673825b1c0e6473bba34cc50d8a0c3e3662a25f5b1cd2478f744054711cdc
Sep 15 11:53:15.915404 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.915371    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-26f1b0/sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx" event={"ID":"a30f985d-e741-4912-a92f-12fada4c06ec","Type":"ContainerStarted","Data":"f4077c9cefc036b5b22dbc721fc5b5f02e72122386fac45fdde81eeaa16270a5"}
Sep 15 11:53:15.915563 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.915420    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-26f1b0/sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx" event={"ID":"a30f985d-e741-4912-a92f-12fada4c06ec","Type":"ContainerStarted","Data":"670673825b1c0e6473bba34cc50d8a0c3e3662a25f5b1cd2478f744054711cdc"}
Sep 15 11:53:15.932046 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:15.931999    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-26f1b0/sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx" podStartSLOduration=0.931984219 podStartE2EDuration="931.984219ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:53:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:53:15.930243433 +0000 UTC m=+1675.392109488" watchObservedRunningTime="2026-09-15 11:53:15.931984219 +0000 UTC m=+1675.393850318"
Sep 15 11:53:25.490524 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:25.490488    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-26f1b0/sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx"
Sep 15 11:53:25.490932 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:25.490539    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-26f1b0/sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx"
Sep 15 11:53:25.502874 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:25.502845    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-26f1b0/sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx"
Sep 15 11:53:25.973151 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:53:25.973124    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-26f1b0/sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx"
Sep 15 11:54:37.576108 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:37.576065    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-26f1b0/sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx"]
Sep 15 11:54:52.603306 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:52.603256    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-26f1b0/sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx" podUID="a30f985d-e741-4912-a92f-12fada4c06ec" containerName="main" containerID="cri-o://f4077c9cefc036b5b22dbc721fc5b5f02e72122386fac45fdde81eeaa16270a5" gracePeriod=45
Sep 15 11:54:52.858358 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:52.858293    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-26f1b0/sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx"
Sep 15 11:54:52.872992 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:52.872964    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a30f985d-e741-4912-a92f-12fada4c06ec-dshm\") pod \"a30f985d-e741-4912-a92f-12fada4c06ec\" (UID: \"a30f985d-e741-4912-a92f-12fada4c06ec\") "
Sep 15 11:54:52.873132 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:52.873008    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a30f985d-e741-4912-a92f-12fada4c06ec-model-cache\") pod \"a30f985d-e741-4912-a92f-12fada4c06ec\" (UID: \"a30f985d-e741-4912-a92f-12fada4c06ec\") "
Sep 15 11:54:52.873132 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:52.873037    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnqbh\" (UniqueName: \"kubernetes.io/projected/a30f985d-e741-4912-a92f-12fada4c06ec-kube-api-access-wnqbh\") pod \"a30f985d-e741-4912-a92f-12fada4c06ec\" (UID: \"a30f985d-e741-4912-a92f-12fada4c06ec\") "
Sep 15 11:54:52.873132 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:52.873057    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a30f985d-e741-4912-a92f-12fada4c06ec-home\") pod \"a30f985d-e741-4912-a92f-12fada4c06ec\" (UID: \"a30f985d-e741-4912-a92f-12fada4c06ec\") "
Sep 15 11:54:52.873132 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:52.873079    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a30f985d-e741-4912-a92f-12fada4c06ec-tmp-dir\") pod \"a30f985d-e741-4912-a92f-12fada4c06ec\" (UID: \"a30f985d-e741-4912-a92f-12fada4c06ec\") "
Sep 15 11:54:52.873402 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:52.873382    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a30f985d-e741-4912-a92f-12fada4c06ec-home" (OuterVolumeSpecName: "home") pod "a30f985d-e741-4912-a92f-12fada4c06ec" (UID: "a30f985d-e741-4912-a92f-12fada4c06ec"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:54:52.873456 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:52.873399    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a30f985d-e741-4912-a92f-12fada4c06ec-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a30f985d-e741-4912-a92f-12fada4c06ec" (UID: "a30f985d-e741-4912-a92f-12fada4c06ec"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:54:52.873456 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:52.873406    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a30f985d-e741-4912-a92f-12fada4c06ec-model-cache" (OuterVolumeSpecName: "model-cache") pod "a30f985d-e741-4912-a92f-12fada4c06ec" (UID: "a30f985d-e741-4912-a92f-12fada4c06ec"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:54:52.875457 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:52.875432    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a30f985d-e741-4912-a92f-12fada4c06ec-dshm" (OuterVolumeSpecName: "dshm") pod "a30f985d-e741-4912-a92f-12fada4c06ec" (UID: "a30f985d-e741-4912-a92f-12fada4c06ec"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:54:52.875571 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:52.875557    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a30f985d-e741-4912-a92f-12fada4c06ec-kube-api-access-wnqbh" (OuterVolumeSpecName: "kube-api-access-wnqbh") pod "a30f985d-e741-4912-a92f-12fada4c06ec" (UID: "a30f985d-e741-4912-a92f-12fada4c06ec"). InnerVolumeSpecName "kube-api-access-wnqbh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:54:52.973626 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:52.973595    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a30f985d-e741-4912-a92f-12fada4c06ec-tls-certs\") pod \"a30f985d-e741-4912-a92f-12fada4c06ec\" (UID: \"a30f985d-e741-4912-a92f-12fada4c06ec\") "
Sep 15 11:54:52.973838 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:52.973791    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a30f985d-e741-4912-a92f-12fada4c06ec-dshm\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:54:52.973838 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:52.973803    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a30f985d-e741-4912-a92f-12fada4c06ec-model-cache\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:54:52.973838 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:52.973813    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnqbh\" (UniqueName: \"kubernetes.io/projected/a30f985d-e741-4912-a92f-12fada4c06ec-kube-api-access-wnqbh\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:54:52.973838 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:52.973820    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a30f985d-e741-4912-a92f-12fada4c06ec-home\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:54:52.973838 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:52.973828    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a30f985d-e741-4912-a92f-12fada4c06ec-tmp-dir\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:54:52.975852 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:52.975825    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a30f985d-e741-4912-a92f-12fada4c06ec-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a30f985d-e741-4912-a92f-12fada4c06ec" (UID: "a30f985d-e741-4912-a92f-12fada4c06ec"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:54:53.073990 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:53.073955    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-26f1b0/rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9"]
Sep 15 11:54:53.074338 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:53.074319    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a30f985d-e741-4912-a92f-12fada4c06ec-tls-certs\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:54:53.074394 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:53.074357    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a30f985d-e741-4912-a92f-12fada4c06ec" containerName="main"
Sep 15 11:54:53.074394 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:53.074374    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a30f985d-e741-4912-a92f-12fada4c06ec" containerName="main"
Sep 15 11:54:53.074480 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:53.074468    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a30f985d-e741-4912-a92f-12fada4c06ec" containerName="main"
Sep 15 11:54:53.077665 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:53.077647    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-26f1b0/rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9"
Sep 15 11:54:53.079987 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:53.079967    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-26f1b0\"/\"rate-test-model-26f1b0-kserve-self-signed-certs\""
Sep 15 11:54:53.085030 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:53.085006    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-26f1b0/rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9"]
Sep 15 11:54:53.175439 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:53.175402    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc56e637-2d95-434d-baab-9a178cd06326-home\") pod \"rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9\" (UID: \"fc56e637-2d95-434d-baab-9a178cd06326\") " pod="ai-tenant-e2e-shared-a-w3-26f1b0/rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9"
Sep 15 11:54:53.175439 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:53.175434    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc56e637-2d95-434d-baab-9a178cd06326-dshm\") pod \"rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9\" (UID: \"fc56e637-2d95-434d-baab-9a178cd06326\") " pod="ai-tenant-e2e-shared-a-w3-26f1b0/rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9"
Sep 15 11:54:53.175677 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:53.175457    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc56e637-2d95-434d-baab-9a178cd06326-model-cache\") pod \"rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9\" (UID: \"fc56e637-2d95-434d-baab-9a178cd06326\") " pod="ai-tenant-e2e-shared-a-w3-26f1b0/rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9"
Sep 15 11:54:53.175677 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:53.175483    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjllf\" (UniqueName: \"kubernetes.io/projected/fc56e637-2d95-434d-baab-9a178cd06326-kube-api-access-pjllf\") pod \"rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9\" (UID: \"fc56e637-2d95-434d-baab-9a178cd06326\") " pod="ai-tenant-e2e-shared-a-w3-26f1b0/rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9"
Sep 15 11:54:53.175677 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:53.175523    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc56e637-2d95-434d-baab-9a178cd06326-tls-certs\") pod \"rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9\" (UID: \"fc56e637-2d95-434d-baab-9a178cd06326\") " pod="ai-tenant-e2e-shared-a-w3-26f1b0/rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9"
Sep 15 11:54:53.175677 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:53.175588    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc56e637-2d95-434d-baab-9a178cd06326-tmp-dir\") pod \"rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9\" (UID: \"fc56e637-2d95-434d-baab-9a178cd06326\") " pod="ai-tenant-e2e-shared-a-w3-26f1b0/rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9"
Sep 15 11:54:53.275977 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:53.275943    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc56e637-2d95-434d-baab-9a178cd06326-home\") pod \"rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9\" (UID: \"fc56e637-2d95-434d-baab-9a178cd06326\") " pod="ai-tenant-e2e-shared-a-w3-26f1b0/rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9"
Sep 15 11:54:53.275977 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:53.275981    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc56e637-2d95-434d-baab-9a178cd06326-dshm\") pod \"rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9\" (UID: \"fc56e637-2d95-434d-baab-9a178cd06326\") " pod="ai-tenant-e2e-shared-a-w3-26f1b0/rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9"
Sep 15 11:54:53.276267 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:53.276001    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc56e637-2d95-434d-baab-9a178cd06326-model-cache\") pod \"rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9\" (UID: \"fc56e637-2d95-434d-baab-9a178cd06326\") " pod="ai-tenant-e2e-shared-a-w3-26f1b0/rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9"
Sep 15 11:54:53.276267 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:53.276019    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjllf\" (UniqueName: \"kubernetes.io/projected/fc56e637-2d95-434d-baab-9a178cd06326-kube-api-access-pjllf\") pod \"rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9\" (UID: \"fc56e637-2d95-434d-baab-9a178cd06326\") " pod="ai-tenant-e2e-shared-a-w3-26f1b0/rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9"
Sep 15 11:54:53.276267 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:53.276079    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc56e637-2d95-434d-baab-9a178cd06326-tls-certs\") pod \"rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9\" (UID: \"fc56e637-2d95-434d-baab-9a178cd06326\") " pod="ai-tenant-e2e-shared-a-w3-26f1b0/rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9"
Sep 15 11:54:53.276267 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:53.276150    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc56e637-2d95-434d-baab-9a178cd06326-tmp-dir\") pod \"rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9\" (UID: \"fc56e637-2d95-434d-baab-9a178cd06326\") " pod="ai-tenant-e2e-shared-a-w3-26f1b0/rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9"
Sep 15 11:54:53.276496 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:53.276429    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc56e637-2d95-434d-baab-9a178cd06326-home\") pod \"rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9\" (UID: \"fc56e637-2d95-434d-baab-9a178cd06326\") " pod="ai-tenant-e2e-shared-a-w3-26f1b0/rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9"
Sep 15 11:54:53.276561 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:53.276490    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc56e637-2d95-434d-baab-9a178cd06326-model-cache\") pod \"rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9\" (UID: \"fc56e637-2d95-434d-baab-9a178cd06326\") " pod="ai-tenant-e2e-shared-a-w3-26f1b0/rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9"
Sep 15 11:54:53.276561 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:53.276518    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc56e637-2d95-434d-baab-9a178cd06326-tmp-dir\") pod \"rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9\" (UID: \"fc56e637-2d95-434d-baab-9a178cd06326\") " pod="ai-tenant-e2e-shared-a-w3-26f1b0/rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9"
Sep 15 11:54:53.278436 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:53.278415    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc56e637-2d95-434d-baab-9a178cd06326-dshm\") pod \"rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9\" (UID: \"fc56e637-2d95-434d-baab-9a178cd06326\") " pod="ai-tenant-e2e-shared-a-w3-26f1b0/rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9"
Sep 15 11:54:53.278684 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:53.278665    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc56e637-2d95-434d-baab-9a178cd06326-tls-certs\") pod \"rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9\" (UID: \"fc56e637-2d95-434d-baab-9a178cd06326\") " pod="ai-tenant-e2e-shared-a-w3-26f1b0/rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9"
Sep 15 11:54:53.283797 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:53.283774    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjllf\" (UniqueName: \"kubernetes.io/projected/fc56e637-2d95-434d-baab-9a178cd06326-kube-api-access-pjllf\") pod \"rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9\" (UID: \"fc56e637-2d95-434d-baab-9a178cd06326\") " pod="ai-tenant-e2e-shared-a-w3-26f1b0/rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9"
Sep 15 11:54:53.359617 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:53.359586    2582 generic.go:356] "Generic (PLEG): container finished" podID="a30f985d-e741-4912-a92f-12fada4c06ec" containerID="f4077c9cefc036b5b22dbc721fc5b5f02e72122386fac45fdde81eeaa16270a5" exitCode=0
Sep 15 11:54:53.359817 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:53.359638    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-26f1b0/sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx"
Sep 15 11:54:53.359817 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:53.359680    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-26f1b0/sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx" event={"ID":"a30f985d-e741-4912-a92f-12fada4c06ec","Type":"ContainerDied","Data":"f4077c9cefc036b5b22dbc721fc5b5f02e72122386fac45fdde81eeaa16270a5"}
Sep 15 11:54:53.359817 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:53.359732    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-26f1b0/sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx" event={"ID":"a30f985d-e741-4912-a92f-12fada4c06ec","Type":"ContainerDied","Data":"670673825b1c0e6473bba34cc50d8a0c3e3662a25f5b1cd2478f744054711cdc"}
Sep 15 11:54:53.359817 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:53.359753    2582 scope.go:117] "RemoveContainer" containerID="f4077c9cefc036b5b22dbc721fc5b5f02e72122386fac45fdde81eeaa16270a5"
Sep 15 11:54:53.368535 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:53.368509    2582 scope.go:117] "RemoveContainer" containerID="f4077c9cefc036b5b22dbc721fc5b5f02e72122386fac45fdde81eeaa16270a5"
Sep 15 11:54:53.368813 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:54:53.368794    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4077c9cefc036b5b22dbc721fc5b5f02e72122386fac45fdde81eeaa16270a5\": container with ID starting with f4077c9cefc036b5b22dbc721fc5b5f02e72122386fac45fdde81eeaa16270a5 not found: ID does not exist" containerID="f4077c9cefc036b5b22dbc721fc5b5f02e72122386fac45fdde81eeaa16270a5"
Sep 15 11:54:53.368873 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:53.368822    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4077c9cefc036b5b22dbc721fc5b5f02e72122386fac45fdde81eeaa16270a5"} err="failed to get container status \"f4077c9cefc036b5b22dbc721fc5b5f02e72122386fac45fdde81eeaa16270a5\": rpc error: code = NotFound desc = could not find container \"f4077c9cefc036b5b22dbc721fc5b5f02e72122386fac45fdde81eeaa16270a5\": container with ID starting with f4077c9cefc036b5b22dbc721fc5b5f02e72122386fac45fdde81eeaa16270a5 not found: ID does not exist"
Sep 15 11:54:53.375320 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:53.375297    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-26f1b0/sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx"]
Sep 15 11:54:53.379212 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:53.379190    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-26f1b0/sub-test-model-26f1b0-kserve-7d457c8bbf-g66lx"]
Sep 15 11:54:53.387568 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:53.387547    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-26f1b0/rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9"
Sep 15 11:54:53.661282 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:53.661155    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-26f1b0/rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9"]
Sep 15 11:54:53.663563 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:54:53.663535    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc56e637_2d95_434d_baab_9a178cd06326.slice/crio-7736486cda4a416944e18f269ff1c933cd41c91027b769839bb3769311f9a6a5 WatchSource:0}: Error finding container 7736486cda4a416944e18f269ff1c933cd41c91027b769839bb3769311f9a6a5: Status 404 returned error can't find the container with id 7736486cda4a416944e18f269ff1c933cd41c91027b769839bb3769311f9a6a5
Sep 15 11:54:54.366427 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:54.366392    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-26f1b0/rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9" event={"ID":"fc56e637-2d95-434d-baab-9a178cd06326","Type":"ContainerStarted","Data":"9c6d2af2812470f3a4cded512653cab418df9ec612401012cee26261914df7e0"}
Sep 15 11:54:54.366427 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:54.366433    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-26f1b0/rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9" event={"ID":"fc56e637-2d95-434d-baab-9a178cd06326","Type":"ContainerStarted","Data":"7736486cda4a416944e18f269ff1c933cd41c91027b769839bb3769311f9a6a5"}
Sep 15 11:54:54.382854 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:54.382791    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-26f1b0/rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9" podStartSLOduration=1.382773888 podStartE2EDuration="1.382773888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:54:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:54:54.380808156 +0000 UTC m=+1773.842674210" watchObservedRunningTime="2026-09-15 11:54:54.382773888 +0000 UTC m=+1773.844639972"
Sep 15 11:54:55.044892 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:54:55.044857    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a30f985d-e741-4912-a92f-12fada4c06ec" path="/var/lib/kubelet/pods/a30f985d-e741-4912-a92f-12fada4c06ec/volumes"
Sep 15 11:55:03.388400 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:55:03.388365    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-26f1b0/rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9"
Sep 15 11:55:03.388800 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:55:03.388434    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-26f1b0/rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9"
Sep 15 11:55:03.401374 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:55:03.401350    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-26f1b0/rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9"
Sep 15 11:55:03.421311 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:55:03.421276    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-26f1b0/rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9"
Sep 15 11:55:55.617525 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:55:55.617491    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-26f1b0/rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9"]
Sep 15 11:56:03.942376 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:03.942336    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f-ngpds"]
Sep 15 11:56:03.945939 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:03.945915    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f-ngpds"
Sep 15 11:56:03.952466 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:03.952438    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-0ecfa6-dockercfg-4j9m2\""
Sep 15 11:56:03.952823 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:03.952805    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-0ecfa6\""
Sep 15 11:56:03.972748 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:03.972719    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f-ngpds"]
Sep 15 11:56:04.002123 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:04.002077    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g592w\" (UniqueName: \"kubernetes.io/projected/3b6ff206-86d2-454d-98b5-7581aba1a431-kube-api-access-g592w\") pod \"payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f-ngpds\" (UID: \"3b6ff206-86d2-454d-98b5-7581aba1a431\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f-ngpds"
Sep 15 11:56:04.002123 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:04.002128    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b6ff206-86d2-454d-98b5-7581aba1a431-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f-ngpds\" (UID: \"3b6ff206-86d2-454d-98b5-7581aba1a431\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f-ngpds"
Sep 15 11:56:04.103096 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:04.103057    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g592w\" (UniqueName: \"kubernetes.io/projected/3b6ff206-86d2-454d-98b5-7581aba1a431-kube-api-access-g592w\") pod \"payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f-ngpds\" (UID: \"3b6ff206-86d2-454d-98b5-7581aba1a431\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f-ngpds"
Sep 15 11:56:04.103096 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:04.103101    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b6ff206-86d2-454d-98b5-7581aba1a431-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f-ngpds\" (UID: \"3b6ff206-86d2-454d-98b5-7581aba1a431\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f-ngpds"
Sep 15 11:56:04.103876 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:04.103856    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b6ff206-86d2-454d-98b5-7581aba1a431-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f-ngpds\" (UID: \"3b6ff206-86d2-454d-98b5-7581aba1a431\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f-ngpds"
Sep 15 11:56:04.131078 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:04.131043    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g592w\" (UniqueName: \"kubernetes.io/projected/3b6ff206-86d2-454d-98b5-7581aba1a431-kube-api-access-g592w\") pod \"payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f-ngpds\" (UID: \"3b6ff206-86d2-454d-98b5-7581aba1a431\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f-ngpds"
Sep 15 11:56:04.258793 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:04.258698    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f-ngpds"
Sep 15 11:56:04.575038 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:04.574961    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f-ngpds"]
Sep 15 11:56:04.578247 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:56:04.578219    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b6ff206_86d2_454d_98b5_7581aba1a431.slice/crio-0e93820993fdfa37ec79eb28eb37b551ef7b6b3cf207950becbf5552cc8d322c WatchSource:0}: Error finding container 0e93820993fdfa37ec79eb28eb37b551ef7b6b3cf207950becbf5552cc8d322c: Status 404 returned error can't find the container with id 0e93820993fdfa37ec79eb28eb37b551ef7b6b3cf207950becbf5552cc8d322c
Sep 15 11:56:04.687723 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:04.687683    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f-ngpds" event={"ID":"3b6ff206-86d2-454d-98b5-7581aba1a431","Type":"ContainerStarted","Data":"d882cd47381f4317698d167a2c1c2a0022cb6efb9b880c07d63d528fcd384487"}
Sep 15 11:56:04.687918 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:04.687749    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f-ngpds" event={"ID":"3b6ff206-86d2-454d-98b5-7581aba1a431","Type":"ContainerStarted","Data":"0e93820993fdfa37ec79eb28eb37b551ef7b6b3cf207950becbf5552cc8d322c"}
Sep 15 11:56:04.687918 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:04.687819    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f-ngpds"
Sep 15 11:56:10.637267 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:10.637227    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-26f1b0/rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9" podUID="fc56e637-2d95-434d-baab-9a178cd06326" containerName="main" containerID="cri-o://9c6d2af2812470f3a4cded512653cab418df9ec612401012cee26261914df7e0" gracePeriod=45
Sep 15 11:56:10.889662 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:10.889598    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-26f1b0/rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9"
Sep 15 11:56:10.909530 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:10.909483    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f-ngpds" podStartSLOduration=7.909464182 podStartE2EDuration="7.909464182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:56:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:56:04.719738496 +0000 UTC m=+1844.181604548" watchObservedRunningTime="2026-09-15 11:56:10.909464182 +0000 UTC m=+1850.371330271"
Sep 15 11:56:10.964767 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:10.964728    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc56e637-2d95-434d-baab-9a178cd06326-home\") pod \"fc56e637-2d95-434d-baab-9a178cd06326\" (UID: \"fc56e637-2d95-434d-baab-9a178cd06326\") "
Sep 15 11:56:10.964959 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:10.964808    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pjllf\" (UniqueName: \"kubernetes.io/projected/fc56e637-2d95-434d-baab-9a178cd06326-kube-api-access-pjllf\") pod \"fc56e637-2d95-434d-baab-9a178cd06326\" (UID: \"fc56e637-2d95-434d-baab-9a178cd06326\") "
Sep 15 11:56:10.964959 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:10.964832    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc56e637-2d95-434d-baab-9a178cd06326-tmp-dir\") pod \"fc56e637-2d95-434d-baab-9a178cd06326\" (UID: \"fc56e637-2d95-434d-baab-9a178cd06326\") "
Sep 15 11:56:10.964959 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:10.964910    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc56e637-2d95-434d-baab-9a178cd06326-model-cache\") pod \"fc56e637-2d95-434d-baab-9a178cd06326\" (UID: \"fc56e637-2d95-434d-baab-9a178cd06326\") "
Sep 15 11:56:10.964959 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:10.964934    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc56e637-2d95-434d-baab-9a178cd06326-dshm\") pod \"fc56e637-2d95-434d-baab-9a178cd06326\" (UID: \"fc56e637-2d95-434d-baab-9a178cd06326\") "
Sep 15 11:56:10.965204 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:10.964980    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc56e637-2d95-434d-baab-9a178cd06326-tls-certs\") pod \"fc56e637-2d95-434d-baab-9a178cd06326\" (UID: \"fc56e637-2d95-434d-baab-9a178cd06326\") "
Sep 15 11:56:10.965204 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:10.964983    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc56e637-2d95-434d-baab-9a178cd06326-home" (OuterVolumeSpecName: "home") pod "fc56e637-2d95-434d-baab-9a178cd06326" (UID: "fc56e637-2d95-434d-baab-9a178cd06326"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:56:10.965308 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:10.965197    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc56e637-2d95-434d-baab-9a178cd06326-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fc56e637-2d95-434d-baab-9a178cd06326" (UID: "fc56e637-2d95-434d-baab-9a178cd06326"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:56:10.965308 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:10.965230    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc56e637-2d95-434d-baab-9a178cd06326-model-cache" (OuterVolumeSpecName: "model-cache") pod "fc56e637-2d95-434d-baab-9a178cd06326" (UID: "fc56e637-2d95-434d-baab-9a178cd06326"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:56:10.965308 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:10.965281    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc56e637-2d95-434d-baab-9a178cd06326-home\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:56:10.965308 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:10.965303    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc56e637-2d95-434d-baab-9a178cd06326-tmp-dir\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:56:10.967084 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:10.967055    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc56e637-2d95-434d-baab-9a178cd06326-kube-api-access-pjllf" (OuterVolumeSpecName: "kube-api-access-pjllf") pod "fc56e637-2d95-434d-baab-9a178cd06326" (UID: "fc56e637-2d95-434d-baab-9a178cd06326"). InnerVolumeSpecName "kube-api-access-pjllf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:56:10.967286 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:10.967165    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc56e637-2d95-434d-baab-9a178cd06326-dshm" (OuterVolumeSpecName: "dshm") pod "fc56e637-2d95-434d-baab-9a178cd06326" (UID: "fc56e637-2d95-434d-baab-9a178cd06326"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:56:10.967346 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:10.967289    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc56e637-2d95-434d-baab-9a178cd06326-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fc56e637-2d95-434d-baab-9a178cd06326" (UID: "fc56e637-2d95-434d-baab-9a178cd06326"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:56:11.065684 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:11.065658    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pjllf\" (UniqueName: \"kubernetes.io/projected/fc56e637-2d95-434d-baab-9a178cd06326-kube-api-access-pjllf\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:56:11.065684 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:11.065686    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc56e637-2d95-434d-baab-9a178cd06326-model-cache\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:56:11.065861 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:11.065699    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc56e637-2d95-434d-baab-9a178cd06326-dshm\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:56:11.065861 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:11.065710    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc56e637-2d95-434d-baab-9a178cd06326-tls-certs\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:56:11.721048 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:11.721011    2582 generic.go:356] "Generic (PLEG): container finished" podID="fc56e637-2d95-434d-baab-9a178cd06326" containerID="9c6d2af2812470f3a4cded512653cab418df9ec612401012cee26261914df7e0" exitCode=0
Sep 15 11:56:11.721498 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:11.721063    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-26f1b0/rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9"
Sep 15 11:56:11.721498 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:11.721086    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-26f1b0/rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9" event={"ID":"fc56e637-2d95-434d-baab-9a178cd06326","Type":"ContainerDied","Data":"9c6d2af2812470f3a4cded512653cab418df9ec612401012cee26261914df7e0"}
Sep 15 11:56:11.721498 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:11.721123    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-26f1b0/rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9" event={"ID":"fc56e637-2d95-434d-baab-9a178cd06326","Type":"ContainerDied","Data":"7736486cda4a416944e18f269ff1c933cd41c91027b769839bb3769311f9a6a5"}
Sep 15 11:56:11.721498 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:11.721145    2582 scope.go:117] "RemoveContainer" containerID="9c6d2af2812470f3a4cded512653cab418df9ec612401012cee26261914df7e0"
Sep 15 11:56:11.729743 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:11.729726    2582 scope.go:117] "RemoveContainer" containerID="9c6d2af2812470f3a4cded512653cab418df9ec612401012cee26261914df7e0"
Sep 15 11:56:11.730034 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:56:11.730015    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c6d2af2812470f3a4cded512653cab418df9ec612401012cee26261914df7e0\": container with ID starting with 9c6d2af2812470f3a4cded512653cab418df9ec612401012cee26261914df7e0 not found: ID does not exist" containerID="9c6d2af2812470f3a4cded512653cab418df9ec612401012cee26261914df7e0"
Sep 15 11:56:11.730116 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:11.730042    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c6d2af2812470f3a4cded512653cab418df9ec612401012cee26261914df7e0"} err="failed to get container status \"9c6d2af2812470f3a4cded512653cab418df9ec612401012cee26261914df7e0\": rpc error: code = NotFound desc = could not find container \"9c6d2af2812470f3a4cded512653cab418df9ec612401012cee26261914df7e0\": container with ID starting with 9c6d2af2812470f3a4cded512653cab418df9ec612401012cee26261914df7e0 not found: ID does not exist"
Sep 15 11:56:11.741054 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:11.741030    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-26f1b0/rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9"]
Sep 15 11:56:11.752814 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:11.752786    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-26f1b0/rate-test-model-26f1b0-kserve-9b4cbb7bc-ggxq9"]
Sep 15 11:56:13.045355 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:13.045319    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc56e637-2d95-434d-baab-9a178cd06326" path="/var/lib/kubelet/pods/fc56e637-2d95-434d-baab-9a178cd06326/volumes"
Sep 15 11:56:15.695323 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:15.695293    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f-ngpds"
Sep 15 11:56:26.290688 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:26.290656    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"]
Sep 15 11:56:26.291108 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:26.291057    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc56e637-2d95-434d-baab-9a178cd06326" containerName="main"
Sep 15 11:56:26.291108 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:26.291069    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc56e637-2d95-434d-baab-9a178cd06326" containerName="main"
Sep 15 11:56:26.291205 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:26.291134    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc56e637-2d95-434d-baab-9a178cd06326" containerName="main"
Sep 15 11:56:26.294478 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:26.294456    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"
Sep 15 11:56:26.297288 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:26.297270    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-2023d5-openshift-default-dockercfg-72lhn\""
Sep 15 11:56:26.315784 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:26.315756    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"]
Sep 15 11:56:26.396410 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:26.396374    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74958bf4-3496-4a47-915e-d22db0fe930d-istio-token\") pod \"e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q\" (UID: \"74958bf4-3496-4a47-915e-d22db0fe930d\") " pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"
Sep 15 11:56:26.396588 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:26.396422    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74958bf4-3496-4a47-915e-d22db0fe930d-istio-podinfo\") pod \"e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q\" (UID: \"74958bf4-3496-4a47-915e-d22db0fe930d\") " pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"
Sep 15 11:56:26.396588 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:26.396507    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74958bf4-3496-4a47-915e-d22db0fe930d-istio-envoy\") pod \"e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q\" (UID: \"74958bf4-3496-4a47-915e-d22db0fe930d\") " pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"
Sep 15 11:56:26.396588 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:26.396540    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9wpg\" (UniqueName: \"kubernetes.io/projected/74958bf4-3496-4a47-915e-d22db0fe930d-kube-api-access-n9wpg\") pod \"e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q\" (UID: \"74958bf4-3496-4a47-915e-d22db0fe930d\") " pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"
Sep 15 11:56:26.396588 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:26.396576    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74958bf4-3496-4a47-915e-d22db0fe930d-credential-socket\") pod \"e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q\" (UID: \"74958bf4-3496-4a47-915e-d22db0fe930d\") " pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"
Sep 15 11:56:26.396738 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:26.396604    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74958bf4-3496-4a47-915e-d22db0fe930d-workload-socket\") pod \"e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q\" (UID: \"74958bf4-3496-4a47-915e-d22db0fe930d\") " pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"
Sep 15 11:56:26.396738 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:26.396627    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74958bf4-3496-4a47-915e-d22db0fe930d-istiod-ca-cert\") pod \"e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q\" (UID: \"74958bf4-3496-4a47-915e-d22db0fe930d\") " pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"
Sep 15 11:56:26.396738 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:26.396652    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74958bf4-3496-4a47-915e-d22db0fe930d-istio-data\") pod \"e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q\" (UID: \"74958bf4-3496-4a47-915e-d22db0fe930d\") " pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"
Sep 15 11:56:26.396738 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:26.396681    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74958bf4-3496-4a47-915e-d22db0fe930d-workload-certs\") pod \"e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q\" (UID: \"74958bf4-3496-4a47-915e-d22db0fe930d\") " pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"
Sep 15 11:56:26.497830 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:26.497796    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74958bf4-3496-4a47-915e-d22db0fe930d-istiod-ca-cert\") pod \"e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q\" (UID: \"74958bf4-3496-4a47-915e-d22db0fe930d\") " pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"
Sep 15 11:56:26.498033 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:26.497839    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74958bf4-3496-4a47-915e-d22db0fe930d-istio-data\") pod \"e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q\" (UID: \"74958bf4-3496-4a47-915e-d22db0fe930d\") " pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"
Sep 15 11:56:26.498033 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:26.497965    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74958bf4-3496-4a47-915e-d22db0fe930d-workload-certs\") pod \"e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q\" (UID: \"74958bf4-3496-4a47-915e-d22db0fe930d\") " pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"
Sep 15 11:56:26.498033 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:26.498018    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74958bf4-3496-4a47-915e-d22db0fe930d-istio-token\") pod \"e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q\" (UID: \"74958bf4-3496-4a47-915e-d22db0fe930d\") " pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"
Sep 15 11:56:26.498256 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:26.498060    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74958bf4-3496-4a47-915e-d22db0fe930d-istio-podinfo\") pod \"e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q\" (UID: \"74958bf4-3496-4a47-915e-d22db0fe930d\") " pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"
Sep 15 11:56:26.498256 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:26.498106    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74958bf4-3496-4a47-915e-d22db0fe930d-istio-envoy\") pod \"e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q\" (UID: \"74958bf4-3496-4a47-915e-d22db0fe930d\") " pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"
Sep 15 11:56:26.498256 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:26.498125    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9wpg\" (UniqueName: \"kubernetes.io/projected/74958bf4-3496-4a47-915e-d22db0fe930d-kube-api-access-n9wpg\") pod \"e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q\" (UID: \"74958bf4-3496-4a47-915e-d22db0fe930d\") " pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"
Sep 15 11:56:26.498404 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:26.498276    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74958bf4-3496-4a47-915e-d22db0fe930d-istio-data\") pod \"e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q\" (UID: \"74958bf4-3496-4a47-915e-d22db0fe930d\") " pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"
Sep 15 11:56:26.498404 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:26.498331    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74958bf4-3496-4a47-915e-d22db0fe930d-credential-socket\") pod \"e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q\" (UID: \"74958bf4-3496-4a47-915e-d22db0fe930d\") " pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"
Sep 15 11:56:26.498404 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:26.498363    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74958bf4-3496-4a47-915e-d22db0fe930d-workload-certs\") pod \"e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q\" (UID: \"74958bf4-3496-4a47-915e-d22db0fe930d\") " pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"
Sep 15 11:56:26.498404 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:26.498373    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74958bf4-3496-4a47-915e-d22db0fe930d-workload-socket\") pod \"e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q\" (UID: \"74958bf4-3496-4a47-915e-d22db0fe930d\") " pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"
Sep 15 11:56:26.498629 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:26.498608    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74958bf4-3496-4a47-915e-d22db0fe930d-workload-socket\") pod \"e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q\" (UID: \"74958bf4-3496-4a47-915e-d22db0fe930d\") " pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"
Sep 15 11:56:26.498691 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:26.498618    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74958bf4-3496-4a47-915e-d22db0fe930d-istiod-ca-cert\") pod \"e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q\" (UID: \"74958bf4-3496-4a47-915e-d22db0fe930d\") " pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"
Sep 15 11:56:26.498691 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:26.498651    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74958bf4-3496-4a47-915e-d22db0fe930d-credential-socket\") pod \"e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q\" (UID: \"74958bf4-3496-4a47-915e-d22db0fe930d\") " pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"
Sep 15 11:56:26.500447 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:26.500422    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74958bf4-3496-4a47-915e-d22db0fe930d-istio-envoy\") pod \"e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q\" (UID: \"74958bf4-3496-4a47-915e-d22db0fe930d\") " pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"
Sep 15 11:56:26.500739 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:26.500706    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74958bf4-3496-4a47-915e-d22db0fe930d-istio-podinfo\") pod \"e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q\" (UID: \"74958bf4-3496-4a47-915e-d22db0fe930d\") " pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"
Sep 15 11:56:26.506541 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:26.506515    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9wpg\" (UniqueName: \"kubernetes.io/projected/74958bf4-3496-4a47-915e-d22db0fe930d-kube-api-access-n9wpg\") pod \"e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q\" (UID: \"74958bf4-3496-4a47-915e-d22db0fe930d\") " pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"
Sep 15 11:56:26.506662 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:26.506642    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74958bf4-3496-4a47-915e-d22db0fe930d-istio-token\") pod \"e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q\" (UID: \"74958bf4-3496-4a47-915e-d22db0fe930d\") " pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"
Sep 15 11:56:26.604741 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:26.604654    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"
Sep 15 11:56:26.883874 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:26.883839    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"]
Sep 15 11:56:26.887706 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:56:26.887679    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74958bf4_3496_4a47_915e_d22db0fe930d.slice/crio-6f46d53c4b8b1cb4da25c483e4d8aa916cf6ce5742f115f8e885b07860efa983 WatchSource:0}: Error finding container 6f46d53c4b8b1cb4da25c483e4d8aa916cf6ce5742f115f8e885b07860efa983: Status 404 returned error can't find the container with id 6f46d53c4b8b1cb4da25c483e4d8aa916cf6ce5742f115f8e885b07860efa983
Sep 15 11:56:26.889794 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:26.889777    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 11:56:27.801629 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:27.801592    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q" event={"ID":"74958bf4-3496-4a47-915e-d22db0fe930d","Type":"ContainerStarted","Data":"6f46d53c4b8b1cb4da25c483e4d8aa916cf6ce5742f115f8e885b07860efa983"}
Sep 15 11:56:29.722933 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:29.722896    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 15 11:56:29.723232 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:29.722971    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 15 11:56:29.723232 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:29.722998    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 15 11:56:29.814664 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:29.814602    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q" event={"ID":"74958bf4-3496-4a47-915e-d22db0fe930d","Type":"ContainerStarted","Data":"eef8d7e4f33ac1b77753485401830023c5d6197bdcba07f9fca77a8a39920a16"}
Sep 15 11:56:29.834697 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:29.834636    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q" podStartSLOduration=1.001980777 podStartE2EDuration="3.834616031s" totalImagesPullingTime="2.832635254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:56:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:56:29.83337468 +0000 UTC m=+1869.295240735" watchObservedRunningTime="2026-09-15 11:56:29.834616031 +0000 UTC m=+1869.296482084"
Sep 15 11:56:30.605808 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:30.605764    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"
Sep 15 11:56:30.611022 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:30.610992    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"
Sep 15 11:56:30.819785 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:30.819757    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"
Sep 15 11:56:30.820776 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:30.820756    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"
Sep 15 11:56:46.862345 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:46.862309    2582 patch_prober.go:28] interesting pod/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 15 11:56:46.862765 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:46.862379    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q" podUID="74958bf4-3496-4a47-915e-d22db0fe930d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 15 11:56:47.899853 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:47.899822    2582 generic.go:356] "Generic (PLEG): container finished" podID="74958bf4-3496-4a47-915e-d22db0fe930d" containerID="eef8d7e4f33ac1b77753485401830023c5d6197bdcba07f9fca77a8a39920a16" exitCode=0
Sep 15 11:56:47.900332 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:47.899899    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q" event={"ID":"74958bf4-3496-4a47-915e-d22db0fe930d","Type":"ContainerDied","Data":"eef8d7e4f33ac1b77753485401830023c5d6197bdcba07f9fca77a8a39920a16"}
Sep 15 11:56:47.900332 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:47.900314    2582 scope.go:117] "RemoveContainer" containerID="eef8d7e4f33ac1b77753485401830023c5d6197bdcba07f9fca77a8a39920a16"
Sep 15 11:56:47.902340 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:47.902311    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 15 11:56:47.902423 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:47.902384    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 15 11:56:47.902423 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:47.902415    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 15 11:56:48.906884 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:48.906852    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q" event={"ID":"74958bf4-3496-4a47-915e-d22db0fe930d","Type":"ContainerStarted","Data":"cf3dd8b72b2c841a53f718fb4577f59c0686d39aea316fb46d9a391f5290c8c8"}
Sep 15 11:56:49.605266 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:49.605228    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"
Sep 15 11:56:49.605565 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:49.605533    2582 patch_prober.go:28] interesting pod/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 15 11:56:49.605688 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:49.605587    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q" podUID="74958bf4-3496-4a47-915e-d22db0fe930d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 15 11:56:50.605456 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:50.605418    2582 patch_prober.go:28] interesting pod/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 15 11:56:50.605875 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:50.605477    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q" podUID="74958bf4-3496-4a47-915e-d22db0fe930d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 15 11:56:51.605444 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:51.605406    2582 patch_prober.go:28] interesting pod/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 15 11:56:51.605627 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:51.605468    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q" podUID="74958bf4-3496-4a47-915e-d22db0fe930d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 15 11:56:52.605087 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:52.605041    2582 patch_prober.go:28] interesting pod/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 15 11:56:52.605284 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:52.605107    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q" podUID="74958bf4-3496-4a47-915e-d22db0fe930d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 15 11:56:53.605453 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:53.605414    2582 patch_prober.go:28] interesting pod/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 15 11:56:53.605947 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:53.605479    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q" podUID="74958bf4-3496-4a47-915e-d22db0fe930d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 15 11:56:54.609374 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:54.609342    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"
Sep 15 11:56:54.609843 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:54.609714    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"
Sep 15 11:56:54.610487 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:56:54.610465    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"
Sep 15 11:57:01.733323 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:01.733295    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-7frsd_aba71c39-2aa1-4e31-bc47-a7106371c009/payload-processing/0.log"
Sep 15 11:57:32.573090 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:32.573043    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f-ngpds_3b6ff206-86d2-454d-98b5-7581aba1a431/payload-processing/0.log"
Sep 15 11:57:32.695122 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:32.695095    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-7frsd_aba71c39-2aa1-4e31-bc47-a7106371c009/payload-processing/0.log"
Sep 15 11:57:33.368266 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:33.368224    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"]
Sep 15 11:57:33.371563 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:33.371537    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"
Sep 15 11:57:33.374355 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:33.374325    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-cd36d2-openshift-default-dockercfg-gwmcs\""
Sep 15 11:57:33.383225 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:33.383153    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"]
Sep 15 11:57:33.386883 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:33.386860    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/290008a0-48d0-40f7-8e37-a8e3ee6320e4-credential-socket\") pod \"e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s\" (UID: \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\") " pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"
Sep 15 11:57:33.386989 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:33.386897    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/290008a0-48d0-40f7-8e37-a8e3ee6320e4-workload-certs\") pod \"e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s\" (UID: \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\") " pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"
Sep 15 11:57:33.386989 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:33.386930    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/290008a0-48d0-40f7-8e37-a8e3ee6320e4-istiod-ca-cert\") pod \"e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s\" (UID: \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\") " pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"
Sep 15 11:57:33.387092 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:33.387010    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/290008a0-48d0-40f7-8e37-a8e3ee6320e4-istio-token\") pod \"e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s\" (UID: \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\") " pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"
Sep 15 11:57:33.387092 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:33.387055    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/290008a0-48d0-40f7-8e37-a8e3ee6320e4-workload-socket\") pod \"e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s\" (UID: \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\") " pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"
Sep 15 11:57:33.387210 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:33.387091    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/290008a0-48d0-40f7-8e37-a8e3ee6320e4-istio-podinfo\") pod \"e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s\" (UID: \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\") " pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"
Sep 15 11:57:33.387210 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:33.387115    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/290008a0-48d0-40f7-8e37-a8e3ee6320e4-istio-data\") pod \"e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s\" (UID: \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\") " pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"
Sep 15 11:57:33.387325 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:33.387237    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/290008a0-48d0-40f7-8e37-a8e3ee6320e4-istio-envoy\") pod \"e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s\" (UID: \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\") " pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"
Sep 15 11:57:33.387325 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:33.387283    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssm2j\" (UniqueName: \"kubernetes.io/projected/290008a0-48d0-40f7-8e37-a8e3ee6320e4-kube-api-access-ssm2j\") pod \"e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s\" (UID: \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\") " pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"
Sep 15 11:57:33.488764 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:33.488725    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/290008a0-48d0-40f7-8e37-a8e3ee6320e4-istiod-ca-cert\") pod \"e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s\" (UID: \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\") " pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"
Sep 15 11:57:33.488968 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:33.488772    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/290008a0-48d0-40f7-8e37-a8e3ee6320e4-istio-token\") pod \"e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s\" (UID: \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\") " pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"
Sep 15 11:57:33.488968 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:33.488796    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/290008a0-48d0-40f7-8e37-a8e3ee6320e4-workload-socket\") pod \"e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s\" (UID: \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\") " pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"
Sep 15 11:57:33.488968 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:33.488818    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/290008a0-48d0-40f7-8e37-a8e3ee6320e4-istio-podinfo\") pod \"e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s\" (UID: \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\") " pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"
Sep 15 11:57:33.488968 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:33.488851    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/290008a0-48d0-40f7-8e37-a8e3ee6320e4-istio-data\") pod \"e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s\" (UID: \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\") " pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"
Sep 15 11:57:33.488968 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:33.488900    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/290008a0-48d0-40f7-8e37-a8e3ee6320e4-istio-envoy\") pod \"e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s\" (UID: \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\") " pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"
Sep 15 11:57:33.488968 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:33.488927    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssm2j\" (UniqueName: \"kubernetes.io/projected/290008a0-48d0-40f7-8e37-a8e3ee6320e4-kube-api-access-ssm2j\") pod \"e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s\" (UID: \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\") " pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"
Sep 15 11:57:33.488968 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:33.488969    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/290008a0-48d0-40f7-8e37-a8e3ee6320e4-credential-socket\") pod \"e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s\" (UID: \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\") " pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"
Sep 15 11:57:33.489460 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:33.488996    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/290008a0-48d0-40f7-8e37-a8e3ee6320e4-workload-certs\") pod \"e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s\" (UID: \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\") " pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"
Sep 15 11:57:33.489460 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:33.489276    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/290008a0-48d0-40f7-8e37-a8e3ee6320e4-workload-socket\") pod \"e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s\" (UID: \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\") " pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"
Sep 15 11:57:33.489460 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:33.489445    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/290008a0-48d0-40f7-8e37-a8e3ee6320e4-istio-data\") pod \"e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s\" (UID: \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\") " pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"
Sep 15 11:57:33.489460 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:33.489457    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/290008a0-48d0-40f7-8e37-a8e3ee6320e4-credential-socket\") pod \"e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s\" (UID: \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\") " pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"
Sep 15 11:57:33.489664 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:33.489535    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/290008a0-48d0-40f7-8e37-a8e3ee6320e4-workload-certs\") pod \"e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s\" (UID: \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\") " pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"
Sep 15 11:57:33.489664 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:33.489585    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/290008a0-48d0-40f7-8e37-a8e3ee6320e4-istiod-ca-cert\") pod \"e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s\" (UID: \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\") " pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"
Sep 15 11:57:33.491611 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:33.491579    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/290008a0-48d0-40f7-8e37-a8e3ee6320e4-istio-envoy\") pod \"e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s\" (UID: \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\") " pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"
Sep 15 11:57:33.491942 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:33.491924    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/290008a0-48d0-40f7-8e37-a8e3ee6320e4-istio-podinfo\") pod \"e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s\" (UID: \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\") " pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"
Sep 15 11:57:33.496564 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:33.496541    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/290008a0-48d0-40f7-8e37-a8e3ee6320e4-istio-token\") pod \"e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s\" (UID: \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\") " pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"
Sep 15 11:57:33.496774 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:33.496756    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssm2j\" (UniqueName: \"kubernetes.io/projected/290008a0-48d0-40f7-8e37-a8e3ee6320e4-kube-api-access-ssm2j\") pod \"e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s\" (UID: \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\") " pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"
Sep 15 11:57:33.682237 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:33.682203    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"
Sep 15 11:57:33.966546 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:33.962664    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"]
Sep 15 11:57:33.973227 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:33.973168    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 15 11:57:33.973327 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:33.973260    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 15 11:57:33.973327 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:33.973287    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 15 11:57:34.136605 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:34.136564    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s" event={"ID":"290008a0-48d0-40f7-8e37-a8e3ee6320e4","Type":"ContainerStarted","Data":"5be47c4628bacf481359e990a534fb50992f68ef444b545b7dfaec3269f492d5"}
Sep 15 11:57:34.136758 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:34.136636    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s" event={"ID":"290008a0-48d0-40f7-8e37-a8e3ee6320e4","Type":"ContainerStarted","Data":"9deb740f05ebe8892dbd72b1e4c8383949e7d1e044cb0e56d371a4a44967a5ef"}
Sep 15 11:57:34.159383 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:34.159323    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s" podStartSLOduration=1.159306973 podStartE2EDuration="1.159306973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:57:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:57:34.157204002 +0000 UTC m=+1933.619070069" watchObservedRunningTime="2026-09-15 11:57:34.159306973 +0000 UTC m=+1933.621173072"
Sep 15 11:57:34.683077 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:34.683043    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"
Sep 15 11:57:35.688343 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:35.688313    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"
Sep 15 11:57:36.146678 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:36.146650    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"
Sep 15 11:57:36.147712 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:36.147690    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"
Sep 15 11:57:39.700087 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:39.700052    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f"]
Sep 15 11:57:39.703918 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:39.703893    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f"
Sep 15 11:57:39.708254 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:39.708231    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-cd36d2-serving-cert\""
Sep 15 11:57:39.728834 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:39.728756    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f"]
Sep 15 11:57:39.746123 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:39.746081    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjlh7\" (UniqueName: \"kubernetes.io/projected/2a1653f0-6e27-4f99-bcfe-d43bf167398c-kube-api-access-gjlh7\") pod \"maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f\" (UID: \"2a1653f0-6e27-4f99-bcfe-d43bf167398c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f"
Sep 15 11:57:39.746315 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:39.746137    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a1653f0-6e27-4f99-bcfe-d43bf167398c-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f\" (UID: \"2a1653f0-6e27-4f99-bcfe-d43bf167398c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f"
Sep 15 11:57:39.746315 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:39.746224    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a1653f0-6e27-4f99-bcfe-d43bf167398c-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f\" (UID: \"2a1653f0-6e27-4f99-bcfe-d43bf167398c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f"
Sep 15 11:57:39.746315 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:39.746297    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a1653f0-6e27-4f99-bcfe-d43bf167398c-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f\" (UID: \"2a1653f0-6e27-4f99-bcfe-d43bf167398c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f"
Sep 15 11:57:39.846970 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:39.846939    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjlh7\" (UniqueName: \"kubernetes.io/projected/2a1653f0-6e27-4f99-bcfe-d43bf167398c-kube-api-access-gjlh7\") pod \"maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f\" (UID: \"2a1653f0-6e27-4f99-bcfe-d43bf167398c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f"
Sep 15 11:57:39.847156 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:39.846980    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a1653f0-6e27-4f99-bcfe-d43bf167398c-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f\" (UID: \"2a1653f0-6e27-4f99-bcfe-d43bf167398c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f"
Sep 15 11:57:39.847156 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:39.847006    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a1653f0-6e27-4f99-bcfe-d43bf167398c-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f\" (UID: \"2a1653f0-6e27-4f99-bcfe-d43bf167398c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f"
Sep 15 11:57:39.847156 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:39.847058    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a1653f0-6e27-4f99-bcfe-d43bf167398c-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f\" (UID: \"2a1653f0-6e27-4f99-bcfe-d43bf167398c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f"
Sep 15 11:57:39.847156 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:57:39.847102    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd36d2-serving-cert: secret "maas-api-e2e-ipp-cleanup-cd36d2-serving-cert" not found
Sep 15 11:57:39.847342 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:57:39.847166    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a1653f0-6e27-4f99-bcfe-d43bf167398c-maas-api-tls podName:2a1653f0-6e27-4f99-bcfe-d43bf167398c nodeName:}" failed. No retries permitted until 2026-09-15 11:57:40.34715055 +0000 UTC m=+1939.809016580 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2a1653f0-6e27-4f99-bcfe-d43bf167398c-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f" (UID: "2a1653f0-6e27-4f99-bcfe-d43bf167398c") : secret "maas-api-e2e-ipp-cleanup-cd36d2-serving-cert" not found
Sep 15 11:57:39.847871 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:39.847797    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a1653f0-6e27-4f99-bcfe-d43bf167398c-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f\" (UID: \"2a1653f0-6e27-4f99-bcfe-d43bf167398c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f"
Sep 15 11:57:39.849634 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:39.849612    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a1653f0-6e27-4f99-bcfe-d43bf167398c-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f\" (UID: \"2a1653f0-6e27-4f99-bcfe-d43bf167398c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f"
Sep 15 11:57:39.857236 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:39.857212    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjlh7\" (UniqueName: \"kubernetes.io/projected/2a1653f0-6e27-4f99-bcfe-d43bf167398c-kube-api-access-gjlh7\") pod \"maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f\" (UID: \"2a1653f0-6e27-4f99-bcfe-d43bf167398c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f"
Sep 15 11:57:40.351563 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:40.351521    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a1653f0-6e27-4f99-bcfe-d43bf167398c-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f\" (UID: \"2a1653f0-6e27-4f99-bcfe-d43bf167398c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f"
Sep 15 11:57:40.354082 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:40.354062    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a1653f0-6e27-4f99-bcfe-d43bf167398c-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f\" (UID: \"2a1653f0-6e27-4f99-bcfe-d43bf167398c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f"
Sep 15 11:57:40.389073 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:40.389043    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5-tvnhq"]
Sep 15 11:57:40.392629 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:40.392613    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5-tvnhq"
Sep 15 11:57:40.395045 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:40.395016    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-cd36d2-dockercfg-2mkkx\""
Sep 15 11:57:40.395245 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:40.395228    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-cd36d2\""
Sep 15 11:57:40.406835 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:40.406812    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5-tvnhq"]
Sep 15 11:57:40.452651 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:40.452612    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1070cadb-2df9-465d-b217-28f1441319e0-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5-tvnhq\" (UID: \"1070cadb-2df9-465d-b217-28f1441319e0\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5-tvnhq"
Sep 15 11:57:40.452832 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:40.452704    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67qh2\" (UniqueName: \"kubernetes.io/projected/1070cadb-2df9-465d-b217-28f1441319e0-kube-api-access-67qh2\") pod \"payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5-tvnhq\" (UID: \"1070cadb-2df9-465d-b217-28f1441319e0\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5-tvnhq"
Sep 15 11:57:40.553737 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:40.553704    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1070cadb-2df9-465d-b217-28f1441319e0-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5-tvnhq\" (UID: \"1070cadb-2df9-465d-b217-28f1441319e0\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5-tvnhq"
Sep 15 11:57:40.553937 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:40.553762    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67qh2\" (UniqueName: \"kubernetes.io/projected/1070cadb-2df9-465d-b217-28f1441319e0-kube-api-access-67qh2\") pod \"payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5-tvnhq\" (UID: \"1070cadb-2df9-465d-b217-28f1441319e0\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5-tvnhq"
Sep 15 11:57:40.554506 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:40.554482    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1070cadb-2df9-465d-b217-28f1441319e0-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5-tvnhq\" (UID: \"1070cadb-2df9-465d-b217-28f1441319e0\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5-tvnhq"
Sep 15 11:57:40.561932 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:40.561905    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67qh2\" (UniqueName: \"kubernetes.io/projected/1070cadb-2df9-465d-b217-28f1441319e0-kube-api-access-67qh2\") pod \"payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5-tvnhq\" (UID: \"1070cadb-2df9-465d-b217-28f1441319e0\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5-tvnhq"
Sep 15 11:57:40.615999 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:40.615917    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f"
Sep 15 11:57:40.703835 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:40.703801    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5-tvnhq"
Sep 15 11:57:40.893510 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:40.893485    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f"]
Sep 15 11:57:40.895556 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:57:40.895527    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a1653f0_6e27_4f99_bcfe_d43bf167398c.slice/crio-de40333ab9a8a61db278e1ab4e04904a2dab41c9f21f655be901cf5ccf8744f0 WatchSource:0}: Error finding container de40333ab9a8a61db278e1ab4e04904a2dab41c9f21f655be901cf5ccf8744f0: Status 404 returned error can't find the container with id de40333ab9a8a61db278e1ab4e04904a2dab41c9f21f655be901cf5ccf8744f0
Sep 15 11:57:40.977392 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:40.977366    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5-tvnhq"]
Sep 15 11:57:40.979936 ip-10-0-131-95 kubenswrapper[2582]: W0915 11:57:40.979909    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1070cadb_2df9_465d_b217_28f1441319e0.slice/crio-60fd4e68e66bfba732197bb25702794fb971c80bf9ad413e493b991c9502fe2f WatchSource:0}: Error finding container 60fd4e68e66bfba732197bb25702794fb971c80bf9ad413e493b991c9502fe2f: Status 404 returned error can't find the container with id 60fd4e68e66bfba732197bb25702794fb971c80bf9ad413e493b991c9502fe2f
Sep 15 11:57:41.171621 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:41.171520    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5-tvnhq" event={"ID":"1070cadb-2df9-465d-b217-28f1441319e0","Type":"ContainerStarted","Data":"9d075e6e7aa37b0bb2ea50df2d17c6f804757f1a7bbafc4ecc3bd427128d67e8"}
Sep 15 11:57:41.171621 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:41.171587    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5-tvnhq" event={"ID":"1070cadb-2df9-465d-b217-28f1441319e0","Type":"ContainerStarted","Data":"60fd4e68e66bfba732197bb25702794fb971c80bf9ad413e493b991c9502fe2f"}
Sep 15 11:57:41.171858 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:41.171716    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5-tvnhq"
Sep 15 11:57:41.172828 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:41.172806    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f" event={"ID":"2a1653f0-6e27-4f99-bcfe-d43bf167398c","Type":"ContainerStarted","Data":"de40333ab9a8a61db278e1ab4e04904a2dab41c9f21f655be901cf5ccf8744f0"}
Sep 15 11:57:41.192354 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:41.192303    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5-tvnhq" podStartSLOduration=1.192289421 podStartE2EDuration="1.192289421s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:57:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:57:41.19121264 +0000 UTC m=+1940.653078694" watchObservedRunningTime="2026-09-15 11:57:41.192289421 +0000 UTC m=+1940.654155542"
Sep 15 11:57:42.179496 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:42.179455    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f" event={"ID":"2a1653f0-6e27-4f99-bcfe-d43bf167398c","Type":"ContainerStarted","Data":"7df9f582e72b4d887b1a330b873a8da9b20c3d8cfbe3a093a7f2205f768c388f"}
Sep 15 11:57:42.196484 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:42.196426    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f" podStartSLOduration=2.737410375 podStartE2EDuration="3.196408618s" totalImagesPullingTime="458.998243ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:57:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:57:42.195036333 +0000 UTC m=+1941.656902385" watchObservedRunningTime="2026-09-15 11:57:42.196408618 +0000 UTC m=+1941.658274672"
Sep 15 11:57:43.184521 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:43.184492    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f"
Sep 15 11:57:49.195990 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:49.195961    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f"
Sep 15 11:57:52.182357 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:52.182326    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5-tvnhq"
Sep 15 11:57:55.254990 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:55.254956    2582 generic.go:356] "Generic (PLEG): container finished" podID="290008a0-48d0-40f7-8e37-a8e3ee6320e4" containerID="5be47c4628bacf481359e990a534fb50992f68ef444b545b7dfaec3269f492d5" exitCode=0
Sep 15 11:57:55.255399 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:55.255029    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s" event={"ID":"290008a0-48d0-40f7-8e37-a8e3ee6320e4","Type":"ContainerDied","Data":"5be47c4628bacf481359e990a534fb50992f68ef444b545b7dfaec3269f492d5"}
Sep 15 11:57:55.255450 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:55.255436    2582 scope.go:117] "RemoveContainer" containerID="5be47c4628bacf481359e990a534fb50992f68ef444b545b7dfaec3269f492d5"
Sep 15 11:57:55.256509 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:55.256486    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 15 11:57:55.256561 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:55.256548    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 15 11:57:55.256598 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:55.256580    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 15 11:57:56.262018 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:56.261983    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s" event={"ID":"290008a0-48d0-40f7-8e37-a8e3ee6320e4","Type":"ContainerStarted","Data":"610d6a60282ae6ade2efa910945af46bfbd172b8737858abd1f602604eff0c22"}
Sep 15 11:57:56.682644 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:56.682591    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"
Sep 15 11:57:56.682886 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:56.682862    2582 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 15 11:57:56.682932 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:56.682912    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s" podUID="290008a0-48d0-40f7-8e37-a8e3ee6320e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 15 11:57:57.683495 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:57.683462    2582 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 15 11:57:57.683878 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:57.683515    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s" podUID="290008a0-48d0-40f7-8e37-a8e3ee6320e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 15 11:57:58.683387 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:58.683353    2582 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 15 11:57:58.683582 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:58.683407    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s" podUID="290008a0-48d0-40f7-8e37-a8e3ee6320e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 15 11:57:59.682747 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:59.682706    2582 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 15 11:57:59.682928 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:57:59.682770    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s" podUID="290008a0-48d0-40f7-8e37-a8e3ee6320e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 15 11:58:00.683624 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:00.683582    2582 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 15 11:58:00.684012 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:00.683647    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s" podUID="290008a0-48d0-40f7-8e37-a8e3ee6320e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 15 11:58:01.687309 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:01.687274    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"
Sep 15 11:58:01.687761 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:01.687539    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"
Sep 15 11:58:01.688197 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:01.688158    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"
Sep 15 11:58:17.991021 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:17.990931    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f"]
Sep 15 11:58:17.991567 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:17.991222    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f" podUID="2a1653f0-6e27-4f99-bcfe-d43bf167398c" containerName="maas-api" containerID="cri-o://7df9f582e72b4d887b1a330b873a8da9b20c3d8cfbe3a093a7f2205f768c388f" gracePeriod=30
Sep 15 11:58:18.110755 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:18.110636    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5-tvnhq"]
Sep 15 11:58:18.111767 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:18.110902    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5-tvnhq" podUID="1070cadb-2df9-465d-b217-28f1441319e0" containerName="payload-processing" containerID="cri-o://9d075e6e7aa37b0bb2ea50df2d17c6f804757f1a7bbafc4ecc3bd427128d67e8" gracePeriod=30
Sep 15 11:58:18.257437 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:18.257409    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f"
Sep 15 11:58:18.312876 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:18.312811    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a1653f0-6e27-4f99-bcfe-d43bf167398c-metrics-certs\") pod \"2a1653f0-6e27-4f99-bcfe-d43bf167398c\" (UID: \"2a1653f0-6e27-4f99-bcfe-d43bf167398c\") "
Sep 15 11:58:18.313098 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:18.312882    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a1653f0-6e27-4f99-bcfe-d43bf167398c-maas-api-tls\") pod \"2a1653f0-6e27-4f99-bcfe-d43bf167398c\" (UID: \"2a1653f0-6e27-4f99-bcfe-d43bf167398c\") "
Sep 15 11:58:18.313098 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:18.312934    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjlh7\" (UniqueName: \"kubernetes.io/projected/2a1653f0-6e27-4f99-bcfe-d43bf167398c-kube-api-access-gjlh7\") pod \"2a1653f0-6e27-4f99-bcfe-d43bf167398c\" (UID: \"2a1653f0-6e27-4f99-bcfe-d43bf167398c\") "
Sep 15 11:58:18.313098 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:18.312995    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a1653f0-6e27-4f99-bcfe-d43bf167398c-openshift-service-ca\") pod \"2a1653f0-6e27-4f99-bcfe-d43bf167398c\" (UID: \"2a1653f0-6e27-4f99-bcfe-d43bf167398c\") "
Sep 15 11:58:18.313662 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:18.313630    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a1653f0-6e27-4f99-bcfe-d43bf167398c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2a1653f0-6e27-4f99-bcfe-d43bf167398c" (UID: "2a1653f0-6e27-4f99-bcfe-d43bf167398c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:58:18.316958 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:18.316776    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a1653f0-6e27-4f99-bcfe-d43bf167398c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2a1653f0-6e27-4f99-bcfe-d43bf167398c" (UID: "2a1653f0-6e27-4f99-bcfe-d43bf167398c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:58:18.316958 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:18.316919    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a1653f0-6e27-4f99-bcfe-d43bf167398c-kube-api-access-gjlh7" (OuterVolumeSpecName: "kube-api-access-gjlh7") pod "2a1653f0-6e27-4f99-bcfe-d43bf167398c" (UID: "2a1653f0-6e27-4f99-bcfe-d43bf167398c"). InnerVolumeSpecName "kube-api-access-gjlh7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:58:18.317490 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:18.317454    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a1653f0-6e27-4f99-bcfe-d43bf167398c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2a1653f0-6e27-4f99-bcfe-d43bf167398c" (UID: "2a1653f0-6e27-4f99-bcfe-d43bf167398c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:58:18.370217 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:18.370188    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5-tvnhq"
Sep 15 11:58:18.370872 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:18.370848    2582 generic.go:356] "Generic (PLEG): container finished" podID="1070cadb-2df9-465d-b217-28f1441319e0" containerID="9d075e6e7aa37b0bb2ea50df2d17c6f804757f1a7bbafc4ecc3bd427128d67e8" exitCode=0
Sep 15 11:58:18.370997 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:18.370930    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5-tvnhq" event={"ID":"1070cadb-2df9-465d-b217-28f1441319e0","Type":"ContainerDied","Data":"9d075e6e7aa37b0bb2ea50df2d17c6f804757f1a7bbafc4ecc3bd427128d67e8"}
Sep 15 11:58:18.370997 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:18.370990    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5-tvnhq" event={"ID":"1070cadb-2df9-465d-b217-28f1441319e0","Type":"ContainerDied","Data":"60fd4e68e66bfba732197bb25702794fb971c80bf9ad413e493b991c9502fe2f"}
Sep 15 11:58:18.371082 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:18.371023    2582 scope.go:117] "RemoveContainer" containerID="9d075e6e7aa37b0bb2ea50df2d17c6f804757f1a7bbafc4ecc3bd427128d67e8"
Sep 15 11:58:18.372150 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:18.372124    2582 generic.go:356] "Generic (PLEG): container finished" podID="2a1653f0-6e27-4f99-bcfe-d43bf167398c" containerID="7df9f582e72b4d887b1a330b873a8da9b20c3d8cfbe3a093a7f2205f768c388f" exitCode=0
Sep 15 11:58:18.372295 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:18.372208    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f"
Sep 15 11:58:18.372295 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:18.372228    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f" event={"ID":"2a1653f0-6e27-4f99-bcfe-d43bf167398c","Type":"ContainerDied","Data":"7df9f582e72b4d887b1a330b873a8da9b20c3d8cfbe3a093a7f2205f768c388f"}
Sep 15 11:58:18.372295 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:18.372279    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f" event={"ID":"2a1653f0-6e27-4f99-bcfe-d43bf167398c","Type":"ContainerDied","Data":"de40333ab9a8a61db278e1ab4e04904a2dab41c9f21f655be901cf5ccf8744f0"}
Sep 15 11:58:18.380553 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:18.380535    2582 scope.go:117] "RemoveContainer" containerID="9d075e6e7aa37b0bb2ea50df2d17c6f804757f1a7bbafc4ecc3bd427128d67e8"
Sep 15 11:58:18.381037 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:58:18.381013    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d075e6e7aa37b0bb2ea50df2d17c6f804757f1a7bbafc4ecc3bd427128d67e8\": container with ID starting with 9d075e6e7aa37b0bb2ea50df2d17c6f804757f1a7bbafc4ecc3bd427128d67e8 not found: ID does not exist" containerID="9d075e6e7aa37b0bb2ea50df2d17c6f804757f1a7bbafc4ecc3bd427128d67e8"
Sep 15 11:58:18.381133 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:18.381048    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d075e6e7aa37b0bb2ea50df2d17c6f804757f1a7bbafc4ecc3bd427128d67e8"} err="failed to get container status \"9d075e6e7aa37b0bb2ea50df2d17c6f804757f1a7bbafc4ecc3bd427128d67e8\": rpc error: code = NotFound desc = could not find container \"9d075e6e7aa37b0bb2ea50df2d17c6f804757f1a7bbafc4ecc3bd427128d67e8\": container with ID starting with 9d075e6e7aa37b0bb2ea50df2d17c6f804757f1a7bbafc4ecc3bd427128d67e8 not found: ID does not exist"
Sep 15 11:58:18.381133 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:18.381071    2582 scope.go:117] "RemoveContainer" containerID="7df9f582e72b4d887b1a330b873a8da9b20c3d8cfbe3a093a7f2205f768c388f"
Sep 15 11:58:18.390676 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:18.390550    2582 scope.go:117] "RemoveContainer" containerID="7df9f582e72b4d887b1a330b873a8da9b20c3d8cfbe3a093a7f2205f768c388f"
Sep 15 11:58:18.390891 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:58:18.390863    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7df9f582e72b4d887b1a330b873a8da9b20c3d8cfbe3a093a7f2205f768c388f\": container with ID starting with 7df9f582e72b4d887b1a330b873a8da9b20c3d8cfbe3a093a7f2205f768c388f not found: ID does not exist" containerID="7df9f582e72b4d887b1a330b873a8da9b20c3d8cfbe3a093a7f2205f768c388f"
Sep 15 11:58:18.390999 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:18.390901    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7df9f582e72b4d887b1a330b873a8da9b20c3d8cfbe3a093a7f2205f768c388f"} err="failed to get container status \"7df9f582e72b4d887b1a330b873a8da9b20c3d8cfbe3a093a7f2205f768c388f\": rpc error: code = NotFound desc = could not find container \"7df9f582e72b4d887b1a330b873a8da9b20c3d8cfbe3a093a7f2205f768c388f\": container with ID starting with 7df9f582e72b4d887b1a330b873a8da9b20c3d8cfbe3a093a7f2205f768c388f not found: ID does not exist"
Sep 15 11:58:18.401163 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:18.401133    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f"]
Sep 15 11:58:18.406815 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:18.406785    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd36d2-7795bb8c46-dhw4f"]
Sep 15 11:58:18.415597 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:18.415545    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1070cadb-2df9-465d-b217-28f1441319e0-plugins-config-volume\") pod \"1070cadb-2df9-465d-b217-28f1441319e0\" (UID: \"1070cadb-2df9-465d-b217-28f1441319e0\") "
Sep 15 11:58:18.415773 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:18.415663    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67qh2\" (UniqueName: \"kubernetes.io/projected/1070cadb-2df9-465d-b217-28f1441319e0-kube-api-access-67qh2\") pod \"1070cadb-2df9-465d-b217-28f1441319e0\" (UID: \"1070cadb-2df9-465d-b217-28f1441319e0\") "
Sep 15 11:58:18.416331 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:18.416002    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a1653f0-6e27-4f99-bcfe-d43bf167398c-metrics-certs\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:58:18.416331 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:18.416024    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a1653f0-6e27-4f99-bcfe-d43bf167398c-maas-api-tls\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:58:18.416331 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:18.416038    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjlh7\" (UniqueName: \"kubernetes.io/projected/2a1653f0-6e27-4f99-bcfe-d43bf167398c-kube-api-access-gjlh7\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:58:18.416331 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:18.416052    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a1653f0-6e27-4f99-bcfe-d43bf167398c-openshift-service-ca\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:58:18.416331 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:18.416286    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1070cadb-2df9-465d-b217-28f1441319e0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1070cadb-2df9-465d-b217-28f1441319e0" (UID: "1070cadb-2df9-465d-b217-28f1441319e0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:58:18.418734 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:18.418707    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1070cadb-2df9-465d-b217-28f1441319e0-kube-api-access-67qh2" (OuterVolumeSpecName: "kube-api-access-67qh2") pod "1070cadb-2df9-465d-b217-28f1441319e0" (UID: "1070cadb-2df9-465d-b217-28f1441319e0"). InnerVolumeSpecName "kube-api-access-67qh2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:58:18.517331 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:18.517232    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1070cadb-2df9-465d-b217-28f1441319e0-plugins-config-volume\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:58:18.517331 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:18.517264    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67qh2\" (UniqueName: \"kubernetes.io/projected/1070cadb-2df9-465d-b217-28f1441319e0-kube-api-access-67qh2\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:58:19.045991 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:19.045953    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a1653f0-6e27-4f99-bcfe-d43bf167398c" path="/var/lib/kubelet/pods/2a1653f0-6e27-4f99-bcfe-d43bf167398c/volumes"
Sep 15 11:58:19.379252 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:19.379223    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5-tvnhq"
Sep 15 11:58:19.394252 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:19.394216    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5-tvnhq"]
Sep 15 11:58:19.400048 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:19.400020    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5-tvnhq"]
Sep 15 11:58:21.045788 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:21.045756    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1070cadb-2df9-465d-b217-28f1441319e0" path="/var/lib/kubelet/pods/1070cadb-2df9-465d-b217-28f1441319e0/volumes"
Sep 15 11:58:25.107461 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:25.107426    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"]
Sep 15 11:58:25.108038 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:25.107637    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s" podUID="290008a0-48d0-40f7-8e37-a8e3ee6320e4" containerName="istio-proxy" containerID="cri-o://610d6a60282ae6ade2efa910945af46bfbd172b8737858abd1f602604eff0c22" gracePeriod=30
Sep 15 11:58:30.368149 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:30.368121    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"
Sep 15 11:58:30.426875 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:30.426846    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ssm2j\" (UniqueName: \"kubernetes.io/projected/290008a0-48d0-40f7-8e37-a8e3ee6320e4-kube-api-access-ssm2j\") pod \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\" (UID: \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\") "
Sep 15 11:58:30.427074 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:30.426886    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/290008a0-48d0-40f7-8e37-a8e3ee6320e4-credential-socket\") pod \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\" (UID: \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\") "
Sep 15 11:58:30.427074 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:30.426905    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/290008a0-48d0-40f7-8e37-a8e3ee6320e4-workload-socket\") pod \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\" (UID: \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\") "
Sep 15 11:58:30.427074 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:30.426933    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/290008a0-48d0-40f7-8e37-a8e3ee6320e4-istio-podinfo\") pod \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\" (UID: \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\") "
Sep 15 11:58:30.427074 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:30.426973    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/290008a0-48d0-40f7-8e37-a8e3ee6320e4-istio-envoy\") pod \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\" (UID: \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\") "
Sep 15 11:58:30.427074 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:30.427007    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/290008a0-48d0-40f7-8e37-a8e3ee6320e4-istiod-ca-cert\") pod \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\" (UID: \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\") "
Sep 15 11:58:30.427074 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:30.427049    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/290008a0-48d0-40f7-8e37-a8e3ee6320e4-istio-data\") pod \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\" (UID: \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\") "
Sep 15 11:58:30.427416 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:30.427082    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/290008a0-48d0-40f7-8e37-a8e3ee6320e4-istio-token\") pod \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\" (UID: \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\") "
Sep 15 11:58:30.427416 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:30.427117    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/290008a0-48d0-40f7-8e37-a8e3ee6320e4-workload-certs\") pod \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\" (UID: \"290008a0-48d0-40f7-8e37-a8e3ee6320e4\") "
Sep 15 11:58:30.427416 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:30.427318    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/290008a0-48d0-40f7-8e37-a8e3ee6320e4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "290008a0-48d0-40f7-8e37-a8e3ee6320e4" (UID: "290008a0-48d0-40f7-8e37-a8e3ee6320e4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:58:30.427571 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:30.427443    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/290008a0-48d0-40f7-8e37-a8e3ee6320e4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "290008a0-48d0-40f7-8e37-a8e3ee6320e4" (UID: "290008a0-48d0-40f7-8e37-a8e3ee6320e4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:58:30.427571 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:30.427562    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/290008a0-48d0-40f7-8e37-a8e3ee6320e4-credential-socket\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:58:30.427689 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:30.427582    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/290008a0-48d0-40f7-8e37-a8e3ee6320e4-workload-socket\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:58:30.427689 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:30.427587    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/290008a0-48d0-40f7-8e37-a8e3ee6320e4-istio-data" (OuterVolumeSpecName: "istio-data") pod "290008a0-48d0-40f7-8e37-a8e3ee6320e4" (UID: "290008a0-48d0-40f7-8e37-a8e3ee6320e4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:58:30.427793 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:30.427682    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/290008a0-48d0-40f7-8e37-a8e3ee6320e4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "290008a0-48d0-40f7-8e37-a8e3ee6320e4" (UID: "290008a0-48d0-40f7-8e37-a8e3ee6320e4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:58:30.427841 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:30.427785    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/290008a0-48d0-40f7-8e37-a8e3ee6320e4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "290008a0-48d0-40f7-8e37-a8e3ee6320e4" (UID: "290008a0-48d0-40f7-8e37-a8e3ee6320e4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:58:30.429714 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:30.429681    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/290008a0-48d0-40f7-8e37-a8e3ee6320e4-istio-token" (OuterVolumeSpecName: "istio-token") pod "290008a0-48d0-40f7-8e37-a8e3ee6320e4" (UID: "290008a0-48d0-40f7-8e37-a8e3ee6320e4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:58:30.429914 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:30.429890    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/290008a0-48d0-40f7-8e37-a8e3ee6320e4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "290008a0-48d0-40f7-8e37-a8e3ee6320e4" (UID: "290008a0-48d0-40f7-8e37-a8e3ee6320e4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 11:58:30.430095 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:30.430072    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/290008a0-48d0-40f7-8e37-a8e3ee6320e4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "290008a0-48d0-40f7-8e37-a8e3ee6320e4" (UID: "290008a0-48d0-40f7-8e37-a8e3ee6320e4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:58:30.430227 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:30.430074    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/290008a0-48d0-40f7-8e37-a8e3ee6320e4-kube-api-access-ssm2j" (OuterVolumeSpecName: "kube-api-access-ssm2j") pod "290008a0-48d0-40f7-8e37-a8e3ee6320e4" (UID: "290008a0-48d0-40f7-8e37-a8e3ee6320e4"). InnerVolumeSpecName "kube-api-access-ssm2j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:58:30.432702 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:30.432680    2582 generic.go:356] "Generic (PLEG): container finished" podID="290008a0-48d0-40f7-8e37-a8e3ee6320e4" containerID="610d6a60282ae6ade2efa910945af46bfbd172b8737858abd1f602604eff0c22" exitCode=0
Sep 15 11:58:30.432806 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:30.432793    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"
Sep 15 11:58:30.432885 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:30.432795    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s" event={"ID":"290008a0-48d0-40f7-8e37-a8e3ee6320e4","Type":"ContainerDied","Data":"610d6a60282ae6ade2efa910945af46bfbd172b8737858abd1f602604eff0c22"}
Sep 15 11:58:30.432925 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:30.432916    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s" event={"ID":"290008a0-48d0-40f7-8e37-a8e3ee6320e4","Type":"ContainerDied","Data":"9deb740f05ebe8892dbd72b1e4c8383949e7d1e044cb0e56d371a4a44967a5ef"}
Sep 15 11:58:30.432960 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:30.432945    2582 scope.go:117] "RemoveContainer" containerID="610d6a60282ae6ade2efa910945af46bfbd172b8737858abd1f602604eff0c22"
Sep 15 11:58:30.448321 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:30.448300    2582 scope.go:117] "RemoveContainer" containerID="5be47c4628bacf481359e990a534fb50992f68ef444b545b7dfaec3269f492d5"
Sep 15 11:58:30.456277 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:30.456252    2582 scope.go:117] "RemoveContainer" containerID="610d6a60282ae6ade2efa910945af46bfbd172b8737858abd1f602604eff0c22"
Sep 15 11:58:30.456622 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:58:30.456601    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"610d6a60282ae6ade2efa910945af46bfbd172b8737858abd1f602604eff0c22\": container with ID starting with 610d6a60282ae6ade2efa910945af46bfbd172b8737858abd1f602604eff0c22 not found: ID does not exist" containerID="610d6a60282ae6ade2efa910945af46bfbd172b8737858abd1f602604eff0c22"
Sep 15 11:58:30.456696 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:30.456630    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"610d6a60282ae6ade2efa910945af46bfbd172b8737858abd1f602604eff0c22"} err="failed to get container status \"610d6a60282ae6ade2efa910945af46bfbd172b8737858abd1f602604eff0c22\": rpc error: code = NotFound desc = could not find container \"610d6a60282ae6ade2efa910945af46bfbd172b8737858abd1f602604eff0c22\": container with ID starting with 610d6a60282ae6ade2efa910945af46bfbd172b8737858abd1f602604eff0c22 not found: ID does not exist"
Sep 15 11:58:30.456696 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:30.456647    2582 scope.go:117] "RemoveContainer" containerID="5be47c4628bacf481359e990a534fb50992f68ef444b545b7dfaec3269f492d5"
Sep 15 11:58:30.457237 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:58:30.457051    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5be47c4628bacf481359e990a534fb50992f68ef444b545b7dfaec3269f492d5\": container with ID starting with 5be47c4628bacf481359e990a534fb50992f68ef444b545b7dfaec3269f492d5 not found: ID does not exist" containerID="5be47c4628bacf481359e990a534fb50992f68ef444b545b7dfaec3269f492d5"
Sep 15 11:58:30.457237 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:30.457101    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5be47c4628bacf481359e990a534fb50992f68ef444b545b7dfaec3269f492d5"} err="failed to get container status \"5be47c4628bacf481359e990a534fb50992f68ef444b545b7dfaec3269f492d5\": rpc error: code = NotFound desc = could not find container \"5be47c4628bacf481359e990a534fb50992f68ef444b545b7dfaec3269f492d5\": container with ID starting with 5be47c4628bacf481359e990a534fb50992f68ef444b545b7dfaec3269f492d5 not found: ID does not exist"
Sep 15 11:58:30.459534 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:30.459513    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"]
Sep 15 11:58:30.462945 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:30.462923    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s"]
Sep 15 11:58:30.528392 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:30.528358    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ssm2j\" (UniqueName: \"kubernetes.io/projected/290008a0-48d0-40f7-8e37-a8e3ee6320e4-kube-api-access-ssm2j\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:58:30.528392 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:30.528386    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/290008a0-48d0-40f7-8e37-a8e3ee6320e4-istio-podinfo\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:58:30.528392 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:30.528396    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/290008a0-48d0-40f7-8e37-a8e3ee6320e4-istio-envoy\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:58:30.528631 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:30.528404    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/290008a0-48d0-40f7-8e37-a8e3ee6320e4-istiod-ca-cert\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:58:30.528631 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:30.528412    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/290008a0-48d0-40f7-8e37-a8e3ee6320e4-istio-data\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:58:30.528631 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:30.528420    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/290008a0-48d0-40f7-8e37-a8e3ee6320e4-istio-token\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:58:30.528631 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:30.528427    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/290008a0-48d0-40f7-8e37-a8e3ee6320e4-workload-certs\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:58:31.045914 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:31.045881    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="290008a0-48d0-40f7-8e37-a8e3ee6320e4" path="/var/lib/kubelet/pods/290008a0-48d0-40f7-8e37-a8e3ee6320e4/volumes"
Sep 15 11:58:44.243675 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:44.243627    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f-ngpds"]
Sep 15 11:58:44.244277 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:44.243892    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f-ngpds" podUID="3b6ff206-86d2-454d-98b5-7581aba1a431" containerName="payload-processing" containerID="cri-o://d882cd47381f4317698d167a2c1c2a0022cb6efb9b880c07d63d528fcd384487" gracePeriod=30
Sep 15 11:58:44.504228 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:44.504188    2582 generic.go:356] "Generic (PLEG): container finished" podID="3b6ff206-86d2-454d-98b5-7581aba1a431" containerID="d882cd47381f4317698d167a2c1c2a0022cb6efb9b880c07d63d528fcd384487" exitCode=0
Sep 15 11:58:44.504506 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:44.504233    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f-ngpds" event={"ID":"3b6ff206-86d2-454d-98b5-7581aba1a431","Type":"ContainerDied","Data":"d882cd47381f4317698d167a2c1c2a0022cb6efb9b880c07d63d528fcd384487"}
Sep 15 11:58:44.504506 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:44.504299    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f-ngpds" event={"ID":"3b6ff206-86d2-454d-98b5-7581aba1a431","Type":"ContainerDied","Data":"0e93820993fdfa37ec79eb28eb37b551ef7b6b3cf207950becbf5552cc8d322c"}
Sep 15 11:58:44.504506 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:44.504325    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0e93820993fdfa37ec79eb28eb37b551ef7b6b3cf207950becbf5552cc8d322c"
Sep 15 11:58:44.510919 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:44.510893    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f-ngpds"
Sep 15 11:58:44.652681 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:44.652649    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g592w\" (UniqueName: \"kubernetes.io/projected/3b6ff206-86d2-454d-98b5-7581aba1a431-kube-api-access-g592w\") pod \"3b6ff206-86d2-454d-98b5-7581aba1a431\" (UID: \"3b6ff206-86d2-454d-98b5-7581aba1a431\") "
Sep 15 11:58:44.652876 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:44.652775    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b6ff206-86d2-454d-98b5-7581aba1a431-plugins-config-volume\") pod \"3b6ff206-86d2-454d-98b5-7581aba1a431\" (UID: \"3b6ff206-86d2-454d-98b5-7581aba1a431\") "
Sep 15 11:58:44.653144 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:44.653120    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b6ff206-86d2-454d-98b5-7581aba1a431-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3b6ff206-86d2-454d-98b5-7581aba1a431" (UID: "3b6ff206-86d2-454d-98b5-7581aba1a431"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:58:44.654877 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:44.654858    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b6ff206-86d2-454d-98b5-7581aba1a431-kube-api-access-g592w" (OuterVolumeSpecName: "kube-api-access-g592w") pod "3b6ff206-86d2-454d-98b5-7581aba1a431" (UID: "3b6ff206-86d2-454d-98b5-7581aba1a431"). InnerVolumeSpecName "kube-api-access-g592w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:58:44.753567 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:44.753485    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b6ff206-86d2-454d-98b5-7581aba1a431-plugins-config-volume\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:58:44.753567 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:44.753513    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g592w\" (UniqueName: \"kubernetes.io/projected/3b6ff206-86d2-454d-98b5-7581aba1a431-kube-api-access-g592w\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:58:45.508255 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:45.508223    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f-ngpds"
Sep 15 11:58:45.526256 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:45.526228    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f-ngpds"]
Sep 15 11:58:45.530430 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:45.530407    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f-ngpds"]
Sep 15 11:58:47.045100 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:58:47.045067    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b6ff206-86d2-454d-98b5-7581aba1a431" path="/var/lib/kubelet/pods/3b6ff206-86d2-454d-98b5-7581aba1a431/volumes"
Sep 15 11:59:50.780030 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:50.779943    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"]
Sep 15 11:59:50.780647 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:50.780165    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q" podUID="74958bf4-3496-4a47-915e-d22db0fe930d" containerName="istio-proxy" containerID="cri-o://cf3dd8b72b2c841a53f718fb4577f59c0686d39aea316fb46d9a391f5290c8c8" gracePeriod=30
Sep 15 11:59:54.612234 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:54.612195    2582 patch_prober.go:28] interesting pod/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 11:59:54.612629 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:54.612253    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q" podUID="74958bf4-3496-4a47-915e-d22db0fe930d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 11:59:56.021855 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:56.021830    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"
Sep 15 11:59:56.189813 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:56.189775    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n9wpg\" (UniqueName: \"kubernetes.io/projected/74958bf4-3496-4a47-915e-d22db0fe930d-kube-api-access-n9wpg\") pod \"74958bf4-3496-4a47-915e-d22db0fe930d\" (UID: \"74958bf4-3496-4a47-915e-d22db0fe930d\") "
Sep 15 11:59:56.189993 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:56.189830    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74958bf4-3496-4a47-915e-d22db0fe930d-istio-envoy\") pod \"74958bf4-3496-4a47-915e-d22db0fe930d\" (UID: \"74958bf4-3496-4a47-915e-d22db0fe930d\") "
Sep 15 11:59:56.189993 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:56.189855    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74958bf4-3496-4a47-915e-d22db0fe930d-istio-podinfo\") pod \"74958bf4-3496-4a47-915e-d22db0fe930d\" (UID: \"74958bf4-3496-4a47-915e-d22db0fe930d\") "
Sep 15 11:59:56.189993 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:56.189885    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74958bf4-3496-4a47-915e-d22db0fe930d-credential-socket\") pod \"74958bf4-3496-4a47-915e-d22db0fe930d\" (UID: \"74958bf4-3496-4a47-915e-d22db0fe930d\") "
Sep 15 11:59:56.189993 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:56.189921    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74958bf4-3496-4a47-915e-d22db0fe930d-istio-token\") pod \"74958bf4-3496-4a47-915e-d22db0fe930d\" (UID: \"74958bf4-3496-4a47-915e-d22db0fe930d\") "
Sep 15 11:59:56.190251 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:56.190097    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74958bf4-3496-4a47-915e-d22db0fe930d-workload-socket\") pod \"74958bf4-3496-4a47-915e-d22db0fe930d\" (UID: \"74958bf4-3496-4a47-915e-d22db0fe930d\") "
Sep 15 11:59:56.190251 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:56.190153    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74958bf4-3496-4a47-915e-d22db0fe930d-istio-data\") pod \"74958bf4-3496-4a47-915e-d22db0fe930d\" (UID: \"74958bf4-3496-4a47-915e-d22db0fe930d\") "
Sep 15 11:59:56.190251 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:56.190213    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74958bf4-3496-4a47-915e-d22db0fe930d-istiod-ca-cert\") pod \"74958bf4-3496-4a47-915e-d22db0fe930d\" (UID: \"74958bf4-3496-4a47-915e-d22db0fe930d\") "
Sep 15 11:59:56.190389 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:56.190249    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74958bf4-3496-4a47-915e-d22db0fe930d-workload-certs\") pod \"74958bf4-3496-4a47-915e-d22db0fe930d\" (UID: \"74958bf4-3496-4a47-915e-d22db0fe930d\") "
Sep 15 11:59:56.190389 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:56.190259    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74958bf4-3496-4a47-915e-d22db0fe930d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "74958bf4-3496-4a47-915e-d22db0fe930d" (UID: "74958bf4-3496-4a47-915e-d22db0fe930d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:59:56.190500 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:56.190379    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74958bf4-3496-4a47-915e-d22db0fe930d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "74958bf4-3496-4a47-915e-d22db0fe930d" (UID: "74958bf4-3496-4a47-915e-d22db0fe930d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:59:56.190500 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:56.190388    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74958bf4-3496-4a47-915e-d22db0fe930d-istio-data" (OuterVolumeSpecName: "istio-data") pod "74958bf4-3496-4a47-915e-d22db0fe930d" (UID: "74958bf4-3496-4a47-915e-d22db0fe930d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:59:56.190894 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:56.190603    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74958bf4-3496-4a47-915e-d22db0fe930d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "74958bf4-3496-4a47-915e-d22db0fe930d" (UID: "74958bf4-3496-4a47-915e-d22db0fe930d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:59:56.190894 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:56.190667    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74958bf4-3496-4a47-915e-d22db0fe930d-credential-socket\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:59:56.190894 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:56.190837    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74958bf4-3496-4a47-915e-d22db0fe930d-workload-socket\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:59:56.190894 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:56.190856    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74958bf4-3496-4a47-915e-d22db0fe930d-istio-data\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:59:56.191145 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:56.191010    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74958bf4-3496-4a47-915e-d22db0fe930d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "74958bf4-3496-4a47-915e-d22db0fe930d" (UID: "74958bf4-3496-4a47-915e-d22db0fe930d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:59:56.192319 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:56.192299    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74958bf4-3496-4a47-915e-d22db0fe930d-kube-api-access-n9wpg" (OuterVolumeSpecName: "kube-api-access-n9wpg") pod "74958bf4-3496-4a47-915e-d22db0fe930d" (UID: "74958bf4-3496-4a47-915e-d22db0fe930d"). InnerVolumeSpecName "kube-api-access-n9wpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:59:56.192531 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:56.192517    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74958bf4-3496-4a47-915e-d22db0fe930d-istio-token" (OuterVolumeSpecName: "istio-token") pod "74958bf4-3496-4a47-915e-d22db0fe930d" (UID: "74958bf4-3496-4a47-915e-d22db0fe930d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:59:56.192694 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:56.192670    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74958bf4-3496-4a47-915e-d22db0fe930d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "74958bf4-3496-4a47-915e-d22db0fe930d" (UID: "74958bf4-3496-4a47-915e-d22db0fe930d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:59:56.192767 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:56.192725    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/74958bf4-3496-4a47-915e-d22db0fe930d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "74958bf4-3496-4a47-915e-d22db0fe930d" (UID: "74958bf4-3496-4a47-915e-d22db0fe930d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 11:59:56.291409 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:56.291379    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74958bf4-3496-4a47-915e-d22db0fe930d-istio-token\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:59:56.291409 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:56.291404    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74958bf4-3496-4a47-915e-d22db0fe930d-istiod-ca-cert\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:59:56.291409 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:56.291412    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74958bf4-3496-4a47-915e-d22db0fe930d-workload-certs\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:59:56.291615 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:56.291420    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9wpg\" (UniqueName: \"kubernetes.io/projected/74958bf4-3496-4a47-915e-d22db0fe930d-kube-api-access-n9wpg\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:59:56.291615 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:56.291429    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74958bf4-3496-4a47-915e-d22db0fe930d-istio-envoy\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:59:56.291615 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:56.291437    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74958bf4-3496-4a47-915e-d22db0fe930d-istio-podinfo\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 11:59:56.860787 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:56.860750    2582 generic.go:356] "Generic (PLEG): container finished" podID="74958bf4-3496-4a47-915e-d22db0fe930d" containerID="cf3dd8b72b2c841a53f718fb4577f59c0686d39aea316fb46d9a391f5290c8c8" exitCode=0
Sep 15 11:59:56.860960 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:56.860801    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"
Sep 15 11:59:56.860960 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:56.860835    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q" event={"ID":"74958bf4-3496-4a47-915e-d22db0fe930d","Type":"ContainerDied","Data":"cf3dd8b72b2c841a53f718fb4577f59c0686d39aea316fb46d9a391f5290c8c8"}
Sep 15 11:59:56.860960 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:56.860887    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q" event={"ID":"74958bf4-3496-4a47-915e-d22db0fe930d","Type":"ContainerDied","Data":"6f46d53c4b8b1cb4da25c483e4d8aa916cf6ce5742f115f8e885b07860efa983"}
Sep 15 11:59:56.860960 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:56.860910    2582 scope.go:117] "RemoveContainer" containerID="cf3dd8b72b2c841a53f718fb4577f59c0686d39aea316fb46d9a391f5290c8c8"
Sep 15 11:59:56.870338 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:56.870322    2582 scope.go:117] "RemoveContainer" containerID="eef8d7e4f33ac1b77753485401830023c5d6197bdcba07f9fca77a8a39920a16"
Sep 15 11:59:56.878389 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:56.878374    2582 scope.go:117] "RemoveContainer" containerID="cf3dd8b72b2c841a53f718fb4577f59c0686d39aea316fb46d9a391f5290c8c8"
Sep 15 11:59:56.878671 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:59:56.878639    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf3dd8b72b2c841a53f718fb4577f59c0686d39aea316fb46d9a391f5290c8c8\": container with ID starting with cf3dd8b72b2c841a53f718fb4577f59c0686d39aea316fb46d9a391f5290c8c8 not found: ID does not exist" containerID="cf3dd8b72b2c841a53f718fb4577f59c0686d39aea316fb46d9a391f5290c8c8"
Sep 15 11:59:56.878718 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:56.878679    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf3dd8b72b2c841a53f718fb4577f59c0686d39aea316fb46d9a391f5290c8c8"} err="failed to get container status \"cf3dd8b72b2c841a53f718fb4577f59c0686d39aea316fb46d9a391f5290c8c8\": rpc error: code = NotFound desc = could not find container \"cf3dd8b72b2c841a53f718fb4577f59c0686d39aea316fb46d9a391f5290c8c8\": container with ID starting with cf3dd8b72b2c841a53f718fb4577f59c0686d39aea316fb46d9a391f5290c8c8 not found: ID does not exist"
Sep 15 11:59:56.878718 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:56.878694    2582 scope.go:117] "RemoveContainer" containerID="eef8d7e4f33ac1b77753485401830023c5d6197bdcba07f9fca77a8a39920a16"
Sep 15 11:59:56.878920 ip-10-0-131-95 kubenswrapper[2582]: E0915 11:59:56.878901    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eef8d7e4f33ac1b77753485401830023c5d6197bdcba07f9fca77a8a39920a16\": container with ID starting with eef8d7e4f33ac1b77753485401830023c5d6197bdcba07f9fca77a8a39920a16 not found: ID does not exist" containerID="eef8d7e4f33ac1b77753485401830023c5d6197bdcba07f9fca77a8a39920a16"
Sep 15 11:59:56.878966 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:56.878927    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eef8d7e4f33ac1b77753485401830023c5d6197bdcba07f9fca77a8a39920a16"} err="failed to get container status \"eef8d7e4f33ac1b77753485401830023c5d6197bdcba07f9fca77a8a39920a16\": rpc error: code = NotFound desc = could not find container \"eef8d7e4f33ac1b77753485401830023c5d6197bdcba07f9fca77a8a39920a16\": container with ID starting with eef8d7e4f33ac1b77753485401830023c5d6197bdcba07f9fca77a8a39920a16 not found: ID does not exist"
Sep 15 11:59:56.884900 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:56.884879    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"]
Sep 15 11:59:56.889640 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:56.889621    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q"]
Sep 15 11:59:57.044867 ip-10-0-131-95 kubenswrapper[2582]: I0915 11:59:57.044832    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74958bf4-3496-4a47-915e-d22db0fe930d" path="/var/lib/kubelet/pods/74958bf4-3496-4a47-915e-d22db0fe930d/volumes"
Sep 15 12:00:01.657078 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:01.657039    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242"]
Sep 15 12:00:01.657579 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:01.657322    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242" podUID="3cac8de2-5d37-40f3-8043-9c609967a0ad" containerName="maas-api" containerID="cri-o://2f7fee961ac1b33e46f0ab7b708eedcb8c05389061d829906c0143d914afa6e4" gracePeriod=30
Sep 15 12:00:01.888491 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:01.888463    2582 generic.go:356] "Generic (PLEG): container finished" podID="3cac8de2-5d37-40f3-8043-9c609967a0ad" containerID="2f7fee961ac1b33e46f0ab7b708eedcb8c05389061d829906c0143d914afa6e4" exitCode=0
Sep 15 12:00:01.888634 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:01.888515    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242" event={"ID":"3cac8de2-5d37-40f3-8043-9c609967a0ad","Type":"ContainerDied","Data":"2f7fee961ac1b33e46f0ab7b708eedcb8c05389061d829906c0143d914afa6e4"}
Sep 15 12:00:01.906895 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:01.906870    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242"
Sep 15 12:00:01.938455 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:01.938372    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3cac8de2-5d37-40f3-8043-9c609967a0ad-metrics-certs\") pod \"3cac8de2-5d37-40f3-8043-9c609967a0ad\" (UID: \"3cac8de2-5d37-40f3-8043-9c609967a0ad\") "
Sep 15 12:00:01.938455 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:01.938423    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3cac8de2-5d37-40f3-8043-9c609967a0ad-maas-api-tls\") pod \"3cac8de2-5d37-40f3-8043-9c609967a0ad\" (UID: \"3cac8de2-5d37-40f3-8043-9c609967a0ad\") "
Sep 15 12:00:01.938455 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:01.938448    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3cac8de2-5d37-40f3-8043-9c609967a0ad-openshift-service-ca\") pod \"3cac8de2-5d37-40f3-8043-9c609967a0ad\" (UID: \"3cac8de2-5d37-40f3-8043-9c609967a0ad\") "
Sep 15 12:00:01.938680 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:01.938617    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7kz2\" (UniqueName: \"kubernetes.io/projected/3cac8de2-5d37-40f3-8043-9c609967a0ad-kube-api-access-v7kz2\") pod \"3cac8de2-5d37-40f3-8043-9c609967a0ad\" (UID: \"3cac8de2-5d37-40f3-8043-9c609967a0ad\") "
Sep 15 12:00:01.938750 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:01.938721    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cac8de2-5d37-40f3-8043-9c609967a0ad-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3cac8de2-5d37-40f3-8043-9c609967a0ad" (UID: "3cac8de2-5d37-40f3-8043-9c609967a0ad"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:00:01.938896 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:01.938878    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3cac8de2-5d37-40f3-8043-9c609967a0ad-openshift-service-ca\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 12:00:01.940779 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:01.940745    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cac8de2-5d37-40f3-8043-9c609967a0ad-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3cac8de2-5d37-40f3-8043-9c609967a0ad" (UID: "3cac8de2-5d37-40f3-8043-9c609967a0ad"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:00:01.940779 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:01.940765    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cac8de2-5d37-40f3-8043-9c609967a0ad-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3cac8de2-5d37-40f3-8043-9c609967a0ad" (UID: "3cac8de2-5d37-40f3-8043-9c609967a0ad"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:00:01.940967 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:01.940941    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cac8de2-5d37-40f3-8043-9c609967a0ad-kube-api-access-v7kz2" (OuterVolumeSpecName: "kube-api-access-v7kz2") pod "3cac8de2-5d37-40f3-8043-9c609967a0ad" (UID: "3cac8de2-5d37-40f3-8043-9c609967a0ad"). InnerVolumeSpecName "kube-api-access-v7kz2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:00:02.039482 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:02.039446    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3cac8de2-5d37-40f3-8043-9c609967a0ad-maas-api-tls\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 12:00:02.039482 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:02.039482    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7kz2\" (UniqueName: \"kubernetes.io/projected/3cac8de2-5d37-40f3-8043-9c609967a0ad-kube-api-access-v7kz2\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 12:00:02.039691 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:02.039498    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3cac8de2-5d37-40f3-8043-9c609967a0ad-metrics-certs\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 12:00:02.895895 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:02.895858    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242"
Sep 15 12:00:02.895895 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:02.895876    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242" event={"ID":"3cac8de2-5d37-40f3-8043-9c609967a0ad","Type":"ContainerDied","Data":"5410654667a33229a247f1b47b0247d067107be86f2b4cd3d28970eb08405399"}
Sep 15 12:00:02.896439 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:02.895957    2582 scope.go:117] "RemoveContainer" containerID="2f7fee961ac1b33e46f0ab7b708eedcb8c05389061d829906c0143d914afa6e4"
Sep 15 12:00:02.919448 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:02.919420    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242"]
Sep 15 12:00:02.924597 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:02.924571    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-26f1b0-5cbdbc9dd9-8x242"]
Sep 15 12:00:03.045789 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:03.045753    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cac8de2-5d37-40f3-8043-9c609967a0ad" path="/var/lib/kubelet/pods/3cac8de2-5d37-40f3-8043-9c609967a0ad/volumes"
Sep 15 12:00:19.460158 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:19.460125    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c-7dzcq"]
Sep 15 12:00:19.460736 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:19.460410    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c-7dzcq" podUID="694f893f-8150-4906-8bed-889fab8516b5" containerName="payload-processing" containerID="cri-o://ff6703543eac2aa83a02343e48bbf6d482c1ce71407d328a8e0268dd825bb12d" gracePeriod=30
Sep 15 12:00:19.721760 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:19.721686    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c-7dzcq"
Sep 15 12:00:19.786679 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:19.786637    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9z6x\" (UniqueName: \"kubernetes.io/projected/694f893f-8150-4906-8bed-889fab8516b5-kube-api-access-t9z6x\") pod \"694f893f-8150-4906-8bed-889fab8516b5\" (UID: \"694f893f-8150-4906-8bed-889fab8516b5\") "
Sep 15 12:00:19.786879 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:19.786758    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/694f893f-8150-4906-8bed-889fab8516b5-plugins-config-volume\") pod \"694f893f-8150-4906-8bed-889fab8516b5\" (UID: \"694f893f-8150-4906-8bed-889fab8516b5\") "
Sep 15 12:00:19.787200 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:19.787141    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/694f893f-8150-4906-8bed-889fab8516b5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "694f893f-8150-4906-8bed-889fab8516b5" (UID: "694f893f-8150-4906-8bed-889fab8516b5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:00:19.789280 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:19.789253    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/694f893f-8150-4906-8bed-889fab8516b5-kube-api-access-t9z6x" (OuterVolumeSpecName: "kube-api-access-t9z6x") pod "694f893f-8150-4906-8bed-889fab8516b5" (UID: "694f893f-8150-4906-8bed-889fab8516b5"). InnerVolumeSpecName "kube-api-access-t9z6x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:00:19.887891 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:19.887851    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9z6x\" (UniqueName: \"kubernetes.io/projected/694f893f-8150-4906-8bed-889fab8516b5-kube-api-access-t9z6x\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 12:00:19.887891 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:19.887883    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/694f893f-8150-4906-8bed-889fab8516b5-plugins-config-volume\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 12:00:19.980909 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:19.980817    2582 generic.go:356] "Generic (PLEG): container finished" podID="694f893f-8150-4906-8bed-889fab8516b5" containerID="ff6703543eac2aa83a02343e48bbf6d482c1ce71407d328a8e0268dd825bb12d" exitCode=0
Sep 15 12:00:19.980909 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:19.980860    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c-7dzcq"
Sep 15 12:00:19.980909 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:19.980886    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c-7dzcq" event={"ID":"694f893f-8150-4906-8bed-889fab8516b5","Type":"ContainerDied","Data":"ff6703543eac2aa83a02343e48bbf6d482c1ce71407d328a8e0268dd825bb12d"}
Sep 15 12:00:19.981210 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:19.980930    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c-7dzcq" event={"ID":"694f893f-8150-4906-8bed-889fab8516b5","Type":"ContainerDied","Data":"41fd901fb3ac20b1dd2986c95e3619d3ae4506eb48f2359de1983365c4211cdc"}
Sep 15 12:00:19.981210 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:19.980951    2582 scope.go:117] "RemoveContainer" containerID="ff6703543eac2aa83a02343e48bbf6d482c1ce71407d328a8e0268dd825bb12d"
Sep 15 12:00:19.992088 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:19.992064    2582 scope.go:117] "RemoveContainer" containerID="ff6703543eac2aa83a02343e48bbf6d482c1ce71407d328a8e0268dd825bb12d"
Sep 15 12:00:19.992559 ip-10-0-131-95 kubenswrapper[2582]: E0915 12:00:19.992526    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff6703543eac2aa83a02343e48bbf6d482c1ce71407d328a8e0268dd825bb12d\": container with ID starting with ff6703543eac2aa83a02343e48bbf6d482c1ce71407d328a8e0268dd825bb12d not found: ID does not exist" containerID="ff6703543eac2aa83a02343e48bbf6d482c1ce71407d328a8e0268dd825bb12d"
Sep 15 12:00:19.992645 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:19.992567    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff6703543eac2aa83a02343e48bbf6d482c1ce71407d328a8e0268dd825bb12d"} err="failed to get container status \"ff6703543eac2aa83a02343e48bbf6d482c1ce71407d328a8e0268dd825bb12d\": rpc error: code = NotFound desc = could not find container \"ff6703543eac2aa83a02343e48bbf6d482c1ce71407d328a8e0268dd825bb12d\": container with ID starting with ff6703543eac2aa83a02343e48bbf6d482c1ce71407d328a8e0268dd825bb12d not found: ID does not exist"
Sep 15 12:00:20.004460 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:20.004429    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c-7dzcq"]
Sep 15 12:00:20.006216 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:20.006194    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c-7dzcq"]
Sep 15 12:00:21.045679 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:21.045643    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="694f893f-8150-4906-8bed-889fab8516b5" path="/var/lib/kubelet/pods/694f893f-8150-4906-8bed-889fab8516b5/volumes"
Sep 15 12:00:28.675034 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:28.674990    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84f7f65f89-w8k9f"]
Sep 15 12:00:28.675578 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:28.675259    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-84f7f65f89-w8k9f" podUID="b46fa9f1-352a-42e7-a11e-5c3619643249" containerName="manager" containerID="cri-o://b76e972ba05b18ecfc0ae5974cc89372b4e58f21992a6581495a46f725eea06e" gracePeriod=30
Sep 15 12:00:28.923326 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:28.923298    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84f7f65f89-w8k9f"
Sep 15 12:00:28.964528 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:28.964436    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b46fa9f1-352a-42e7-a11e-5c3619643249-webhook-cert\") pod \"b46fa9f1-352a-42e7-a11e-5c3619643249\" (UID: \"b46fa9f1-352a-42e7-a11e-5c3619643249\") "
Sep 15 12:00:28.964528 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:28.964500    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8fxmg\" (UniqueName: \"kubernetes.io/projected/b46fa9f1-352a-42e7-a11e-5c3619643249-kube-api-access-8fxmg\") pod \"b46fa9f1-352a-42e7-a11e-5c3619643249\" (UID: \"b46fa9f1-352a-42e7-a11e-5c3619643249\") "
Sep 15 12:00:28.964783 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:28.964534    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b46fa9f1-352a-42e7-a11e-5c3619643249-metrics-certs\") pod \"b46fa9f1-352a-42e7-a11e-5c3619643249\" (UID: \"b46fa9f1-352a-42e7-a11e-5c3619643249\") "
Sep 15 12:00:28.966811 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:28.966773    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b46fa9f1-352a-42e7-a11e-5c3619643249-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b46fa9f1-352a-42e7-a11e-5c3619643249" (UID: "b46fa9f1-352a-42e7-a11e-5c3619643249"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:00:28.966946 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:28.966880    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b46fa9f1-352a-42e7-a11e-5c3619643249-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b46fa9f1-352a-42e7-a11e-5c3619643249" (UID: "b46fa9f1-352a-42e7-a11e-5c3619643249"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:00:28.966946 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:28.966921    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b46fa9f1-352a-42e7-a11e-5c3619643249-kube-api-access-8fxmg" (OuterVolumeSpecName: "kube-api-access-8fxmg") pod "b46fa9f1-352a-42e7-a11e-5c3619643249" (UID: "b46fa9f1-352a-42e7-a11e-5c3619643249"). InnerVolumeSpecName "kube-api-access-8fxmg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:00:29.023382 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:29.023348    2582 generic.go:356] "Generic (PLEG): container finished" podID="b46fa9f1-352a-42e7-a11e-5c3619643249" containerID="b76e972ba05b18ecfc0ae5974cc89372b4e58f21992a6581495a46f725eea06e" exitCode=0
Sep 15 12:00:29.023548 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:29.023390    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84f7f65f89-w8k9f" event={"ID":"b46fa9f1-352a-42e7-a11e-5c3619643249","Type":"ContainerDied","Data":"b76e972ba05b18ecfc0ae5974cc89372b4e58f21992a6581495a46f725eea06e"}
Sep 15 12:00:29.023548 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:29.023431    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84f7f65f89-w8k9f" event={"ID":"b46fa9f1-352a-42e7-a11e-5c3619643249","Type":"ContainerDied","Data":"4a1ce94797bb5c18a01819b314c1c4c625e69e86b174f8ce1d614a6c69bcdca4"}
Sep 15 12:00:29.023548 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:29.023452    2582 scope.go:117] "RemoveContainer" containerID="b76e972ba05b18ecfc0ae5974cc89372b4e58f21992a6581495a46f725eea06e"
Sep 15 12:00:29.023548 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:29.023391    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84f7f65f89-w8k9f"
Sep 15 12:00:29.033060 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:29.033037    2582 scope.go:117] "RemoveContainer" containerID="b76e972ba05b18ecfc0ae5974cc89372b4e58f21992a6581495a46f725eea06e"
Sep 15 12:00:29.033371 ip-10-0-131-95 kubenswrapper[2582]: E0915 12:00:29.033353    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b76e972ba05b18ecfc0ae5974cc89372b4e58f21992a6581495a46f725eea06e\": container with ID starting with b76e972ba05b18ecfc0ae5974cc89372b4e58f21992a6581495a46f725eea06e not found: ID does not exist" containerID="b76e972ba05b18ecfc0ae5974cc89372b4e58f21992a6581495a46f725eea06e"
Sep 15 12:00:29.033455 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:29.033379    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b76e972ba05b18ecfc0ae5974cc89372b4e58f21992a6581495a46f725eea06e"} err="failed to get container status \"b76e972ba05b18ecfc0ae5974cc89372b4e58f21992a6581495a46f725eea06e\": rpc error: code = NotFound desc = could not find container \"b76e972ba05b18ecfc0ae5974cc89372b4e58f21992a6581495a46f725eea06e\": container with ID starting with b76e972ba05b18ecfc0ae5974cc89372b4e58f21992a6581495a46f725eea06e not found: ID does not exist"
Sep 15 12:00:29.045119 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:29.045088    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84f7f65f89-w8k9f"]
Sep 15 12:00:29.052215 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:29.052169    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-84f7f65f89-w8k9f"]
Sep 15 12:00:29.065606 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:29.065573    2582 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b46fa9f1-352a-42e7-a11e-5c3619643249-webhook-cert\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 12:00:29.065606 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:29.065603    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8fxmg\" (UniqueName: \"kubernetes.io/projected/b46fa9f1-352a-42e7-a11e-5c3619643249-kube-api-access-8fxmg\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 12:00:29.065752 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:29.065612    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b46fa9f1-352a-42e7-a11e-5c3619643249-metrics-certs\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 12:00:31.043949 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:00:31.043915    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b46fa9f1-352a-42e7-a11e-5c3619643249" path="/var/lib/kubelet/pods/b46fa9f1-352a-42e7-a11e-5c3619643249/volumes"
Sep 15 12:01:29.857889 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:29.857851    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-84f7f65f89-bvcnw"]
Sep 15 12:01:29.858501 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:29.858211    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74958bf4-3496-4a47-915e-d22db0fe930d" containerName="istio-proxy"
Sep 15 12:01:29.858501 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:29.858228    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="74958bf4-3496-4a47-915e-d22db0fe930d" containerName="istio-proxy"
Sep 15 12:01:29.858501 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:29.858243    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b46fa9f1-352a-42e7-a11e-5c3619643249" containerName="manager"
Sep 15 12:01:29.858501 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:29.858252    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b46fa9f1-352a-42e7-a11e-5c3619643249" containerName="manager"
Sep 15 12:01:29.858501 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:29.858265    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="290008a0-48d0-40f7-8e37-a8e3ee6320e4" containerName="istio-proxy"
Sep 15 12:01:29.858501 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:29.858274    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="290008a0-48d0-40f7-8e37-a8e3ee6320e4" containerName="istio-proxy"
Sep 15 12:01:29.858501 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:29.858283    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cac8de2-5d37-40f3-8043-9c609967a0ad" containerName="maas-api"
Sep 15 12:01:29.858501 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:29.858289    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cac8de2-5d37-40f3-8043-9c609967a0ad" containerName="maas-api"
Sep 15 12:01:29.858501 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:29.858299    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b6ff206-86d2-454d-98b5-7581aba1a431" containerName="payload-processing"
Sep 15 12:01:29.858501 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:29.858307    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b6ff206-86d2-454d-98b5-7581aba1a431" containerName="payload-processing"
Sep 15 12:01:29.858501 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:29.858320    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74958bf4-3496-4a47-915e-d22db0fe930d" containerName="istio-proxy"
Sep 15 12:01:29.858501 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:29.858325    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="74958bf4-3496-4a47-915e-d22db0fe930d" containerName="istio-proxy"
Sep 15 12:01:29.858501 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:29.858338    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a1653f0-6e27-4f99-bcfe-d43bf167398c" containerName="maas-api"
Sep 15 12:01:29.858501 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:29.858347    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a1653f0-6e27-4f99-bcfe-d43bf167398c" containerName="maas-api"
Sep 15 12:01:29.858501 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:29.858358    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="694f893f-8150-4906-8bed-889fab8516b5" containerName="payload-processing"
Sep 15 12:01:29.858501 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:29.858367    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="694f893f-8150-4906-8bed-889fab8516b5" containerName="payload-processing"
Sep 15 12:01:29.858501 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:29.858377    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1070cadb-2df9-465d-b217-28f1441319e0" containerName="payload-processing"
Sep 15 12:01:29.858501 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:29.858385    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1070cadb-2df9-465d-b217-28f1441319e0" containerName="payload-processing"
Sep 15 12:01:29.858501 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:29.858402    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="290008a0-48d0-40f7-8e37-a8e3ee6320e4" containerName="istio-proxy"
Sep 15 12:01:29.858501 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:29.858410    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="290008a0-48d0-40f7-8e37-a8e3ee6320e4" containerName="istio-proxy"
Sep 15 12:01:29.859130 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:29.858517    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b46fa9f1-352a-42e7-a11e-5c3619643249" containerName="manager"
Sep 15 12:01:29.859130 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:29.858527    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="290008a0-48d0-40f7-8e37-a8e3ee6320e4" containerName="istio-proxy"
Sep 15 12:01:29.859130 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:29.858535    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="74958bf4-3496-4a47-915e-d22db0fe930d" containerName="istio-proxy"
Sep 15 12:01:29.859130 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:29.858546    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a1653f0-6e27-4f99-bcfe-d43bf167398c" containerName="maas-api"
Sep 15 12:01:29.859130 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:29.858553    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cac8de2-5d37-40f3-8043-9c609967a0ad" containerName="maas-api"
Sep 15 12:01:29.859130 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:29.858562    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="74958bf4-3496-4a47-915e-d22db0fe930d" containerName="istio-proxy"
Sep 15 12:01:29.859130 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:29.858571    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="694f893f-8150-4906-8bed-889fab8516b5" containerName="payload-processing"
Sep 15 12:01:29.859130 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:29.858579    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1070cadb-2df9-465d-b217-28f1441319e0" containerName="payload-processing"
Sep 15 12:01:29.859130 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:29.858585    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b6ff206-86d2-454d-98b5-7581aba1a431" containerName="payload-processing"
Sep 15 12:01:29.861477 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:29.861461    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84f7f65f89-bvcnw"
Sep 15 12:01:29.864480 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:29.864360    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 15 12:01:29.864480 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:29.864378    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w7hxh\""
Sep 15 12:01:29.864480 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:29.864368    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 15 12:01:29.864480 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:29.864371    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 15 12:01:29.871482 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:29.871460    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84f7f65f89-bvcnw"]
Sep 15 12:01:29.985714 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:29.985658    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f56836e-a1e4-47c1-b4d3-0c4b77051ec8-metrics-certs\") pod \"maas-controller-84f7f65f89-bvcnw\" (UID: \"1f56836e-a1e4-47c1-b4d3-0c4b77051ec8\") " pod="opendatahub/maas-controller-84f7f65f89-bvcnw"
Sep 15 12:01:29.985714 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:29.985719    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs9wj\" (UniqueName: \"kubernetes.io/projected/1f56836e-a1e4-47c1-b4d3-0c4b77051ec8-kube-api-access-cs9wj\") pod \"maas-controller-84f7f65f89-bvcnw\" (UID: \"1f56836e-a1e4-47c1-b4d3-0c4b77051ec8\") " pod="opendatahub/maas-controller-84f7f65f89-bvcnw"
Sep 15 12:01:29.985959 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:29.985801    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1f56836e-a1e4-47c1-b4d3-0c4b77051ec8-webhook-cert\") pod \"maas-controller-84f7f65f89-bvcnw\" (UID: \"1f56836e-a1e4-47c1-b4d3-0c4b77051ec8\") " pod="opendatahub/maas-controller-84f7f65f89-bvcnw"
Sep 15 12:01:30.086496 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:30.086452    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f56836e-a1e4-47c1-b4d3-0c4b77051ec8-metrics-certs\") pod \"maas-controller-84f7f65f89-bvcnw\" (UID: \"1f56836e-a1e4-47c1-b4d3-0c4b77051ec8\") " pod="opendatahub/maas-controller-84f7f65f89-bvcnw"
Sep 15 12:01:30.086756 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:30.086502    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs9wj\" (UniqueName: \"kubernetes.io/projected/1f56836e-a1e4-47c1-b4d3-0c4b77051ec8-kube-api-access-cs9wj\") pod \"maas-controller-84f7f65f89-bvcnw\" (UID: \"1f56836e-a1e4-47c1-b4d3-0c4b77051ec8\") " pod="opendatahub/maas-controller-84f7f65f89-bvcnw"
Sep 15 12:01:30.086756 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:30.086566    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1f56836e-a1e4-47c1-b4d3-0c4b77051ec8-webhook-cert\") pod \"maas-controller-84f7f65f89-bvcnw\" (UID: \"1f56836e-a1e4-47c1-b4d3-0c4b77051ec8\") " pod="opendatahub/maas-controller-84f7f65f89-bvcnw"
Sep 15 12:01:30.089196 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:30.089154    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1f56836e-a1e4-47c1-b4d3-0c4b77051ec8-webhook-cert\") pod \"maas-controller-84f7f65f89-bvcnw\" (UID: \"1f56836e-a1e4-47c1-b4d3-0c4b77051ec8\") " pod="opendatahub/maas-controller-84f7f65f89-bvcnw"
Sep 15 12:01:30.089308 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:30.089222    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f56836e-a1e4-47c1-b4d3-0c4b77051ec8-metrics-certs\") pod \"maas-controller-84f7f65f89-bvcnw\" (UID: \"1f56836e-a1e4-47c1-b4d3-0c4b77051ec8\") " pod="opendatahub/maas-controller-84f7f65f89-bvcnw"
Sep 15 12:01:30.098779 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:30.098757    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs9wj\" (UniqueName: \"kubernetes.io/projected/1f56836e-a1e4-47c1-b4d3-0c4b77051ec8-kube-api-access-cs9wj\") pod \"maas-controller-84f7f65f89-bvcnw\" (UID: \"1f56836e-a1e4-47c1-b4d3-0c4b77051ec8\") " pod="opendatahub/maas-controller-84f7f65f89-bvcnw"
Sep 15 12:01:30.172504 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:30.172472    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84f7f65f89-bvcnw"
Sep 15 12:01:30.443766 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:30.443735    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84f7f65f89-bvcnw"]
Sep 15 12:01:30.446390 ip-10-0-131-95 kubenswrapper[2582]: W0915 12:01:30.446362    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f56836e_a1e4_47c1_b4d3_0c4b77051ec8.slice/crio-63cf2883f72a232620660606f84158078b41b66aede1ff994809adc2feaccf25 WatchSource:0}: Error finding container 63cf2883f72a232620660606f84158078b41b66aede1ff994809adc2feaccf25: Status 404 returned error can't find the container with id 63cf2883f72a232620660606f84158078b41b66aede1ff994809adc2feaccf25
Sep 15 12:01:30.447539 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:30.447520    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 12:01:31.307437 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:31.307339    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84f7f65f89-bvcnw" event={"ID":"1f56836e-a1e4-47c1-b4d3-0c4b77051ec8","Type":"ContainerStarted","Data":"a8c22660e9110a66ac2b82d3877261d12bf7e4e8f04a30e8b1fd7824a20e5809"}
Sep 15 12:01:31.307437 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:31.307410    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84f7f65f89-bvcnw" event={"ID":"1f56836e-a1e4-47c1-b4d3-0c4b77051ec8","Type":"ContainerStarted","Data":"63cf2883f72a232620660606f84158078b41b66aede1ff994809adc2feaccf25"}
Sep 15 12:01:31.307873 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:31.307444    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-84f7f65f89-bvcnw"
Sep 15 12:01:31.325933 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:31.325874    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-84f7f65f89-bvcnw" podStartSLOduration=1.7311379649999998 podStartE2EDuration="2.325852934s" totalImagesPullingTime="594.714969ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:01:31.325504883 +0000 UTC m=+2170.787370936" watchObservedRunningTime="2026-09-15 12:01:31.325852934 +0000 UTC m=+2170.787718988"
Sep 15 12:01:42.313323 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:42.313288    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-84f7f65f89-bvcnw"
Sep 15 12:01:51.659110 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:51.659059    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84f7f65f89-bvcnw"]
Sep 15 12:01:51.659677 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:51.659320    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-84f7f65f89-bvcnw" podUID="1f56836e-a1e4-47c1-b4d3-0c4b77051ec8" containerName="manager" containerID="cri-o://a8c22660e9110a66ac2b82d3877261d12bf7e4e8f04a30e8b1fd7824a20e5809" gracePeriod=30
Sep 15 12:01:51.903779 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:51.903754    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84f7f65f89-bvcnw"
Sep 15 12:01:52.083795 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:52.083705    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cs9wj\" (UniqueName: \"kubernetes.io/projected/1f56836e-a1e4-47c1-b4d3-0c4b77051ec8-kube-api-access-cs9wj\") pod \"1f56836e-a1e4-47c1-b4d3-0c4b77051ec8\" (UID: \"1f56836e-a1e4-47c1-b4d3-0c4b77051ec8\") "
Sep 15 12:01:52.083795 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:52.083769    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f56836e-a1e4-47c1-b4d3-0c4b77051ec8-metrics-certs\") pod \"1f56836e-a1e4-47c1-b4d3-0c4b77051ec8\" (UID: \"1f56836e-a1e4-47c1-b4d3-0c4b77051ec8\") "
Sep 15 12:01:52.083795 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:52.083791    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1f56836e-a1e4-47c1-b4d3-0c4b77051ec8-webhook-cert\") pod \"1f56836e-a1e4-47c1-b4d3-0c4b77051ec8\" (UID: \"1f56836e-a1e4-47c1-b4d3-0c4b77051ec8\") "
Sep 15 12:01:52.086088 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:52.086054    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f56836e-a1e4-47c1-b4d3-0c4b77051ec8-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1f56836e-a1e4-47c1-b4d3-0c4b77051ec8" (UID: "1f56836e-a1e4-47c1-b4d3-0c4b77051ec8"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:01:52.086088 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:52.086077    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f56836e-a1e4-47c1-b4d3-0c4b77051ec8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1f56836e-a1e4-47c1-b4d3-0c4b77051ec8" (UID: "1f56836e-a1e4-47c1-b4d3-0c4b77051ec8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:01:52.086281 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:52.086107    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f56836e-a1e4-47c1-b4d3-0c4b77051ec8-kube-api-access-cs9wj" (OuterVolumeSpecName: "kube-api-access-cs9wj") pod "1f56836e-a1e4-47c1-b4d3-0c4b77051ec8" (UID: "1f56836e-a1e4-47c1-b4d3-0c4b77051ec8"). InnerVolumeSpecName "kube-api-access-cs9wj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:01:52.185399 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:52.185349    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cs9wj\" (UniqueName: \"kubernetes.io/projected/1f56836e-a1e4-47c1-b4d3-0c4b77051ec8-kube-api-access-cs9wj\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 12:01:52.185399 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:52.185390    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f56836e-a1e4-47c1-b4d3-0c4b77051ec8-metrics-certs\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 12:01:52.185399 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:52.185404    2582 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1f56836e-a1e4-47c1-b4d3-0c4b77051ec8-webhook-cert\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 12:01:52.402845 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:52.402808    2582 generic.go:356] "Generic (PLEG): container finished" podID="1f56836e-a1e4-47c1-b4d3-0c4b77051ec8" containerID="a8c22660e9110a66ac2b82d3877261d12bf7e4e8f04a30e8b1fd7824a20e5809" exitCode=0
Sep 15 12:01:52.403014 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:52.402859    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84f7f65f89-bvcnw"
Sep 15 12:01:52.403014 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:52.402865    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84f7f65f89-bvcnw" event={"ID":"1f56836e-a1e4-47c1-b4d3-0c4b77051ec8","Type":"ContainerDied","Data":"a8c22660e9110a66ac2b82d3877261d12bf7e4e8f04a30e8b1fd7824a20e5809"}
Sep 15 12:01:52.403014 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:52.402918    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84f7f65f89-bvcnw" event={"ID":"1f56836e-a1e4-47c1-b4d3-0c4b77051ec8","Type":"ContainerDied","Data":"63cf2883f72a232620660606f84158078b41b66aede1ff994809adc2feaccf25"}
Sep 15 12:01:52.403014 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:52.402941    2582 scope.go:117] "RemoveContainer" containerID="a8c22660e9110a66ac2b82d3877261d12bf7e4e8f04a30e8b1fd7824a20e5809"
Sep 15 12:01:52.412058 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:52.412040    2582 scope.go:117] "RemoveContainer" containerID="a8c22660e9110a66ac2b82d3877261d12bf7e4e8f04a30e8b1fd7824a20e5809"
Sep 15 12:01:52.412357 ip-10-0-131-95 kubenswrapper[2582]: E0915 12:01:52.412338    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8c22660e9110a66ac2b82d3877261d12bf7e4e8f04a30e8b1fd7824a20e5809\": container with ID starting with a8c22660e9110a66ac2b82d3877261d12bf7e4e8f04a30e8b1fd7824a20e5809 not found: ID does not exist" containerID="a8c22660e9110a66ac2b82d3877261d12bf7e4e8f04a30e8b1fd7824a20e5809"
Sep 15 12:01:52.412421 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:52.412365    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8c22660e9110a66ac2b82d3877261d12bf7e4e8f04a30e8b1fd7824a20e5809"} err="failed to get container status \"a8c22660e9110a66ac2b82d3877261d12bf7e4e8f04a30e8b1fd7824a20e5809\": rpc error: code = NotFound desc = could not find container \"a8c22660e9110a66ac2b82d3877261d12bf7e4e8f04a30e8b1fd7824a20e5809\": container with ID starting with a8c22660e9110a66ac2b82d3877261d12bf7e4e8f04a30e8b1fd7824a20e5809 not found: ID does not exist"
Sep 15 12:01:52.423400 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:52.423379    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84f7f65f89-bvcnw"]
Sep 15 12:01:52.426953 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:52.426932    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-84f7f65f89-bvcnw"]
Sep 15 12:01:53.045075 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:53.045043    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f56836e-a1e4-47c1-b4d3-0c4b77051ec8" path="/var/lib/kubelet/pods/1f56836e-a1e4-47c1-b4d3-0c4b77051ec8/volumes"
Sep 15 12:01:53.198477 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:53.198447    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-84f7f65f89-s4v94"]
Sep 15 12:01:53.198760 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:53.198749    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f56836e-a1e4-47c1-b4d3-0c4b77051ec8" containerName="manager"
Sep 15 12:01:53.198803 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:53.198762    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f56836e-a1e4-47c1-b4d3-0c4b77051ec8" containerName="manager"
Sep 15 12:01:53.198838 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:53.198817    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="290008a0-48d0-40f7-8e37-a8e3ee6320e4" containerName="istio-proxy"
Sep 15 12:01:53.198838 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:53.198828    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f56836e-a1e4-47c1-b4d3-0c4b77051ec8" containerName="manager"
Sep 15 12:01:53.203126 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:53.203105    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84f7f65f89-s4v94"
Sep 15 12:01:53.206051 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:53.206031    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 15 12:01:53.206161 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:53.206033    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w7hxh\""
Sep 15 12:01:53.206161 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:53.206102    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 15 12:01:53.206161 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:53.206067    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 15 12:01:53.211250 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:53.211230    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84f7f65f89-s4v94"]
Sep 15 12:01:53.396343 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:53.396313    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtqs9\" (UniqueName: \"kubernetes.io/projected/18d914b3-ad5c-40ce-9681-fa6681653c6f-kube-api-access-vtqs9\") pod \"maas-controller-84f7f65f89-s4v94\" (UID: \"18d914b3-ad5c-40ce-9681-fa6681653c6f\") " pod="opendatahub/maas-controller-84f7f65f89-s4v94"
Sep 15 12:01:53.396500 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:53.396350    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/18d914b3-ad5c-40ce-9681-fa6681653c6f-webhook-cert\") pod \"maas-controller-84f7f65f89-s4v94\" (UID: \"18d914b3-ad5c-40ce-9681-fa6681653c6f\") " pod="opendatahub/maas-controller-84f7f65f89-s4v94"
Sep 15 12:01:53.396543 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:53.396503    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18d914b3-ad5c-40ce-9681-fa6681653c6f-metrics-certs\") pod \"maas-controller-84f7f65f89-s4v94\" (UID: \"18d914b3-ad5c-40ce-9681-fa6681653c6f\") " pod="opendatahub/maas-controller-84f7f65f89-s4v94"
Sep 15 12:01:53.497077 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:53.497029    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtqs9\" (UniqueName: \"kubernetes.io/projected/18d914b3-ad5c-40ce-9681-fa6681653c6f-kube-api-access-vtqs9\") pod \"maas-controller-84f7f65f89-s4v94\" (UID: \"18d914b3-ad5c-40ce-9681-fa6681653c6f\") " pod="opendatahub/maas-controller-84f7f65f89-s4v94"
Sep 15 12:01:53.497077 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:53.497076    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/18d914b3-ad5c-40ce-9681-fa6681653c6f-webhook-cert\") pod \"maas-controller-84f7f65f89-s4v94\" (UID: \"18d914b3-ad5c-40ce-9681-fa6681653c6f\") " pod="opendatahub/maas-controller-84f7f65f89-s4v94"
Sep 15 12:01:53.497381 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:53.497161    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18d914b3-ad5c-40ce-9681-fa6681653c6f-metrics-certs\") pod \"maas-controller-84f7f65f89-s4v94\" (UID: \"18d914b3-ad5c-40ce-9681-fa6681653c6f\") " pod="opendatahub/maas-controller-84f7f65f89-s4v94"
Sep 15 12:01:53.499799 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:53.499769    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/18d914b3-ad5c-40ce-9681-fa6681653c6f-webhook-cert\") pod \"maas-controller-84f7f65f89-s4v94\" (UID: \"18d914b3-ad5c-40ce-9681-fa6681653c6f\") " pod="opendatahub/maas-controller-84f7f65f89-s4v94"
Sep 15 12:01:53.499901 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:53.499821    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18d914b3-ad5c-40ce-9681-fa6681653c6f-metrics-certs\") pod \"maas-controller-84f7f65f89-s4v94\" (UID: \"18d914b3-ad5c-40ce-9681-fa6681653c6f\") " pod="opendatahub/maas-controller-84f7f65f89-s4v94"
Sep 15 12:01:53.505396 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:53.505374    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtqs9\" (UniqueName: \"kubernetes.io/projected/18d914b3-ad5c-40ce-9681-fa6681653c6f-kube-api-access-vtqs9\") pod \"maas-controller-84f7f65f89-s4v94\" (UID: \"18d914b3-ad5c-40ce-9681-fa6681653c6f\") " pod="opendatahub/maas-controller-84f7f65f89-s4v94"
Sep 15 12:01:53.514253 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:53.514231    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84f7f65f89-s4v94"
Sep 15 12:01:53.786596 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:53.786569    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84f7f65f89-s4v94"]
Sep 15 12:01:53.788469 ip-10-0-131-95 kubenswrapper[2582]: W0915 12:01:53.788441    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18d914b3_ad5c_40ce_9681_fa6681653c6f.slice/crio-b0dd720740903c3a7c595675e0b53eacf371009b977800be518e689ebcf83f71 WatchSource:0}: Error finding container b0dd720740903c3a7c595675e0b53eacf371009b977800be518e689ebcf83f71: Status 404 returned error can't find the container with id b0dd720740903c3a7c595675e0b53eacf371009b977800be518e689ebcf83f71
Sep 15 12:01:54.190878 ip-10-0-131-95 kubenswrapper[2582]: E0915 12:01:54.190834    2582 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image" image="quay.io/opendatahub/maas-controller@sha256:7a4f668d32e3d85c004d563caa66fae56427e5521e63aa77d22e376fa6338fd0"
Sep 15 12:01:54.191265 ip-10-0-131-95 kubenswrapper[2582]: E0915 12:01:54.190946    2582 kuberuntime_manager.go:1459] "Unhandled Error" err="container manager start failed in pod maas-controller-84f7f65f89-s4v94_opendatahub(18d914b3-ad5c-40ce-9681-fa6681653c6f): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image" logger="UnhandledError"
Sep 15 12:01:54.191265 ip-10-0-131-95 kubenswrapper[2582]: E0915 12:01:54.190977    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image\"" pod="opendatahub/maas-controller-84f7f65f89-s4v94" podUID="18d914b3-ad5c-40ce-9681-fa6681653c6f"
Sep 15 12:01:54.418974 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:01:54.418933    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84f7f65f89-s4v94" event={"ID":"18d914b3-ad5c-40ce-9681-fa6681653c6f","Type":"ContainerStarted","Data":"b0dd720740903c3a7c595675e0b53eacf371009b977800be518e689ebcf83f71"}
Sep 15 12:01:54.419600 ip-10-0-131-95 kubenswrapper[2582]: E0915 12:01:54.419569    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/maas-controller@sha256:7a4f668d32e3d85c004d563caa66fae56427e5521e63aa77d22e376fa6338fd0\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image\"" pod="opendatahub/maas-controller-84f7f65f89-s4v94" podUID="18d914b3-ad5c-40ce-9681-fa6681653c6f"
Sep 15 12:01:55.423478 ip-10-0-131-95 kubenswrapper[2582]: E0915 12:01:55.423438    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/maas-controller@sha256:7a4f668d32e3d85c004d563caa66fae56427e5521e63aa77d22e376fa6338fd0\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image\"" pod="opendatahub/maas-controller-84f7f65f89-s4v94" podUID="18d914b3-ad5c-40ce-9681-fa6681653c6f"
Sep 15 12:02:09.481601 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:02:09.481567    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84f7f65f89-s4v94" event={"ID":"18d914b3-ad5c-40ce-9681-fa6681653c6f","Type":"ContainerStarted","Data":"4e25c447444a78926ba75cbf4495c064d091f6c4775d3d3b27265cfd6b3f9864"}
Sep 15 12:02:09.482066 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:02:09.481777    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-84f7f65f89-s4v94"
Sep 15 12:02:09.503829 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:02:09.503778    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-84f7f65f89-s4v94" podStartSLOduration=1.705199029 podStartE2EDuration="16.503762479s" totalImagesPullingTime="14.79856345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-09-15 12:02:09.501509721 +0000 UTC m=+2208.963375774" watchObservedRunningTime="2026-09-15 12:02:09.503762479 +0000 UTC m=+2208.965628532"
Sep 15 12:02:20.491279 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:02:20.491244    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-84f7f65f89-s4v94"
Sep 15 12:02:21.279911 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:02:21.279879    2582 scope.go:117] "RemoveContainer" containerID="d882cd47381f4317698d167a2c1c2a0022cb6efb9b880c07d63d528fcd384487"
Sep 15 12:05:02.859008 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:02.858954    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx"]
Sep 15 12:05:02.862625 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:02.862606    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx"
Sep 15 12:05:02.864800 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:02.864778    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-9b1f7de3-kserve-self-signed-certs\""
Sep 15 12:05:02.870167 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:02.870139    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx"]
Sep 15 12:05:02.907748 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:02.907708    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb7a9cf1-860f-4017-96f8-793cc969c36a-tmp-dir\") pod \"e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx\" (UID: \"bb7a9cf1-860f-4017-96f8-793cc969c36a\") " pod="llm/e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx"
Sep 15 12:05:02.907748 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:02.907759    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb7a9cf1-860f-4017-96f8-793cc969c36a-tls-certs\") pod \"e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx\" (UID: \"bb7a9cf1-860f-4017-96f8-793cc969c36a\") " pod="llm/e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx"
Sep 15 12:05:02.907972 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:02.907799    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb7a9cf1-860f-4017-96f8-793cc969c36a-model-cache\") pod \"e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx\" (UID: \"bb7a9cf1-860f-4017-96f8-793cc969c36a\") " pod="llm/e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx"
Sep 15 12:05:02.907972 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:02.907832    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb7a9cf1-860f-4017-96f8-793cc969c36a-home\") pod \"e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx\" (UID: \"bb7a9cf1-860f-4017-96f8-793cc969c36a\") " pod="llm/e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx"
Sep 15 12:05:02.907972 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:02.907875    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsjqx\" (UniqueName: \"kubernetes.io/projected/bb7a9cf1-860f-4017-96f8-793cc969c36a-kube-api-access-nsjqx\") pod \"e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx\" (UID: \"bb7a9cf1-860f-4017-96f8-793cc969c36a\") " pod="llm/e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx"
Sep 15 12:05:02.907972 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:02.907896    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb7a9cf1-860f-4017-96f8-793cc969c36a-dshm\") pod \"e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx\" (UID: \"bb7a9cf1-860f-4017-96f8-793cc969c36a\") " pod="llm/e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx"
Sep 15 12:05:03.008807 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:03.008763    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb7a9cf1-860f-4017-96f8-793cc969c36a-model-cache\") pod \"e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx\" (UID: \"bb7a9cf1-860f-4017-96f8-793cc969c36a\") " pod="llm/e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx"
Sep 15 12:05:03.008807 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:03.008812    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb7a9cf1-860f-4017-96f8-793cc969c36a-home\") pod \"e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx\" (UID: \"bb7a9cf1-860f-4017-96f8-793cc969c36a\") " pod="llm/e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx"
Sep 15 12:05:03.009083 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:03.008870    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsjqx\" (UniqueName: \"kubernetes.io/projected/bb7a9cf1-860f-4017-96f8-793cc969c36a-kube-api-access-nsjqx\") pod \"e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx\" (UID: \"bb7a9cf1-860f-4017-96f8-793cc969c36a\") " pod="llm/e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx"
Sep 15 12:05:03.009083 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:03.008900    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb7a9cf1-860f-4017-96f8-793cc969c36a-dshm\") pod \"e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx\" (UID: \"bb7a9cf1-860f-4017-96f8-793cc969c36a\") " pod="llm/e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx"
Sep 15 12:05:03.009083 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:03.008944    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb7a9cf1-860f-4017-96f8-793cc969c36a-tmp-dir\") pod \"e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx\" (UID: \"bb7a9cf1-860f-4017-96f8-793cc969c36a\") " pod="llm/e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx"
Sep 15 12:05:03.009083 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:03.008980    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb7a9cf1-860f-4017-96f8-793cc969c36a-tls-certs\") pod \"e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx\" (UID: \"bb7a9cf1-860f-4017-96f8-793cc969c36a\") " pod="llm/e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx"
Sep 15 12:05:03.009328 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:03.009286    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb7a9cf1-860f-4017-96f8-793cc969c36a-model-cache\") pod \"e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx\" (UID: \"bb7a9cf1-860f-4017-96f8-793cc969c36a\") " pod="llm/e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx"
Sep 15 12:05:03.009463 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:03.009424    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb7a9cf1-860f-4017-96f8-793cc969c36a-tmp-dir\") pod \"e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx\" (UID: \"bb7a9cf1-860f-4017-96f8-793cc969c36a\") " pod="llm/e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx"
Sep 15 12:05:03.009463 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:03.009447    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb7a9cf1-860f-4017-96f8-793cc969c36a-home\") pod \"e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx\" (UID: \"bb7a9cf1-860f-4017-96f8-793cc969c36a\") " pod="llm/e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx"
Sep 15 12:05:03.011552 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:03.011532    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb7a9cf1-860f-4017-96f8-793cc969c36a-dshm\") pod \"e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx\" (UID: \"bb7a9cf1-860f-4017-96f8-793cc969c36a\") " pod="llm/e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx"
Sep 15 12:05:03.011675 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:03.011656    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb7a9cf1-860f-4017-96f8-793cc969c36a-tls-certs\") pod \"e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx\" (UID: \"bb7a9cf1-860f-4017-96f8-793cc969c36a\") " pod="llm/e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx"
Sep 15 12:05:03.020475 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:03.020449    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsjqx\" (UniqueName: \"kubernetes.io/projected/bb7a9cf1-860f-4017-96f8-793cc969c36a-kube-api-access-nsjqx\") pod \"e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx\" (UID: \"bb7a9cf1-860f-4017-96f8-793cc969c36a\") " pod="llm/e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx"
Sep 15 12:05:03.173372 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:03.173326    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx"
Sep 15 12:05:03.449403 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:03.449374    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx"]
Sep 15 12:05:03.451949 ip-10-0-131-95 kubenswrapper[2582]: W0915 12:05:03.451926    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb7a9cf1_860f_4017_96f8_793cc969c36a.slice/crio-50cb047a5e0257f2f5a8683b5510c1567d868ecbd826ba01f51c76ba1fb22f27 WatchSource:0}: Error finding container 50cb047a5e0257f2f5a8683b5510c1567d868ecbd826ba01f51c76ba1fb22f27: Status 404 returned error can't find the container with id 50cb047a5e0257f2f5a8683b5510c1567d868ecbd826ba01f51c76ba1fb22f27
Sep 15 12:05:04.256899 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:04.256864    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx" event={"ID":"bb7a9cf1-860f-4017-96f8-793cc969c36a","Type":"ContainerStarted","Data":"8a9dddd534fd3aee83e2426e36e5ea581484776a9da033c7250fb2bdf950e837"}
Sep 15 12:05:04.257358 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:04.256909    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx" event={"ID":"bb7a9cf1-860f-4017-96f8-793cc969c36a","Type":"ContainerStarted","Data":"50cb047a5e0257f2f5a8683b5510c1567d868ecbd826ba01f51c76ba1fb22f27"}
Sep 15 12:05:04.272719 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:04.272659    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx" podStartSLOduration=2.2726388699999998 podStartE2EDuration="2.27263887s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:05:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:05:04.27132407 +0000 UTC m=+2383.733190122" watchObservedRunningTime="2026-09-15 12:05:04.27263887 +0000 UTC m=+2383.734504926"
Sep 15 12:05:13.174104 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:13.174060    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx"
Sep 15 12:05:13.174611 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:13.174131    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx"
Sep 15 12:05:13.187402 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:13.187376    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx"
Sep 15 12:05:13.307427 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:13.307400    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx"
Sep 15 12:05:27.665467 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:27.665429    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx"]
Sep 15 12:05:42.685421 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:42.685341    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx" podUID="bb7a9cf1-860f-4017-96f8-793cc969c36a" containerName="main" containerID="cri-o://8a9dddd534fd3aee83e2426e36e5ea581484776a9da033c7250fb2bdf950e837" gracePeriod=45
Sep 15 12:05:42.923655 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:42.923631    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx"
Sep 15 12:05:42.958482 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:42.958402    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb7a9cf1-860f-4017-96f8-793cc969c36a-tls-certs\") pod \"bb7a9cf1-860f-4017-96f8-793cc969c36a\" (UID: \"bb7a9cf1-860f-4017-96f8-793cc969c36a\") "
Sep 15 12:05:42.958482 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:42.958446    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb7a9cf1-860f-4017-96f8-793cc969c36a-home\") pod \"bb7a9cf1-860f-4017-96f8-793cc969c36a\" (UID: \"bb7a9cf1-860f-4017-96f8-793cc969c36a\") "
Sep 15 12:05:42.958482 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:42.958466    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb7a9cf1-860f-4017-96f8-793cc969c36a-dshm\") pod \"bb7a9cf1-860f-4017-96f8-793cc969c36a\" (UID: \"bb7a9cf1-860f-4017-96f8-793cc969c36a\") "
Sep 15 12:05:42.958758 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:42.958492    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nsjqx\" (UniqueName: \"kubernetes.io/projected/bb7a9cf1-860f-4017-96f8-793cc969c36a-kube-api-access-nsjqx\") pod \"bb7a9cf1-860f-4017-96f8-793cc969c36a\" (UID: \"bb7a9cf1-860f-4017-96f8-793cc969c36a\") "
Sep 15 12:05:42.958758 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:42.958520    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb7a9cf1-860f-4017-96f8-793cc969c36a-tmp-dir\") pod \"bb7a9cf1-860f-4017-96f8-793cc969c36a\" (UID: \"bb7a9cf1-860f-4017-96f8-793cc969c36a\") "
Sep 15 12:05:42.958758 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:42.958542    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb7a9cf1-860f-4017-96f8-793cc969c36a-model-cache\") pod \"bb7a9cf1-860f-4017-96f8-793cc969c36a\" (UID: \"bb7a9cf1-860f-4017-96f8-793cc969c36a\") "
Sep 15 12:05:42.958758 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:42.958701    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb7a9cf1-860f-4017-96f8-793cc969c36a-home" (OuterVolumeSpecName: "home") pod "bb7a9cf1-860f-4017-96f8-793cc969c36a" (UID: "bb7a9cf1-860f-4017-96f8-793cc969c36a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:05:42.958937 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:42.958823    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb7a9cf1-860f-4017-96f8-793cc969c36a-home\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 12:05:42.958937 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:42.958814    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb7a9cf1-860f-4017-96f8-793cc969c36a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bb7a9cf1-860f-4017-96f8-793cc969c36a" (UID: "bb7a9cf1-860f-4017-96f8-793cc969c36a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:05:42.958937 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:42.958893    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb7a9cf1-860f-4017-96f8-793cc969c36a-model-cache" (OuterVolumeSpecName: "model-cache") pod "bb7a9cf1-860f-4017-96f8-793cc969c36a" (UID: "bb7a9cf1-860f-4017-96f8-793cc969c36a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:05:42.960960 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:42.960927    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb7a9cf1-860f-4017-96f8-793cc969c36a-dshm" (OuterVolumeSpecName: "dshm") pod "bb7a9cf1-860f-4017-96f8-793cc969c36a" (UID: "bb7a9cf1-860f-4017-96f8-793cc969c36a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:05:42.961166 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:42.961145    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb7a9cf1-860f-4017-96f8-793cc969c36a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bb7a9cf1-860f-4017-96f8-793cc969c36a" (UID: "bb7a9cf1-860f-4017-96f8-793cc969c36a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:05:42.961166 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:42.961151    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb7a9cf1-860f-4017-96f8-793cc969c36a-kube-api-access-nsjqx" (OuterVolumeSpecName: "kube-api-access-nsjqx") pod "bb7a9cf1-860f-4017-96f8-793cc969c36a" (UID: "bb7a9cf1-860f-4017-96f8-793cc969c36a"). InnerVolumeSpecName "kube-api-access-nsjqx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:05:43.060052 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:43.060025    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb7a9cf1-860f-4017-96f8-793cc969c36a-tmp-dir\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 12:05:43.060052 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:43.060049    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb7a9cf1-860f-4017-96f8-793cc969c36a-model-cache\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 12:05:43.060212 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:43.060058    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb7a9cf1-860f-4017-96f8-793cc969c36a-tls-certs\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 12:05:43.060212 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:43.060066    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb7a9cf1-860f-4017-96f8-793cc969c36a-dshm\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 12:05:43.060212 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:43.060073    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nsjqx\" (UniqueName: \"kubernetes.io/projected/bb7a9cf1-860f-4017-96f8-793cc969c36a-kube-api-access-nsjqx\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 12:05:43.427683 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:43.427629    2582 generic.go:356] "Generic (PLEG): container finished" podID="bb7a9cf1-860f-4017-96f8-793cc969c36a" containerID="8a9dddd534fd3aee83e2426e36e5ea581484776a9da033c7250fb2bdf950e837" exitCode=0
Sep 15 12:05:43.427683 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:43.427672    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx"
Sep 15 12:05:43.427945 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:43.427710    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx" event={"ID":"bb7a9cf1-860f-4017-96f8-793cc969c36a","Type":"ContainerDied","Data":"8a9dddd534fd3aee83e2426e36e5ea581484776a9da033c7250fb2bdf950e837"}
Sep 15 12:05:43.427945 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:43.427754    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx" event={"ID":"bb7a9cf1-860f-4017-96f8-793cc969c36a","Type":"ContainerDied","Data":"50cb047a5e0257f2f5a8683b5510c1567d868ecbd826ba01f51c76ba1fb22f27"}
Sep 15 12:05:43.427945 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:43.427772    2582 scope.go:117] "RemoveContainer" containerID="8a9dddd534fd3aee83e2426e36e5ea581484776a9da033c7250fb2bdf950e837"
Sep 15 12:05:43.436386 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:43.436366    2582 scope.go:117] "RemoveContainer" containerID="8a9dddd534fd3aee83e2426e36e5ea581484776a9da033c7250fb2bdf950e837"
Sep 15 12:05:43.436669 ip-10-0-131-95 kubenswrapper[2582]: E0915 12:05:43.436647    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a9dddd534fd3aee83e2426e36e5ea581484776a9da033c7250fb2bdf950e837\": container with ID starting with 8a9dddd534fd3aee83e2426e36e5ea581484776a9da033c7250fb2bdf950e837 not found: ID does not exist" containerID="8a9dddd534fd3aee83e2426e36e5ea581484776a9da033c7250fb2bdf950e837"
Sep 15 12:05:43.436743 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:43.436677    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a9dddd534fd3aee83e2426e36e5ea581484776a9da033c7250fb2bdf950e837"} err="failed to get container status \"8a9dddd534fd3aee83e2426e36e5ea581484776a9da033c7250fb2bdf950e837\": rpc error: code = NotFound desc = could not find container \"8a9dddd534fd3aee83e2426e36e5ea581484776a9da033c7250fb2bdf950e837\": container with ID starting with 8a9dddd534fd3aee83e2426e36e5ea581484776a9da033c7250fb2bdf950e837 not found: ID does not exist"
Sep 15 12:05:43.442980 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:43.442957    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx"]
Sep 15 12:05:43.448762 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:43.448741    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-9b1f7de3-kserve-58555d8cd7-qmvxx"]
Sep 15 12:05:45.044893 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:45.044863    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb7a9cf1-860f-4017-96f8-793cc969c36a" path="/var/lib/kubelet/pods/bb7a9cf1-860f-4017-96f8-793cc969c36a/volumes"
Sep 15 12:05:55.934685 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:55.934648    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-679d646747-bxjl5"]
Sep 15 12:05:55.935316 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:55.935005    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb7a9cf1-860f-4017-96f8-793cc969c36a" containerName="main"
Sep 15 12:05:55.935316 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:55.935017    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb7a9cf1-860f-4017-96f8-793cc969c36a" containerName="main"
Sep 15 12:05:55.935316 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:55.935087    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb7a9cf1-860f-4017-96f8-793cc969c36a" containerName="main"
Sep 15 12:05:55.939226 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:55.939202    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-679d646747-bxjl5"
Sep 15 12:05:55.949434 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:55.949405    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-679d646747-bxjl5"]
Sep 15 12:05:55.979035 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:55.979001    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9eaf6e9a-cc68-4c9d-9ec2-ad28d6567353-maas-api-tls\") pod \"maas-api-679d646747-bxjl5\" (UID: \"9eaf6e9a-cc68-4c9d-9ec2-ad28d6567353\") " pod="odh-ai-gateway-infra/maas-api-679d646747-bxjl5"
Sep 15 12:05:55.979259 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:55.979042    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9eaf6e9a-cc68-4c9d-9ec2-ad28d6567353-metrics-certs\") pod \"maas-api-679d646747-bxjl5\" (UID: \"9eaf6e9a-cc68-4c9d-9ec2-ad28d6567353\") " pod="odh-ai-gateway-infra/maas-api-679d646747-bxjl5"
Sep 15 12:05:55.979259 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:55.979118    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h85bf\" (UniqueName: \"kubernetes.io/projected/9eaf6e9a-cc68-4c9d-9ec2-ad28d6567353-kube-api-access-h85bf\") pod \"maas-api-679d646747-bxjl5\" (UID: \"9eaf6e9a-cc68-4c9d-9ec2-ad28d6567353\") " pod="odh-ai-gateway-infra/maas-api-679d646747-bxjl5"
Sep 15 12:05:55.979259 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:55.979145    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9eaf6e9a-cc68-4c9d-9ec2-ad28d6567353-openshift-service-ca\") pod \"maas-api-679d646747-bxjl5\" (UID: \"9eaf6e9a-cc68-4c9d-9ec2-ad28d6567353\") " pod="odh-ai-gateway-infra/maas-api-679d646747-bxjl5"
Sep 15 12:05:56.080045 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:56.080007    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h85bf\" (UniqueName: \"kubernetes.io/projected/9eaf6e9a-cc68-4c9d-9ec2-ad28d6567353-kube-api-access-h85bf\") pod \"maas-api-679d646747-bxjl5\" (UID: \"9eaf6e9a-cc68-4c9d-9ec2-ad28d6567353\") " pod="odh-ai-gateway-infra/maas-api-679d646747-bxjl5"
Sep 15 12:05:56.080045 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:56.080058    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9eaf6e9a-cc68-4c9d-9ec2-ad28d6567353-openshift-service-ca\") pod \"maas-api-679d646747-bxjl5\" (UID: \"9eaf6e9a-cc68-4c9d-9ec2-ad28d6567353\") " pod="odh-ai-gateway-infra/maas-api-679d646747-bxjl5"
Sep 15 12:05:56.080342 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:56.080098    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9eaf6e9a-cc68-4c9d-9ec2-ad28d6567353-maas-api-tls\") pod \"maas-api-679d646747-bxjl5\" (UID: \"9eaf6e9a-cc68-4c9d-9ec2-ad28d6567353\") " pod="odh-ai-gateway-infra/maas-api-679d646747-bxjl5"
Sep 15 12:05:56.080342 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:56.080124    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9eaf6e9a-cc68-4c9d-9ec2-ad28d6567353-metrics-certs\") pod \"maas-api-679d646747-bxjl5\" (UID: \"9eaf6e9a-cc68-4c9d-9ec2-ad28d6567353\") " pod="odh-ai-gateway-infra/maas-api-679d646747-bxjl5"
Sep 15 12:05:56.080749 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:56.080722    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9eaf6e9a-cc68-4c9d-9ec2-ad28d6567353-openshift-service-ca\") pod \"maas-api-679d646747-bxjl5\" (UID: \"9eaf6e9a-cc68-4c9d-9ec2-ad28d6567353\") " pod="odh-ai-gateway-infra/maas-api-679d646747-bxjl5"
Sep 15 12:05:56.082879 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:56.082854    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9eaf6e9a-cc68-4c9d-9ec2-ad28d6567353-metrics-certs\") pod \"maas-api-679d646747-bxjl5\" (UID: \"9eaf6e9a-cc68-4c9d-9ec2-ad28d6567353\") " pod="odh-ai-gateway-infra/maas-api-679d646747-bxjl5"
Sep 15 12:05:56.082963 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:56.082897    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9eaf6e9a-cc68-4c9d-9ec2-ad28d6567353-maas-api-tls\") pod \"maas-api-679d646747-bxjl5\" (UID: \"9eaf6e9a-cc68-4c9d-9ec2-ad28d6567353\") " pod="odh-ai-gateway-infra/maas-api-679d646747-bxjl5"
Sep 15 12:05:56.090859 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:56.090838    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h85bf\" (UniqueName: \"kubernetes.io/projected/9eaf6e9a-cc68-4c9d-9ec2-ad28d6567353-kube-api-access-h85bf\") pod \"maas-api-679d646747-bxjl5\" (UID: \"9eaf6e9a-cc68-4c9d-9ec2-ad28d6567353\") " pod="odh-ai-gateway-infra/maas-api-679d646747-bxjl5"
Sep 15 12:05:56.251923 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:56.251831    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-679d646747-bxjl5"
Sep 15 12:05:56.531722 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:56.531695    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-679d646747-bxjl5"]
Sep 15 12:05:56.534237 ip-10-0-131-95 kubenswrapper[2582]: W0915 12:05:56.534207    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eaf6e9a_cc68_4c9d_9ec2_ad28d6567353.slice/crio-deaa01bc25d60c69963c6f36bfe23f0e5b6b400c6e5c7e3c6820ed5ddcd8faaa WatchSource:0}: Error finding container deaa01bc25d60c69963c6f36bfe23f0e5b6b400c6e5c7e3c6820ed5ddcd8faaa: Status 404 returned error can't find the container with id deaa01bc25d60c69963c6f36bfe23f0e5b6b400c6e5c7e3c6820ed5ddcd8faaa
Sep 15 12:05:57.494108 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:05:57.494077    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-679d646747-bxjl5" event={"ID":"9eaf6e9a-cc68-4c9d-9ec2-ad28d6567353","Type":"ContainerStarted","Data":"deaa01bc25d60c69963c6f36bfe23f0e5b6b400c6e5c7e3c6820ed5ddcd8faaa"}
Sep 15 12:06:00.509342 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:00.509305    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-679d646747-bxjl5" event={"ID":"9eaf6e9a-cc68-4c9d-9ec2-ad28d6567353","Type":"ContainerStarted","Data":"38bdee02f7c6fdb74b132cca6ac5cfb53b250add829d62aaa7b24d3489fc20ca"}
Sep 15 12:06:00.509731 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:00.509443    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-679d646747-bxjl5"
Sep 15 12:06:00.527705 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:00.527657    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-679d646747-bxjl5" podStartSLOduration=2.22451877 podStartE2EDuration="5.52764209s" totalImagesPullingTime="3.30312332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:05:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:06:00.526198842 +0000 UTC m=+2439.988064897" watchObservedRunningTime="2026-09-15 12:06:00.52764209 +0000 UTC m=+2439.989508143"
Sep 15 12:06:06.519603 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:06.519573    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-679d646747-bxjl5"
Sep 15 12:06:06.569915 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:06.569884    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-9fb85669f-gspbg"]
Sep 15 12:06:06.570126 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:06.570076    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-9fb85669f-gspbg" podUID="484f8c91-969e-4c57-bf18-1213c48cd1d7" containerName="maas-api" containerID="cri-o://f613a59f36916be7600bc0afdb83f842dec8de28fa1346cab2f848ee311e5451" gracePeriod=30
Sep 15 12:06:07.478957 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:07.478918    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-9fb85669f-gspbg" podUID="484f8c91-969e-4c57-bf18-1213c48cd1d7" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.27:8443/health\": dial tcp 10.134.0.27:8443: connect: connection refused"
Sep 15 12:06:07.819743 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:07.819719    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-9fb85669f-gspbg"
Sep 15 12:06:07.894668 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:07.894634    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/484f8c91-969e-4c57-bf18-1213c48cd1d7-maas-api-tls\") pod \"484f8c91-969e-4c57-bf18-1213c48cd1d7\" (UID: \"484f8c91-969e-4c57-bf18-1213c48cd1d7\") "
Sep 15 12:06:07.894668 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:07.894675    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/484f8c91-969e-4c57-bf18-1213c48cd1d7-openshift-service-ca\") pod \"484f8c91-969e-4c57-bf18-1213c48cd1d7\" (UID: \"484f8c91-969e-4c57-bf18-1213c48cd1d7\") "
Sep 15 12:06:07.894883 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:07.894740    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6md9d\" (UniqueName: \"kubernetes.io/projected/484f8c91-969e-4c57-bf18-1213c48cd1d7-kube-api-access-6md9d\") pod \"484f8c91-969e-4c57-bf18-1213c48cd1d7\" (UID: \"484f8c91-969e-4c57-bf18-1213c48cd1d7\") "
Sep 15 12:06:07.894883 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:07.894772    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/484f8c91-969e-4c57-bf18-1213c48cd1d7-metrics-certs\") pod \"484f8c91-969e-4c57-bf18-1213c48cd1d7\" (UID: \"484f8c91-969e-4c57-bf18-1213c48cd1d7\") "
Sep 15 12:06:07.895099 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:07.895069    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/484f8c91-969e-4c57-bf18-1213c48cd1d7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "484f8c91-969e-4c57-bf18-1213c48cd1d7" (UID: "484f8c91-969e-4c57-bf18-1213c48cd1d7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:06:07.896949 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:07.896920    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/484f8c91-969e-4c57-bf18-1213c48cd1d7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "484f8c91-969e-4c57-bf18-1213c48cd1d7" (UID: "484f8c91-969e-4c57-bf18-1213c48cd1d7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:06:07.897060 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:07.896980    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/484f8c91-969e-4c57-bf18-1213c48cd1d7-kube-api-access-6md9d" (OuterVolumeSpecName: "kube-api-access-6md9d") pod "484f8c91-969e-4c57-bf18-1213c48cd1d7" (UID: "484f8c91-969e-4c57-bf18-1213c48cd1d7"). InnerVolumeSpecName "kube-api-access-6md9d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:06:07.897060 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:07.897027    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/484f8c91-969e-4c57-bf18-1213c48cd1d7-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "484f8c91-969e-4c57-bf18-1213c48cd1d7" (UID: "484f8c91-969e-4c57-bf18-1213c48cd1d7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:06:07.995846 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:07.995765    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/484f8c91-969e-4c57-bf18-1213c48cd1d7-maas-api-tls\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 12:06:07.995846 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:07.995793    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/484f8c91-969e-4c57-bf18-1213c48cd1d7-openshift-service-ca\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 12:06:07.995846 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:07.995803    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6md9d\" (UniqueName: \"kubernetes.io/projected/484f8c91-969e-4c57-bf18-1213c48cd1d7-kube-api-access-6md9d\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 12:06:07.995846 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:07.995811    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/484f8c91-969e-4c57-bf18-1213c48cd1d7-metrics-certs\") on node \"ip-10-0-131-95.ec2.internal\" DevicePath \"\""
Sep 15 12:06:08.545593 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:08.545554    2582 generic.go:356] "Generic (PLEG): container finished" podID="484f8c91-969e-4c57-bf18-1213c48cd1d7" containerID="f613a59f36916be7600bc0afdb83f842dec8de28fa1346cab2f848ee311e5451" exitCode=0
Sep 15 12:06:08.545791 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:08.545602    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-9fb85669f-gspbg"
Sep 15 12:06:08.545791 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:08.545639    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-9fb85669f-gspbg" event={"ID":"484f8c91-969e-4c57-bf18-1213c48cd1d7","Type":"ContainerDied","Data":"f613a59f36916be7600bc0afdb83f842dec8de28fa1346cab2f848ee311e5451"}
Sep 15 12:06:08.545791 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:08.545689    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-9fb85669f-gspbg" event={"ID":"484f8c91-969e-4c57-bf18-1213c48cd1d7","Type":"ContainerDied","Data":"8122b3e32dddd23d2117ec1680713a6740e4cad089ba6cdb154595dc499ad0ba"}
Sep 15 12:06:08.545791 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:08.545710    2582 scope.go:117] "RemoveContainer" containerID="f613a59f36916be7600bc0afdb83f842dec8de28fa1346cab2f848ee311e5451"
Sep 15 12:06:08.555067 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:08.555048    2582 scope.go:117] "RemoveContainer" containerID="f613a59f36916be7600bc0afdb83f842dec8de28fa1346cab2f848ee311e5451"
Sep 15 12:06:08.555372 ip-10-0-131-95 kubenswrapper[2582]: E0915 12:06:08.555352    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f613a59f36916be7600bc0afdb83f842dec8de28fa1346cab2f848ee311e5451\": container with ID starting with f613a59f36916be7600bc0afdb83f842dec8de28fa1346cab2f848ee311e5451 not found: ID does not exist" containerID="f613a59f36916be7600bc0afdb83f842dec8de28fa1346cab2f848ee311e5451"
Sep 15 12:06:08.555455 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:08.555382    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f613a59f36916be7600bc0afdb83f842dec8de28fa1346cab2f848ee311e5451"} err="failed to get container status \"f613a59f36916be7600bc0afdb83f842dec8de28fa1346cab2f848ee311e5451\": rpc error: code = NotFound desc = could not find container \"f613a59f36916be7600bc0afdb83f842dec8de28fa1346cab2f848ee311e5451\": container with ID starting with f613a59f36916be7600bc0afdb83f842dec8de28fa1346cab2f848ee311e5451 not found: ID does not exist"
Sep 15 12:06:08.565616 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:08.565589    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-9fb85669f-gspbg"]
Sep 15 12:06:08.571961 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:08.571939    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-9fb85669f-gspbg"]
Sep 15 12:06:09.044669 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:09.044630    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="484f8c91-969e-4c57-bf18-1213c48cd1d7" path="/var/lib/kubelet/pods/484f8c91-969e-4c57-bf18-1213c48cd1d7/volumes"
Sep 15 12:06:23.024910 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:23.024861    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-9ttpp_a09ce552-8d39-46c9-8636-4a4e660f35d4/manager/0.log"
Sep 15 12:06:23.140832 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:23.140800    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-rkl98_5c49bde6-f1d3-4a2a-88cf-941b03a40cec/manager/0.log"
Sep 15 12:06:23.256532 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:23.256500    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-84f7f65f89-s4v94_18d914b3-ad5c-40ce-9681-fa6681653c6f/manager/0.log"
Sep 15 12:06:23.713892 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:23.713859    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-99f4658c8-r2prg_5f497f61-05e4-483d-8466-3324e1c333ea/copy-manifests/0.log"
Sep 15 12:06:23.720287 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:23.720262    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-99f4658c8-r2prg_5f497f61-05e4-483d-8466-3324e1c333ea/manager/0.log"
Sep 15 12:06:24.164695 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:24.164669    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-679d646747-bxjl5_9eaf6e9a-cc68-4c9d-9ec2-ad28d6567353/maas-api/0.log"
Sep 15 12:06:24.596274 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:24.596195    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-nrlw6_962add8e-530f-4c89-a7e3-38016c28de49/postgres/0.log"
Sep 15 12:06:25.465089 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:25.465044    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-kmmpd_d6e2a4e8-765f-4062-b864-598b9d15b6da/manager/0.log"
Sep 15 12:06:25.581461 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:25.581429    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-ctrdh_6d8ceef5-19b0-4e77-a5b5-76541dd78766/manager/0.log"
Sep 15 12:06:26.484011 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:26.483958    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-7pdsq_41aa5744-80c2-4bdb-8266-9c47a73cdb55/discovery/0.log"
Sep 15 12:06:26.598671 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:26.598622    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59bc95f796-6kfg5_9ed3b65d-fc65-4f40-9e21-ef52dfe796ef/kube-auth-proxy/0.log"
Sep 15 12:06:27.049573 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:27.049539    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-7frsd_aba71c39-2aa1-4e31-bc47-a7106371c009/payload-processing/0.log"
Sep 15 12:06:27.622731 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:27.622701    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-vxz2r_de3ba2c5-3af3-47c6-aed7-11e625f21117/main/0.log"
Sep 15 12:06:28.080633 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:28.080593    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-jj6s2_62ff724c-414c-408c-9872-92e9a9346a0a/main/0.log"
Sep 15 12:06:36.552004 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:36.551974    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dm5z4_270f712b-6161-4b60-8f89-0b2bcad6f27c/global-pull-secret-syncer/0.log"
Sep 15 12:06:36.626906 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:36.626869    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nbgzq_cab4df79-1ae2-4498-a8db-7bf2bf6d0042/konnectivity-agent/0.log"
Sep 15 12:06:36.676839 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:36.676809    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-95.ec2.internal_8f133eefe581cc2b4f83ef628d20097a/haproxy/0.log"
Sep 15 12:06:41.220533 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:41.220501    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-kmmpd_d6e2a4e8-765f-4062-b864-598b9d15b6da/manager/0.log"
Sep 15 12:06:41.244491 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:41.244463    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-ctrdh_6d8ceef5-19b0-4e77-a5b5-76541dd78766/manager/0.log"
Sep 15 12:06:43.195141 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:43.195110    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g4nq7_aee1ae9c-c04a-413c-821e-b2a39a29f192/node-exporter/0.log"
Sep 15 12:06:43.213886 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:43.213864    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g4nq7_aee1ae9c-c04a-413c-821e-b2a39a29f192/kube-rbac-proxy/0.log"
Sep 15 12:06:43.233632 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:43.233601    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g4nq7_aee1ae9c-c04a-413c-821e-b2a39a29f192/init-textfile/0.log"
Sep 15 12:06:43.744256 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:43.744219    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-mc9fm_76a3e53b-84f0-4737-96f6-94d90381a83a/prometheus-operator-admission-webhook/0.log"
Sep 15 12:06:46.765974 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:46.765946    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-6tqxc_8abc8e28-e2ec-4c09-a19e-83c506dafe45/download-server/0.log"
Sep 15 12:06:48.531617 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:48.531582    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-545ff_9e3fd00a-fbc1-4297-90de-8e45975e3648/dns/0.log"
Sep 15 12:06:48.550993 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:48.550964    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-545ff_9e3fd00a-fbc1-4297-90de-8e45975e3648/kube-rbac-proxy/0.log"
Sep 15 12:06:48.689913 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:48.689879    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hn4pl_55799bb6-be25-43c7-b9fa-2dcb81a6fb84/dns-node-resolver/0.log"
Sep 15 12:06:49.222886 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:49.222858    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-64d479d79d-ztcsf_050bb0ba-ec3c-4a7a-ad4d-2cd96497a9cf/registry/0.log"
Sep 15 12:06:49.288212 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:49.288170    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rxz9x_a1800c05-2abc-414f-b183-5ba0aef5ae63/node-ca/0.log"
Sep 15 12:06:49.505077 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:49.504994    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rmwp6/perf-node-gather-daemonset-dl64f"]
Sep 15 12:06:49.505367 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:49.505353    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="484f8c91-969e-4c57-bf18-1213c48cd1d7" containerName="maas-api"
Sep 15 12:06:49.505424 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:49.505369    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="484f8c91-969e-4c57-bf18-1213c48cd1d7" containerName="maas-api"
Sep 15 12:06:49.505424 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:49.505420    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="484f8c91-969e-4c57-bf18-1213c48cd1d7" containerName="maas-api"
Sep 15 12:06:49.508634 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:49.508613    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-dl64f"
Sep 15 12:06:49.510735 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:49.510716    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rmwp6\"/\"openshift-service-ca.crt\""
Sep 15 12:06:49.510844 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:49.510718    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rmwp6\"/\"kube-root-ca.crt\""
Sep 15 12:06:49.511486 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:49.511472    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rmwp6\"/\"default-dockercfg-k4p5p\""
Sep 15 12:06:49.520985 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:49.520961    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rmwp6/perf-node-gather-daemonset-dl64f"]
Sep 15 12:06:49.651455 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:49.651423    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5833d9bc-792d-44ec-91f3-605cea4329dc-lib-modules\") pod \"perf-node-gather-daemonset-dl64f\" (UID: \"5833d9bc-792d-44ec-91f3-605cea4329dc\") " pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-dl64f"
Sep 15 12:06:49.651455 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:49.651460    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5833d9bc-792d-44ec-91f3-605cea4329dc-podres\") pod \"perf-node-gather-daemonset-dl64f\" (UID: \"5833d9bc-792d-44ec-91f3-605cea4329dc\") " pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-dl64f"
Sep 15 12:06:49.651848 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:49.651487    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5833d9bc-792d-44ec-91f3-605cea4329dc-proc\") pod \"perf-node-gather-daemonset-dl64f\" (UID: \"5833d9bc-792d-44ec-91f3-605cea4329dc\") " pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-dl64f"
Sep 15 12:06:49.651848 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:49.651575    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvvcn\" (UniqueName: \"kubernetes.io/projected/5833d9bc-792d-44ec-91f3-605cea4329dc-kube-api-access-wvvcn\") pod \"perf-node-gather-daemonset-dl64f\" (UID: \"5833d9bc-792d-44ec-91f3-605cea4329dc\") " pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-dl64f"
Sep 15 12:06:49.651848 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:49.651608    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5833d9bc-792d-44ec-91f3-605cea4329dc-sys\") pod \"perf-node-gather-daemonset-dl64f\" (UID: \"5833d9bc-792d-44ec-91f3-605cea4329dc\") " pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-dl64f"
Sep 15 12:06:49.752240 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:49.752213    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvvcn\" (UniqueName: \"kubernetes.io/projected/5833d9bc-792d-44ec-91f3-605cea4329dc-kube-api-access-wvvcn\") pod \"perf-node-gather-daemonset-dl64f\" (UID: \"5833d9bc-792d-44ec-91f3-605cea4329dc\") " pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-dl64f"
Sep 15 12:06:49.752408 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:49.752250    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5833d9bc-792d-44ec-91f3-605cea4329dc-sys\") pod \"perf-node-gather-daemonset-dl64f\" (UID: \"5833d9bc-792d-44ec-91f3-605cea4329dc\") " pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-dl64f"
Sep 15 12:06:49.752408 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:49.752296    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5833d9bc-792d-44ec-91f3-605cea4329dc-lib-modules\") pod \"perf-node-gather-daemonset-dl64f\" (UID: \"5833d9bc-792d-44ec-91f3-605cea4329dc\") " pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-dl64f"
Sep 15 12:06:49.752408 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:49.752324    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5833d9bc-792d-44ec-91f3-605cea4329dc-podres\") pod \"perf-node-gather-daemonset-dl64f\" (UID: \"5833d9bc-792d-44ec-91f3-605cea4329dc\") " pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-dl64f"
Sep 15 12:06:49.752408 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:49.752357    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5833d9bc-792d-44ec-91f3-605cea4329dc-proc\") pod \"perf-node-gather-daemonset-dl64f\" (UID: \"5833d9bc-792d-44ec-91f3-605cea4329dc\") " pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-dl64f"
Sep 15 12:06:49.752408 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:49.752381    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5833d9bc-792d-44ec-91f3-605cea4329dc-sys\") pod \"perf-node-gather-daemonset-dl64f\" (UID: \"5833d9bc-792d-44ec-91f3-605cea4329dc\") " pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-dl64f"
Sep 15 12:06:49.752581 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:49.752422    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5833d9bc-792d-44ec-91f3-605cea4329dc-proc\") pod \"perf-node-gather-daemonset-dl64f\" (UID: \"5833d9bc-792d-44ec-91f3-605cea4329dc\") " pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-dl64f"
Sep 15 12:06:49.752581 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:49.752482    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5833d9bc-792d-44ec-91f3-605cea4329dc-lib-modules\") pod \"perf-node-gather-daemonset-dl64f\" (UID: \"5833d9bc-792d-44ec-91f3-605cea4329dc\") " pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-dl64f"
Sep 15 12:06:49.752581 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:49.752500    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5833d9bc-792d-44ec-91f3-605cea4329dc-podres\") pod \"perf-node-gather-daemonset-dl64f\" (UID: \"5833d9bc-792d-44ec-91f3-605cea4329dc\") " pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-dl64f"
Sep 15 12:06:49.761310 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:49.761249    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvvcn\" (UniqueName: \"kubernetes.io/projected/5833d9bc-792d-44ec-91f3-605cea4329dc-kube-api-access-wvvcn\") pod \"perf-node-gather-daemonset-dl64f\" (UID: \"5833d9bc-792d-44ec-91f3-605cea4329dc\") " pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-dl64f"
Sep 15 12:06:49.817912 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:49.817888    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-dl64f"
Sep 15 12:06:50.088882 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:50.088854    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rmwp6/perf-node-gather-daemonset-dl64f"]
Sep 15 12:06:50.091439 ip-10-0-131-95 kubenswrapper[2582]: W0915 12:06:50.091407    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5833d9bc_792d_44ec_91f3_605cea4329dc.slice/crio-db031aca5d8673e81c64ad5cb06edebf0d2608539efa6a14f1093f33d6bcdbdc WatchSource:0}: Error finding container db031aca5d8673e81c64ad5cb06edebf0d2608539efa6a14f1093f33d6bcdbdc: Status 404 returned error can't find the container with id db031aca5d8673e81c64ad5cb06edebf0d2608539efa6a14f1093f33d6bcdbdc
Sep 15 12:06:50.685505 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:50.685466    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-7pdsq_41aa5744-80c2-4bdb-8266-9c47a73cdb55/discovery/0.log"
Sep 15 12:06:50.708713 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:50.708689    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59bc95f796-6kfg5_9ed3b65d-fc65-4f40-9e21-ef52dfe796ef/kube-auth-proxy/0.log"
Sep 15 12:06:50.733421 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:50.733395    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-dl64f" event={"ID":"5833d9bc-792d-44ec-91f3-605cea4329dc","Type":"ContainerStarted","Data":"4e7fba0d91df5b867e9d9a04ed6710704e04801aea777366b955276b56d8828d"}
Sep 15 12:06:50.733573 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:50.733463    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-dl64f" event={"ID":"5833d9bc-792d-44ec-91f3-605cea4329dc","Type":"ContainerStarted","Data":"db031aca5d8673e81c64ad5cb06edebf0d2608539efa6a14f1093f33d6bcdbdc"}
Sep 15 12:06:50.733573 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:50.733521    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-dl64f"
Sep 15 12:06:50.750826 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:50.750776    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-dl64f" podStartSLOduration=1.750762333 podStartE2EDuration="1.750762333s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:06:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:06:50.748299769 +0000 UTC m=+2490.210165821" watchObservedRunningTime="2026-09-15 12:06:50.750762333 +0000 UTC m=+2490.212628385"
Sep 15 12:06:50.820064 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:50.820037    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-7frsd_aba71c39-2aa1-4e31-bc47-a7106371c009/payload-processing/0.log"
Sep 15 12:06:51.836431 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:51.836402    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-596pk_3d055f0d-31e8-4cca-bd4b-8b856dbb3966/serve-healthcheck-canary/0.log"
Sep 15 12:06:52.400479 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:52.400445    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vmxh2_76f2f3eb-5c06-4648-a30d-80cc7356d880/kube-rbac-proxy/0.log"
Sep 15 12:06:52.419718 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:52.419694    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vmxh2_76f2f3eb-5c06-4648-a30d-80cc7356d880/exporter/0.log"
Sep 15 12:06:52.438542 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:52.438515    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vmxh2_76f2f3eb-5c06-4648-a30d-80cc7356d880/extractor/0.log"
Sep 15 12:06:54.671509 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:54.671475    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-9ttpp_a09ce552-8d39-46c9-8636-4a4e660f35d4/manager/0.log"
Sep 15 12:06:54.918852 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:54.918815    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-rkl98_5c49bde6-f1d3-4a2a-88cf-941b03a40cec/manager/0.log"
Sep 15 12:06:54.996337 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:54.996241    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-84f7f65f89-s4v94_18d914b3-ad5c-40ce-9681-fa6681653c6f/manager/0.log"
Sep 15 12:06:55.239849 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:55.239823    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-99f4658c8-r2prg_5f497f61-05e4-483d-8466-3324e1c333ea/manager/0.log"
Sep 15 12:06:55.258361 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:55.258292    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-99f4658c8-r2prg_5f497f61-05e4-483d-8466-3324e1c333ea/copy-manifests/0.log"
Sep 15 12:06:56.499487 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:56.499457    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-5gn2j_533fdea2-e855-42f8-a728-349905f03b92/openshift-lws-operator/0.log"
Sep 15 12:06:56.748990 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:56.748960    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rmwp6/perf-node-gather-daemonset-dl64f"
Sep 15 12:06:57.263831 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:57.263793    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-7pdsq_41aa5744-80c2-4bdb-8266-9c47a73cdb55/discovery/0.log"
Sep 15 12:06:57.273529 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:57.273504    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59bc95f796-6kfg5_9ed3b65d-fc65-4f40-9e21-ef52dfe796ef/kube-auth-proxy/0.log"
Sep 15 12:06:57.368582 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:57.368552    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-7frsd_aba71c39-2aa1-4e31-bc47-a7106371c009/payload-processing/0.log"
Sep 15 12:06:59.525767 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:59.525654    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-7pdsq_41aa5744-80c2-4bdb-8266-9c47a73cdb55/discovery/0.log"
Sep 15 12:06:59.552134 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:59.552111    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59bc95f796-6kfg5_9ed3b65d-fc65-4f40-9e21-ef52dfe796ef/kube-auth-proxy/0.log"
Sep 15 12:06:59.647786 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:06:59.647749    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-7frsd_aba71c39-2aa1-4e31-bc47-a7106371c009/payload-processing/0.log"
Sep 15 12:07:03.407285 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:07:03.407257    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bbk72_355f0ff9-8c8d-4093-b576-2f6060c7c1b2/kube-multus-additional-cni-plugins/0.log"
Sep 15 12:07:03.429113 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:07:03.429084    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bbk72_355f0ff9-8c8d-4093-b576-2f6060c7c1b2/egress-router-binary-copy/0.log"
Sep 15 12:07:03.448416 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:07:03.448389    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bbk72_355f0ff9-8c8d-4093-b576-2f6060c7c1b2/cni-plugins/0.log"
Sep 15 12:07:03.466615 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:07:03.466593    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bbk72_355f0ff9-8c8d-4093-b576-2f6060c7c1b2/bond-cni-plugin/0.log"
Sep 15 12:07:03.485253 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:07:03.485224    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bbk72_355f0ff9-8c8d-4093-b576-2f6060c7c1b2/routeoverride-cni/0.log"
Sep 15 12:07:03.506898 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:07:03.506867    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bbk72_355f0ff9-8c8d-4093-b576-2f6060c7c1b2/whereabouts-cni-bincopy/0.log"
Sep 15 12:07:03.528670 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:07:03.528638    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bbk72_355f0ff9-8c8d-4093-b576-2f6060c7c1b2/whereabouts-cni/0.log"
Sep 15 12:07:03.854256 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:07:03.854136    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sg9pm_499ee50f-63c2-4ade-a676-edb6066f3d0e/kube-multus/0.log"
Sep 15 12:07:04.052223 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:07:04.052195    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dzzfd_485ecbb4-5f72-4e62-bce1-0d97de480e0b/network-metrics-daemon/0.log"
Sep 15 12:07:04.068989 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:07:04.068962    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dzzfd_485ecbb4-5f72-4e62-bce1-0d97de480e0b/kube-rbac-proxy/0.log"
Sep 15 12:07:05.159790 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:07:05.159759    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lspr9_4d410cfe-4ca2-43e1-bf20-06634657a5a6/ovn-controller/0.log"
Sep 15 12:07:05.183829 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:07:05.183803    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lspr9_4d410cfe-4ca2-43e1-bf20-06634657a5a6/ovn-acl-logging/0.log"
Sep 15 12:07:05.212525 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:07:05.212492    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lspr9_4d410cfe-4ca2-43e1-bf20-06634657a5a6/kube-rbac-proxy-node/0.log"
Sep 15 12:07:05.238346 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:07:05.238322    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lspr9_4d410cfe-4ca2-43e1-bf20-06634657a5a6/kube-rbac-proxy-ovn-metrics/0.log"
Sep 15 12:07:05.259089 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:07:05.259063    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lspr9_4d410cfe-4ca2-43e1-bf20-06634657a5a6/northd/0.log"
Sep 15 12:07:05.277746 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:07:05.277722    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lspr9_4d410cfe-4ca2-43e1-bf20-06634657a5a6/nbdb/0.log"
Sep 15 12:07:05.296859 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:07:05.296837    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lspr9_4d410cfe-4ca2-43e1-bf20-06634657a5a6/sbdb/0.log"
Sep 15 12:07:05.353040 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:07:05.353001    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lspr9_4d410cfe-4ca2-43e1-bf20-06634657a5a6/ovnkube-controller/0.log"
Sep 15 12:07:06.643478 ip-10-0-131-95 kubenswrapper[2582]: I0915 12:07:06.643433    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-bk6zq_e1eb4055-797f-4589-8f60-a46f631ad4e9/network-check-target-container/0.log"