Sep 07 16:54:31.335589 ip-10-0-131-84 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 07 16:54:31.335602 ip-10-0-131-84 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 07 16:54:31.335612 ip-10-0-131-84 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 07 16:54:31.336021 ip-10-0-131-84 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 07 16:54:40.830063 ip-10-0-131-84 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
Sep 07 16:54:40.830077 ip-10-0-131-84 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot da8b4a32998f409e84790565b5bb6e5b --
Sep 07 16:56:21.733818 ip-10-0-131-84 systemd[1]: Starting Kubernetes Kubelet...
Sep 07 16:56:22.178468 ip-10-0-131-84 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 07 16:56:22.178468 ip-10-0-131-84 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 07 16:56:22.178468 ip-10-0-131-84 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 07 16:56:22.178468 ip-10-0-131-84 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 07 16:56:22.178468 ip-10-0-131-84 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 07 16:56:22.181322 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.181232    2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 07 16:56:22.185452 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185433    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 16:56:22.185452 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185449    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 16:56:22.185452 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185455    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 16:56:22.185679 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185459    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 16:56:22.185679 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185466    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 16:56:22.185679 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185472    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 16:56:22.185679 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185476    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 16:56:22.185679 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185480    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 16:56:22.185679 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185485    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 16:56:22.185679 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185489    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 16:56:22.185679 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185493    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 16:56:22.185679 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185498    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 16:56:22.185679 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185504    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 16:56:22.185679 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185509    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 16:56:22.185679 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185529    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 16:56:22.185679 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185535    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 16:56:22.185679 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185540    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 16:56:22.185679 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185544    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 16:56:22.185679 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185550    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 16:56:22.185679 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185554    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 16:56:22.185679 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185559    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 16:56:22.186233 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185565    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 16:56:22.186233 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185570    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 16:56:22.186233 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185574    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 16:56:22.186233 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185578    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 16:56:22.186233 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185581    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 16:56:22.186233 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185585    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 16:56:22.186233 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185589    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 16:56:22.186233 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185593    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 16:56:22.186233 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185597    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 16:56:22.186233 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185601    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 16:56:22.186233 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185606    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 16:56:22.186233 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185610    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 16:56:22.186233 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185614    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 16:56:22.186233 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185618    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 16:56:22.186233 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185622    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 16:56:22.186233 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185627    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 16:56:22.186233 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185632    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 16:56:22.186233 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185636    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 16:56:22.186233 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185640    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 16:56:22.186233 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185644    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 16:56:22.186766 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185649    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 16:56:22.186766 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185653    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 16:56:22.186766 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185658    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 16:56:22.186766 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185662    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 16:56:22.186766 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185667    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 16:56:22.186766 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185671    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 16:56:22.186766 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185675    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 16:56:22.186766 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185680    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 16:56:22.186766 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185684    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 16:56:22.186766 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185688    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 16:56:22.186766 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185692    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 16:56:22.186766 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185696    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 16:56:22.186766 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185701    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 16:56:22.186766 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185705    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 16:56:22.186766 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185709    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 16:56:22.186766 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185713    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 16:56:22.186766 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185718    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 16:56:22.186766 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185722    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 16:56:22.186766 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185726    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 16:56:22.186766 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185730    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 16:56:22.187274 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185734    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 16:56:22.187274 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185738    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 16:56:22.187274 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185742    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 16:56:22.187274 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185747    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 16:56:22.187274 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185751    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 16:56:22.187274 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185756    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 16:56:22.187274 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185761    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 16:56:22.187274 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185767    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 16:56:22.187274 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185771    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 16:56:22.187274 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185776    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 16:56:22.187274 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185780    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 16:56:22.187274 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185785    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 16:56:22.187274 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185789    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 16:56:22.187274 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185794    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 16:56:22.187274 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185798    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 16:56:22.187274 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185803    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 16:56:22.187274 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185807    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 16:56:22.187274 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185812    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 16:56:22.187274 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185817    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 16:56:22.187748 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185821    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 16:56:22.187748 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185825    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 16:56:22.187748 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185829    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 16:56:22.187748 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185833    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 16:56:22.187748 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185837    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 16:56:22.187748 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185841    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 16:56:22.187748 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185845    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 16:56:22.187748 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185849    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 16:56:22.187748 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185854    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 16:56:22.187748 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185858    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 16:56:22.187748 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185862    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 16:56:22.187748 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185866    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 16:56:22.187748 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185870    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 16:56:22.187748 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185874    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 16:56:22.187748 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185878    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 16:56:22.187748 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185882    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 16:56:22.187748 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185886    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 16:56:22.187748 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185890    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 16:56:22.187748 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.185895    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 16:56:22.189492 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189470    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 16:56:22.189492 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189487    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 16:56:22.189492 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189491    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 16:56:22.189492 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189496    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 16:56:22.189661 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189499    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 16:56:22.189661 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189503    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 16:56:22.189661 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189506    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 16:56:22.189661 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189510    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 16:56:22.189661 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189527    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 16:56:22.189661 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189531    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 16:56:22.189661 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189537    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 16:56:22.189661 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189540    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 16:56:22.189661 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189543    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 16:56:22.189661 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189546    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 16:56:22.189661 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189549    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 16:56:22.189661 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189551    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 16:56:22.189661 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189554    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 16:56:22.189661 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189557    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 16:56:22.189661 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189560    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 16:56:22.189661 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189563    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 16:56:22.189661 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189566    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 16:56:22.189661 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189569    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 16:56:22.189661 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189572    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 16:56:22.189661 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189578    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 16:56:22.190324 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189581    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 16:56:22.190324 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189583    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 16:56:22.190324 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189586    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 16:56:22.190324 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189589    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 16:56:22.190324 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189592    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 16:56:22.190324 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189595    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 16:56:22.190324 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189598    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 16:56:22.190324 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189600    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 16:56:22.190324 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189603    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 16:56:22.190324 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189607    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 16:56:22.190324 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189609    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 16:56:22.190324 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189615    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 16:56:22.190324 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189619    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 16:56:22.190324 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189621    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 16:56:22.190324 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189624    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 16:56:22.190324 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189627    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 16:56:22.190324 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189630    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 16:56:22.190324 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189632    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 16:56:22.190324 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189635    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 16:56:22.190324 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189638    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 16:56:22.190845 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189640    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 16:56:22.190845 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189643    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 16:56:22.190845 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189648    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 16:56:22.190845 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189655    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 16:56:22.190845 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189658    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 16:56:22.190845 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189661    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 16:56:22.190845 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189665    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 16:56:22.190845 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189670    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 16:56:22.190845 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189674    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 16:56:22.190845 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189677    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 16:56:22.190845 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189680    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 16:56:22.190845 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189683    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 16:56:22.190845 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189686    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 16:56:22.190845 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189689    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 16:56:22.190845 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189695    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 16:56:22.190845 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189698    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 16:56:22.190845 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189701    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 16:56:22.190845 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189704    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 16:56:22.190845 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189706    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 16:56:22.191304 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189709    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 16:56:22.191304 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189712    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 16:56:22.191304 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189715    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 16:56:22.191304 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189718    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 16:56:22.191304 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189721    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 16:56:22.191304 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189724    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 16:56:22.191304 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189750    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 16:56:22.191304 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189770    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 16:56:22.191304 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189774    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 16:56:22.191304 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189778    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 16:56:22.191304 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189781    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 16:56:22.191304 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189785    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 16:56:22.191304 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189788    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 16:56:22.191304 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189792    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 16:56:22.191304 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189797    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 16:56:22.191304 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189801    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 16:56:22.191304 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189806    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 16:56:22.191304 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189833    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 16:56:22.191304 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189857    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 16:56:22.191790 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189866    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 16:56:22.191790 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.189890    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 16:56:22.191790 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.190041    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 16:56:22.191790 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.190051    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 16:56:22.191790 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.190057    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 16:56:22.191790 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.190060    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 16:56:22.191790 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.190063    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 16:56:22.191790 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.190067    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 16:56:22.191790 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.190069    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 16:56:22.191790 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.190072    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 16:56:22.191790 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.190075    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 16:56:22.191790 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.190077    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 16:56:22.191790 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.190080    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 16:56:22.191790 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.190082    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 16:56:22.191790 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.190086    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 16:56:22.191790 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.190088    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 16:56:22.191790 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.190091    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 16:56:22.191790 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191424    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 16:56:22.191790 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191431    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 16:56:22.191790 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191435    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 16:56:22.192397 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191438    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 16:56:22.192397 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191441    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 16:56:22.192397 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191443    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 16:56:22.192397 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191446    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 16:56:22.192397 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191449    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 16:56:22.192397 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191452    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 16:56:22.192397 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191455    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 16:56:22.192397 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191458    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 16:56:22.192397 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191460    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 16:56:22.192397 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191463    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 16:56:22.192397 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191466    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 16:56:22.192397 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191468    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 16:56:22.192397 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191471    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 16:56:22.192397 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191475    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 16:56:22.192397 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191478    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 16:56:22.192397 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191481    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 16:56:22.192397 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191484    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 16:56:22.192397 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191486    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 16:56:22.192397 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191489    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 16:56:22.192397 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191492    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 16:56:22.192901 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191494    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 16:56:22.192901 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191497    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 16:56:22.192901 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191500    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 16:56:22.192901 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191502    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 16:56:22.192901 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191505    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 16:56:22.192901 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191507    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 16:56:22.192901 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191510    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 16:56:22.192901 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191526    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 16:56:22.192901 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191529    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 16:56:22.192901 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191532    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 16:56:22.192901 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191534    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 16:56:22.192901 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191537    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 16:56:22.192901 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191539    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 16:56:22.192901 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191542    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 16:56:22.192901 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191545    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 16:56:22.192901 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191547    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 16:56:22.192901 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191550    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 16:56:22.192901 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191552    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 16:56:22.192901 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191555    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 16:56:22.192901 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191559    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 16:56:22.193418 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191563    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 16:56:22.193418 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191567    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 16:56:22.193418 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191570    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 16:56:22.193418 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191573    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 16:56:22.193418 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191576    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 16:56:22.193418 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191580    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 16:56:22.193418 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191583    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 16:56:22.193418 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191586    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 16:56:22.193418 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191588    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 16:56:22.193418 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191591    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 16:56:22.193418 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191594    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 16:56:22.193418 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191596    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 16:56:22.193418 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191599    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 16:56:22.193418 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191601    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 16:56:22.193418 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191604    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 16:56:22.193418 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191607    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 16:56:22.193418 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191609    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 16:56:22.193418 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191612    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 16:56:22.193418 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191615    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 16:56:22.193888 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191617    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 16:56:22.193888 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191620    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 16:56:22.193888 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191622    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 16:56:22.193888 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191625    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 16:56:22.193888 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191627    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 16:56:22.193888 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191630    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 16:56:22.193888 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191632    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 16:56:22.193888 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191636    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 16:56:22.193888 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191641    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 16:56:22.193888 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191645    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 16:56:22.193888 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191648    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 16:56:22.193888 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191651    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 16:56:22.193888 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191653    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 16:56:22.193888 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191656    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 16:56:22.193888 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191659    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 16:56:22.193888 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191662    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 16:56:22.193888 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191665    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 16:56:22.193888 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191667    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 16:56:22.193888 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191670    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 16:56:22.194342 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191673    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 16:56:22.194342 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191675    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 16:56:22.194342 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191678    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 16:56:22.194342 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191681    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 16:56:22.194342 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191683    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 16:56:22.194342 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191686    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 16:56:22.194342 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191688    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 16:56:22.194342 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191691    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 16:56:22.194342 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191694    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 16:56:22.194342 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191697    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 16:56:22.194342 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191699    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 16:56:22.194342 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191702    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 16:56:22.194342 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191704    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 16:56:22.194342 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191707    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 16:56:22.194342 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191709    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 16:56:22.194342 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191712    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 16:56:22.194342 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191714    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 16:56:22.194342 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.191717    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 16:56:22.194342 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191790    2558 flags.go:64] FLAG: --address="0.0.0.0"
Sep 07 16:56:22.194342 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191830    2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 07 16:56:22.194342 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191837    2558 flags.go:64] FLAG: --anonymous-auth="true"
Sep 07 16:56:22.194897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191841    2558 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 07 16:56:22.194897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191846    2558 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 07 16:56:22.194897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191849    2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 07 16:56:22.194897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191854    2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 07 16:56:22.194897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191859    2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 07 16:56:22.194897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191863    2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 07 16:56:22.194897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191866    2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 07 16:56:22.194897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191870    2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 07 16:56:22.194897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191873    2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 07 16:56:22.194897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191876    2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 07 16:56:22.194897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191879    2558 flags.go:64] FLAG: --cgroup-root=""
Sep 07 16:56:22.194897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191882    2558 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 07 16:56:22.194897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191885    2558 flags.go:64] FLAG: --client-ca-file=""
Sep 07 16:56:22.194897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191888    2558 flags.go:64] FLAG: --cloud-provider="external"
Sep 07 16:56:22.194897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191891    2558 flags.go:64] FLAG: --cluster-dns="[]"
Sep 07 16:56:22.194897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191897    2558 flags.go:64] FLAG: --cluster-domain=""
Sep 07 16:56:22.194897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191900    2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 07 16:56:22.194897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191903    2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 07 16:56:22.194897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191906    2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 07 16:56:22.194897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191909    2558 flags.go:64] FLAG: --container-log-max-files="5"
Sep 07 16:56:22.194897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191913    2558 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 07 16:56:22.194897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191916    2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 07 16:56:22.194897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191919    2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 07 16:56:22.195429 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191922    2558 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 07 16:56:22.195429 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191925    2558 flags.go:64] FLAG: --contention-profiling="false"
Sep 07 16:56:22.195429 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191928    2558 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 07 16:56:22.195429 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191931    2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 07 16:56:22.195429 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191934    2558 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 07 16:56:22.195429 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191937    2558 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 07 16:56:22.195429 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191941    2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 07 16:56:22.195429 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191944    2558 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 07 16:56:22.195429 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191947    2558 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 07 16:56:22.195429 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191950    2558 flags.go:64] FLAG: --enable-load-reader="false"
Sep 07 16:56:22.195429 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191953    2558 flags.go:64] FLAG: --enable-server="true"
Sep 07 16:56:22.195429 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191956    2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 07 16:56:22.195429 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191960    2558 flags.go:64] FLAG: --event-burst="100"
Sep 07 16:56:22.195429 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191963    2558 flags.go:64] FLAG: --event-qps="50"
Sep 07 16:56:22.195429 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191967    2558 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 07 16:56:22.195429 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191970    2558 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 07 16:56:22.195429 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191973    2558 flags.go:64] FLAG: --eviction-hard=""
Sep 07 16:56:22.195429 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191976    2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 07 16:56:22.195429 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191980    2558 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 07 16:56:22.195429 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191983    2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 07 16:56:22.195429 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191986    2558 flags.go:64] FLAG: --eviction-soft=""
Sep 07 16:56:22.195429 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191988    2558 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 07 16:56:22.195429 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191991    2558 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 07 16:56:22.195429 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191995    2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 07 16:56:22.195429 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.191998    2558 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 07 16:56:22.196075 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192000    2558 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 07 16:56:22.196075 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192003    2558 flags.go:64] FLAG: --fail-swap-on="true"
Sep 07 16:56:22.196075 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192006    2558 flags.go:64] FLAG: --feature-gates=""
Sep 07 16:56:22.196075 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192015    2558 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 07 16:56:22.196075 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192017    2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 07 16:56:22.196075 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192020    2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 07 16:56:22.196075 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192024    2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 07 16:56:22.196075 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192027    2558 flags.go:64] FLAG: --healthz-port="10248"
Sep 07 16:56:22.196075 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192030    2558 flags.go:64] FLAG: --help="false"
Sep 07 16:56:22.196075 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192033    2558 flags.go:64] FLAG: --hostname-override="ip-10-0-131-84.ec2.internal"
Sep 07 16:56:22.196075 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192036    2558 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 07 16:56:22.196075 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192039    2558 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 07 16:56:22.196075 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192042    2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 07 16:56:22.196075 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192046    2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 07 16:56:22.196075 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192049    2558 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 07 16:56:22.196075 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192053    2558 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 07 16:56:22.196075 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192055    2558 flags.go:64] FLAG: --image-service-endpoint=""
Sep 07 16:56:22.196075 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192058    2558 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 07 16:56:22.196075 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192062    2558 flags.go:64] FLAG: --kube-api-burst="100"
Sep 07 16:56:22.196075 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192065    2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 07 16:56:22.196075 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192068    2558 flags.go:64] FLAG: --kube-api-qps="50"
Sep 07 16:56:22.196075 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192071    2558 flags.go:64] FLAG: --kube-reserved=""
Sep 07 16:56:22.196075 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192074    2558 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 07 16:56:22.196075 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192077    2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 07 16:56:22.196681 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192080    2558 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 07 16:56:22.196681 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192082    2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 07 16:56:22.196681 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192085    2558 flags.go:64] FLAG: --lock-file=""
Sep 07 16:56:22.196681 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192088    2558 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 07 16:56:22.196681 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192091    2558 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 07 16:56:22.196681 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192094    2558 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 07 16:56:22.196681 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192099    2558 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 07 16:56:22.196681 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192103    2558 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 07 16:56:22.196681 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192105    2558 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 07 16:56:22.196681 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192108    2558 flags.go:64] FLAG: --logging-format="text"
Sep 07 16:56:22.196681 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192111    2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 07 16:56:22.196681 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192114    2558 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 07 16:56:22.196681 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192117    2558 flags.go:64] FLAG: --manifest-url=""
Sep 07 16:56:22.196681 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192120    2558 flags.go:64] FLAG: --manifest-url-header=""
Sep 07 16:56:22.196681 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192124    2558 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 07 16:56:22.196681 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192128    2558 flags.go:64] FLAG: --max-open-files="1000000"
Sep 07 16:56:22.196681 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192132    2558 flags.go:64] FLAG: --max-pods="110"
Sep 07 16:56:22.196681 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192135    2558 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 07 16:56:22.196681 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192138    2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 07 16:56:22.196681 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192141    2558 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 07 16:56:22.196681 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192144    2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 07 16:56:22.196681 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192147    2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 07 16:56:22.196681 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192150    2558 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 07 16:56:22.196681 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192165    2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 07 16:56:22.196681 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192173    2558 flags.go:64] FLAG: --node-status-max-images="50"
Sep 07 16:56:22.197312 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192177    2558 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 07 16:56:22.197312 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192181    2558 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 07 16:56:22.197312 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192184    2558 flags.go:64] FLAG: --pod-cidr=""
Sep 07 16:56:22.197312 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192187    2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 07 16:56:22.197312 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192192    2558 flags.go:64] FLAG: --pod-manifest-path=""
Sep 07 16:56:22.197312 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192195    2558 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 07 16:56:22.197312 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192199    2558 flags.go:64] FLAG: --pods-per-core="0"
Sep 07 16:56:22.197312 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192201    2558 flags.go:64] FLAG: --port="10250"
Sep 07 16:56:22.197312 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192204    2558 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 07 16:56:22.197312 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192207    2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0783b5bd15e251751"
Sep 07 16:56:22.197312 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192211    2558 flags.go:64] FLAG: --qos-reserved=""
Sep 07 16:56:22.197312 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192213    2558 flags.go:64] FLAG: --read-only-port="10255"
Sep 07 16:56:22.197312 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192216    2558 flags.go:64] FLAG: --register-node="true"
Sep 07 16:56:22.197312 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192219    2558 flags.go:64] FLAG: --register-with-taints=""
Sep 07 16:56:22.197312 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192223    2558 flags.go:64] FLAG: --registry-burst="10"
Sep 07 16:56:22.197312 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192226    2558 flags.go:64] FLAG: --registry-qps="5"
Sep 07 16:56:22.197312 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192229    2558 flags.go:64] FLAG: --reserved-cpus=""
Sep 07 16:56:22.197312 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192232    2558 flags.go:64] FLAG: --reserved-memory=""
Sep 07 16:56:22.197312 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192236    2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 07 16:56:22.197312 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192239    2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 07 16:56:22.197312 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192242    2558 flags.go:64] FLAG: --rotate-certificates="false"
Sep 07 16:56:22.197312 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192245    2558 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 07 16:56:22.197312 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192250    2558 flags.go:64] FLAG: --runonce="false"
Sep 07 16:56:22.197312 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192253    2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 07 16:56:22.197312 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192256    2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 07 16:56:22.197928 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192259    2558 flags.go:64] FLAG: --seccomp-default="false"
Sep 07 16:56:22.197928 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192262    2558 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 07 16:56:22.197928 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192265    2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 07 16:56:22.197928 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192268    2558 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 07 16:56:22.197928 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192271    2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 07 16:56:22.197928 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192276    2558 flags.go:64] FLAG: --storage-driver-password="root"
Sep 07 16:56:22.197928 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192279    2558 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 07 16:56:22.197928 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192282    2558 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 07 16:56:22.197928 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192285    2558 flags.go:64] FLAG: --storage-driver-user="root"
Sep 07 16:56:22.197928 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192288    2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 07 16:56:22.197928 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192291    2558 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 07 16:56:22.197928 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192294    2558 flags.go:64] FLAG: --system-cgroups=""
Sep 07 16:56:22.197928 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192297    2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 07 16:56:22.197928 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192302    2558 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 07 16:56:22.197928 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192305    2558 flags.go:64] FLAG: --tls-cert-file=""
Sep 07 16:56:22.197928 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192308    2558 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 07 16:56:22.197928 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192313    2558 flags.go:64] FLAG: --tls-min-version=""
Sep 07 16:56:22.197928 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192316    2558 flags.go:64] FLAG: --tls-private-key-file=""
Sep 07 16:56:22.197928 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192319    2558 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 07 16:56:22.197928 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192322    2558 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 07 16:56:22.197928 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192325    2558 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 07 16:56:22.197928 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192328    2558 flags.go:64] FLAG: --v="2"
Sep 07 16:56:22.197928 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192332    2558 flags.go:64] FLAG: --version="false"
Sep 07 16:56:22.197928 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192336    2558 flags.go:64] FLAG: --vmodule=""
Sep 07 16:56:22.197928 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192340    2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 07 16:56:22.198645 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192344    2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 07 16:56:22.198645 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192480    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 16:56:22.198645 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192484    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 16:56:22.198645 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192487    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 16:56:22.198645 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192492    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 16:56:22.198645 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192495    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 16:56:22.198645 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192498    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 16:56:22.198645 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192501    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 16:56:22.198645 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192504    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 16:56:22.198645 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192507    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 16:56:22.198645 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192510    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 16:56:22.198645 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192525    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 16:56:22.198645 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192530    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 16:56:22.198645 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192532    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 16:56:22.198645 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192535    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 16:56:22.198645 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192538    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 16:56:22.198645 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192540    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 16:56:22.198645 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192543    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 16:56:22.198645 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192546    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 16:56:22.198645 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192549    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 16:56:22.199160 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192553    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 16:56:22.199160 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192557    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 16:56:22.199160 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192560    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 16:56:22.199160 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192563    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 16:56:22.199160 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192566    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 16:56:22.199160 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192569    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 16:56:22.199160 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192572    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 16:56:22.199160 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192575    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 16:56:22.199160 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192578    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 16:56:22.199160 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192580    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 16:56:22.199160 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192583    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 16:56:22.199160 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192586    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 16:56:22.199160 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192588    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 16:56:22.199160 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192591    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 16:56:22.199160 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192594    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 16:56:22.199160 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192596    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 16:56:22.199160 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192600    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 16:56:22.199160 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192603    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 16:56:22.199160 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192605    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 16:56:22.199643 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192608    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 16:56:22.199643 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192610    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 16:56:22.199643 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192613    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 16:56:22.199643 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192615    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 16:56:22.199643 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192618    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 16:56:22.199643 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192622    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 16:56:22.199643 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192624    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 16:56:22.199643 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192627    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 16:56:22.199643 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192629    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 16:56:22.199643 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192632    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 16:56:22.199643 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192634    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 16:56:22.199643 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192637    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 16:56:22.199643 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192640    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 16:56:22.199643 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192642    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 16:56:22.199643 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192645    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 16:56:22.199643 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192647    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 16:56:22.199643 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192650    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 16:56:22.199643 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192652    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 16:56:22.199643 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192654    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 16:56:22.199643 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192657    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 16:56:22.200122 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192659    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 16:56:22.200122 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192662    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 16:56:22.200122 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192664    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 16:56:22.200122 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192667    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 16:56:22.200122 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192669    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 16:56:22.200122 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192672    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 16:56:22.200122 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192675    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 16:56:22.200122 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192678    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 16:56:22.200122 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192680    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 16:56:22.200122 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192684    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 16:56:22.200122 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192687    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 16:56:22.200122 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192691    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 16:56:22.200122 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192694    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 16:56:22.200122 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192697    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 16:56:22.200122 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192700    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 16:56:22.200122 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192702    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 16:56:22.200122 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192706    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 16:56:22.200122 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192711    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 16:56:22.200122 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192714    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 16:56:22.200612 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192718    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 16:56:22.200612 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192721    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 16:56:22.200612 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192723    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 16:56:22.200612 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192726    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 16:56:22.200612 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192729    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 16:56:22.200612 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192732    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 16:56:22.200612 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192734    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 16:56:22.200612 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192737    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 16:56:22.200612 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192739    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 16:56:22.200612 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192742    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 16:56:22.200612 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192744    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 16:56:22.200612 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192747    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 16:56:22.200612 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192749    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 16:56:22.200612 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192752    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 16:56:22.200612 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192754    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 16:56:22.200612 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192758    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 16:56:22.200612 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192762    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 16:56:22.200612 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192765    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 16:56:22.200612 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192768    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 16:56:22.200612 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192772    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 16:56:22.201086 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192774    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 16:56:22.201086 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.192777    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 16:56:22.201086 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.192784    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 07 16:56:22.201086 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.200368    2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 07 16:56:22.201086 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.200385    2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 07 16:56:22.201086 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.200407    2558 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 07 16:56:22.201086 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.200412    2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 07 16:56:22.201086 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200466    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 16:56:22.201086 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200471    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 16:56:22.201086 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200474    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 16:56:22.201086 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200478    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 16:56:22.201086 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200480    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 16:56:22.201086 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200484    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 16:56:22.201086 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200486    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 16:56:22.201433 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200489    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 16:56:22.201433 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200492    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 16:56:22.201433 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200495    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 16:56:22.201433 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200497    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 16:56:22.201433 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200500    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 16:56:22.201433 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200502    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 16:56:22.201433 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200505    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 16:56:22.201433 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200508    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 16:56:22.201433 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200523    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 16:56:22.201433 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200526    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 16:56:22.201433 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200528    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 16:56:22.201433 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200532    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 16:56:22.201433 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200536    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 16:56:22.201433 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200539    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 16:56:22.201433 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200542    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 16:56:22.201433 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200544    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 16:56:22.201433 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200547    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 16:56:22.201433 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200549    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 16:56:22.201433 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200552    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 16:56:22.201433 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200554    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 16:56:22.201982 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200557    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 16:56:22.201982 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200560    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 16:56:22.201982 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200564    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 16:56:22.201982 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200567    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 16:56:22.201982 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200570    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 16:56:22.201982 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200573    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 16:56:22.201982 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200575    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 16:56:22.201982 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200578    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 16:56:22.201982 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200581    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 16:56:22.201982 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200583    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 16:56:22.201982 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200586    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 16:56:22.201982 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200589    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 16:56:22.201982 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200591    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 16:56:22.201982 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200594    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 16:56:22.201982 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200597    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 16:56:22.201982 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200599    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 16:56:22.201982 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200602    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 16:56:22.201982 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200604    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 16:56:22.201982 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200607    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 16:56:22.202450 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200609    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 16:56:22.202450 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200612    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 16:56:22.202450 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200615    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 16:56:22.202450 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200617    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 16:56:22.202450 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200620    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 16:56:22.202450 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200623    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 16:56:22.202450 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200626    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 16:56:22.202450 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200628    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 16:56:22.202450 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200631    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 16:56:22.202450 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200633    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 16:56:22.202450 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200636    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 16:56:22.202450 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200638    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 16:56:22.202450 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200641    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 16:56:22.202450 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200644    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 16:56:22.202450 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200646    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 16:56:22.202450 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200650    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 16:56:22.202450 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200654    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 16:56:22.202450 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200656    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 16:56:22.202450 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200659    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 16:56:22.202450 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200662    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 16:56:22.202989 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200664    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 16:56:22.202989 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200668    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 16:56:22.202989 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200672    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 16:56:22.202989 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200675    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 16:56:22.202989 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200677    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 16:56:22.202989 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200680    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 16:56:22.202989 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200683    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 16:56:22.202989 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200686    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 16:56:22.202989 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200688    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 16:56:22.202989 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200693    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 16:56:22.202989 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200696    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 16:56:22.202989 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200699    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 16:56:22.202989 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200702    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 16:56:22.202989 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200705    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 16:56:22.202989 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200708    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 16:56:22.202989 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200711    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 16:56:22.202989 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200713    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 16:56:22.202989 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200716    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 16:56:22.202989 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200718    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 16:56:22.203461 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200721    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 16:56:22.203461 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200723    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 16:56:22.203461 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200726    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 16:56:22.203461 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200728    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 16:56:22.203461 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200731    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 16:56:22.203461 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200734    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 16:56:22.203461 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200736    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 16:56:22.203461 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200739    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 16:56:22.203461 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200742    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 16:56:22.203461 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200745    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 16:56:22.203461 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200748    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 16:56:22.203461 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200750    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 16:56:22.203461 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200753    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 16:56:22.203461 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200755    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 16:56:22.203461 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.200760    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 07 16:56:22.203893 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200869    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 16:56:22.203893 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200873    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 16:56:22.203893 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200876    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 16:56:22.203893 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200879    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 16:56:22.203893 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200882    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 16:56:22.203893 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200885    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 16:56:22.203893 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200887    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 16:56:22.203893 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200890    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 16:56:22.203893 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200892    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 16:56:22.203893 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200895    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 16:56:22.203893 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200897    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 16:56:22.203893 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200900    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 16:56:22.203893 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200903    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 16:56:22.203893 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200905    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 16:56:22.203893 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200908    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 16:56:22.203893 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200910    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 16:56:22.203893 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200913    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 16:56:22.203893 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200915    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 16:56:22.203893 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200917    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 16:56:22.203893 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200920    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 16:56:22.204380 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200922    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 16:56:22.204380 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200925    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 16:56:22.204380 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200928    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 16:56:22.204380 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200930    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 16:56:22.204380 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200933    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 16:56:22.204380 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200936    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 16:56:22.204380 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200939    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 16:56:22.204380 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200941    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 16:56:22.204380 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200944    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 16:56:22.204380 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200947    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 16:56:22.204380 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200949    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 16:56:22.204380 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200952    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 16:56:22.204380 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200956    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 16:56:22.204380 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200959    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 16:56:22.204380 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200962    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 16:56:22.204380 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200965    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 16:56:22.204380 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200967    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 16:56:22.204380 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200970    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 16:56:22.204380 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200972    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 16:56:22.204982 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200975    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 16:56:22.204982 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200977    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 16:56:22.204982 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200980    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 16:56:22.204982 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200982    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 16:56:22.204982 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200985    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 16:56:22.204982 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200987    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 16:56:22.204982 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200990    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 16:56:22.204982 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200992    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 16:56:22.204982 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200994    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 16:56:22.204982 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.200997    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 16:56:22.204982 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201001    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 16:56:22.204982 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201004    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 16:56:22.204982 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201007    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 16:56:22.204982 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201009    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 16:56:22.204982 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201013    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 16:56:22.204982 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201016    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 16:56:22.204982 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201018    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 16:56:22.204982 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201021    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 16:56:22.204982 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201024    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 16:56:22.204982 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201027    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 16:56:22.205465 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201029    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 16:56:22.205465 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201032    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 16:56:22.205465 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201035    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 16:56:22.205465 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201037    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 16:56:22.205465 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201041    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 16:56:22.205465 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201044    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 16:56:22.205465 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201046    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 16:56:22.205465 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201049    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 16:56:22.205465 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201051    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 16:56:22.205465 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201054    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 16:56:22.205465 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201056    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 16:56:22.205465 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201059    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 16:56:22.205465 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201061    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 16:56:22.205465 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201064    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 16:56:22.205465 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201066    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 16:56:22.205465 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201068    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 16:56:22.205465 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201071    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 16:56:22.205465 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201074    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 16:56:22.205465 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201077    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 16:56:22.205465 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201079    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 16:56:22.206169 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201082    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 16:56:22.206169 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201084    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 16:56:22.206169 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201087    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 16:56:22.206169 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201090    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 16:56:22.206169 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201092    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 16:56:22.206169 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201095    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 16:56:22.206169 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201099    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 16:56:22.206169 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201101    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 16:56:22.206169 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201104    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 16:56:22.206169 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201106    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 16:56:22.206169 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201109    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 16:56:22.206169 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201112    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 16:56:22.206169 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201114    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 16:56:22.206169 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201117    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 16:56:22.206169 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201119    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 16:56:22.206169 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201122    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 16:56:22.206169 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201125    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 16:56:22.206169 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201128    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 16:56:22.206169 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201130    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 16:56:22.206169 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:22.201133    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 16:56:22.206899 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.201137    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 07 16:56:22.206899 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.201236    2558 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 07 16:56:22.206899 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.203530    2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 07 16:56:22.206899 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.204626    2558 server.go:1019] "Starting client certificate rotation"
Sep 07 16:56:22.206899 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.204740    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 07 16:56:22.206899 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.204788    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 07 16:56:22.207531 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.207503    2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 07 16:56:22.211706 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.211688    2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 07 16:56:22.220492 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.220473    2558 log.go:25] "Validated CRI v1 runtime API"
Sep 07 16:56:22.223837 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.223820    2558 log.go:25] "Validated CRI v1 image API"
Sep 07 16:56:22.224724 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.224701    2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 07 16:56:22.230310 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.230290    2558 fs.go:135] Filesystem UUIDs: map[0f6b9ce6-ccec-4dfb-a8be-0038ab48c5a6:/dev/nvme0n1p3 5012dd77-fe6d-4a96-a436-11e93882bdad:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Sep 07 16:56:22.230390 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.230310    2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 07 16:56:22.237793 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.237637    2558 manager.go:216] Machine: {Timestamp:2026-09-07 16:56:22.23591339 +0000 UTC m=+0.375066944 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097664 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b260237eecf4cc56d0c80a9090748 SystemUUID:ec2b2602-37ee-cf4c-c56d-0c80a9090748 BootID:da8b4a32-998f-409e-8479-0565b5bb6e5b Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:31:39:c4:8a:37 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:31:39:c4:8a:37 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3a:20:46:10:db:66 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 07 16:56:22.237793 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.237782    2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 07 16:56:22.237927 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.237887    2558 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 07 16:56:22.241658 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.241633    2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 07 16:56:22.241803 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.241662    2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-84.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 07 16:56:22.242527 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.242507    2558 topology_manager.go:138] "Creating topology manager with none policy"
Sep 07 16:56:22.242568 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.242531    2558 container_manager_linux.go:309] "Creating device plugin manager"
Sep 07 16:56:22.242568 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.242540    2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 07 16:56:22.242568 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.242554    2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 07 16:56:22.243606 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.243591    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 07 16:56:22.379578 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.379550    2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 07 16:56:22.384064 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.384050    2558 state_mem.go:36] "Initialized new in-memory state store"
Sep 07 16:56:22.384192 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.384181    2558 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 07 16:56:22.384227 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.384216    2558 kubelet.go:486] "Attempting to sync node with API server"
Sep 07 16:56:22.384256 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.384228    2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 07 16:56:22.384256 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.384241    2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 07 16:56:22.384256 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.384251    2558 kubelet.go:398] "Adding apiserver pod source"
Sep 07 16:56:22.384409 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.384261    2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 07 16:56:22.384690 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.384674    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 07 16:56:22.384764 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.384697    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 07 16:56:22.388018 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.388002    2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 07 16:56:22.390996 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.390982    2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 07 16:56:22.391051 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.391012    2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 07 16:56:22.391187 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.391177    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 07 16:56:22.391237 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.391192    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 07 16:56:22.391237 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.391198    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 07 16:56:22.391237 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.391203    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 07 16:56:22.391237 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.391211    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 07 16:56:22.391237 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.391216    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 07 16:56:22.391840 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.391831    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 07 16:56:22.391840 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.391840    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 07 16:56:22.391905 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.391847    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 07 16:56:22.391905 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.391852    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 07 16:56:22.391905 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.391861    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 07 16:56:22.391905 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.391869    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 07 16:56:22.393591 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.393580    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 07 16:56:22.393591 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.393591    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 07 16:56:22.397305 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.397291    2558 server.go:1268] "Started kubelet"
Sep 07 16:56:22.397437 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.397409    2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 07 16:56:22.397504 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.397413    2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 07 16:56:22.397504 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.397484    2558 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 07 16:56:22.398014 ip-10-0-131-84 systemd[1]: Started Kubernetes Kubelet.
Sep 07 16:56:22.399440 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.399400    2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 07 16:56:22.399604 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.399591    2558 server.go:310] "Adding debug handlers to kubelet server"
Sep 07 16:56:22.402894 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.402867    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-26kj8"
Sep 07 16:56:22.403007 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.402893    2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-84.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 07 16:56:22.403110 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:22.403085    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-84.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 07 16:56:22.403409 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:22.403384    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 07 16:56:22.404022 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:22.404002    2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 07 16:56:22.408815 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.408794    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 07 16:56:22.409112 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:22.407976    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-84.ec2.internal.18d31849d5f15ff8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-84.ec2.internal,UID:ip-10-0-131-84.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-84.ec2.internal,},FirstTimestamp:2026-09-07 16:56:22.397263864 +0000 UTC m=+0.536417414,LastTimestamp:2026-09-07 16:56:22.397263864 +0000 UTC m=+0.536417414,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-84.ec2.internal,}"
Sep 07 16:56:22.409439 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.409424    2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 07 16:56:22.409631 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:22.409609    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-84.ec2.internal\" not found"
Sep 07 16:56:22.410419 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.410286    2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 07 16:56:22.410419 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.410290    2558 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 07 16:56:22.410569 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.410431    2558 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 07 16:56:22.410569 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.410543    2558 reconstruct.go:97] "Volume reconstruction finished"
Sep 07 16:56:22.410569 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.410552    2558 reconciler.go:29] "Reconciler: start to sync state"
Sep 07 16:56:22.411717 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.411695    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-26kj8"
Sep 07 16:56:22.411867 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.411852    2558 factory.go:55] Registering systemd factory
Sep 07 16:56:22.411929 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.411871    2558 factory.go:223] Registration of the systemd container factory successfully
Sep 07 16:56:22.412071 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.412060    2558 factory.go:153] Registering CRI-O factory
Sep 07 16:56:22.412131 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.412074    2558 factory.go:223] Registration of the crio container factory successfully
Sep 07 16:56:22.412131 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.412122    2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 07 16:56:22.412218 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.412142    2558 factory.go:103] Registering Raw factory
Sep 07 16:56:22.412218 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.412158    2558 manager.go:1196] Started watching for new ooms in manager
Sep 07 16:56:22.412497 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.412483    2558 manager.go:349] Starting recovery of all containers
Sep 07 16:56:22.412955 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:22.412931    2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-84.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 07 16:56:22.413055 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:22.413033    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 07 16:56:22.422441 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.422424    2558 manager.go:354] Recovery completed
Sep 07 16:56:22.426510 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.426498    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 16:56:22.428306 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.428285    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-84.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 16:56:22.428393 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.428315    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-84.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 16:56:22.428393 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.428326    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-84.ec2.internal" event="NodeHasSufficientPID"
Sep 07 16:56:22.428949 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.428887    2558 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 07 16:56:22.428949 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.428902    2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 07 16:56:22.428949 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.428890    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 16:56:22.428949 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.428920    2558 state_mem.go:36] "Initialized new in-memory state store"
Sep 07 16:56:22.429662 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.429645    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-84.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 16:56:22.429718 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.429674    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-84.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 16:56:22.429718 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.429687    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-84.ec2.internal" event="NodeHasSufficientPID"
Sep 07 16:56:22.430938 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.430923    2558 policy_none.go:49] "None policy: Start"
Sep 07 16:56:22.431006 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.430942    2558 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 07 16:56:22.431006 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.430954    2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 07 16:56:22.432820 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.432809    2558 policy_none.go:47] "Start"
Sep 07 16:56:22.469056 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.469038    2558 manager.go:337] "Starting Device Plugin manager"
Sep 07 16:56:22.488566 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:22.469075    2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 07 16:56:22.488566 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.469087    2558 server.go:87] "Starting device plugin registration server"
Sep 07 16:56:22.488566 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.469406    2558 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 07 16:56:22.488566 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.469416    2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 07 16:56:22.488566 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.469557    2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 07 16:56:22.488566 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.469642    2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 07 16:56:22.488566 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.469651    2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 07 16:56:22.488566 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:22.470166    2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 07 16:56:22.488566 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:22.470208    2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-84.ec2.internal\" not found"
Sep 07 16:56:22.488566 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.478443    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 07 16:56:22.488566 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.479575    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 07 16:56:22.488566 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.479621    2558 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 07 16:56:22.488566 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.479640    2558 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 07 16:56:22.488566 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:22.479681    2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 07 16:56:22.488566 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.481703    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 16:56:22.569750 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.569716    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 16:56:22.570750 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.570717    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-84.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 16:56:22.570847 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.570756    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-84.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 16:56:22.570847 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.570770    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-84.ec2.internal" event="NodeHasSufficientPID"
Sep 07 16:56:22.570847 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.570794    2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-84.ec2.internal"
Sep 07 16:56:22.579996 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.579971    2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-84.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-84.ec2.internal"]
Sep 07 16:56:22.580094 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.580039    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 16:56:22.581553 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.581538    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-84.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 16:56:22.581625 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.581563    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-84.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 16:56:22.581625 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.581577    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-84.ec2.internal" event="NodeHasSufficientPID"
Sep 07 16:56:22.583843 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.583829    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 16:56:22.583991 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.583976    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-84.ec2.internal"
Sep 07 16:56:22.584087 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.584011    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 16:56:22.584531 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.584497    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-84.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 16:56:22.584602 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.584542    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-84.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 16:56:22.584602 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.584553    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-84.ec2.internal" event="NodeHasSufficientPID"
Sep 07 16:56:22.584602 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.584502    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-84.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 16:56:22.584700 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.584608    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-84.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 16:56:22.584700 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.584620    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-84.ec2.internal" event="NodeHasSufficientPID"
Sep 07 16:56:22.585192 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.585179    2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-84.ec2.internal"
Sep 07 16:56:22.585239 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:22.585197    2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-84.ec2.internal\": node \"ip-10-0-131-84.ec2.internal\" not found"
Sep 07 16:56:22.586585 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.586569    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-84.ec2.internal"
Sep 07 16:56:22.586665 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.586600    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 16:56:22.587230 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.587214    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-84.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 16:56:22.587283 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.587240    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-84.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 16:56:22.587283 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.587250    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-84.ec2.internal" event="NodeHasSufficientPID"
Sep 07 16:56:22.611894 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.611874    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e4ab8ac774ca9f7f62f0d52f1027e3dd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-84.ec2.internal\" (UID: \"e4ab8ac774ca9f7f62f0d52f1027e3dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-84.ec2.internal"
Sep 07 16:56:22.611985 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.611940    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4ab8ac774ca9f7f62f0d52f1027e3dd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-84.ec2.internal\" (UID: \"e4ab8ac774ca9f7f62f0d52f1027e3dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-84.ec2.internal"
Sep 07 16:56:22.611985 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.611957    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2bcf0fe9132996095ce4831570ed6ab9-config\") pod \"kube-apiserver-proxy-ip-10-0-131-84.ec2.internal\" (UID: \"2bcf0fe9132996095ce4831570ed6ab9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-84.ec2.internal"
Sep 07 16:56:22.613313 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:22.613298    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-84.ec2.internal\" not found" node="ip-10-0-131-84.ec2.internal"
Sep 07 16:56:22.617659 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:22.617644    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-84.ec2.internal\" not found" node="ip-10-0-131-84.ec2.internal"
Sep 07 16:56:22.672997 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:22.672972    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-84.ec2.internal\" not found"
Sep 07 16:56:22.712916 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.712841    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e4ab8ac774ca9f7f62f0d52f1027e3dd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-84.ec2.internal\" (UID: \"e4ab8ac774ca9f7f62f0d52f1027e3dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-84.ec2.internal"
Sep 07 16:56:22.712916 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.712872    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4ab8ac774ca9f7f62f0d52f1027e3dd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-84.ec2.internal\" (UID: \"e4ab8ac774ca9f7f62f0d52f1027e3dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-84.ec2.internal"
Sep 07 16:56:22.712916 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.712889    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2bcf0fe9132996095ce4831570ed6ab9-config\") pod \"kube-apiserver-proxy-ip-10-0-131-84.ec2.internal\" (UID: \"2bcf0fe9132996095ce4831570ed6ab9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-84.ec2.internal"
Sep 07 16:56:22.713091 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.712957    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2bcf0fe9132996095ce4831570ed6ab9-config\") pod \"kube-apiserver-proxy-ip-10-0-131-84.ec2.internal\" (UID: \"2bcf0fe9132996095ce4831570ed6ab9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-84.ec2.internal"
Sep 07 16:56:22.713091 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.712954    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e4ab8ac774ca9f7f62f0d52f1027e3dd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-84.ec2.internal\" (UID: \"e4ab8ac774ca9f7f62f0d52f1027e3dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-84.ec2.internal"
Sep 07 16:56:22.713091 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:22.712954    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4ab8ac774ca9f7f62f0d52f1027e3dd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-84.ec2.internal\" (UID: \"e4ab8ac774ca9f7f62f0d52f1027e3dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-84.ec2.internal"
Sep 07 16:56:22.773410 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:22.773377    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-84.ec2.internal\" not found"
Sep 07 16:56:23.981194 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:23.981168    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-84.ec2.internal\" not found"
Sep 07 16:56:24.024858 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.024831    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-84.ec2.internal"
Sep 07 16:56:24.030029 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.029903    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-84.ec2.internal"
Sep 07 16:56:24.082019 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:24.081941    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-84.ec2.internal\" not found"
Sep 07 16:56:24.182515 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:24.182490    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-84.ec2.internal\" not found"
Sep 07 16:56:24.283070 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:24.283027    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-84.ec2.internal\" not found"
Sep 07 16:56:24.313190 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.313170    2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 07 16:56:24.313579 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.313334    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 07 16:56:24.377207 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.377143    2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 16:56:24.383859 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:24.383838    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-84.ec2.internal\" not found"
Sep 07 16:56:24.456282 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.456256    2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 16:56:24.492454 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.492435    2558 apiserver.go:52] "Watching apiserver"
Sep 07 16:56:24.502943 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.502921    2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 07 16:56:24.503227 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.503210    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-gp54c","openshift-multus/multus-additional-cni-plugins-9xhzz","openshift-multus/multus-g769p","openshift-network-operator/iptables-alerter-t9lbf","openshift-ovn-kubernetes/ovnkube-node-fwj7s","kube-system/global-pull-secret-syncer-tfbtz","kube-system/konnectivity-agent-r4pfn","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n99gx","openshift-dns/node-resolver-hj7sr","openshift-image-registry/node-ca-vnzgb","openshift-multus/network-metrics-daemon-wgp2q","openshift-network-diagnostics/network-check-target-br7j9"]
Sep 07 16:56:24.505601 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.505583    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.507733 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.507715    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.509738 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.509724    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-t9lbf"
Sep 07 16:56:24.511136 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.511122    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8ftzg\""
Sep 07 16:56:24.511201 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.511133    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 07 16:56:24.511201 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.511138    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 07 16:56:24.511921 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.511906    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.514194 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.514180    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r4pfn"
Sep 07 16:56:24.516418 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.516402    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vnzgb"
Sep 07 16:56:24.516617 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.516594    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 07 16:56:24.517491 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.517470    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-84.ec2.internal"
Sep 07 16:56:24.520150 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.520129    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgp2q"
Sep 07 16:56:24.520260 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:24.520218    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgp2q" podUID="be68761b-c682-40af-af90-5816b2b5e637"
Sep 07 16:56:24.520325 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.520256    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 07 16:56:24.520378 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.520344    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 07 16:56:24.520828 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.520503    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 07 16:56:24.520828 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.520663    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 07 16:56:24.520828 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.520663    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 07 16:56:24.520828 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.520672    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4ntwt\""
Sep 07 16:56:24.520828 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.520736    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 07 16:56:24.521099 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.520934    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 07 16:56:24.521099 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.520940    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 07 16:56:24.521099 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.520965    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 07 16:56:24.521790 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.521627    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 07 16:56:24.521790 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.521640    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 07 16:56:24.521790 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.521649    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 07 16:56:24.521790 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.521676    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 07 16:56:24.521790 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.521638    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cfxjz\""
Sep 07 16:56:24.521790 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.521653    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-svt29\""
Sep 07 16:56:24.521790 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.521635    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 07 16:56:24.521790 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.521678    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 07 16:56:24.521790 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.521764    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mgs26\""
Sep 07 16:56:24.522171 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.521856    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 07 16:56:24.522171 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.521940    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 07 16:56:24.522171 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.521944    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 07 16:56:24.522171 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.521944    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tw2bp\""
Sep 07 16:56:24.522171 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.522151    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-06 16:51:23 +0000 UTC" deadline="2028-03-10 05:43:00.069841363 +0000 UTC"
Sep 07 16:56:24.522334 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.522180    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13188h46m35.547662976s"
Sep 07 16:56:24.522758 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.522740    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9xhzz"
Sep 07 16:56:24.524953 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.524936    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfbtz"
Sep 07 16:56:24.525026 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:24.524981    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfbtz" podUID="3475a555-fcbb-4145-bf0a-91a8d6b0099b"
Sep 07 16:56:24.525026 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.524988    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-host-run-ovn-kubernetes\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.525026 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525018    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-host-cni-netd\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.525125 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525042    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ncdh\" (UniqueName: \"kubernetes.io/projected/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-kube-api-access-4ncdh\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.525125 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525063    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cfb4fb95-10b1-421f-89bf-3ef2180791f1-run\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.525125 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525093    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cfb4fb95-10b1-421f-89bf-3ef2180791f1-host\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.525125 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525116    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-host-var-lib-kubelet\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.525251 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525139    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a477d932-fad5-4317-bfd7-2c5f56eb234f-serviceca\") pod \"node-ca-vnzgb\" (UID: \"a477d932-fad5-4317-bfd7-2c5f56eb234f\") " pod="openshift-image-registry/node-ca-vnzgb"
Sep 07 16:56:24.525251 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525161    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-host-var-lib-cni-multus\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.525251 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525183    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bghnq\" (UniqueName: \"kubernetes.io/projected/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-kube-api-access-bghnq\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.525251 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525206    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-host-run-netns\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.525368 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525228    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-run-ovn\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.525368 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525272    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-host-slash\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.525368 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525288    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv97x\" (UniqueName: \"kubernetes.io/projected/be68761b-c682-40af-af90-5816b2b5e637-kube-api-access-qv97x\") pod \"network-metrics-daemon-wgp2q\" (UID: \"be68761b-c682-40af-af90-5816b2b5e637\") " pod="openshift-multus/network-metrics-daemon-wgp2q"
Sep 07 16:56:24.525368 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525302    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/05b23baa-883b-420a-afc8-ed4f9dd1a534-konnectivity-ca\") pod \"konnectivity-agent-r4pfn\" (UID: \"05b23baa-883b-420a-afc8-ed4f9dd1a534\") " pod="kube-system/konnectivity-agent-r4pfn"
Sep 07 16:56:24.525368 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525317    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cfb4fb95-10b1-421f-89bf-3ef2180791f1-etc-systemd\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.525368 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525331    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cfb4fb95-10b1-421f-89bf-3ef2180791f1-tmp\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.525368 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525345    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-multus-conf-dir\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.525368 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525359    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-var-lib-openvswitch\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.525580 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525396    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be68761b-c682-40af-af90-5816b2b5e637-metrics-certs\") pod \"network-metrics-daemon-wgp2q\" (UID: \"be68761b-c682-40af-af90-5816b2b5e637\") " pod="openshift-multus/network-metrics-daemon-wgp2q"
Sep 07 16:56:24.525580 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525415    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-hostroot\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.525580 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525430    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-host-run-multus-certs\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.525580 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525443    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-host-kubelet\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.525580 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525459    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.525580 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525473    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfvqw\" (UniqueName: \"kubernetes.io/projected/a477d932-fad5-4317-bfd7-2c5f56eb234f-kube-api-access-xfvqw\") pod \"node-ca-vnzgb\" (UID: \"a477d932-fad5-4317-bfd7-2c5f56eb234f\") " pod="openshift-image-registry/node-ca-vnzgb"
Sep 07 16:56:24.525580 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525488    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-multus-socket-dir-parent\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.525580 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525507    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cfb4fb95-10b1-421f-89bf-3ef2180791f1-etc-sysconfig\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.525580 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525522    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfb4fb95-10b1-421f-89bf-3ef2180791f1-var-lib-kubelet\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.525580 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525536    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-host-run-k8s-cni-cncf-io\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.525580 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525549    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0b3bf99d-b84e-4f42-a4d6-2a5c8e0ab334-iptables-alerter-script\") pod \"iptables-alerter-t9lbf\" (UID: \"0b3bf99d-b84e-4f42-a4d6-2a5c8e0ab334\") " pod="openshift-network-operator/iptables-alerter-t9lbf"
Sep 07 16:56:24.525580 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525569    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b3bf99d-b84e-4f42-a4d6-2a5c8e0ab334-host-slash\") pod \"iptables-alerter-t9lbf\" (UID: \"0b3bf99d-b84e-4f42-a4d6-2a5c8e0ab334\") " pod="openshift-network-operator/iptables-alerter-t9lbf"
Sep 07 16:56:24.525897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525594    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-run-systemd\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.525897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525612    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-etc-openvswitch\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.525897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525626    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-env-overrides\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.525897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525644    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a477d932-fad5-4317-bfd7-2c5f56eb234f-host\") pod \"node-ca-vnzgb\" (UID: \"a477d932-fad5-4317-bfd7-2c5f56eb234f\") " pod="openshift-image-registry/node-ca-vnzgb"
Sep 07 16:56:24.525897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525657    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-run-openvswitch\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.525897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525670    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cfb4fb95-10b1-421f-89bf-3ef2180791f1-sys\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.525897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525691    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-multus-cni-dir\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.525897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525709    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-host-cni-bin\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.525897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525724    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfb4fb95-10b1-421f-89bf-3ef2180791f1-etc-kubernetes\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.525897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525736    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/05b23baa-883b-420a-afc8-ed4f9dd1a534-agent-certs\") pod \"konnectivity-agent-r4pfn\" (UID: \"05b23baa-883b-420a-afc8-ed4f9dd1a534\") " pod="kube-system/konnectivity-agent-r4pfn"
Sep 07 16:56:24.525897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525750    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-system-cni-dir\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.525897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525762    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-cnibin\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.525897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525776    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-host-run-netns\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.525897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525803    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-ovn-node-metrics-cert\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.525897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525817    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmms7\" (UniqueName: \"kubernetes.io/projected/cfb4fb95-10b1-421f-89bf-3ef2180791f1-kube-api-access-vmms7\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.525897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525841    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-multus-daemon-config\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.525897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525874    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-ovnkube-config\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.526367 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525892    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-ovnkube-script-lib\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.526367 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525909    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cfb4fb95-10b1-421f-89bf-3ef2180791f1-lib-modules\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.526367 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525931    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cfb4fb95-10b1-421f-89bf-3ef2180791f1-etc-tuned\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.526367 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525954    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-cni-binary-copy\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.526367 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.525968    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-etc-kubernetes\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.526367 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.526002    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-systemd-units\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.526367 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.526029    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bll7p\" (UniqueName: \"kubernetes.io/projected/0b3bf99d-b84e-4f42-a4d6-2a5c8e0ab334-kube-api-access-bll7p\") pod \"iptables-alerter-t9lbf\" (UID: \"0b3bf99d-b84e-4f42-a4d6-2a5c8e0ab334\") " pod="openshift-network-operator/iptables-alerter-t9lbf"
Sep 07 16:56:24.526367 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.526046    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cfb4fb95-10b1-421f-89bf-3ef2180791f1-etc-sysctl-d\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.526367 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.526074    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cfb4fb95-10b1-421f-89bf-3ef2180791f1-etc-sysctl-conf\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.526367 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.526093    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-host-var-lib-cni-bin\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.526367 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.526121    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cfb4fb95-10b1-421f-89bf-3ef2180791f1-etc-modprobe-d\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.526367 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.526141    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-node-log\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.526367 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.526155    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-log-socket\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.527372 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.527359    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n99gx"
Sep 07 16:56:24.529642 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.529627    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hj7sr"
Sep 07 16:56:24.530710 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.530695    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 07 16:56:24.530905 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.530889    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 07 16:56:24.531000 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.530986    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 07 16:56:24.531068 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.531053    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 07 16:56:24.531123 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.531110    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 07 16:56:24.531231 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.531218    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sm5qw\""
Sep 07 16:56:24.531322 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.531219    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7cjcl\""
Sep 07 16:56:24.531816 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.531802    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-br7j9"
Sep 07 16:56:24.531863 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:24.531850    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-br7j9" podUID="b1a3d666-c0a6-4510-a0c2-5ae3c552097b"
Sep 07 16:56:24.532548 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.532533    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 07 16:56:24.533083 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.533070    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6jtzt\""
Sep 07 16:56:24.533154 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.533140    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 07 16:56:24.545116 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.545101    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 07 16:56:24.546004 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.545992    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 07 16:56:24.546819 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.546805    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-84.ec2.internal"]
Sep 07 16:56:24.547165 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.547154    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-84.ec2.internal"
Sep 07 16:56:24.555808 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.555791    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 07 16:56:24.556045 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.556031    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-84.ec2.internal"]
Sep 07 16:56:24.582706 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.582681    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dxppr"
Sep 07 16:56:24.605462 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.605439    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dxppr"
Sep 07 16:56:24.619591 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.619569    2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 07 16:56:24.626904 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.626882    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-run-openvswitch\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.627091 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.626910    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cfb4fb95-10b1-421f-89bf-3ef2180791f1-sys\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.627091 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.626927    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-multus-cni-dir\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.627091 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.626941    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-host-cni-bin\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.627091 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.626957    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfb4fb95-10b1-421f-89bf-3ef2180791f1-etc-kubernetes\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.627091 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627009    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-run-openvswitch\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.627091 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627023    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/05b23baa-883b-420a-afc8-ed4f9dd1a534-agent-certs\") pod \"konnectivity-agent-r4pfn\" (UID: \"05b23baa-883b-420a-afc8-ed4f9dd1a534\") " pod="kube-system/konnectivity-agent-r4pfn"
Sep 07 16:56:24.627091 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627012    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cfb4fb95-10b1-421f-89bf-3ef2180791f1-sys\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.627091 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627063    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e526a4b1-0e57-478e-ad59-7f160bbdbcc1-system-cni-dir\") pod \"multus-additional-cni-plugins-9xhzz\" (UID: \"e526a4b1-0e57-478e-ad59-7f160bbdbcc1\") " pod="openshift-multus/multus-additional-cni-plugins-9xhzz"
Sep 07 16:56:24.627091 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627064    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-multus-cni-dir\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.627091 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627092    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e526a4b1-0e57-478e-ad59-7f160bbdbcc1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9xhzz\" (UID: \"e526a4b1-0e57-478e-ad59-7f160bbdbcc1\") " pod="openshift-multus/multus-additional-cni-plugins-9xhzz"
Sep 07 16:56:24.627577 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627068    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfb4fb95-10b1-421f-89bf-3ef2180791f1-etc-kubernetes\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.627577 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627025    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-host-cni-bin\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.627577 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627117    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z9wv\" (UniqueName: \"kubernetes.io/projected/b1a3d666-c0a6-4510-a0c2-5ae3c552097b-kube-api-access-8z9wv\") pod \"network-check-target-br7j9\" (UID: \"b1a3d666-c0a6-4510-a0c2-5ae3c552097b\") " pod="openshift-network-diagnostics/network-check-target-br7j9"
Sep 07 16:56:24.627577 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627142    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-system-cni-dir\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.627577 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627164    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-cnibin\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.627577 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627192    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-host-run-netns\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.627577 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627208    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-ovn-node-metrics-cert\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.627577 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627214    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-system-cni-dir\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.627577 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627225    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0f8a3bb5-596d-4af1-81a2-1abf894c717b-etc-selinux\") pod \"aws-ebs-csi-driver-node-n99gx\" (UID: \"0f8a3bb5-596d-4af1-81a2-1abf894c717b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n99gx"
Sep 07 16:56:24.627577 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627224    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-cnibin\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.627577 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627258    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-host-run-netns\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.627577 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627261    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmms7\" (UniqueName: \"kubernetes.io/projected/cfb4fb95-10b1-421f-89bf-3ef2180791f1-kube-api-access-vmms7\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.627577 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627310    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-multus-daemon-config\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.627577 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627358    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-ovnkube-config\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.627577 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627383    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-ovnkube-script-lib\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.627577 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627410    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e526a4b1-0e57-478e-ad59-7f160bbdbcc1-cni-binary-copy\") pod \"multus-additional-cni-plugins-9xhzz\" (UID: \"e526a4b1-0e57-478e-ad59-7f160bbdbcc1\") " pod="openshift-multus/multus-additional-cni-plugins-9xhzz"
Sep 07 16:56:24.627577 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627440    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cfb4fb95-10b1-421f-89bf-3ef2180791f1-lib-modules\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.627577 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627452    2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 07 16:56:24.628447 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627462    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cfb4fb95-10b1-421f-89bf-3ef2180791f1-etc-tuned\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.628447 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627487    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-cni-binary-copy\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.628447 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627510    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-etc-kubernetes\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.628447 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627535    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-systemd-units\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.628447 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627561    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bll7p\" (UniqueName: \"kubernetes.io/projected/0b3bf99d-b84e-4f42-a4d6-2a5c8e0ab334-kube-api-access-bll7p\") pod \"iptables-alerter-t9lbf\" (UID: \"0b3bf99d-b84e-4f42-a4d6-2a5c8e0ab334\") " pod="openshift-network-operator/iptables-alerter-t9lbf"
Sep 07 16:56:24.628447 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627584    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cfb4fb95-10b1-421f-89bf-3ef2180791f1-etc-sysctl-d\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.628447 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627597    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cfb4fb95-10b1-421f-89bf-3ef2180791f1-lib-modules\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.628447 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627606    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cfb4fb95-10b1-421f-89bf-3ef2180791f1-etc-sysctl-conf\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.628447 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627632    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-host-var-lib-cni-bin\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.628447 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627620    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-etc-kubernetes\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.628447 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627658    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4fd644cb-0777-45a8-94a9-129dd37858f1-hosts-file\") pod \"node-resolver-hj7sr\" (UID: \"4fd644cb-0777-45a8-94a9-129dd37858f1\") " pod="openshift-dns/node-resolver-hj7sr"
Sep 07 16:56:24.628447 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627685    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sq6t9\" (UniqueName: \"kubernetes.io/projected/4fd644cb-0777-45a8-94a9-129dd37858f1-kube-api-access-sq6t9\") pod \"node-resolver-hj7sr\" (UID: \"4fd644cb-0777-45a8-94a9-129dd37858f1\") " pod="openshift-dns/node-resolver-hj7sr"
Sep 07 16:56:24.628447 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627710    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cfb4fb95-10b1-421f-89bf-3ef2180791f1-etc-modprobe-d\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.628447 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627734    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-node-log\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.628447 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627761    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-log-socket\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.628447 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627787    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-host-run-ovn-kubernetes\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.628447 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627810    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-host-cni-netd\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.629260 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627834    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ncdh\" (UniqueName: \"kubernetes.io/projected/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-kube-api-access-4ncdh\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.629260 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627864    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cfb4fb95-10b1-421f-89bf-3ef2180791f1-run\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.629260 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627885    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cfb4fb95-10b1-421f-89bf-3ef2180791f1-host\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.629260 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627910    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-host-var-lib-kubelet\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.629260 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627933    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a477d932-fad5-4317-bfd7-2c5f56eb234f-serviceca\") pod \"node-ca-vnzgb\" (UID: \"a477d932-fad5-4317-bfd7-2c5f56eb234f\") " pod="openshift-image-registry/node-ca-vnzgb"
Sep 07 16:56:24.629260 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627960    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e526a4b1-0e57-478e-ad59-7f160bbdbcc1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9xhzz\" (UID: \"e526a4b1-0e57-478e-ad59-7f160bbdbcc1\") " pod="openshift-multus/multus-additional-cni-plugins-9xhzz"
Sep 07 16:56:24.629260 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627978    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-ovnkube-config\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.629260 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628007    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0f8a3bb5-596d-4af1-81a2-1abf894c717b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n99gx\" (UID: \"0f8a3bb5-596d-4af1-81a2-1abf894c717b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n99gx"
Sep 07 16:56:24.629260 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.627978    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-multus-daemon-config\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.629260 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628029    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-node-log\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.629260 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628046    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-host-var-lib-cni-multus\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.629260 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628060    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cfb4fb95-10b1-421f-89bf-3ef2180791f1-run\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.629260 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628077    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cfb4fb95-10b1-421f-89bf-3ef2180791f1-host\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.629260 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628086    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bghnq\" (UniqueName: \"kubernetes.io/projected/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-kube-api-access-bghnq\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.629260 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628111    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-host-run-netns\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.629260 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628102    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-cni-binary-copy\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.629260 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628124    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-host-var-lib-kubelet\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.629260 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628136    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-host-run-ovn-kubernetes\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.630112 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628088    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-systemd-units\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.630112 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628133    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-run-ovn\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.630112 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628003    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-ovnkube-script-lib\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.630112 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628164    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-host-var-lib-cni-multus\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.630112 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628190    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cfb4fb95-10b1-421f-89bf-3ef2180791f1-etc-sysctl-d\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.630112 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628207    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-host-run-netns\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.630112 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628213    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-host-cni-netd\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.630112 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628232    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-log-socket\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.630112 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628293    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2jbp\" (UniqueName: \"kubernetes.io/projected/e526a4b1-0e57-478e-ad59-7f160bbdbcc1-kube-api-access-p2jbp\") pod \"multus-additional-cni-plugins-9xhzz\" (UID: \"e526a4b1-0e57-478e-ad59-7f160bbdbcc1\") " pod="openshift-multus/multus-additional-cni-plugins-9xhzz"
Sep 07 16:56:24.630112 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628354    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cfb4fb95-10b1-421f-89bf-3ef2180791f1-etc-sysctl-conf\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.630112 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628407    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3475a555-fcbb-4145-bf0a-91a8d6b0099b-kubelet-config\") pod \"global-pull-secret-syncer-tfbtz\" (UID: \"3475a555-fcbb-4145-bf0a-91a8d6b0099b\") " pod="kube-system/global-pull-secret-syncer-tfbtz"
Sep 07 16:56:24.630112 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628436    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0f8a3bb5-596d-4af1-81a2-1abf894c717b-device-dir\") pod \"aws-ebs-csi-driver-node-n99gx\" (UID: \"0f8a3bb5-596d-4af1-81a2-1abf894c717b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n99gx"
Sep 07 16:56:24.630112 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628445    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-host-var-lib-cni-bin\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.630112 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628452    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cfb4fb95-10b1-421f-89bf-3ef2180791f1-etc-modprobe-d\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.630112 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628461    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-host-slash\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.630112 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628512    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-host-slash\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.630112 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628518    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv97x\" (UniqueName: \"kubernetes.io/projected/be68761b-c682-40af-af90-5816b2b5e637-kube-api-access-qv97x\") pod \"network-metrics-daemon-wgp2q\" (UID: \"be68761b-c682-40af-af90-5816b2b5e637\") " pod="openshift-multus/network-metrics-daemon-wgp2q"
Sep 07 16:56:24.630975 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628523    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-run-ovn\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.630975 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628626    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/05b23baa-883b-420a-afc8-ed4f9dd1a534-konnectivity-ca\") pod \"konnectivity-agent-r4pfn\" (UID: \"05b23baa-883b-420a-afc8-ed4f9dd1a534\") " pod="kube-system/konnectivity-agent-r4pfn"
Sep 07 16:56:24.630975 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628646    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e526a4b1-0e57-478e-ad59-7f160bbdbcc1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9xhzz\" (UID: \"e526a4b1-0e57-478e-ad59-7f160bbdbcc1\") " pod="openshift-multus/multus-additional-cni-plugins-9xhzz"
Sep 07 16:56:24.630975 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628660    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a477d932-fad5-4317-bfd7-2c5f56eb234f-serviceca\") pod \"node-ca-vnzgb\" (UID: \"a477d932-fad5-4317-bfd7-2c5f56eb234f\") " pod="openshift-image-registry/node-ca-vnzgb"
Sep 07 16:56:24.630975 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628666    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3475a555-fcbb-4145-bf0a-91a8d6b0099b-dbus\") pod \"global-pull-secret-syncer-tfbtz\" (UID: \"3475a555-fcbb-4145-bf0a-91a8d6b0099b\") " pod="kube-system/global-pull-secret-syncer-tfbtz"
Sep 07 16:56:24.630975 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628714    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0f8a3bb5-596d-4af1-81a2-1abf894c717b-registration-dir\") pod \"aws-ebs-csi-driver-node-n99gx\" (UID: \"0f8a3bb5-596d-4af1-81a2-1abf894c717b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n99gx"
Sep 07 16:56:24.630975 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628743    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cfb4fb95-10b1-421f-89bf-3ef2180791f1-etc-systemd\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.630975 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628761    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cfb4fb95-10b1-421f-89bf-3ef2180791f1-tmp\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.630975 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628771    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cfb4fb95-10b1-421f-89bf-3ef2180791f1-etc-systemd\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.630975 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628776    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-multus-conf-dir\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.630975 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628799    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-var-lib-openvswitch\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.630975 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628815    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be68761b-c682-40af-af90-5816b2b5e637-metrics-certs\") pod \"network-metrics-daemon-wgp2q\" (UID: \"be68761b-c682-40af-af90-5816b2b5e637\") " pod="openshift-multus/network-metrics-daemon-wgp2q"
Sep 07 16:56:24.630975 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628836    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0f8a3bb5-596d-4af1-81a2-1abf894c717b-socket-dir\") pod \"aws-ebs-csi-driver-node-n99gx\" (UID: \"0f8a3bb5-596d-4af1-81a2-1abf894c717b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n99gx"
Sep 07 16:56:24.630975 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628856    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq7m8\" (UniqueName: \"kubernetes.io/projected/0f8a3bb5-596d-4af1-81a2-1abf894c717b-kube-api-access-hq7m8\") pod \"aws-ebs-csi-driver-node-n99gx\" (UID: \"0f8a3bb5-596d-4af1-81a2-1abf894c717b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n99gx"
Sep 07 16:56:24.630975 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628879    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fd644cb-0777-45a8-94a9-129dd37858f1-tmp-dir\") pod \"node-resolver-hj7sr\" (UID: \"4fd644cb-0777-45a8-94a9-129dd37858f1\") " pod="openshift-dns/node-resolver-hj7sr"
Sep 07 16:56:24.630975 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628904    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-hostroot\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.630975 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628909    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-var-lib-openvswitch\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.631791 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628927    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-host-run-multus-certs\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.631791 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628951    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-multus-conf-dir\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.631791 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628951    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-host-kubelet\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.631791 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628987    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-host-kubelet\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.631791 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.628987    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.631791 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.629031    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfvqw\" (UniqueName: \"kubernetes.io/projected/a477d932-fad5-4317-bfd7-2c5f56eb234f-kube-api-access-xfvqw\") pod \"node-ca-vnzgb\" (UID: \"a477d932-fad5-4317-bfd7-2c5f56eb234f\") " pod="openshift-image-registry/node-ca-vnzgb"
Sep 07 16:56:24.631791 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.629058    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-multus-socket-dir-parent\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.631791 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:24.629076    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:56:24.631791 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.629082    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cfb4fb95-10b1-421f-89bf-3ef2180791f1-etc-sysconfig\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.631791 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.629104    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfb4fb95-10b1-421f-89bf-3ef2180791f1-var-lib-kubelet\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.631791 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:24.629139    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be68761b-c682-40af-af90-5816b2b5e637-metrics-certs podName:be68761b-c682-40af-af90-5816b2b5e637 nodeName:}" failed. No retries permitted until 2026-09-07 16:56:25.129121627 +0000 UTC m=+2.160552399 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be68761b-c682-40af-af90-5816b2b5e637-metrics-certs") pod "network-metrics-daemon-wgp2q" (UID: "be68761b-c682-40af-af90-5816b2b5e637") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:56:24.631791 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.629166    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-host-run-k8s-cni-cncf-io\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.631791 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.629159    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/05b23baa-883b-420a-afc8-ed4f9dd1a534-konnectivity-ca\") pod \"konnectivity-agent-r4pfn\" (UID: \"05b23baa-883b-420a-afc8-ed4f9dd1a534\") " pod="kube-system/konnectivity-agent-r4pfn"
Sep 07 16:56:24.631791 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.629189    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0b3bf99d-b84e-4f42-a4d6-2a5c8e0ab334-iptables-alerter-script\") pod \"iptables-alerter-t9lbf\" (UID: \"0b3bf99d-b84e-4f42-a4d6-2a5c8e0ab334\") " pod="openshift-network-operator/iptables-alerter-t9lbf"
Sep 07 16:56:24.631791 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.629213    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b3bf99d-b84e-4f42-a4d6-2a5c8e0ab334-host-slash\") pod \"iptables-alerter-t9lbf\" (UID: \"0b3bf99d-b84e-4f42-a4d6-2a5c8e0ab334\") " pod="openshift-network-operator/iptables-alerter-t9lbf"
Sep 07 16:56:24.631791 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.629229    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cfb4fb95-10b1-421f-89bf-3ef2180791f1-etc-sysconfig\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.631791 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.629253    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3475a555-fcbb-4145-bf0a-91a8d6b0099b-original-pull-secret\") pod \"global-pull-secret-syncer-tfbtz\" (UID: \"3475a555-fcbb-4145-bf0a-91a8d6b0099b\") " pod="kube-system/global-pull-secret-syncer-tfbtz"
Sep 07 16:56:24.632324 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.629278    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.632324 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.629285    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0f8a3bb5-596d-4af1-81a2-1abf894c717b-sys-fs\") pod \"aws-ebs-csi-driver-node-n99gx\" (UID: \"0f8a3bb5-596d-4af1-81a2-1abf894c717b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n99gx"
Sep 07 16:56:24.632324 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.629310    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfb4fb95-10b1-421f-89bf-3ef2180791f1-var-lib-kubelet\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.632324 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.629318    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-run-systemd\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.632324 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.629344    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-etc-openvswitch\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.632324 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.629345    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-host-run-k8s-cni-cncf-io\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.632324 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.629344    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-multus-socket-dir-parent\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.632324 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.629378    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-env-overrides\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.632324 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.629393    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-etc-openvswitch\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.632324 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.629407    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-hostroot\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.632324 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.629412    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b3bf99d-b84e-4f42-a4d6-2a5c8e0ab334-host-slash\") pod \"iptables-alerter-t9lbf\" (UID: \"0b3bf99d-b84e-4f42-a4d6-2a5c8e0ab334\") " pod="openshift-network-operator/iptables-alerter-t9lbf"
Sep 07 16:56:24.632324 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.629450    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-run-systemd\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.632324 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.629516    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-host-run-multus-certs\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.632324 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.629549    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a477d932-fad5-4317-bfd7-2c5f56eb234f-host\") pod \"node-ca-vnzgb\" (UID: \"a477d932-fad5-4317-bfd7-2c5f56eb234f\") " pod="openshift-image-registry/node-ca-vnzgb"
Sep 07 16:56:24.632324 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.629615    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e526a4b1-0e57-478e-ad59-7f160bbdbcc1-cnibin\") pod \"multus-additional-cni-plugins-9xhzz\" (UID: \"e526a4b1-0e57-478e-ad59-7f160bbdbcc1\") " pod="openshift-multus/multus-additional-cni-plugins-9xhzz"
Sep 07 16:56:24.632324 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.629698    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a477d932-fad5-4317-bfd7-2c5f56eb234f-host\") pod \"node-ca-vnzgb\" (UID: \"a477d932-fad5-4317-bfd7-2c5f56eb234f\") " pod="openshift-image-registry/node-ca-vnzgb"
Sep 07 16:56:24.632324 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.629858    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-env-overrides\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.632324 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.629903    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0b3bf99d-b84e-4f42-a4d6-2a5c8e0ab334-iptables-alerter-script\") pod \"iptables-alerter-t9lbf\" (UID: \"0b3bf99d-b84e-4f42-a4d6-2a5c8e0ab334\") " pod="openshift-network-operator/iptables-alerter-t9lbf"
Sep 07 16:56:24.632944 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.631337    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cfb4fb95-10b1-421f-89bf-3ef2180791f1-etc-tuned\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.632944 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.631630    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/05b23baa-883b-420a-afc8-ed4f9dd1a534-agent-certs\") pod \"konnectivity-agent-r4pfn\" (UID: \"05b23baa-883b-420a-afc8-ed4f9dd1a534\") " pod="kube-system/konnectivity-agent-r4pfn"
Sep 07 16:56:24.632944 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.631889    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cfb4fb95-10b1-421f-89bf-3ef2180791f1-tmp\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.632944 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.631925    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-ovn-node-metrics-cert\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.641341 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.641318    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmms7\" (UniqueName: \"kubernetes.io/projected/cfb4fb95-10b1-421f-89bf-3ef2180791f1-kube-api-access-vmms7\") pod \"tuned-gp54c\" (UID: \"cfb4fb95-10b1-421f-89bf-3ef2180791f1\") " pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.660118 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.660082    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bll7p\" (UniqueName: \"kubernetes.io/projected/0b3bf99d-b84e-4f42-a4d6-2a5c8e0ab334-kube-api-access-bll7p\") pod \"iptables-alerter-t9lbf\" (UID: \"0b3bf99d-b84e-4f42-a4d6-2a5c8e0ab334\") " pod="openshift-network-operator/iptables-alerter-t9lbf"
Sep 07 16:56:24.660271 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.660177    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ncdh\" (UniqueName: \"kubernetes.io/projected/9b97dbca-7e8f-4e05-9cc4-8f42785f01e7-kube-api-access-4ncdh\") pod \"ovnkube-node-fwj7s\" (UID: \"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.661513 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.661488    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfvqw\" (UniqueName: \"kubernetes.io/projected/a477d932-fad5-4317-bfd7-2c5f56eb234f-kube-api-access-xfvqw\") pod \"node-ca-vnzgb\" (UID: \"a477d932-fad5-4317-bfd7-2c5f56eb234f\") " pod="openshift-image-registry/node-ca-vnzgb"
Sep 07 16:56:24.675653 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.675629    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv97x\" (UniqueName: \"kubernetes.io/projected/be68761b-c682-40af-af90-5816b2b5e637-kube-api-access-qv97x\") pod \"network-metrics-daemon-wgp2q\" (UID: \"be68761b-c682-40af-af90-5816b2b5e637\") " pod="openshift-multus/network-metrics-daemon-wgp2q"
Sep 07 16:56:24.676698 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.676678    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bghnq\" (UniqueName: \"kubernetes.io/projected/7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd-kube-api-access-bghnq\") pod \"multus-g769p\" (UID: \"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd\") " pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.705346 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.705319    2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 16:56:24.730513 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.730480    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2jbp\" (UniqueName: \"kubernetes.io/projected/e526a4b1-0e57-478e-ad59-7f160bbdbcc1-kube-api-access-p2jbp\") pod \"multus-additional-cni-plugins-9xhzz\" (UID: \"e526a4b1-0e57-478e-ad59-7f160bbdbcc1\") " pod="openshift-multus/multus-additional-cni-plugins-9xhzz"
Sep 07 16:56:24.730610 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.730521    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3475a555-fcbb-4145-bf0a-91a8d6b0099b-kubelet-config\") pod \"global-pull-secret-syncer-tfbtz\" (UID: \"3475a555-fcbb-4145-bf0a-91a8d6b0099b\") " pod="kube-system/global-pull-secret-syncer-tfbtz"
Sep 07 16:56:24.730610 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.730540    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0f8a3bb5-596d-4af1-81a2-1abf894c717b-device-dir\") pod \"aws-ebs-csi-driver-node-n99gx\" (UID: \"0f8a3bb5-596d-4af1-81a2-1abf894c717b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n99gx"
Sep 07 16:56:24.730610 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.730564    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e526a4b1-0e57-478e-ad59-7f160bbdbcc1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9xhzz\" (UID: \"e526a4b1-0e57-478e-ad59-7f160bbdbcc1\") " pod="openshift-multus/multus-additional-cni-plugins-9xhzz"
Sep 07 16:56:24.730754 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.730607    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3475a555-fcbb-4145-bf0a-91a8d6b0099b-kubelet-config\") pod \"global-pull-secret-syncer-tfbtz\" (UID: \"3475a555-fcbb-4145-bf0a-91a8d6b0099b\") " pod="kube-system/global-pull-secret-syncer-tfbtz"
Sep 07 16:56:24.730754 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.730631    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0f8a3bb5-596d-4af1-81a2-1abf894c717b-device-dir\") pod \"aws-ebs-csi-driver-node-n99gx\" (UID: \"0f8a3bb5-596d-4af1-81a2-1abf894c717b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n99gx"
Sep 07 16:56:24.730754 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.730682    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3475a555-fcbb-4145-bf0a-91a8d6b0099b-dbus\") pod \"global-pull-secret-syncer-tfbtz\" (UID: \"3475a555-fcbb-4145-bf0a-91a8d6b0099b\") " pod="kube-system/global-pull-secret-syncer-tfbtz"
Sep 07 16:56:24.730754 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.730719    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0f8a3bb5-596d-4af1-81a2-1abf894c717b-registration-dir\") pod \"aws-ebs-csi-driver-node-n99gx\" (UID: \"0f8a3bb5-596d-4af1-81a2-1abf894c717b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n99gx"
Sep 07 16:56:24.730942 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.730762    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3475a555-fcbb-4145-bf0a-91a8d6b0099b-dbus\") pod \"global-pull-secret-syncer-tfbtz\" (UID: \"3475a555-fcbb-4145-bf0a-91a8d6b0099b\") " pod="kube-system/global-pull-secret-syncer-tfbtz"
Sep 07 16:56:24.730942 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.730762    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0f8a3bb5-596d-4af1-81a2-1abf894c717b-socket-dir\") pod \"aws-ebs-csi-driver-node-n99gx\" (UID: \"0f8a3bb5-596d-4af1-81a2-1abf894c717b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n99gx"
Sep 07 16:56:24.730942 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.730791    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0f8a3bb5-596d-4af1-81a2-1abf894c717b-registration-dir\") pod \"aws-ebs-csi-driver-node-n99gx\" (UID: \"0f8a3bb5-596d-4af1-81a2-1abf894c717b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n99gx"
Sep 07 16:56:24.730942 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.730809    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq7m8\" (UniqueName: \"kubernetes.io/projected/0f8a3bb5-596d-4af1-81a2-1abf894c717b-kube-api-access-hq7m8\") pod \"aws-ebs-csi-driver-node-n99gx\" (UID: \"0f8a3bb5-596d-4af1-81a2-1abf894c717b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n99gx"
Sep 07 16:56:24.730942 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.730829    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fd644cb-0777-45a8-94a9-129dd37858f1-tmp-dir\") pod \"node-resolver-hj7sr\" (UID: \"4fd644cb-0777-45a8-94a9-129dd37858f1\") " pod="openshift-dns/node-resolver-hj7sr"
Sep 07 16:56:24.730942 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.730862    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3475a555-fcbb-4145-bf0a-91a8d6b0099b-original-pull-secret\") pod \"global-pull-secret-syncer-tfbtz\" (UID: \"3475a555-fcbb-4145-bf0a-91a8d6b0099b\") " pod="kube-system/global-pull-secret-syncer-tfbtz"
Sep 07 16:56:24.730942 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.730864    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0f8a3bb5-596d-4af1-81a2-1abf894c717b-socket-dir\") pod \"aws-ebs-csi-driver-node-n99gx\" (UID: \"0f8a3bb5-596d-4af1-81a2-1abf894c717b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n99gx"
Sep 07 16:56:24.730942 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.730879    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0f8a3bb5-596d-4af1-81a2-1abf894c717b-sys-fs\") pod \"aws-ebs-csi-driver-node-n99gx\" (UID: \"0f8a3bb5-596d-4af1-81a2-1abf894c717b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n99gx"
Sep 07 16:56:24.730942 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.730902    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e526a4b1-0e57-478e-ad59-7f160bbdbcc1-cnibin\") pod \"multus-additional-cni-plugins-9xhzz\" (UID: \"e526a4b1-0e57-478e-ad59-7f160bbdbcc1\") " pod="openshift-multus/multus-additional-cni-plugins-9xhzz"
Sep 07 16:56:24.730942 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.730937    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e526a4b1-0e57-478e-ad59-7f160bbdbcc1-system-cni-dir\") pod \"multus-additional-cni-plugins-9xhzz\" (UID: \"e526a4b1-0e57-478e-ad59-7f160bbdbcc1\") " pod="openshift-multus/multus-additional-cni-plugins-9xhzz"
Sep 07 16:56:24.731414 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.730951    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e526a4b1-0e57-478e-ad59-7f160bbdbcc1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9xhzz\" (UID: \"e526a4b1-0e57-478e-ad59-7f160bbdbcc1\") " pod="openshift-multus/multus-additional-cni-plugins-9xhzz"
Sep 07 16:56:24.731414 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:24.730958    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 16:56:24.731414 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.730977    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z9wv\" (UniqueName: \"kubernetes.io/projected/b1a3d666-c0a6-4510-a0c2-5ae3c552097b-kube-api-access-8z9wv\") pod \"network-check-target-br7j9\" (UID: \"b1a3d666-c0a6-4510-a0c2-5ae3c552097b\") " pod="openshift-network-diagnostics/network-check-target-br7j9"
Sep 07 16:56:24.731414 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.730994    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0f8a3bb5-596d-4af1-81a2-1abf894c717b-etc-selinux\") pod \"aws-ebs-csi-driver-node-n99gx\" (UID: \"0f8a3bb5-596d-4af1-81a2-1abf894c717b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n99gx"
Sep 07 16:56:24.731414 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.731002    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e526a4b1-0e57-478e-ad59-7f160bbdbcc1-cnibin\") pod \"multus-additional-cni-plugins-9xhzz\" (UID: \"e526a4b1-0e57-478e-ad59-7f160bbdbcc1\") " pod="openshift-multus/multus-additional-cni-plugins-9xhzz"
Sep 07 16:56:24.731414 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:24.731013    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3475a555-fcbb-4145-bf0a-91a8d6b0099b-original-pull-secret podName:3475a555-fcbb-4145-bf0a-91a8d6b0099b nodeName:}" failed. No retries permitted until 2026-09-07 16:56:25.230995948 +0000 UTC m=+2.262426731 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3475a555-fcbb-4145-bf0a-91a8d6b0099b-original-pull-secret") pod "global-pull-secret-syncer-tfbtz" (UID: "3475a555-fcbb-4145-bf0a-91a8d6b0099b") : object "kube-system"/"original-pull-secret" not registered
Sep 07 16:56:24.731414 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.731050    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e526a4b1-0e57-478e-ad59-7f160bbdbcc1-cni-binary-copy\") pod \"multus-additional-cni-plugins-9xhzz\" (UID: \"e526a4b1-0e57-478e-ad59-7f160bbdbcc1\") " pod="openshift-multus/multus-additional-cni-plugins-9xhzz"
Sep 07 16:56:24.731414 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.731059    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0f8a3bb5-596d-4af1-81a2-1abf894c717b-sys-fs\") pod \"aws-ebs-csi-driver-node-n99gx\" (UID: \"0f8a3bb5-596d-4af1-81a2-1abf894c717b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n99gx"
Sep 07 16:56:24.731414 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.731072    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0f8a3bb5-596d-4af1-81a2-1abf894c717b-etc-selinux\") pod \"aws-ebs-csi-driver-node-n99gx\" (UID: \"0f8a3bb5-596d-4af1-81a2-1abf894c717b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n99gx"
Sep 07 16:56:24.731414 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.731080    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fd644cb-0777-45a8-94a9-129dd37858f1-tmp-dir\") pod \"node-resolver-hj7sr\" (UID: \"4fd644cb-0777-45a8-94a9-129dd37858f1\") " pod="openshift-dns/node-resolver-hj7sr"
Sep 07 16:56:24.731414 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.731103    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e526a4b1-0e57-478e-ad59-7f160bbdbcc1-system-cni-dir\") pod \"multus-additional-cni-plugins-9xhzz\" (UID: \"e526a4b1-0e57-478e-ad59-7f160bbdbcc1\") " pod="openshift-multus/multus-additional-cni-plugins-9xhzz"
Sep 07 16:56:24.731414 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.731138    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4fd644cb-0777-45a8-94a9-129dd37858f1-hosts-file\") pod \"node-resolver-hj7sr\" (UID: \"4fd644cb-0777-45a8-94a9-129dd37858f1\") " pod="openshift-dns/node-resolver-hj7sr"
Sep 07 16:56:24.731414 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.731186    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sq6t9\" (UniqueName: \"kubernetes.io/projected/4fd644cb-0777-45a8-94a9-129dd37858f1-kube-api-access-sq6t9\") pod \"node-resolver-hj7sr\" (UID: \"4fd644cb-0777-45a8-94a9-129dd37858f1\") " pod="openshift-dns/node-resolver-hj7sr"
Sep 07 16:56:24.731414 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.731232    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4fd644cb-0777-45a8-94a9-129dd37858f1-hosts-file\") pod \"node-resolver-hj7sr\" (UID: \"4fd644cb-0777-45a8-94a9-129dd37858f1\") " pod="openshift-dns/node-resolver-hj7sr"
Sep 07 16:56:24.731414 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.731253    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e526a4b1-0e57-478e-ad59-7f160bbdbcc1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9xhzz\" (UID: \"e526a4b1-0e57-478e-ad59-7f160bbdbcc1\") " pod="openshift-multus/multus-additional-cni-plugins-9xhzz"
Sep 07 16:56:24.731414 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.731271    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e526a4b1-0e57-478e-ad59-7f160bbdbcc1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9xhzz\" (UID: \"e526a4b1-0e57-478e-ad59-7f160bbdbcc1\") " pod="openshift-multus/multus-additional-cni-plugins-9xhzz"
Sep 07 16:56:24.732043 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.731298    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0f8a3bb5-596d-4af1-81a2-1abf894c717b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n99gx\" (UID: \"0f8a3bb5-596d-4af1-81a2-1abf894c717b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n99gx"
Sep 07 16:56:24.732043 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.731355    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0f8a3bb5-596d-4af1-81a2-1abf894c717b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n99gx\" (UID: \"0f8a3bb5-596d-4af1-81a2-1abf894c717b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n99gx"
Sep 07 16:56:24.732043 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.731684    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e526a4b1-0e57-478e-ad59-7f160bbdbcc1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9xhzz\" (UID: \"e526a4b1-0e57-478e-ad59-7f160bbdbcc1\") " pod="openshift-multus/multus-additional-cni-plugins-9xhzz"
Sep 07 16:56:24.732043 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.731740    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e526a4b1-0e57-478e-ad59-7f160bbdbcc1-cni-binary-copy\") pod \"multus-additional-cni-plugins-9xhzz\" (UID: \"e526a4b1-0e57-478e-ad59-7f160bbdbcc1\") " pod="openshift-multus/multus-additional-cni-plugins-9xhzz"
Sep 07 16:56:24.732043 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.731823    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e526a4b1-0e57-478e-ad59-7f160bbdbcc1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9xhzz\" (UID: \"e526a4b1-0e57-478e-ad59-7f160bbdbcc1\") " pod="openshift-multus/multus-additional-cni-plugins-9xhzz"
Sep 07 16:56:24.753427 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:24.752926    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 16:56:24.753427 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:24.753127    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 16:56:24.753427 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:24.753143    2558 projected.go:196] Error preparing data for projected volume kube-api-access-8z9wv for pod openshift-network-diagnostics/network-check-target-br7j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:56:24.753664 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:24.753474    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b1a3d666-c0a6-4510-a0c2-5ae3c552097b-kube-api-access-8z9wv podName:b1a3d666-c0a6-4510-a0c2-5ae3c552097b nodeName:}" failed. No retries permitted until 2026-09-07 16:56:25.253411922 +0000 UTC m=+2.284842695 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8z9wv" (UniqueName: "kubernetes.io/projected/b1a3d666-c0a6-4510-a0c2-5ae3c552097b-kube-api-access-8z9wv") pod "network-check-target-br7j9" (UID: "b1a3d666-c0a6-4510-a0c2-5ae3c552097b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:56:24.756082 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.755567    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sq6t9\" (UniqueName: \"kubernetes.io/projected/4fd644cb-0777-45a8-94a9-129dd37858f1-kube-api-access-sq6t9\") pod \"node-resolver-hj7sr\" (UID: \"4fd644cb-0777-45a8-94a9-129dd37858f1\") " pod="openshift-dns/node-resolver-hj7sr"
Sep 07 16:56:24.756082 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.755972    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq7m8\" (UniqueName: \"kubernetes.io/projected/0f8a3bb5-596d-4af1-81a2-1abf894c717b-kube-api-access-hq7m8\") pod \"aws-ebs-csi-driver-node-n99gx\" (UID: \"0f8a3bb5-596d-4af1-81a2-1abf894c717b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n99gx"
Sep 07 16:56:24.758055 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.758037    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2jbp\" (UniqueName: \"kubernetes.io/projected/e526a4b1-0e57-478e-ad59-7f160bbdbcc1-kube-api-access-p2jbp\") pod \"multus-additional-cni-plugins-9xhzz\" (UID: \"e526a4b1-0e57-478e-ad59-7f160bbdbcc1\") " pod="openshift-multus/multus-additional-cni-plugins-9xhzz"
Sep 07 16:56:24.775543 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:24.775520    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bcf0fe9132996095ce4831570ed6ab9.slice/crio-fca08381ff5297cc000b10d3e94831e8f8c65f1a19cdb6b8cac6fa3cf2656e91 WatchSource:0}: Error finding container fca08381ff5297cc000b10d3e94831e8f8c65f1a19cdb6b8cac6fa3cf2656e91: Status 404 returned error can't find the container with id fca08381ff5297cc000b10d3e94831e8f8c65f1a19cdb6b8cac6fa3cf2656e91
Sep 07 16:56:24.779492 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.779478    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 16:56:24.841373 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.841345    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gp54c"
Sep 07 16:56:24.851705 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:24.851676    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfb4fb95_10b1_421f_89bf_3ef2180791f1.slice/crio-fea2894f0f07c1c02722365e63e7e5641da8cf53580ce9301f1c6ba2a5c1849f WatchSource:0}: Error finding container fea2894f0f07c1c02722365e63e7e5641da8cf53580ce9301f1c6ba2a5c1849f: Status 404 returned error can't find the container with id fea2894f0f07c1c02722365e63e7e5641da8cf53580ce9301f1c6ba2a5c1849f
Sep 07 16:56:24.865645 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.865625    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g769p"
Sep 07 16:56:24.873180 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:24.873158    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7126d5fe_991d_4a2e_9f7b_9b0bfb1906cd.slice/crio-5363acff4e73793650e534b01f60d227f4fc1b0428ebc450ba217492f675245f WatchSource:0}: Error finding container 5363acff4e73793650e534b01f60d227f4fc1b0428ebc450ba217492f675245f: Status 404 returned error can't find the container with id 5363acff4e73793650e534b01f60d227f4fc1b0428ebc450ba217492f675245f
Sep 07 16:56:24.883353 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.883336    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-t9lbf"
Sep 07 16:56:24.892442 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:24.892293    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b3bf99d_b84e_4f42_a4d6_2a5c8e0ab334.slice/crio-bc9444e5878281bc879cf21201c4980c7649faaca843998a73794f5a78647d07 WatchSource:0}: Error finding container bc9444e5878281bc879cf21201c4980c7649faaca843998a73794f5a78647d07: Status 404 returned error can't find the container with id bc9444e5878281bc879cf21201c4980c7649faaca843998a73794f5a78647d07
Sep 07 16:56:24.901322 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.901305    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:24.908797 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:24.908777    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b97dbca_7e8f_4e05_9cc4_8f42785f01e7.slice/crio-4c7476a60cc9445cfb562be931a6daa896489cbff8558c374d49058bf145c36f WatchSource:0}: Error finding container 4c7476a60cc9445cfb562be931a6daa896489cbff8558c374d49058bf145c36f: Status 404 returned error can't find the container with id 4c7476a60cc9445cfb562be931a6daa896489cbff8558c374d49058bf145c36f
Sep 07 16:56:24.917795 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.917778    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r4pfn"
Sep 07 16:56:24.925529 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:24.925510    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05b23baa_883b_420a_afc8_ed4f9dd1a534.slice/crio-4da04686baeed4226e0560030245ce9d936a547501239eeedc7cfefee43097a6 WatchSource:0}: Error finding container 4da04686baeed4226e0560030245ce9d936a547501239eeedc7cfefee43097a6: Status 404 returned error can't find the container with id 4da04686baeed4226e0560030245ce9d936a547501239eeedc7cfefee43097a6
Sep 07 16:56:24.938953 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.938934    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vnzgb"
Sep 07 16:56:24.946935 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:24.946911    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda477d932_fad5_4317_bfd7_2c5f56eb234f.slice/crio-d1ef005710a5a8868722f2e0d7790a0b155242b488ab167ba8a97b3c4edf8d41 WatchSource:0}: Error finding container d1ef005710a5a8868722f2e0d7790a0b155242b488ab167ba8a97b3c4edf8d41: Status 404 returned error can't find the container with id d1ef005710a5a8868722f2e0d7790a0b155242b488ab167ba8a97b3c4edf8d41
Sep 07 16:56:24.963515 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.963494    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9xhzz"
Sep 07 16:56:24.971694 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:24.971668    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode526a4b1_0e57_478e_ad59_7f160bbdbcc1.slice/crio-6584eb7958e34df26bbfcb8396e6c900462a26b4f0f42a5b621e54a05e3dff65 WatchSource:0}: Error finding container 6584eb7958e34df26bbfcb8396e6c900462a26b4f0f42a5b621e54a05e3dff65: Status 404 returned error can't find the container with id 6584eb7958e34df26bbfcb8396e6c900462a26b4f0f42a5b621e54a05e3dff65
Sep 07 16:56:24.983889 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.983869    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n99gx"
Sep 07 16:56:24.988650 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:24.988632    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hj7sr"
Sep 07 16:56:24.991426 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:24.991409    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f8a3bb5_596d_4af1_81a2_1abf894c717b.slice/crio-460553a1813cb130a7fde4e5fb7f452bc8084dd06dc6b2177b7f4531177d07f4 WatchSource:0}: Error finding container 460553a1813cb130a7fde4e5fb7f452bc8084dd06dc6b2177b7f4531177d07f4: Status 404 returned error can't find the container with id 460553a1813cb130a7fde4e5fb7f452bc8084dd06dc6b2177b7f4531177d07f4
Sep 07 16:56:25.133778 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:25.133696    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be68761b-c682-40af-af90-5816b2b5e637-metrics-certs\") pod \"network-metrics-daemon-wgp2q\" (UID: \"be68761b-c682-40af-af90-5816b2b5e637\") " pod="openshift-multus/network-metrics-daemon-wgp2q"
Sep 07 16:56:25.133908 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:25.133796    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:56:25.133908 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:25.133845    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be68761b-c682-40af-af90-5816b2b5e637-metrics-certs podName:be68761b-c682-40af-af90-5816b2b5e637 nodeName:}" failed. No retries permitted until 2026-09-07 16:56:26.133834264 +0000 UTC m=+3.165265033 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be68761b-c682-40af-af90-5816b2b5e637-metrics-certs") pod "network-metrics-daemon-wgp2q" (UID: "be68761b-c682-40af-af90-5816b2b5e637") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:56:25.233969 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:25.233939    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3475a555-fcbb-4145-bf0a-91a8d6b0099b-original-pull-secret\") pod \"global-pull-secret-syncer-tfbtz\" (UID: \"3475a555-fcbb-4145-bf0a-91a8d6b0099b\") " pod="kube-system/global-pull-secret-syncer-tfbtz"
Sep 07 16:56:25.234115 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:25.234044    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 16:56:25.234115 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:25.234097    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3475a555-fcbb-4145-bf0a-91a8d6b0099b-original-pull-secret podName:3475a555-fcbb-4145-bf0a-91a8d6b0099b nodeName:}" failed. No retries permitted until 2026-09-07 16:56:26.234083772 +0000 UTC m=+3.265514541 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3475a555-fcbb-4145-bf0a-91a8d6b0099b-original-pull-secret") pod "global-pull-secret-syncer-tfbtz" (UID: "3475a555-fcbb-4145-bf0a-91a8d6b0099b") : object "kube-system"/"original-pull-secret" not registered
Sep 07 16:56:25.335138 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:25.334528    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z9wv\" (UniqueName: \"kubernetes.io/projected/b1a3d666-c0a6-4510-a0c2-5ae3c552097b-kube-api-access-8z9wv\") pod \"network-check-target-br7j9\" (UID: \"b1a3d666-c0a6-4510-a0c2-5ae3c552097b\") " pod="openshift-network-diagnostics/network-check-target-br7j9"
Sep 07 16:56:25.335138 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:25.334715    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 16:56:25.335138 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:25.334733    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 16:56:25.335138 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:25.334746    2558 projected.go:196] Error preparing data for projected volume kube-api-access-8z9wv for pod openshift-network-diagnostics/network-check-target-br7j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:56:25.335138 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:25.334805    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b1a3d666-c0a6-4510-a0c2-5ae3c552097b-kube-api-access-8z9wv podName:b1a3d666-c0a6-4510-a0c2-5ae3c552097b nodeName:}" failed. No retries permitted until 2026-09-07 16:56:26.334788251 +0000 UTC m=+3.366219035 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8z9wv" (UniqueName: "kubernetes.io/projected/b1a3d666-c0a6-4510-a0c2-5ae3c552097b-kube-api-access-8z9wv") pod "network-check-target-br7j9" (UID: "b1a3d666-c0a6-4510-a0c2-5ae3c552097b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:56:25.597131 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:25.595998    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 16:56:25.608337 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:25.608299    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 16:51:24 +0000 UTC" deadline="2028-05-27 17:43:05.54435067 +0000 UTC"
Sep 07 16:56:25.608337 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:25.608340    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15072h46m39.936015202s"
Sep 07 16:56:25.617568 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:25.617515    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hj7sr" event={"ID":"4fd644cb-0777-45a8-94a9-129dd37858f1","Type":"ContainerStarted","Data":"9b1d5f979ea46ea36676501d1c1df70f42e2a10a81cc1c172d9b48e8973eb2f8"}
Sep 07 16:56:25.628077 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:25.628038    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n99gx" event={"ID":"0f8a3bb5-596d-4af1-81a2-1abf894c717b","Type":"ContainerStarted","Data":"460553a1813cb130a7fde4e5fb7f452bc8084dd06dc6b2177b7f4531177d07f4"}
Sep 07 16:56:25.641115 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:25.640993    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r4pfn" event={"ID":"05b23baa-883b-420a-afc8-ed4f9dd1a534","Type":"ContainerStarted","Data":"4da04686baeed4226e0560030245ce9d936a547501239eeedc7cfefee43097a6"}
Sep 07 16:56:25.651759 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:25.651726    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-84.ec2.internal" event={"ID":"2bcf0fe9132996095ce4831570ed6ab9","Type":"ContainerStarted","Data":"fca08381ff5297cc000b10d3e94831e8f8c65f1a19cdb6b8cac6fa3cf2656e91"}
Sep 07 16:56:25.663387 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:25.663354    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9xhzz" event={"ID":"e526a4b1-0e57-478e-ad59-7f160bbdbcc1","Type":"ContainerStarted","Data":"6584eb7958e34df26bbfcb8396e6c900462a26b4f0f42a5b621e54a05e3dff65"}
Sep 07 16:56:25.677576 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:25.677546    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vnzgb" event={"ID":"a477d932-fad5-4317-bfd7-2c5f56eb234f","Type":"ContainerStarted","Data":"d1ef005710a5a8868722f2e0d7790a0b155242b488ab167ba8a97b3c4edf8d41"}
Sep 07 16:56:25.687163 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:25.687132    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s" event={"ID":"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7","Type":"ContainerStarted","Data":"4c7476a60cc9445cfb562be931a6daa896489cbff8558c374d49058bf145c36f"}
Sep 07 16:56:25.693463 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:25.693433    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-t9lbf" event={"ID":"0b3bf99d-b84e-4f42-a4d6-2a5c8e0ab334","Type":"ContainerStarted","Data":"bc9444e5878281bc879cf21201c4980c7649faaca843998a73794f5a78647d07"}
Sep 07 16:56:25.698944 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:25.698918    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g769p" event={"ID":"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd","Type":"ContainerStarted","Data":"5363acff4e73793650e534b01f60d227f4fc1b0428ebc450ba217492f675245f"}
Sep 07 16:56:25.707430 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:25.707403    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gp54c" event={"ID":"cfb4fb95-10b1-421f-89bf-3ef2180791f1","Type":"ContainerStarted","Data":"fea2894f0f07c1c02722365e63e7e5641da8cf53580ce9301f1c6ba2a5c1849f"}
Sep 07 16:56:25.727838 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:25.727733    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-84.ec2.internal" event={"ID":"e4ab8ac774ca9f7f62f0d52f1027e3dd","Type":"ContainerStarted","Data":"076f33fc49795bdfe7485089ba01a70e4bd0cc46c68d23959dd331e68c3990d9"}
Sep 07 16:56:26.147324 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:26.146693    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be68761b-c682-40af-af90-5816b2b5e637-metrics-certs\") pod \"network-metrics-daemon-wgp2q\" (UID: \"be68761b-c682-40af-af90-5816b2b5e637\") " pod="openshift-multus/network-metrics-daemon-wgp2q"
Sep 07 16:56:26.147324 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:26.146893    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:56:26.147324 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:26.146954    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be68761b-c682-40af-af90-5816b2b5e637-metrics-certs podName:be68761b-c682-40af-af90-5816b2b5e637 nodeName:}" failed. No retries permitted until 2026-09-07 16:56:28.146936491 +0000 UTC m=+5.178367275 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be68761b-c682-40af-af90-5816b2b5e637-metrics-certs") pod "network-metrics-daemon-wgp2q" (UID: "be68761b-c682-40af-af90-5816b2b5e637") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:56:26.248007 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:26.247970    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3475a555-fcbb-4145-bf0a-91a8d6b0099b-original-pull-secret\") pod \"global-pull-secret-syncer-tfbtz\" (UID: \"3475a555-fcbb-4145-bf0a-91a8d6b0099b\") " pod="kube-system/global-pull-secret-syncer-tfbtz"
Sep 07 16:56:26.248196 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:26.248180    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 16:56:26.248285 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:26.248267    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3475a555-fcbb-4145-bf0a-91a8d6b0099b-original-pull-secret podName:3475a555-fcbb-4145-bf0a-91a8d6b0099b nodeName:}" failed. No retries permitted until 2026-09-07 16:56:28.248232989 +0000 UTC m=+5.279663771 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3475a555-fcbb-4145-bf0a-91a8d6b0099b-original-pull-secret") pod "global-pull-secret-syncer-tfbtz" (UID: "3475a555-fcbb-4145-bf0a-91a8d6b0099b") : object "kube-system"/"original-pull-secret" not registered
Sep 07 16:56:26.349536 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:26.349442    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z9wv\" (UniqueName: \"kubernetes.io/projected/b1a3d666-c0a6-4510-a0c2-5ae3c552097b-kube-api-access-8z9wv\") pod \"network-check-target-br7j9\" (UID: \"b1a3d666-c0a6-4510-a0c2-5ae3c552097b\") " pod="openshift-network-diagnostics/network-check-target-br7j9"
Sep 07 16:56:26.349991 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:26.349646    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 16:56:26.349991 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:26.349664    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 16:56:26.349991 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:26.349677    2558 projected.go:196] Error preparing data for projected volume kube-api-access-8z9wv for pod openshift-network-diagnostics/network-check-target-br7j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:56:26.349991 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:26.349734    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b1a3d666-c0a6-4510-a0c2-5ae3c552097b-kube-api-access-8z9wv podName:b1a3d666-c0a6-4510-a0c2-5ae3c552097b nodeName:}" failed. No retries permitted until 2026-09-07 16:56:28.34971622 +0000 UTC m=+5.381147003 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8z9wv" (UniqueName: "kubernetes.io/projected/b1a3d666-c0a6-4510-a0c2-5ae3c552097b-kube-api-access-8z9wv") pod "network-check-target-br7j9" (UID: "b1a3d666-c0a6-4510-a0c2-5ae3c552097b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:56:26.588308 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:26.588216    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-br7j9"
Sep 07 16:56:26.588485 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:26.588369    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-br7j9" podUID="b1a3d666-c0a6-4510-a0c2-5ae3c552097b"
Sep 07 16:56:26.588841 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:26.588818    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgp2q"
Sep 07 16:56:26.588968 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:26.588920    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgp2q" podUID="be68761b-c682-40af-af90-5816b2b5e637"
Sep 07 16:56:26.589047 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:26.588985    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfbtz"
Sep 07 16:56:26.589100 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:26.589063    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfbtz" podUID="3475a555-fcbb-4145-bf0a-91a8d6b0099b"
Sep 07 16:56:26.609342 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:26.609284    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 16:51:24 +0000 UTC" deadline="2028-06-22 09:04:10.92584202 +0000 UTC"
Sep 07 16:56:26.609342 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:26.609339    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15688h7m44.316506354s"
Sep 07 16:56:28.166365 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:28.165790    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be68761b-c682-40af-af90-5816b2b5e637-metrics-certs\") pod \"network-metrics-daemon-wgp2q\" (UID: \"be68761b-c682-40af-af90-5816b2b5e637\") " pod="openshift-multus/network-metrics-daemon-wgp2q"
Sep 07 16:56:28.166365 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:28.165953    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:56:28.166365 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:28.166015    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be68761b-c682-40af-af90-5816b2b5e637-metrics-certs podName:be68761b-c682-40af-af90-5816b2b5e637 nodeName:}" failed. No retries permitted until 2026-09-07 16:56:32.16599581 +0000 UTC m=+9.197426581 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be68761b-c682-40af-af90-5816b2b5e637-metrics-certs") pod "network-metrics-daemon-wgp2q" (UID: "be68761b-c682-40af-af90-5816b2b5e637") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:56:28.266671 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:28.266640    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3475a555-fcbb-4145-bf0a-91a8d6b0099b-original-pull-secret\") pod \"global-pull-secret-syncer-tfbtz\" (UID: \"3475a555-fcbb-4145-bf0a-91a8d6b0099b\") " pod="kube-system/global-pull-secret-syncer-tfbtz"
Sep 07 16:56:28.266941 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:28.266752    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 16:56:28.266941 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:28.266805    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3475a555-fcbb-4145-bf0a-91a8d6b0099b-original-pull-secret podName:3475a555-fcbb-4145-bf0a-91a8d6b0099b nodeName:}" failed. No retries permitted until 2026-09-07 16:56:32.266791688 +0000 UTC m=+9.298222456 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3475a555-fcbb-4145-bf0a-91a8d6b0099b-original-pull-secret") pod "global-pull-secret-syncer-tfbtz" (UID: "3475a555-fcbb-4145-bf0a-91a8d6b0099b") : object "kube-system"/"original-pull-secret" not registered
Sep 07 16:56:28.368161 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:28.367498    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z9wv\" (UniqueName: \"kubernetes.io/projected/b1a3d666-c0a6-4510-a0c2-5ae3c552097b-kube-api-access-8z9wv\") pod \"network-check-target-br7j9\" (UID: \"b1a3d666-c0a6-4510-a0c2-5ae3c552097b\") " pod="openshift-network-diagnostics/network-check-target-br7j9"
Sep 07 16:56:28.368161 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:28.367663    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 16:56:28.368161 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:28.367688    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 16:56:28.368161 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:28.367701    2558 projected.go:196] Error preparing data for projected volume kube-api-access-8z9wv for pod openshift-network-diagnostics/network-check-target-br7j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:56:28.368161 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:28.367774    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b1a3d666-c0a6-4510-a0c2-5ae3c552097b-kube-api-access-8z9wv podName:b1a3d666-c0a6-4510-a0c2-5ae3c552097b nodeName:}" failed. No retries permitted until 2026-09-07 16:56:32.3677541 +0000 UTC m=+9.399184884 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8z9wv" (UniqueName: "kubernetes.io/projected/b1a3d666-c0a6-4510-a0c2-5ae3c552097b-kube-api-access-8z9wv") pod "network-check-target-br7j9" (UID: "b1a3d666-c0a6-4510-a0c2-5ae3c552097b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:56:28.588493 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:28.588462    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-br7j9"
Sep 07 16:56:28.588653 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:28.588570    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgp2q"
Sep 07 16:56:28.588653 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:28.588585    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-br7j9" podUID="b1a3d666-c0a6-4510-a0c2-5ae3c552097b"
Sep 07 16:56:28.588775 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:28.588695    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgp2q" podUID="be68761b-c682-40af-af90-5816b2b5e637"
Sep 07 16:56:28.588775 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:28.588747    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfbtz"
Sep 07 16:56:28.588870 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:28.588826    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfbtz" podUID="3475a555-fcbb-4145-bf0a-91a8d6b0099b"
Sep 07 16:56:30.588458 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:30.588425    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-br7j9"
Sep 07 16:56:30.588915 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:30.588550    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-br7j9" podUID="b1a3d666-c0a6-4510-a0c2-5ae3c552097b"
Sep 07 16:56:30.588915 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:30.588872    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfbtz"
Sep 07 16:56:30.589060 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:30.588987    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfbtz" podUID="3475a555-fcbb-4145-bf0a-91a8d6b0099b"
Sep 07 16:56:30.589112 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:30.589072    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgp2q"
Sep 07 16:56:30.589188 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:30.589160    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgp2q" podUID="be68761b-c682-40af-af90-5816b2b5e637"
Sep 07 16:56:32.199408 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:32.199371    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be68761b-c682-40af-af90-5816b2b5e637-metrics-certs\") pod \"network-metrics-daemon-wgp2q\" (UID: \"be68761b-c682-40af-af90-5816b2b5e637\") " pod="openshift-multus/network-metrics-daemon-wgp2q"
Sep 07 16:56:32.199966 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:32.199513    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:56:32.199966 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:32.199579    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be68761b-c682-40af-af90-5816b2b5e637-metrics-certs podName:be68761b-c682-40af-af90-5816b2b5e637 nodeName:}" failed. No retries permitted until 2026-09-07 16:56:40.199562802 +0000 UTC m=+17.230993576 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be68761b-c682-40af-af90-5816b2b5e637-metrics-certs") pod "network-metrics-daemon-wgp2q" (UID: "be68761b-c682-40af-af90-5816b2b5e637") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:56:32.300156 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:32.300010    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3475a555-fcbb-4145-bf0a-91a8d6b0099b-original-pull-secret\") pod \"global-pull-secret-syncer-tfbtz\" (UID: \"3475a555-fcbb-4145-bf0a-91a8d6b0099b\") " pod="kube-system/global-pull-secret-syncer-tfbtz"
Sep 07 16:56:32.300321 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:32.300166    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 16:56:32.300321 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:32.300260    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3475a555-fcbb-4145-bf0a-91a8d6b0099b-original-pull-secret podName:3475a555-fcbb-4145-bf0a-91a8d6b0099b nodeName:}" failed. No retries permitted until 2026-09-07 16:56:40.300220781 +0000 UTC m=+17.331651570 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3475a555-fcbb-4145-bf0a-91a8d6b0099b-original-pull-secret") pod "global-pull-secret-syncer-tfbtz" (UID: "3475a555-fcbb-4145-bf0a-91a8d6b0099b") : object "kube-system"/"original-pull-secret" not registered
Sep 07 16:56:32.400579 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:32.400536    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z9wv\" (UniqueName: \"kubernetes.io/projected/b1a3d666-c0a6-4510-a0c2-5ae3c552097b-kube-api-access-8z9wv\") pod \"network-check-target-br7j9\" (UID: \"b1a3d666-c0a6-4510-a0c2-5ae3c552097b\") " pod="openshift-network-diagnostics/network-check-target-br7j9"
Sep 07 16:56:32.400792 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:32.400767    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 16:56:32.400792 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:32.400792    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 16:56:32.400792 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:32.400802    2558 projected.go:196] Error preparing data for projected volume kube-api-access-8z9wv for pod openshift-network-diagnostics/network-check-target-br7j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:56:32.401010 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:32.400858    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b1a3d666-c0a6-4510-a0c2-5ae3c552097b-kube-api-access-8z9wv podName:b1a3d666-c0a6-4510-a0c2-5ae3c552097b nodeName:}" failed. No retries permitted until 2026-09-07 16:56:40.400839971 +0000 UTC m=+17.432270742 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8z9wv" (UniqueName: "kubernetes.io/projected/b1a3d666-c0a6-4510-a0c2-5ae3c552097b-kube-api-access-8z9wv") pod "network-check-target-br7j9" (UID: "b1a3d666-c0a6-4510-a0c2-5ae3c552097b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:56:32.588469 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:32.588375    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfbtz"
Sep 07 16:56:32.588469 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:32.588421    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgp2q"
Sep 07 16:56:32.588469 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:32.588419    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-br7j9"
Sep 07 16:56:32.588735 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:32.588509    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfbtz" podUID="3475a555-fcbb-4145-bf0a-91a8d6b0099b"
Sep 07 16:56:32.588735 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:32.588625    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgp2q" podUID="be68761b-c682-40af-af90-5816b2b5e637"
Sep 07 16:56:32.588846 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:32.588728    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-br7j9" podUID="b1a3d666-c0a6-4510-a0c2-5ae3c552097b"
Sep 07 16:56:34.588302 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:34.588266    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfbtz"
Sep 07 16:56:34.588720 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:34.588322    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgp2q"
Sep 07 16:56:34.588720 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:34.588273    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-br7j9"
Sep 07 16:56:34.588720 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:34.588388    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfbtz" podUID="3475a555-fcbb-4145-bf0a-91a8d6b0099b"
Sep 07 16:56:34.588720 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:34.588509    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-br7j9" podUID="b1a3d666-c0a6-4510-a0c2-5ae3c552097b"
Sep 07 16:56:34.588720 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:34.588604    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgp2q" podUID="be68761b-c682-40af-af90-5816b2b5e637"
Sep 07 16:56:36.588277 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:36.588248    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfbtz"
Sep 07 16:56:36.588639 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:36.588248    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgp2q"
Sep 07 16:56:36.588639 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:36.588363    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfbtz" podUID="3475a555-fcbb-4145-bf0a-91a8d6b0099b"
Sep 07 16:56:36.588639 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:36.588248    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-br7j9"
Sep 07 16:56:36.588639 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:36.588421    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgp2q" podUID="be68761b-c682-40af-af90-5816b2b5e637"
Sep 07 16:56:36.588639 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:36.588505    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-br7j9" podUID="b1a3d666-c0a6-4510-a0c2-5ae3c552097b"
Sep 07 16:56:38.587563 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:38.587532    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-br7j9"
Sep 07 16:56:38.587967 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:38.587678    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfbtz"
Sep 07 16:56:38.587967 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:38.587685    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-br7j9" podUID="b1a3d666-c0a6-4510-a0c2-5ae3c552097b"
Sep 07 16:56:38.587967 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:38.587686    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgp2q"
Sep 07 16:56:38.587967 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:38.587793    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfbtz" podUID="3475a555-fcbb-4145-bf0a-91a8d6b0099b"
Sep 07 16:56:38.587967 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:38.587907    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgp2q" podUID="be68761b-c682-40af-af90-5816b2b5e637"
Sep 07 16:56:40.256444 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:40.256353    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be68761b-c682-40af-af90-5816b2b5e637-metrics-certs\") pod \"network-metrics-daemon-wgp2q\" (UID: \"be68761b-c682-40af-af90-5816b2b5e637\") " pod="openshift-multus/network-metrics-daemon-wgp2q"
Sep 07 16:56:40.256851 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:40.256508    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:56:40.256851 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:40.256574    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be68761b-c682-40af-af90-5816b2b5e637-metrics-certs podName:be68761b-c682-40af-af90-5816b2b5e637 nodeName:}" failed. No retries permitted until 2026-09-07 16:56:56.256556409 +0000 UTC m=+33.287987202 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be68761b-c682-40af-af90-5816b2b5e637-metrics-certs") pod "network-metrics-daemon-wgp2q" (UID: "be68761b-c682-40af-af90-5816b2b5e637") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:56:40.357603 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:40.357564    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3475a555-fcbb-4145-bf0a-91a8d6b0099b-original-pull-secret\") pod \"global-pull-secret-syncer-tfbtz\" (UID: \"3475a555-fcbb-4145-bf0a-91a8d6b0099b\") " pod="kube-system/global-pull-secret-syncer-tfbtz"
Sep 07 16:56:40.357800 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:40.357699    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 16:56:40.357800 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:40.357779    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3475a555-fcbb-4145-bf0a-91a8d6b0099b-original-pull-secret podName:3475a555-fcbb-4145-bf0a-91a8d6b0099b nodeName:}" failed. No retries permitted until 2026-09-07 16:56:56.357757865 +0000 UTC m=+33.389188655 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3475a555-fcbb-4145-bf0a-91a8d6b0099b-original-pull-secret") pod "global-pull-secret-syncer-tfbtz" (UID: "3475a555-fcbb-4145-bf0a-91a8d6b0099b") : object "kube-system"/"original-pull-secret" not registered
Sep 07 16:56:40.458328 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:40.458294    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z9wv\" (UniqueName: \"kubernetes.io/projected/b1a3d666-c0a6-4510-a0c2-5ae3c552097b-kube-api-access-8z9wv\") pod \"network-check-target-br7j9\" (UID: \"b1a3d666-c0a6-4510-a0c2-5ae3c552097b\") " pod="openshift-network-diagnostics/network-check-target-br7j9"
Sep 07 16:56:40.458501 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:40.458470    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 16:56:40.458501 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:40.458494    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 16:56:40.458639 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:40.458505    2558 projected.go:196] Error preparing data for projected volume kube-api-access-8z9wv for pod openshift-network-diagnostics/network-check-target-br7j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:56:40.458639 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:40.458557    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b1a3d666-c0a6-4510-a0c2-5ae3c552097b-kube-api-access-8z9wv podName:b1a3d666-c0a6-4510-a0c2-5ae3c552097b nodeName:}" failed. No retries permitted until 2026-09-07 16:56:56.458542739 +0000 UTC m=+33.489973513 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8z9wv" (UniqueName: "kubernetes.io/projected/b1a3d666-c0a6-4510-a0c2-5ae3c552097b-kube-api-access-8z9wv") pod "network-check-target-br7j9" (UID: "b1a3d666-c0a6-4510-a0c2-5ae3c552097b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:56:40.588445 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:40.588368    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfbtz"
Sep 07 16:56:40.588445 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:40.588409    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-br7j9"
Sep 07 16:56:40.588661 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:40.588487    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgp2q"
Sep 07 16:56:40.588661 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:40.588510    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfbtz" podUID="3475a555-fcbb-4145-bf0a-91a8d6b0099b"
Sep 07 16:56:40.588661 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:40.588596    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgp2q" podUID="be68761b-c682-40af-af90-5816b2b5e637"
Sep 07 16:56:40.588776 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:40.588676    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-br7j9" podUID="b1a3d666-c0a6-4510-a0c2-5ae3c552097b"
Sep 07 16:56:42.587613 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:42.587580    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-br7j9"
Sep 07 16:56:42.588190 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:42.587692    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfbtz"
Sep 07 16:56:42.588190 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:42.587698    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-br7j9" podUID="b1a3d666-c0a6-4510-a0c2-5ae3c552097b"
Sep 07 16:56:42.588190 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:42.587714    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgp2q"
Sep 07 16:56:42.588190 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:42.587782    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfbtz" podUID="3475a555-fcbb-4145-bf0a-91a8d6b0099b"
Sep 07 16:56:42.588190 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:42.587882    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgp2q" podUID="be68761b-c682-40af-af90-5816b2b5e637"
Sep 07 16:56:44.588346 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:44.587753    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-br7j9"
Sep 07 16:56:44.588346 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:44.588104    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-br7j9" podUID="b1a3d666-c0a6-4510-a0c2-5ae3c552097b"
Sep 07 16:56:44.588346 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:44.587753    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgp2q"
Sep 07 16:56:44.588346 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:44.588189    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgp2q" podUID="be68761b-c682-40af-af90-5816b2b5e637"
Sep 07 16:56:44.588346 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:44.587790    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfbtz"
Sep 07 16:56:44.589156 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:44.588358    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfbtz" podUID="3475a555-fcbb-4145-bf0a-91a8d6b0099b"
Sep 07 16:56:44.806284 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:44.805953    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9xhzz" event={"ID":"e526a4b1-0e57-478e-ad59-7f160bbdbcc1","Type":"ContainerStarted","Data":"8f9539061e5ca8d3ad50fc462f6519934ab3b991f33557c3bc31c8b3f037d137"}
Sep 07 16:56:44.807671 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:44.807638    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vnzgb" event={"ID":"a477d932-fad5-4317-bfd7-2c5f56eb234f","Type":"ContainerStarted","Data":"b79399a0ac24f47279aeb3ab9de35211b86f080ccc14958d24988193c776f984"}
Sep 07 16:56:44.811035 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:44.811014    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwj7s_9b97dbca-7e8f-4e05-9cc4-8f42785f01e7/ovn-acl-logging/0.log"
Sep 07 16:56:44.811423 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:44.811394    2558 generic.go:356] "Generic (PLEG): container finished" podID="9b97dbca-7e8f-4e05-9cc4-8f42785f01e7" containerID="f77528ecce6cb2bb1632da8b77a136cc44aa4be9c43995b5214409012667144b" exitCode=1
Sep 07 16:56:44.811516 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:44.811455    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s" event={"ID":"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7","Type":"ContainerStarted","Data":"d6b054fa0ddd1a4923e534ae581933a15520297aa663613e4215f0c4860b99ed"}
Sep 07 16:56:44.811566 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:44.811518    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s" event={"ID":"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7","Type":"ContainerStarted","Data":"9be56ceca017629768c2b2c829a3341083e4db22e0946d5f1e3e3e70ebf744b0"}
Sep 07 16:56:44.811619 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:44.811568    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s" event={"ID":"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7","Type":"ContainerStarted","Data":"26b9d2b28446547f0a8e43af4adb79935635223a2b45bf463b84c7bafcc4c138"}
Sep 07 16:56:44.811657 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:44.811617    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s" event={"ID":"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7","Type":"ContainerStarted","Data":"200fafe493d5f9e5eb35c00498af7d59df393564badc35626f6984245eaed6a1"}
Sep 07 16:56:44.811695 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:44.811664    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s" event={"ID":"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7","Type":"ContainerDied","Data":"f77528ecce6cb2bb1632da8b77a136cc44aa4be9c43995b5214409012667144b"}
Sep 07 16:56:44.811746 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:44.811711    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s" event={"ID":"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7","Type":"ContainerStarted","Data":"013d7c8c417a4fcf18e64f3a0d8382a1cf4f1ad6f02e3206491e6338ae1ad146"}
Sep 07 16:56:44.812990 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:44.812972    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g769p" event={"ID":"7126d5fe-991d-4a2e-9f7b-9b0bfb1906cd","Type":"ContainerStarted","Data":"988b057995162758209e0fb4ea9838d759a4060cbc9e078938e6764908bf1652"}
Sep 07 16:56:44.814599 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:44.814568    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gp54c" event={"ID":"cfb4fb95-10b1-421f-89bf-3ef2180791f1","Type":"ContainerStarted","Data":"95ff7df40ef81b0932e1950236493b19ac3e280f2335d05d3852a8b58ba91a50"}
Sep 07 16:56:44.816253 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:44.816218    2558 generic.go:356] "Generic (PLEG): container finished" podID="e4ab8ac774ca9f7f62f0d52f1027e3dd" containerID="4126d6611ff13196b8d89dacb7d5b04bbb71e830a31a20ac3ada8d27d962267b" exitCode=0
Sep 07 16:56:44.816346 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:44.816282    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-84.ec2.internal" event={"ID":"e4ab8ac774ca9f7f62f0d52f1027e3dd","Type":"ContainerDied","Data":"4126d6611ff13196b8d89dacb7d5b04bbb71e830a31a20ac3ada8d27d962267b"}
Sep 07 16:56:44.818461 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:44.818436    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hj7sr" event={"ID":"4fd644cb-0777-45a8-94a9-129dd37858f1","Type":"ContainerStarted","Data":"219cb6b6a16b94a49a250fa250e547e8b28af47e9b60373ee988b837d82b61b2"}
Sep 07 16:56:44.820155 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:44.820137    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n99gx" event={"ID":"0f8a3bb5-596d-4af1-81a2-1abf894c717b","Type":"ContainerStarted","Data":"a9b230acf79bddd7c3705bea0f11d0f03b377274542e54d94bd86e8532b2a90b"}
Sep 07 16:56:44.821837 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:44.821812    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r4pfn" event={"ID":"05b23baa-883b-420a-afc8-ed4f9dd1a534","Type":"ContainerStarted","Data":"e597fbd93345b7423f6e6a42d70571318548e6902811ef9b295f70f385c1cc48"}
Sep 07 16:56:44.823166 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:44.823149    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-84.ec2.internal" event={"ID":"2bcf0fe9132996095ce4831570ed6ab9","Type":"ContainerStarted","Data":"98fdce6c2b022b66d1c11aba15a974158ad9b9aff9436c6f93db0c81ccde1bea"}
Sep 07 16:56:44.856844 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:44.856790    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hj7sr" podStartSLOduration=1.826931925 podStartE2EDuration="20.856770778s" totalImagesPullingTime="19.029838853s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:56:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:56:44.855730619 +0000 UTC m=+21.887161412" watchObservedRunningTime="2026-09-07 16:56:44.856770778 +0000 UTC m=+21.888201570"
Sep 07 16:56:44.923179 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:44.923136    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gp54c" podStartSLOduration=2.748340376 podStartE2EDuration="21.923120009s" totalImagesPullingTime="19.174779633s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:56:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:56:44.923091337 +0000 UTC m=+21.954522128" watchObservedRunningTime="2026-09-07 16:56:44.923120009 +0000 UTC m=+21.954550800"
Sep 07 16:56:44.923547 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:44.923522    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-84.ec2.internal" podStartSLOduration=20.923515174 podStartE2EDuration="20.923515174s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:56:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:56:44.902119885 +0000 UTC m=+21.933550675" watchObservedRunningTime="2026-09-07 16:56:44.923515174 +0000 UTC m=+21.954945962"
Sep 07 16:56:44.945256 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:44.945206    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vnzgb" podStartSLOduration=2.912875256 podStartE2EDuration="21.945190605s" totalImagesPullingTime="19.032315349s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:56:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:56:44.945007718 +0000 UTC m=+21.976438509" watchObservedRunningTime="2026-09-07 16:56:44.945190605 +0000 UTC m=+21.976621392"
Sep 07 16:56:45.041087 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:45.041041    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-g769p" podStartSLOduration=2.563334449 podStartE2EDuration="22.041022916s" totalImagesPullingTime="19.477688467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:56:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:56:44.985127994 +0000 UTC m=+22.016558786" watchObservedRunningTime="2026-09-07 16:56:45.041022916 +0000 UTC m=+22.072453706"
Sep 07 16:56:45.041350 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:45.041328    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-r4pfn" podStartSLOduration=2.958941649 podStartE2EDuration="22.041322434s" totalImagesPullingTime="19.082380785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:56:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:56:45.03996452 +0000 UTC m=+22.071395312" watchObservedRunningTime="2026-09-07 16:56:45.041322434 +0000 UTC m=+22.072753225"
Sep 07 16:56:45.826819 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:45.826792    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-t9lbf" event={"ID":"0b3bf99d-b84e-4f42-a4d6-2a5c8e0ab334","Type":"ContainerStarted","Data":"f69a6f83c999d1bc76086822792be71bc8324040cd0936c949dec626d6b939a8"}
Sep 07 16:56:45.831217 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:45.831191    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-84.ec2.internal" event={"ID":"e4ab8ac774ca9f7f62f0d52f1027e3dd","Type":"ContainerStarted","Data":"cacba138a0283174a78faaf32379650d13a2d775f0dda510cc0f4a90803b21b5"}
Sep 07 16:56:45.832668 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:45.832638    2558 generic.go:356] "Generic (PLEG): container finished" podID="e526a4b1-0e57-478e-ad59-7f160bbdbcc1" containerID="8f9539061e5ca8d3ad50fc462f6519934ab3b991f33557c3bc31c8b3f037d137" exitCode=0
Sep 07 16:56:45.832773 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:45.832717    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9xhzz" event={"ID":"e526a4b1-0e57-478e-ad59-7f160bbdbcc1","Type":"ContainerDied","Data":"8f9539061e5ca8d3ad50fc462f6519934ab3b991f33557c3bc31c8b3f037d137"}
Sep 07 16:56:45.862100 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:45.862075    2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 07 16:56:45.902961 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:45.902916    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-t9lbf" podStartSLOduration=7.816320514 podStartE2EDuration="22.902900777s" totalImagesPullingTime="15.086580263s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:56:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:56:45.857713765 +0000 UTC m=+22.889144555" watchObservedRunningTime="2026-09-07 16:56:45.902900777 +0000 UTC m=+22.934331567"
Sep 07 16:56:45.930227 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:45.930188    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-84.ec2.internal" podStartSLOduration=21.930175045 podStartE2EDuration="21.930175045s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:56:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:56:45.930153641 +0000 UTC m=+22.961584432" watchObservedRunningTime="2026-09-07 16:56:45.930175045 +0000 UTC m=+22.961605838"
Sep 07 16:56:46.306554 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:46.306524    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-r4pfn"
Sep 07 16:56:46.307188 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:46.307159    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-r4pfn"
Sep 07 16:56:46.587984 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:46.587899    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfbtz"
Sep 07 16:56:46.587984 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:46.587933    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-br7j9"
Sep 07 16:56:46.588211 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:46.588018    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgp2q"
Sep 07 16:56:46.588211 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:46.588035    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfbtz" podUID="3475a555-fcbb-4145-bf0a-91a8d6b0099b"
Sep 07 16:56:46.588211 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:46.588130    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgp2q" podUID="be68761b-c682-40af-af90-5816b2b5e637"
Sep 07 16:56:46.588211 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:46.588206    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-br7j9" podUID="b1a3d666-c0a6-4510-a0c2-5ae3c552097b"
Sep 07 16:56:46.589966 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:46.589867    2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-07T16:56:45.862095162Z","UUID":"40c3a21c-4945-49b9-ba3e-a6e96fbfe285","Handler":null,"Name":"","Endpoint":""}
Sep 07 16:56:46.591904 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:46.591889    2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 07 16:56:46.592027 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:46.591922    2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 07 16:56:46.837122 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:46.836935    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n99gx" event={"ID":"0f8a3bb5-596d-4af1-81a2-1abf894c717b","Type":"ContainerStarted","Data":"7ed318e39d34d81824ea67bab4f6354740d4c6046398a87b8c5412cbf49adf3b"}
Sep 07 16:56:46.837463 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:46.837149    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n99gx" event={"ID":"0f8a3bb5-596d-4af1-81a2-1abf894c717b","Type":"ContainerStarted","Data":"c53bfaf3a817fa94cc9bcb32b516e2a0a5b6fe5d766b4bb67ce90f46d9668b7f"}
Sep 07 16:56:46.838845 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:46.838682    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-r4pfn"
Sep 07 16:56:46.839057 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:46.839041    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-r4pfn"
Sep 07 16:56:46.898092 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:46.898046    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n99gx" podStartSLOduration=2.050297997 podStartE2EDuration="22.898028479s" totalImagesPullingTime="20.847730482s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:56:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:56:46.867504798 +0000 UTC m=+23.898935588" watchObservedRunningTime="2026-09-07 16:56:46.898028479 +0000 UTC m=+23.929459272"
Sep 07 16:56:47.842615 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:47.842587    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwj7s_9b97dbca-7e8f-4e05-9cc4-8f42785f01e7/ovn-acl-logging/0.log"
Sep 07 16:56:47.843130 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:47.843099    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s" event={"ID":"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7","Type":"ContainerStarted","Data":"11cb58aa91d5366d225631ea44d7f168736f28b371ecfd4a315e307744e3859f"}
Sep 07 16:56:48.587699 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:48.587666    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfbtz"
Sep 07 16:56:48.587884 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:48.587779    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-br7j9"
Sep 07 16:56:48.587884 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:48.587787    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfbtz" podUID="3475a555-fcbb-4145-bf0a-91a8d6b0099b"
Sep 07 16:56:48.587884 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:48.587809    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgp2q"
Sep 07 16:56:48.588039 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:48.587885    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-br7j9" podUID="b1a3d666-c0a6-4510-a0c2-5ae3c552097b"
Sep 07 16:56:48.588039 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:48.587967    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgp2q" podUID="be68761b-c682-40af-af90-5816b2b5e637"
Sep 07 16:56:50.588561 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:50.588367    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-br7j9"
Sep 07 16:56:50.588987 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:50.588418    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfbtz"
Sep 07 16:56:50.588987 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:50.588650    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-br7j9" podUID="b1a3d666-c0a6-4510-a0c2-5ae3c552097b"
Sep 07 16:56:50.588987 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:50.588421    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgp2q"
Sep 07 16:56:50.588987 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:50.588704    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfbtz" podUID="3475a555-fcbb-4145-bf0a-91a8d6b0099b"
Sep 07 16:56:50.588987 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:50.588780    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgp2q" podUID="be68761b-c682-40af-af90-5816b2b5e637"
Sep 07 16:56:50.851537 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:50.851450    2558 generic.go:356] "Generic (PLEG): container finished" podID="e526a4b1-0e57-478e-ad59-7f160bbdbcc1" containerID="645456cc64aed242e783284d38c66d20bec28178e5f88805d3ad77e6421d8c16" exitCode=0
Sep 07 16:56:50.851695 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:50.851534    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9xhzz" event={"ID":"e526a4b1-0e57-478e-ad59-7f160bbdbcc1","Type":"ContainerDied","Data":"645456cc64aed242e783284d38c66d20bec28178e5f88805d3ad77e6421d8c16"}
Sep 07 16:56:50.855144 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:50.855129    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwj7s_9b97dbca-7e8f-4e05-9cc4-8f42785f01e7/ovn-acl-logging/0.log"
Sep 07 16:56:50.855529 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:50.855511    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s" event={"ID":"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7","Type":"ContainerStarted","Data":"cc6ff1ea3314e3b2b34c7bd48ef68dfb0c90b375f79afe08db10035de3ad3608"}
Sep 07 16:56:50.855750 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:50.855731    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:50.855845 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:50.855793    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:50.855845 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:50.855828    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:50.855946 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:50.855911    2558 scope.go:117] "RemoveContainer" containerID="f77528ecce6cb2bb1632da8b77a136cc44aa4be9c43995b5214409012667144b"
Sep 07 16:56:50.872430 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:50.872410    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:50.873320 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:50.873305    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:56:51.862507 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:51.862479    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwj7s_9b97dbca-7e8f-4e05-9cc4-8f42785f01e7/ovn-acl-logging/0.log"
Sep 07 16:56:51.863070 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:51.862903    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s" event={"ID":"9b97dbca-7e8f-4e05-9cc4-8f42785f01e7","Type":"ContainerStarted","Data":"f6800423d41990cef4137d27f5c8fca86b2856020405c95a67da99f08010c139"}
Sep 07 16:56:52.190608 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:52.190506    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s" podStartSLOduration=10.056545579 podStartE2EDuration="29.190486559s" totalImagesPullingTime="19.13394098s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:56:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:56:51.924028775 +0000 UTC m=+28.955459581" watchObservedRunningTime="2026-09-07 16:56:52.190486559 +0000 UTC m=+29.221917349"
Sep 07 16:56:52.190894 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:52.190880    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wgp2q"]
Sep 07 16:56:52.190999 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:52.190988    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgp2q"
Sep 07 16:56:52.191097 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:52.191082    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgp2q" podUID="be68761b-c682-40af-af90-5816b2b5e637"
Sep 07 16:56:52.198859 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:52.198833    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tfbtz"]
Sep 07 16:56:52.198998 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:52.198942    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfbtz"
Sep 07 16:56:52.199051 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:52.199026    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfbtz" podUID="3475a555-fcbb-4145-bf0a-91a8d6b0099b"
Sep 07 16:56:52.199474 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:52.199447    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-br7j9"]
Sep 07 16:56:52.199542 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:52.199532    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-br7j9"
Sep 07 16:56:52.199618 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:52.199603    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-br7j9" podUID="b1a3d666-c0a6-4510-a0c2-5ae3c552097b"
Sep 07 16:56:52.866944 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:52.866908    2558 generic.go:356] "Generic (PLEG): container finished" podID="e526a4b1-0e57-478e-ad59-7f160bbdbcc1" containerID="bfed4dd166d6ba226c3a6fee658e94c9bdaaab786cf39c8f9eb589081d24f820" exitCode=0
Sep 07 16:56:52.867570 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:52.867000    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9xhzz" event={"ID":"e526a4b1-0e57-478e-ad59-7f160bbdbcc1","Type":"ContainerDied","Data":"bfed4dd166d6ba226c3a6fee658e94c9bdaaab786cf39c8f9eb589081d24f820"}
Sep 07 16:56:53.589226 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:53.588970    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-br7j9"
Sep 07 16:56:53.589386 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:53.589042    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgp2q"
Sep 07 16:56:53.589386 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:53.589064    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfbtz"
Sep 07 16:56:53.589386 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:53.589371    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-br7j9" podUID="b1a3d666-c0a6-4510-a0c2-5ae3c552097b"
Sep 07 16:56:53.589541 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:53.589434    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgp2q" podUID="be68761b-c682-40af-af90-5816b2b5e637"
Sep 07 16:56:53.589541 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:53.589507    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfbtz" podUID="3475a555-fcbb-4145-bf0a-91a8d6b0099b"
Sep 07 16:56:53.872421 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:53.872395    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9xhzz" event={"ID":"e526a4b1-0e57-478e-ad59-7f160bbdbcc1","Type":"ContainerStarted","Data":"0bfef7c2dca03fa024708f4d2de408889db35d13f0e312ba7bc0075858579088"}
Sep 07 16:56:54.876672 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:54.876639    2558 generic.go:356] "Generic (PLEG): container finished" podID="e526a4b1-0e57-478e-ad59-7f160bbdbcc1" containerID="0bfef7c2dca03fa024708f4d2de408889db35d13f0e312ba7bc0075858579088" exitCode=0
Sep 07 16:56:54.877106 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:54.876700    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9xhzz" event={"ID":"e526a4b1-0e57-478e-ad59-7f160bbdbcc1","Type":"ContainerDied","Data":"0bfef7c2dca03fa024708f4d2de408889db35d13f0e312ba7bc0075858579088"}
Sep 07 16:56:55.587850 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:55.587811    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgp2q"
Sep 07 16:56:55.588020 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:55.587821    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-br7j9"
Sep 07 16:56:55.588020 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:55.587959    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgp2q" podUID="be68761b-c682-40af-af90-5816b2b5e637"
Sep 07 16:56:55.588162 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:55.588034    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-br7j9" podUID="b1a3d666-c0a6-4510-a0c2-5ae3c552097b"
Sep 07 16:56:55.588162 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:55.587821    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfbtz"
Sep 07 16:56:55.588162 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:55.588137    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfbtz" podUID="3475a555-fcbb-4145-bf0a-91a8d6b0099b"
Sep 07 16:56:56.268627 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:56.268589    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be68761b-c682-40af-af90-5816b2b5e637-metrics-certs\") pod \"network-metrics-daemon-wgp2q\" (UID: \"be68761b-c682-40af-af90-5816b2b5e637\") " pod="openshift-multus/network-metrics-daemon-wgp2q"
Sep 07 16:56:56.269053 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:56.268745    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:56:56.269053 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:56.268826    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be68761b-c682-40af-af90-5816b2b5e637-metrics-certs podName:be68761b-c682-40af-af90-5816b2b5e637 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:28.268803247 +0000 UTC m=+65.300234018 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be68761b-c682-40af-af90-5816b2b5e637-metrics-certs") pod "network-metrics-daemon-wgp2q" (UID: "be68761b-c682-40af-af90-5816b2b5e637") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 16:56:56.369183 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:56.369144    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3475a555-fcbb-4145-bf0a-91a8d6b0099b-original-pull-secret\") pod \"global-pull-secret-syncer-tfbtz\" (UID: \"3475a555-fcbb-4145-bf0a-91a8d6b0099b\") " pod="kube-system/global-pull-secret-syncer-tfbtz"
Sep 07 16:56:56.369380 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:56.369327    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 16:56:56.369430 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:56.369400    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3475a555-fcbb-4145-bf0a-91a8d6b0099b-original-pull-secret podName:3475a555-fcbb-4145-bf0a-91a8d6b0099b nodeName:}" failed. No retries permitted until 2026-09-07 16:57:28.369380563 +0000 UTC m=+65.400811350 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3475a555-fcbb-4145-bf0a-91a8d6b0099b-original-pull-secret") pod "global-pull-secret-syncer-tfbtz" (UID: "3475a555-fcbb-4145-bf0a-91a8d6b0099b") : object "kube-system"/"original-pull-secret" not registered
Sep 07 16:56:56.470335 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:56.470295    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z9wv\" (UniqueName: \"kubernetes.io/projected/b1a3d666-c0a6-4510-a0c2-5ae3c552097b-kube-api-access-8z9wv\") pod \"network-check-target-br7j9\" (UID: \"b1a3d666-c0a6-4510-a0c2-5ae3c552097b\") " pod="openshift-network-diagnostics/network-check-target-br7j9"
Sep 07 16:56:56.470478 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:56.470425    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 16:56:56.470478 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:56.470441    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 16:56:56.470478 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:56.470450    2558 projected.go:196] Error preparing data for projected volume kube-api-access-8z9wv for pod openshift-network-diagnostics/network-check-target-br7j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:56:56.470596 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:56.470497    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b1a3d666-c0a6-4510-a0c2-5ae3c552097b-kube-api-access-8z9wv podName:b1a3d666-c0a6-4510-a0c2-5ae3c552097b nodeName:}" failed. No retries permitted until 2026-09-07 16:57:28.470483917 +0000 UTC m=+65.501914686 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8z9wv" (UniqueName: "kubernetes.io/projected/b1a3d666-c0a6-4510-a0c2-5ae3c552097b-kube-api-access-8z9wv") pod "network-check-target-br7j9" (UID: "b1a3d666-c0a6-4510-a0c2-5ae3c552097b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 16:56:57.302195 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.302124    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-84.ec2.internal" event="NodeReady"
Sep 07 16:56:57.302556 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.302253    2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 07 16:56:57.339907 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.339846    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-r987z"]
Sep 07 16:56:57.399734 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.399696    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-76767cd44d-9lpwv"]
Sep 07 16:56:57.399900 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.399850    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-r987z"
Sep 07 16:56:57.405894 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.405842    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 07 16:56:57.406396 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.406371    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-cmlx2"]
Sep 07 16:56:57.407657 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.406629    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-8lxfj\""
Sep 07 16:56:57.407657 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.406640    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76767cd44d-9lpwv"
Sep 07 16:56:57.407657 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.406950    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 07 16:56:57.407657 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.407191    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 07 16:56:57.407981 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.407774    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 07 16:56:57.410579 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.410561    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 07 16:56:57.418507 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.418315    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 07 16:56:57.418901 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.418871    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 07 16:56:57.419947 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.419359    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-g564b\""
Sep 07 16:56:57.422784 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.422623    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-r987z"]
Sep 07 16:56:57.422784 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.422676    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-n42x6"]
Sep 07 16:56:57.422941 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.422914    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-cmlx2"
Sep 07 16:56:57.438136 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.438115    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 07 16:56:57.438643 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.438630    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 07 16:56:57.440397 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.440381    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-bkwc2\""
Sep 07 16:56:57.441214 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.441195    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-868d865496-l5lhw"]
Sep 07 16:56:57.441409 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.441323    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-n42x6"
Sep 07 16:56:57.442269 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.442229    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 07 16:56:57.450156 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.450135    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 07 16:56:57.450328 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.450139    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 07 16:56:57.450405 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.450149    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 07 16:56:57.450460 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.450153    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 07 16:56:57.450536 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.450229    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-4zz64\""
Sep 07 16:56:57.459334 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.459311    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-cmlx2"]
Sep 07 16:56:57.459436 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.459346    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-z6w5g"]
Sep 07 16:56:57.459496 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.459438    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-868d865496-l5lhw"
Sep 07 16:56:57.462860 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.462840    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 07 16:56:57.463150 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.463131    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 07 16:56:57.463379 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.463362    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 07 16:56:57.463526 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.463508    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-dtsjw\""
Sep 07 16:56:57.463695 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.463679    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 07 16:56:57.463774 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.463718    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 07 16:56:57.463935 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.463920    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 07 16:56:57.473960 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.473939    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-fkmqj"]
Sep 07 16:56:57.474888 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.474137    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-z6w5g"
Sep 07 16:56:57.476907 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.476889    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 07 16:56:57.477162 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.477142    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0fe9fce-f35b-42eb-b819-23e313bfbfea-registry-tls\") pod \"image-registry-76767cd44d-9lpwv\" (UID: \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\") " pod="openshift-image-registry/image-registry-76767cd44d-9lpwv"
Sep 07 16:56:57.477277 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.477180    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/231f4bfa-55eb-4533-a0b0-f6d845f5fe0f-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-r987z\" (UID: \"231f4bfa-55eb-4533-a0b0-f6d845f5fe0f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-r987z"
Sep 07 16:56:57.477277 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.477211    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/231f4bfa-55eb-4533-a0b0-f6d845f5fe0f-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-r987z\" (UID: \"231f4bfa-55eb-4533-a0b0-f6d845f5fe0f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-r987z"
Sep 07 16:56:57.477398 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.477284    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b0fe9fce-f35b-42eb-b819-23e313bfbfea-ca-trust-extracted\") pod \"image-registry-76767cd44d-9lpwv\" (UID: \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\") " pod="openshift-image-registry/image-registry-76767cd44d-9lpwv"
Sep 07 16:56:57.477398 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.477329    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b0fe9fce-f35b-42eb-b819-23e313bfbfea-registry-certificates\") pod \"image-registry-76767cd44d-9lpwv\" (UID: \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\") " pod="openshift-image-registry/image-registry-76767cd44d-9lpwv"
Sep 07 16:56:57.477398 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.477364    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqkw7\" (UniqueName: \"kubernetes.io/projected/b0fe9fce-f35b-42eb-b819-23e313bfbfea-kube-api-access-hqkw7\") pod \"image-registry-76767cd44d-9lpwv\" (UID: \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\") " pod="openshift-image-registry/image-registry-76767cd44d-9lpwv"
Sep 07 16:56:57.477541 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.477410    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m284l\" (UniqueName: \"kubernetes.io/projected/231f4bfa-55eb-4533-a0b0-f6d845f5fe0f-kube-api-access-m284l\") pod \"kube-storage-version-migrator-operator-8d7dd4675-r987z\" (UID: \"231f4bfa-55eb-4533-a0b0-f6d845f5fe0f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-r987z"
Sep 07 16:56:57.477541 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.477439    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b0fe9fce-f35b-42eb-b819-23e313bfbfea-trusted-ca\") pod \"image-registry-76767cd44d-9lpwv\" (UID: \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\") " pod="openshift-image-registry/image-registry-76767cd44d-9lpwv"
Sep 07 16:56:57.477541 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.477465    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b0fe9fce-f35b-42eb-b819-23e313bfbfea-installation-pull-secrets\") pod \"image-registry-76767cd44d-9lpwv\" (UID: \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\") " pod="openshift-image-registry/image-registry-76767cd44d-9lpwv"
Sep 07 16:56:57.477541 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.477513    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b0fe9fce-f35b-42eb-b819-23e313bfbfea-image-registry-private-configuration\") pod \"image-registry-76767cd44d-9lpwv\" (UID: \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\") " pod="openshift-image-registry/image-registry-76767cd44d-9lpwv"
Sep 07 16:56:57.477835 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.477555    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0fe9fce-f35b-42eb-b819-23e313bfbfea-bound-sa-token\") pod \"image-registry-76767cd44d-9lpwv\" (UID: \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\") " pod="openshift-image-registry/image-registry-76767cd44d-9lpwv"
Sep 07 16:56:57.477952 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.477928    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 07 16:56:57.478024 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.478005    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 07 16:56:57.478105 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.478005    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-c7m2z\""
Sep 07 16:56:57.490145 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.490116    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-f6srd"]
Sep 07 16:56:57.490287 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.490268    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-fkmqj"
Sep 07 16:56:57.496357 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.496335    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 07 16:56:57.496628 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.496498    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 07 16:56:57.496628 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.496582    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 07 16:56:57.496790 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.496725    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-sgxpt\""
Sep 07 16:56:57.497048 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.497029    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 07 16:56:57.501738 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.501721    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 07 16:56:57.502398 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.502380    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bc6d9"]
Sep 07 16:56:57.502514 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.502504    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-f6srd"
Sep 07 16:56:57.504878 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.504855    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 07 16:56:57.504993 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.504946    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-wpv88\""
Sep 07 16:56:57.506557 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.506536    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 07 16:56:57.509046 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.509025    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 07 16:56:57.509154 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.509033    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 07 16:56:57.512058 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.512037    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 07 16:56:57.512399 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.512382    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76767cd44d-9lpwv"]
Sep 07 16:56:57.512503 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.512419    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-fkmqj"]
Sep 07 16:56:57.512503 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.512450    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-n42x6"]
Sep 07 16:56:57.512503 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.512473    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-z6w5g"]
Sep 07 16:56:57.512503 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.512499    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-868d865496-l5lhw"]
Sep 07 16:56:57.512694 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.512519    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bc6d9"]
Sep 07 16:56:57.512694 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.512524    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bc6d9"
Sep 07 16:56:57.512694 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.512536    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-f6srd"]
Sep 07 16:56:57.512694 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.512557    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cbxtz"]
Sep 07 16:56:57.515192 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.515170    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 07 16:56:57.516471 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.516450    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 07 16:56:57.516609 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.516481    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 07 16:56:57.516609 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.516503    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 07 16:56:57.516609 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.516526    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-cw9q9\""
Sep 07 16:56:57.524812 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.524793    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-mnjbb"]
Sep 07 16:56:57.524923 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.524907    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cbxtz"
Sep 07 16:56:57.527710 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.527586    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 07 16:56:57.527710 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.527585    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 07 16:56:57.527710 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.527627    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 07 16:56:57.528043 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.528026    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-g7mrx\""
Sep 07 16:56:57.541216 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.541189    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-26spm"]
Sep 07 16:56:57.541350 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.541306    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-mnjbb"
Sep 07 16:56:57.544469 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.544450    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 07 16:56:57.545017 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.544806    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-w78k6\""
Sep 07 16:56:57.545364 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.545346    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 07 16:56:57.557694 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.557646    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-mnjbb"]
Sep 07 16:56:57.557694 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.557677    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cbxtz"]
Sep 07 16:56:57.557856 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.557698    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-26spm"]
Sep 07 16:56:57.557856 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.557805    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-26spm"
Sep 07 16:56:57.560526 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.560299    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-96tzd\""
Sep 07 16:56:57.560526 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.560370    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 07 16:56:57.560679 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.560570    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 07 16:56:57.578444 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.578388    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xwg9\" (UniqueName: \"kubernetes.io/projected/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-kube-api-access-7xwg9\") pod \"router-default-868d865496-l5lhw\" (UID: \"fcf33d4f-f41e-4380-be30-ba07d4b8dd16\") " pod="openshift-ingress/router-default-868d865496-l5lhw"
Sep 07 16:56:57.578444 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.578421    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m284l\" (UniqueName: \"kubernetes.io/projected/231f4bfa-55eb-4533-a0b0-f6d845f5fe0f-kube-api-access-m284l\") pod \"kube-storage-version-migrator-operator-8d7dd4675-r987z\" (UID: \"231f4bfa-55eb-4533-a0b0-f6d845f5fe0f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-r987z"
Sep 07 16:56:57.578444 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.578446    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b0fe9fce-f35b-42eb-b819-23e313bfbfea-trusted-ca\") pod \"image-registry-76767cd44d-9lpwv\" (UID: \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\") " pod="openshift-image-registry/image-registry-76767cd44d-9lpwv"
Sep 07 16:56:57.578660 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.578467    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-default-certificate\") pod \"router-default-868d865496-l5lhw\" (UID: \"fcf33d4f-f41e-4380-be30-ba07d4b8dd16\") " pod="openshift-ingress/router-default-868d865496-l5lhw"
Sep 07 16:56:57.578660 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.578553    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/24750b4e-c0bc-4c3c-a256-6ca251306d06-trusted-ca\") pod \"console-operator-85b454874b-f6srd\" (UID: \"24750b4e-c0bc-4c3c-a256-6ca251306d06\") " pod="openshift-console-operator/console-operator-85b454874b-f6srd"
Sep 07 16:56:57.578660 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.578593    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scvn8\" (UniqueName: \"kubernetes.io/projected/24750b4e-c0bc-4c3c-a256-6ca251306d06-kube-api-access-scvn8\") pod \"console-operator-85b454874b-f6srd\" (UID: \"24750b4e-c0bc-4c3c-a256-6ca251306d06\") " pod="openshift-console-operator/console-operator-85b454874b-f6srd"
Sep 07 16:56:57.578660 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.578630    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0fe9fce-f35b-42eb-b819-23e313bfbfea-bound-sa-token\") pod \"image-registry-76767cd44d-9lpwv\" (UID: \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\") " pod="openshift-image-registry/image-registry-76767cd44d-9lpwv"
Sep 07 16:56:57.579061 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.578664    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/24750b4e-c0bc-4c3c-a256-6ca251306d06-serving-cert\") pod \"console-operator-85b454874b-f6srd\" (UID: \"24750b4e-c0bc-4c3c-a256-6ca251306d06\") " pod="openshift-console-operator/console-operator-85b454874b-f6srd"
Sep 07 16:56:57.579061 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.578692    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tz8s\" (UniqueName: \"kubernetes.io/projected/3dc65911-abc9-4e9c-95ee-3f766159f1c3-kube-api-access-5tz8s\") pod \"insights-operator-76bcd6ccf5-fkmqj\" (UID: \"3dc65911-abc9-4e9c-95ee-3f766159f1c3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fkmqj"
Sep 07 16:56:57.579061 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.578717    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-metrics-certs\") pod \"router-default-868d865496-l5lhw\" (UID: \"fcf33d4f-f41e-4380-be30-ba07d4b8dd16\") " pod="openshift-ingress/router-default-868d865496-l5lhw"
Sep 07 16:56:57.579061 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.578741    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k48sd\" (UniqueName: \"kubernetes.io/projected/37c768a7-bec4-47dd-870e-1a7686e4b268-kube-api-access-k48sd\") pod \"service-ca-operator-859f94c4b-n42x6\" (UID: \"37c768a7-bec4-47dd-870e-1a7686e4b268\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-n42x6"
Sep 07 16:56:57.579061 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.578771    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/231f4bfa-55eb-4533-a0b0-f6d845f5fe0f-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-r987z\" (UID: \"231f4bfa-55eb-4533-a0b0-f6d845f5fe0f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-r987z"
Sep 07 16:56:57.579061 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.578792    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3dc65911-abc9-4e9c-95ee-3f766159f1c3-tmp\") pod \"insights-operator-76bcd6ccf5-fkmqj\" (UID: \"3dc65911-abc9-4e9c-95ee-3f766159f1c3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fkmqj"
Sep 07 16:56:57.579061 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.578823    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/231f4bfa-55eb-4533-a0b0-f6d845f5fe0f-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-r987z\" (UID: \"231f4bfa-55eb-4533-a0b0-f6d845f5fe0f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-r987z"
Sep 07 16:56:57.579061 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.578852    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/24750b4e-c0bc-4c3c-a256-6ca251306d06-config\") pod \"console-operator-85b454874b-f6srd\" (UID: \"24750b4e-c0bc-4c3c-a256-6ca251306d06\") " pod="openshift-console-operator/console-operator-85b454874b-f6srd"
Sep 07 16:56:57.579061 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.578880    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ggc8\" (UniqueName: \"kubernetes.io/projected/fc156935-53d3-4cc8-9698-3e3cc2a1fd73-kube-api-access-8ggc8\") pod \"cluster-samples-operator-7cdcfcf76c-z6w5g\" (UID: \"fc156935-53d3-4cc8-9698-3e3cc2a1fd73\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-z6w5g"
Sep 07 16:56:57.579061 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.578919    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b0fe9fce-f35b-42eb-b819-23e313bfbfea-installation-pull-secrets\") pod \"image-registry-76767cd44d-9lpwv\" (UID: \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\") " pod="openshift-image-registry/image-registry-76767cd44d-9lpwv"
Sep 07 16:56:57.579061 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.578971    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3dc65911-abc9-4e9c-95ee-3f766159f1c3-snapshots\") pod \"insights-operator-76bcd6ccf5-fkmqj\" (UID: \"3dc65911-abc9-4e9c-95ee-3f766159f1c3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fkmqj"
Sep 07 16:56:57.579061 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.578999    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9fkj\" (UniqueName: \"kubernetes.io/projected/f23afbe6-ab97-47a4-ac01-f2fd36cc0e6b-kube-api-access-b9fkj\") pod \"volume-data-source-validator-695c895bd6-cmlx2\" (UID: \"f23afbe6-ab97-47a4-ac01-f2fd36cc0e6b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-cmlx2"
Sep 07 16:56:57.579061 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.579026    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/37c768a7-bec4-47dd-870e-1a7686e4b268-config\") pod \"service-ca-operator-859f94c4b-n42x6\" (UID: \"37c768a7-bec4-47dd-870e-1a7686e4b268\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-n42x6"
Sep 07 16:56:57.579061 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.579051    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dc65911-abc9-4e9c-95ee-3f766159f1c3-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-fkmqj\" (UID: \"3dc65911-abc9-4e9c-95ee-3f766159f1c3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fkmqj"
Sep 07 16:56:57.579061 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.579074    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-stats-auth\") pod \"router-default-868d865496-l5lhw\" (UID: \"fcf33d4f-f41e-4380-be30-ba07d4b8dd16\") " pod="openshift-ingress/router-default-868d865496-l5lhw"
Sep 07 16:56:57.580221 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.579132    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3dc65911-abc9-4e9c-95ee-3f766159f1c3-serving-cert\") pod \"insights-operator-76bcd6ccf5-fkmqj\" (UID: \"3dc65911-abc9-4e9c-95ee-3f766159f1c3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fkmqj"
Sep 07 16:56:57.580221 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.579164    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b0fe9fce-f35b-42eb-b819-23e313bfbfea-image-registry-private-configuration\") pod \"image-registry-76767cd44d-9lpwv\" (UID: \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\") " pod="openshift-image-registry/image-registry-76767cd44d-9lpwv"
Sep 07 16:56:57.580221 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.579291    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc156935-53d3-4cc8-9698-3e3cc2a1fd73-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-z6w5g\" (UID: \"fc156935-53d3-4cc8-9698-3e3cc2a1fd73\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-z6w5g"
Sep 07 16:56:57.580221 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.579496    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/231f4bfa-55eb-4533-a0b0-f6d845f5fe0f-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-r987z\" (UID: \"231f4bfa-55eb-4533-a0b0-f6d845f5fe0f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-r987z"
Sep 07 16:56:57.580221 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.579562    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dc65911-abc9-4e9c-95ee-3f766159f1c3-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-fkmqj\" (UID: \"3dc65911-abc9-4e9c-95ee-3f766159f1c3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fkmqj"
Sep 07 16:56:57.580221 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.579691    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b0fe9fce-f35b-42eb-b819-23e313bfbfea-trusted-ca\") pod \"image-registry-76767cd44d-9lpwv\" (UID: \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\") " pod="openshift-image-registry/image-registry-76767cd44d-9lpwv"
Sep 07 16:56:57.580221 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:57.579812    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 16:56:57.580221 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:57.579828    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76767cd44d-9lpwv: secret "image-registry-tls" not found
Sep 07 16:56:57.580221 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:57.579885    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0fe9fce-f35b-42eb-b819-23e313bfbfea-registry-tls podName:b0fe9fce-f35b-42eb-b819-23e313bfbfea nodeName:}" failed. No retries permitted until 2026-09-07 16:56:58.079871774 +0000 UTC m=+35.111302543 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b0fe9fce-f35b-42eb-b819-23e313bfbfea-registry-tls") pod "image-registry-76767cd44d-9lpwv" (UID: "b0fe9fce-f35b-42eb-b819-23e313bfbfea") : secret "image-registry-tls" not found
Sep 07 16:56:57.580221 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.580000    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0fe9fce-f35b-42eb-b819-23e313bfbfea-registry-tls\") pod \"image-registry-76767cd44d-9lpwv\" (UID: \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\") " pod="openshift-image-registry/image-registry-76767cd44d-9lpwv"
Sep 07 16:56:57.580221 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.580047    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-service-ca-bundle\") pod \"router-default-868d865496-l5lhw\" (UID: \"fcf33d4f-f41e-4380-be30-ba07d4b8dd16\") " pod="openshift-ingress/router-default-868d865496-l5lhw"
Sep 07 16:56:57.580221 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.580090    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/37c768a7-bec4-47dd-870e-1a7686e4b268-serving-cert\") pod \"service-ca-operator-859f94c4b-n42x6\" (UID: \"37c768a7-bec4-47dd-870e-1a7686e4b268\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-n42x6"
Sep 07 16:56:57.580221 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.580119    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b0fe9fce-f35b-42eb-b819-23e313bfbfea-ca-trust-extracted\") pod \"image-registry-76767cd44d-9lpwv\" (UID: \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\") " pod="openshift-image-registry/image-registry-76767cd44d-9lpwv"
Sep 07 16:56:57.580221 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.580142    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b0fe9fce-f35b-42eb-b819-23e313bfbfea-registry-certificates\") pod \"image-registry-76767cd44d-9lpwv\" (UID: \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\") " pod="openshift-image-registry/image-registry-76767cd44d-9lpwv"
Sep 07 16:56:57.580221 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.580163    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqkw7\" (UniqueName: \"kubernetes.io/projected/b0fe9fce-f35b-42eb-b819-23e313bfbfea-kube-api-access-hqkw7\") pod \"image-registry-76767cd44d-9lpwv\" (UID: \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\") " pod="openshift-image-registry/image-registry-76767cd44d-9lpwv"
Sep 07 16:56:57.580859 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.580492    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b0fe9fce-f35b-42eb-b819-23e313bfbfea-ca-trust-extracted\") pod \"image-registry-76767cd44d-9lpwv\" (UID: \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\") " pod="openshift-image-registry/image-registry-76767cd44d-9lpwv"
Sep 07 16:56:57.580859 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.580797    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b0fe9fce-f35b-42eb-b819-23e313bfbfea-registry-certificates\") pod \"image-registry-76767cd44d-9lpwv\" (UID: \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\") " pod="openshift-image-registry/image-registry-76767cd44d-9lpwv"
Sep 07 16:56:57.583678 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.583652    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/231f4bfa-55eb-4533-a0b0-f6d845f5fe0f-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-r987z\" (UID: \"231f4bfa-55eb-4533-a0b0-f6d845f5fe0f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-r987z"
Sep 07 16:56:57.583910 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.583890    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b0fe9fce-f35b-42eb-b819-23e313bfbfea-image-registry-private-configuration\") pod \"image-registry-76767cd44d-9lpwv\" (UID: \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\") " pod="openshift-image-registry/image-registry-76767cd44d-9lpwv"
Sep 07 16:56:57.583910 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.583906    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b0fe9fce-f35b-42eb-b819-23e313bfbfea-installation-pull-secrets\") pod \"image-registry-76767cd44d-9lpwv\" (UID: \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\") " pod="openshift-image-registry/image-registry-76767cd44d-9lpwv"
Sep 07 16:56:57.588039 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.588022    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-br7j9"
Sep 07 16:56:57.588358 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.588319    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgp2q"
Sep 07 16:56:57.588698 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.588681    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfbtz"
Sep 07 16:56:57.590818 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.590799    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0fe9fce-f35b-42eb-b819-23e313bfbfea-bound-sa-token\") pod \"image-registry-76767cd44d-9lpwv\" (UID: \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\") " pod="openshift-image-registry/image-registry-76767cd44d-9lpwv"
Sep 07 16:56:57.591175 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.591153    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m284l\" (UniqueName: \"kubernetes.io/projected/231f4bfa-55eb-4533-a0b0-f6d845f5fe0f-kube-api-access-m284l\") pod \"kube-storage-version-migrator-operator-8d7dd4675-r987z\" (UID: \"231f4bfa-55eb-4533-a0b0-f6d845f5fe0f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-r987z"
Sep 07 16:56:57.591546 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.591491    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 07 16:56:57.591632 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.591547    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 07 16:56:57.591632 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.591532    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lxz8c\""
Sep 07 16:56:57.591733 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.591652    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bvnj8\""
Sep 07 16:56:57.597067 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.597047    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqkw7\" (UniqueName: \"kubernetes.io/projected/b0fe9fce-f35b-42eb-b819-23e313bfbfea-kube-api-access-hqkw7\") pod \"image-registry-76767cd44d-9lpwv\" (UID: \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\") " pod="openshift-image-registry/image-registry-76767cd44d-9lpwv"
Sep 07 16:56:57.680917 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.680849    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3dc65911-abc9-4e9c-95ee-3f766159f1c3-snapshots\") pod \"insights-operator-76bcd6ccf5-fkmqj\" (UID: \"3dc65911-abc9-4e9c-95ee-3f766159f1c3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fkmqj"
Sep 07 16:56:57.680917 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.680887    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9fkj\" (UniqueName: \"kubernetes.io/projected/f23afbe6-ab97-47a4-ac01-f2fd36cc0e6b-kube-api-access-b9fkj\") pod \"volume-data-source-validator-695c895bd6-cmlx2\" (UID: \"f23afbe6-ab97-47a4-ac01-f2fd36cc0e6b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-cmlx2"
Sep 07 16:56:57.680917 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.680915    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/37c768a7-bec4-47dd-870e-1a7686e4b268-config\") pod \"service-ca-operator-859f94c4b-n42x6\" (UID: \"37c768a7-bec4-47dd-870e-1a7686e4b268\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-n42x6"
Sep 07 16:56:57.681217 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.681045    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dc65911-abc9-4e9c-95ee-3f766159f1c3-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-fkmqj\" (UID: \"3dc65911-abc9-4e9c-95ee-3f766159f1c3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fkmqj"
Sep 07 16:56:57.681217 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.681085    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-stats-auth\") pod \"router-default-868d865496-l5lhw\" (UID: \"fcf33d4f-f41e-4380-be30-ba07d4b8dd16\") " pod="openshift-ingress/router-default-868d865496-l5lhw"
Sep 07 16:56:57.681217 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.681106    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3dc65911-abc9-4e9c-95ee-3f766159f1c3-serving-cert\") pod \"insights-operator-76bcd6ccf5-fkmqj\" (UID: \"3dc65911-abc9-4e9c-95ee-3f766159f1c3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fkmqj"
Sep 07 16:56:57.681217 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.681135    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ce4365f-988f-4113-bee7-d55fd58dbff3-metrics-tls\") pod \"dns-default-26spm\" (UID: \"5ce4365f-988f-4113-bee7-d55fd58dbff3\") " pod="openshift-dns/dns-default-26spm"
Sep 07 16:56:57.681217 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.681172    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnkwz\" (UniqueName: \"kubernetes.io/projected/72d805d0-d863-444e-a934-c37f9304205e-kube-api-access-jnkwz\") pod \"network-check-source-685456655f-mnjbb\" (UID: \"72d805d0-d863-444e-a934-c37f9304205e\") " pod="openshift-network-diagnostics/network-check-source-685456655f-mnjbb"
Sep 07 16:56:57.681217 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.681198    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc156935-53d3-4cc8-9698-3e3cc2a1fd73-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-z6w5g\" (UID: \"fc156935-53d3-4cc8-9698-3e3cc2a1fd73\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-z6w5g"
Sep 07 16:56:57.681594 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.681344    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dc65911-abc9-4e9c-95ee-3f766159f1c3-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-fkmqj\" (UID: \"3dc65911-abc9-4e9c-95ee-3f766159f1c3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fkmqj"
Sep 07 16:56:57.681594 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.681428    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-service-ca-bundle\") pod \"router-default-868d865496-l5lhw\" (UID: \"fcf33d4f-f41e-4380-be30-ba07d4b8dd16\") " pod="openshift-ingress/router-default-868d865496-l5lhw"
Sep 07 16:56:57.681594 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.681462    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/37c768a7-bec4-47dd-870e-1a7686e4b268-serving-cert\") pod \"service-ca-operator-859f94c4b-n42x6\" (UID: \"37c768a7-bec4-47dd-870e-1a7686e4b268\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-n42x6"
Sep 07 16:56:57.681594 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.681522    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/379961e8-79b6-4026-9fdd-1f914d83870d-cert\") pod \"ingress-canary-cbxtz\" (UID: \"379961e8-79b6-4026-9fdd-1f914d83870d\") " pod="openshift-ingress-canary/ingress-canary-cbxtz"
Sep 07 16:56:57.681594 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.681590    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xwg9\" (UniqueName: \"kubernetes.io/projected/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-kube-api-access-7xwg9\") pod \"router-default-868d865496-l5lhw\" (UID: \"fcf33d4f-f41e-4380-be30-ba07d4b8dd16\") " pod="openshift-ingress/router-default-868d865496-l5lhw"
Sep 07 16:56:57.683381 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.681626    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/96e71053-7215-446f-b880-5c7236d5ab72-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-bc6d9\" (UID: \"96e71053-7215-446f-b880-5c7236d5ab72\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bc6d9"
Sep 07 16:56:57.683381 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.681651    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-default-certificate\") pod \"router-default-868d865496-l5lhw\" (UID: \"fcf33d4f-f41e-4380-be30-ba07d4b8dd16\") " pod="openshift-ingress/router-default-868d865496-l5lhw"
Sep 07 16:56:57.683381 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.681690    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ce4365f-988f-4113-bee7-d55fd58dbff3-tmp-dir\") pod \"dns-default-26spm\" (UID: \"5ce4365f-988f-4113-bee7-d55fd58dbff3\") " pod="openshift-dns/dns-default-26spm"
Sep 07 16:56:57.683381 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.681712    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3dc65911-abc9-4e9c-95ee-3f766159f1c3-snapshots\") pod \"insights-operator-76bcd6ccf5-fkmqj\" (UID: \"3dc65911-abc9-4e9c-95ee-3f766159f1c3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fkmqj"
Sep 07 16:56:57.683381 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.681723    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/24750b4e-c0bc-4c3c-a256-6ca251306d06-trusted-ca\") pod \"console-operator-85b454874b-f6srd\" (UID: \"24750b4e-c0bc-4c3c-a256-6ca251306d06\") " pod="openshift-console-operator/console-operator-85b454874b-f6srd"
Sep 07 16:56:57.683381 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.681794    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scvn8\" (UniqueName: \"kubernetes.io/projected/24750b4e-c0bc-4c3c-a256-6ca251306d06-kube-api-access-scvn8\") pod \"console-operator-85b454874b-f6srd\" (UID: \"24750b4e-c0bc-4c3c-a256-6ca251306d06\") " pod="openshift-console-operator/console-operator-85b454874b-f6srd"
Sep 07 16:56:57.683381 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.681825    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/37c768a7-bec4-47dd-870e-1a7686e4b268-config\") pod \"service-ca-operator-859f94c4b-n42x6\" (UID: \"37c768a7-bec4-47dd-870e-1a7686e4b268\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-n42x6"
Sep 07 16:56:57.683381 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.681836    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96e71053-7215-446f-b880-5c7236d5ab72-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-bc6d9\" (UID: \"96e71053-7215-446f-b880-5c7236d5ab72\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bc6d9"
Sep 07 16:56:57.683381 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.681886    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dc65911-abc9-4e9c-95ee-3f766159f1c3-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-fkmqj\" (UID: \"3dc65911-abc9-4e9c-95ee-3f766159f1c3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fkmqj"
Sep 07 16:56:57.683381 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.681902    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jb6z\" (UniqueName: \"kubernetes.io/projected/96e71053-7215-446f-b880-5c7236d5ab72-kube-api-access-2jb6z\") pod \"cluster-monitoring-operator-6cdcc96965-bc6d9\" (UID: \"96e71053-7215-446f-b880-5c7236d5ab72\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bc6d9"
Sep 07 16:56:57.683381 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.681941    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/24750b4e-c0bc-4c3c-a256-6ca251306d06-serving-cert\") pod \"console-operator-85b454874b-f6srd\" (UID: \"24750b4e-c0bc-4c3c-a256-6ca251306d06\") " pod="openshift-console-operator/console-operator-85b454874b-f6srd"
Sep 07 16:56:57.683381 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.681965    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tz8s\" (UniqueName: \"kubernetes.io/projected/3dc65911-abc9-4e9c-95ee-3f766159f1c3-kube-api-access-5tz8s\") pod \"insights-operator-76bcd6ccf5-fkmqj\" (UID: \"3dc65911-abc9-4e9c-95ee-3f766159f1c3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fkmqj"
Sep 07 16:56:57.683381 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.681993    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-metrics-certs\") pod \"router-default-868d865496-l5lhw\" (UID: \"fcf33d4f-f41e-4380-be30-ba07d4b8dd16\") " pod="openshift-ingress/router-default-868d865496-l5lhw"
Sep 07 16:56:57.683381 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.682016    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k48sd\" (UniqueName: \"kubernetes.io/projected/37c768a7-bec4-47dd-870e-1a7686e4b268-kube-api-access-k48sd\") pod \"service-ca-operator-859f94c4b-n42x6\" (UID: \"37c768a7-bec4-47dd-870e-1a7686e4b268\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-n42x6"
Sep 07 16:56:57.683381 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.682046    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nbln\" (UniqueName: \"kubernetes.io/projected/379961e8-79b6-4026-9fdd-1f914d83870d-kube-api-access-7nbln\") pod \"ingress-canary-cbxtz\" (UID: \"379961e8-79b6-4026-9fdd-1f914d83870d\") " pod="openshift-ingress-canary/ingress-canary-cbxtz"
Sep 07 16:56:57.683381 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.682073    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3dc65911-abc9-4e9c-95ee-3f766159f1c3-tmp\") pod \"insights-operator-76bcd6ccf5-fkmqj\" (UID: \"3dc65911-abc9-4e9c-95ee-3f766159f1c3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fkmqj"
Sep 07 16:56:57.684006 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.682099    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5ce4365f-988f-4113-bee7-d55fd58dbff3-config-volume\") pod \"dns-default-26spm\" (UID: \"5ce4365f-988f-4113-bee7-d55fd58dbff3\") " pod="openshift-dns/dns-default-26spm"
Sep 07 16:56:57.684006 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.682121    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/24750b4e-c0bc-4c3c-a256-6ca251306d06-config\") pod \"console-operator-85b454874b-f6srd\" (UID: \"24750b4e-c0bc-4c3c-a256-6ca251306d06\") " pod="openshift-console-operator/console-operator-85b454874b-f6srd"
Sep 07 16:56:57.684006 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.682136    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dc65911-abc9-4e9c-95ee-3f766159f1c3-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-fkmqj\" (UID: \"3dc65911-abc9-4e9c-95ee-3f766159f1c3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fkmqj"
Sep 07 16:56:57.684006 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.682151    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ggc8\" (UniqueName: \"kubernetes.io/projected/fc156935-53d3-4cc8-9698-3e3cc2a1fd73-kube-api-access-8ggc8\") pod \"cluster-samples-operator-7cdcfcf76c-z6w5g\" (UID: \"fc156935-53d3-4cc8-9698-3e3cc2a1fd73\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-z6w5g"
Sep 07 16:56:57.684006 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.682202    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kcpn\" (UniqueName: \"kubernetes.io/projected/5ce4365f-988f-4113-bee7-d55fd58dbff3-kube-api-access-6kcpn\") pod \"dns-default-26spm\" (UID: \"5ce4365f-988f-4113-bee7-d55fd58dbff3\") " pod="openshift-dns/dns-default-26spm"
Sep 07 16:56:57.684006 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:57.681351    2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 07 16:56:57.684006 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:57.682332    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc156935-53d3-4cc8-9698-3e3cc2a1fd73-samples-operator-tls podName:fc156935-53d3-4cc8-9698-3e3cc2a1fd73 nodeName:}" failed. No retries permitted until 2026-09-07 16:56:58.18231121 +0000 UTC m=+35.213741990 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fc156935-53d3-4cc8-9698-3e3cc2a1fd73-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-z6w5g" (UID: "fc156935-53d3-4cc8-9698-3e3cc2a1fd73") : secret "samples-operator-tls" not found
Sep 07 16:56:57.684006 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.682582    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/24750b4e-c0bc-4c3c-a256-6ca251306d06-trusted-ca\") pod \"console-operator-85b454874b-f6srd\" (UID: \"24750b4e-c0bc-4c3c-a256-6ca251306d06\") " pod="openshift-console-operator/console-operator-85b454874b-f6srd"
Sep 07 16:56:57.684006 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:57.682601    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-service-ca-bundle podName:fcf33d4f-f41e-4380-be30-ba07d4b8dd16 nodeName:}" failed. No retries permitted until 2026-09-07 16:56:58.182585585 +0000 UTC m=+35.214016383 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-service-ca-bundle") pod "router-default-868d865496-l5lhw" (UID: "fcf33d4f-f41e-4380-be30-ba07d4b8dd16") : configmap references non-existent config key: service-ca.crt
Sep 07 16:56:57.684006 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:57.682169    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 07 16:56:57.684006 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:57.682917    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-metrics-certs podName:fcf33d4f-f41e-4380-be30-ba07d4b8dd16 nodeName:}" failed. No retries permitted until 2026-09-07 16:56:58.182900536 +0000 UTC m=+35.214331305 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-metrics-certs") pod "router-default-868d865496-l5lhw" (UID: "fcf33d4f-f41e-4380-be30-ba07d4b8dd16") : secret "router-metrics-certs-default" not found
Sep 07 16:56:57.684006 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.682931    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/24750b4e-c0bc-4c3c-a256-6ca251306d06-config\") pod \"console-operator-85b454874b-f6srd\" (UID: \"24750b4e-c0bc-4c3c-a256-6ca251306d06\") " pod="openshift-console-operator/console-operator-85b454874b-f6srd"
Sep 07 16:56:57.684006 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.683154    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3dc65911-abc9-4e9c-95ee-3f766159f1c3-tmp\") pod \"insights-operator-76bcd6ccf5-fkmqj\" (UID: \"3dc65911-abc9-4e9c-95ee-3f766159f1c3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fkmqj"
Sep 07 16:56:57.684006 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.683987    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3dc65911-abc9-4e9c-95ee-3f766159f1c3-serving-cert\") pod \"insights-operator-76bcd6ccf5-fkmqj\" (UID: \"3dc65911-abc9-4e9c-95ee-3f766159f1c3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fkmqj"
Sep 07 16:56:57.684729 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.684097    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-stats-auth\") pod \"router-default-868d865496-l5lhw\" (UID: \"fcf33d4f-f41e-4380-be30-ba07d4b8dd16\") " pod="openshift-ingress/router-default-868d865496-l5lhw"
Sep 07 16:56:57.684783 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.684731    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/24750b4e-c0bc-4c3c-a256-6ca251306d06-serving-cert\") pod \"console-operator-85b454874b-f6srd\" (UID: \"24750b4e-c0bc-4c3c-a256-6ca251306d06\") " pod="openshift-console-operator/console-operator-85b454874b-f6srd"
Sep 07 16:56:57.685615 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.685594    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/37c768a7-bec4-47dd-870e-1a7686e4b268-serving-cert\") pod \"service-ca-operator-859f94c4b-n42x6\" (UID: \"37c768a7-bec4-47dd-870e-1a7686e4b268\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-n42x6"
Sep 07 16:56:57.685745 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.685730    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-default-certificate\") pod \"router-default-868d865496-l5lhw\" (UID: \"fcf33d4f-f41e-4380-be30-ba07d4b8dd16\") " pod="openshift-ingress/router-default-868d865496-l5lhw"
Sep 07 16:56:57.694050 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.694022    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ggc8\" (UniqueName: \"kubernetes.io/projected/fc156935-53d3-4cc8-9698-3e3cc2a1fd73-kube-api-access-8ggc8\") pod \"cluster-samples-operator-7cdcfcf76c-z6w5g\" (UID: \"fc156935-53d3-4cc8-9698-3e3cc2a1fd73\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-z6w5g"
Sep 07 16:56:57.694757 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.694740    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k48sd\" (UniqueName: \"kubernetes.io/projected/37c768a7-bec4-47dd-870e-1a7686e4b268-kube-api-access-k48sd\") pod \"service-ca-operator-859f94c4b-n42x6\" (UID: \"37c768a7-bec4-47dd-870e-1a7686e4b268\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-n42x6"
Sep 07 16:56:57.694970 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.694954    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scvn8\" (UniqueName: \"kubernetes.io/projected/24750b4e-c0bc-4c3c-a256-6ca251306d06-kube-api-access-scvn8\") pod \"console-operator-85b454874b-f6srd\" (UID: \"24750b4e-c0bc-4c3c-a256-6ca251306d06\") " pod="openshift-console-operator/console-operator-85b454874b-f6srd"
Sep 07 16:56:57.695196 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.695180    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xwg9\" (UniqueName: \"kubernetes.io/projected/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-kube-api-access-7xwg9\") pod \"router-default-868d865496-l5lhw\" (UID: \"fcf33d4f-f41e-4380-be30-ba07d4b8dd16\") " pod="openshift-ingress/router-default-868d865496-l5lhw"
Sep 07 16:56:57.700346 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.700327    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9fkj\" (UniqueName: \"kubernetes.io/projected/f23afbe6-ab97-47a4-ac01-f2fd36cc0e6b-kube-api-access-b9fkj\") pod \"volume-data-source-validator-695c895bd6-cmlx2\" (UID: \"f23afbe6-ab97-47a4-ac01-f2fd36cc0e6b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-cmlx2"
Sep 07 16:56:57.700444 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.700330    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tz8s\" (UniqueName: \"kubernetes.io/projected/3dc65911-abc9-4e9c-95ee-3f766159f1c3-kube-api-access-5tz8s\") pod \"insights-operator-76bcd6ccf5-fkmqj\" (UID: \"3dc65911-abc9-4e9c-95ee-3f766159f1c3\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fkmqj"
Sep 07 16:56:57.711919 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.711900    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-r987z"
Sep 07 16:56:57.732350 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.732331    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-cmlx2"
Sep 07 16:56:57.749736 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.749678    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-n42x6"
Sep 07 16:56:57.785966 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.784747    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ce4365f-988f-4113-bee7-d55fd58dbff3-metrics-tls\") pod \"dns-default-26spm\" (UID: \"5ce4365f-988f-4113-bee7-d55fd58dbff3\") " pod="openshift-dns/dns-default-26spm"
Sep 07 16:56:57.785966 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.784815    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnkwz\" (UniqueName: \"kubernetes.io/projected/72d805d0-d863-444e-a934-c37f9304205e-kube-api-access-jnkwz\") pod \"network-check-source-685456655f-mnjbb\" (UID: \"72d805d0-d863-444e-a934-c37f9304205e\") " pod="openshift-network-diagnostics/network-check-source-685456655f-mnjbb"
Sep 07 16:56:57.785966 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.784898    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/379961e8-79b6-4026-9fdd-1f914d83870d-cert\") pod \"ingress-canary-cbxtz\" (UID: \"379961e8-79b6-4026-9fdd-1f914d83870d\") " pod="openshift-ingress-canary/ingress-canary-cbxtz"
Sep 07 16:56:57.785966 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.784959    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/96e71053-7215-446f-b880-5c7236d5ab72-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-bc6d9\" (UID: \"96e71053-7215-446f-b880-5c7236d5ab72\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bc6d9"
Sep 07 16:56:57.785966 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.785076    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ce4365f-988f-4113-bee7-d55fd58dbff3-tmp-dir\") pod \"dns-default-26spm\" (UID: \"5ce4365f-988f-4113-bee7-d55fd58dbff3\") " pod="openshift-dns/dns-default-26spm"
Sep 07 16:56:57.785966 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.785114    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96e71053-7215-446f-b880-5c7236d5ab72-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-bc6d9\" (UID: \"96e71053-7215-446f-b880-5c7236d5ab72\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bc6d9"
Sep 07 16:56:57.785966 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.785147    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jb6z\" (UniqueName: \"kubernetes.io/projected/96e71053-7215-446f-b880-5c7236d5ab72-kube-api-access-2jb6z\") pod \"cluster-monitoring-operator-6cdcc96965-bc6d9\" (UID: \"96e71053-7215-446f-b880-5c7236d5ab72\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bc6d9"
Sep 07 16:56:57.785966 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.785194    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nbln\" (UniqueName: \"kubernetes.io/projected/379961e8-79b6-4026-9fdd-1f914d83870d-kube-api-access-7nbln\") pod \"ingress-canary-cbxtz\" (UID: \"379961e8-79b6-4026-9fdd-1f914d83870d\") " pod="openshift-ingress-canary/ingress-canary-cbxtz"
Sep 07 16:56:57.785966 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.785223    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5ce4365f-988f-4113-bee7-d55fd58dbff3-config-volume\") pod \"dns-default-26spm\" (UID: \"5ce4365f-988f-4113-bee7-d55fd58dbff3\") " pod="openshift-dns/dns-default-26spm"
Sep 07 16:56:57.785966 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.785274    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kcpn\" (UniqueName: \"kubernetes.io/projected/5ce4365f-988f-4113-bee7-d55fd58dbff3-kube-api-access-6kcpn\") pod \"dns-default-26spm\" (UID: \"5ce4365f-988f-4113-bee7-d55fd58dbff3\") " pod="openshift-dns/dns-default-26spm"
Sep 07 16:56:57.785966 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:57.785325    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 16:56:57.785966 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:57.785387    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ce4365f-988f-4113-bee7-d55fd58dbff3-metrics-tls podName:5ce4365f-988f-4113-bee7-d55fd58dbff3 nodeName:}" failed. No retries permitted until 2026-09-07 16:56:58.28536883 +0000 UTC m=+35.316799601 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ce4365f-988f-4113-bee7-d55fd58dbff3-metrics-tls") pod "dns-default-26spm" (UID: "5ce4365f-988f-4113-bee7-d55fd58dbff3") : secret "dns-default-metrics-tls" not found
Sep 07 16:56:57.785966 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:57.785507    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 07 16:56:57.785966 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:57.785548    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96e71053-7215-446f-b880-5c7236d5ab72-cluster-monitoring-operator-tls podName:96e71053-7215-446f-b880-5c7236d5ab72 nodeName:}" failed. No retries permitted until 2026-09-07 16:56:58.28553601 +0000 UTC m=+35.316966779 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/96e71053-7215-446f-b880-5c7236d5ab72-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-bc6d9" (UID: "96e71053-7215-446f-b880-5c7236d5ab72") : secret "cluster-monitoring-operator-tls" not found
Sep 07 16:56:57.786814 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.786343    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/96e71053-7215-446f-b880-5c7236d5ab72-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-bc6d9\" (UID: \"96e71053-7215-446f-b880-5c7236d5ab72\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bc6d9"
Sep 07 16:56:57.786814 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.786463    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5ce4365f-988f-4113-bee7-d55fd58dbff3-config-volume\") pod \"dns-default-26spm\" (UID: \"5ce4365f-988f-4113-bee7-d55fd58dbff3\") " pod="openshift-dns/dns-default-26spm"
Sep 07 16:56:57.786814 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.786713    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ce4365f-988f-4113-bee7-d55fd58dbff3-tmp-dir\") pod \"dns-default-26spm\" (UID: \"5ce4365f-988f-4113-bee7-d55fd58dbff3\") " pod="openshift-dns/dns-default-26spm"
Sep 07 16:56:57.791146 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.791113    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/379961e8-79b6-4026-9fdd-1f914d83870d-cert\") pod \"ingress-canary-cbxtz\" (UID: \"379961e8-79b6-4026-9fdd-1f914d83870d\") " pod="openshift-ingress-canary/ingress-canary-cbxtz"
Sep 07 16:56:57.800993 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.800046    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jb6z\" (UniqueName: \"kubernetes.io/projected/96e71053-7215-446f-b880-5c7236d5ab72-kube-api-access-2jb6z\") pod \"cluster-monitoring-operator-6cdcc96965-bc6d9\" (UID: \"96e71053-7215-446f-b880-5c7236d5ab72\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bc6d9"
Sep 07 16:56:57.800993 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.800530    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-fkmqj"
Sep 07 16:56:57.802157 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.802099    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nbln\" (UniqueName: \"kubernetes.io/projected/379961e8-79b6-4026-9fdd-1f914d83870d-kube-api-access-7nbln\") pod \"ingress-canary-cbxtz\" (UID: \"379961e8-79b6-4026-9fdd-1f914d83870d\") " pod="openshift-ingress-canary/ingress-canary-cbxtz"
Sep 07 16:56:57.802444 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.802399    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kcpn\" (UniqueName: \"kubernetes.io/projected/5ce4365f-988f-4113-bee7-d55fd58dbff3-kube-api-access-6kcpn\") pod \"dns-default-26spm\" (UID: \"5ce4365f-988f-4113-bee7-d55fd58dbff3\") " pod="openshift-dns/dns-default-26spm"
Sep 07 16:56:57.806152 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.806126    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnkwz\" (UniqueName: \"kubernetes.io/projected/72d805d0-d863-444e-a934-c37f9304205e-kube-api-access-jnkwz\") pod \"network-check-source-685456655f-mnjbb\" (UID: \"72d805d0-d863-444e-a934-c37f9304205e\") " pod="openshift-network-diagnostics/network-check-source-685456655f-mnjbb"
Sep 07 16:56:57.816408 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.815807    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-f6srd"
Sep 07 16:56:57.833996 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.833928    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cbxtz"
Sep 07 16:56:57.851200 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:57.851167    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-mnjbb"
Sep 07 16:56:58.057734 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:58.057712    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-r987z"]
Sep 07 16:56:58.059839 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:58.059817    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-cmlx2"]
Sep 07 16:56:58.060888 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:58.060859    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod231f4bfa_55eb_4533_a0b0_f6d845f5fe0f.slice/crio-2903e2634b6a32497c569dbe0439fc4a1071f0a5a3654decfa515ffe7b51aa0c WatchSource:0}: Error finding container 2903e2634b6a32497c569dbe0439fc4a1071f0a5a3654decfa515ffe7b51aa0c: Status 404 returned error can't find the container with id 2903e2634b6a32497c569dbe0439fc4a1071f0a5a3654decfa515ffe7b51aa0c
Sep 07 16:56:58.062286 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:58.062255    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf23afbe6_ab97_47a4_ac01_f2fd36cc0e6b.slice/crio-60fc34af0a9fe76234f9ebe6e788602014d2491bf5696546c59311a7aedff18d WatchSource:0}: Error finding container 60fc34af0a9fe76234f9ebe6e788602014d2491bf5696546c59311a7aedff18d: Status 404 returned error can't find the container with id 60fc34af0a9fe76234f9ebe6e788602014d2491bf5696546c59311a7aedff18d
Sep 07 16:56:58.066918 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:58.066810    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-n42x6"]
Sep 07 16:56:58.068465 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:58.068444    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37c768a7_bec4_47dd_870e_1a7686e4b268.slice/crio-9500ac229a1e82631edfb8a30a5c1583c6964155e8d4c45108ce233b6870b1ee WatchSource:0}: Error finding container 9500ac229a1e82631edfb8a30a5c1583c6964155e8d4c45108ce233b6870b1ee: Status 404 returned error can't find the container with id 9500ac229a1e82631edfb8a30a5c1583c6964155e8d4c45108ce233b6870b1ee
Sep 07 16:56:58.090267 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:58.090221    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0fe9fce-f35b-42eb-b819-23e313bfbfea-registry-tls\") pod \"image-registry-76767cd44d-9lpwv\" (UID: \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\") " pod="openshift-image-registry/image-registry-76767cd44d-9lpwv"
Sep 07 16:56:58.090412 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:58.090394    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 16:56:58.090463 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:58.090416    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76767cd44d-9lpwv: secret "image-registry-tls" not found
Sep 07 16:56:58.090513 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:58.090478    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0fe9fce-f35b-42eb-b819-23e313bfbfea-registry-tls podName:b0fe9fce-f35b-42eb-b819-23e313bfbfea nodeName:}" failed. No retries permitted until 2026-09-07 16:56:59.090459531 +0000 UTC m=+36.121890299 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b0fe9fce-f35b-42eb-b819-23e313bfbfea-registry-tls") pod "image-registry-76767cd44d-9lpwv" (UID: "b0fe9fce-f35b-42eb-b819-23e313bfbfea") : secret "image-registry-tls" not found
Sep 07 16:56:58.129104 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:58.129073    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-fkmqj"]
Sep 07 16:56:58.132304 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:58.132275    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dc65911_abc9_4e9c_95ee_3f766159f1c3.slice/crio-adcc16cebfb1d1385e824a399ea728d4d8d1d47666d9a5838ffd261cc6736491 WatchSource:0}: Error finding container adcc16cebfb1d1385e824a399ea728d4d8d1d47666d9a5838ffd261cc6736491: Status 404 returned error can't find the container with id adcc16cebfb1d1385e824a399ea728d4d8d1d47666d9a5838ffd261cc6736491
Sep 07 16:56:58.135748 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:58.135690    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-f6srd"]
Sep 07 16:56:58.138402 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:58.138376    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24750b4e_c0bc_4c3c_a256_6ca251306d06.slice/crio-635f5f6ccb31571ace42cb4fdf01a1617a91c7013bf6c6cc4ae4fcba7ad0c22f WatchSource:0}: Error finding container 635f5f6ccb31571ace42cb4fdf01a1617a91c7013bf6c6cc4ae4fcba7ad0c22f: Status 404 returned error can't find the container with id 635f5f6ccb31571ace42cb4fdf01a1617a91c7013bf6c6cc4ae4fcba7ad0c22f
Sep 07 16:56:58.152998 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:58.152974    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cbxtz"]
Sep 07 16:56:58.155972 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:58.155947    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod379961e8_79b6_4026_9fdd_1f914d83870d.slice/crio-e772a5319addb60a6ec9c00c0a2d743b7652e42be93fc27ca3ddbb83a95eb20b WatchSource:0}: Error finding container e772a5319addb60a6ec9c00c0a2d743b7652e42be93fc27ca3ddbb83a95eb20b: Status 404 returned error can't find the container with id e772a5319addb60a6ec9c00c0a2d743b7652e42be93fc27ca3ddbb83a95eb20b
Sep 07 16:56:58.191153 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:58.191118    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-service-ca-bundle\") pod \"router-default-868d865496-l5lhw\" (UID: \"fcf33d4f-f41e-4380-be30-ba07d4b8dd16\") " pod="openshift-ingress/router-default-868d865496-l5lhw"
Sep 07 16:56:58.191337 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:58.191319    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-metrics-certs\") pod \"router-default-868d865496-l5lhw\" (UID: \"fcf33d4f-f41e-4380-be30-ba07d4b8dd16\") " pod="openshift-ingress/router-default-868d865496-l5lhw"
Sep 07 16:56:58.191413 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:58.191355    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-service-ca-bundle podName:fcf33d4f-f41e-4380-be30-ba07d4b8dd16 nodeName:}" failed. No retries permitted until 2026-09-07 16:56:59.191332097 +0000 UTC m=+36.222762881 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-service-ca-bundle") pod "router-default-868d865496-l5lhw" (UID: "fcf33d4f-f41e-4380-be30-ba07d4b8dd16") : configmap references non-existent config key: service-ca.crt
Sep 07 16:56:58.191531 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:58.191437    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 07 16:56:58.191531 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:58.191472    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc156935-53d3-4cc8-9698-3e3cc2a1fd73-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-z6w5g\" (UID: \"fc156935-53d3-4cc8-9698-3e3cc2a1fd73\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-z6w5g"
Sep 07 16:56:58.191531 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:58.191509    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-metrics-certs podName:fcf33d4f-f41e-4380-be30-ba07d4b8dd16 nodeName:}" failed. No retries permitted until 2026-09-07 16:56:59.191474872 +0000 UTC m=+36.222905641 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-metrics-certs") pod "router-default-868d865496-l5lhw" (UID: "fcf33d4f-f41e-4380-be30-ba07d4b8dd16") : secret "router-metrics-certs-default" not found
Sep 07 16:56:58.191692 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:58.191585    2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 07 16:56:58.191740 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:58.191667    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc156935-53d3-4cc8-9698-3e3cc2a1fd73-samples-operator-tls podName:fc156935-53d3-4cc8-9698-3e3cc2a1fd73 nodeName:}" failed. No retries permitted until 2026-09-07 16:56:59.191652696 +0000 UTC m=+36.223083484 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fc156935-53d3-4cc8-9698-3e3cc2a1fd73-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-z6w5g" (UID: "fc156935-53d3-4cc8-9698-3e3cc2a1fd73") : secret "samples-operator-tls" not found
Sep 07 16:56:58.194170 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:58.194147    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-mnjbb"]
Sep 07 16:56:58.197253 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:56:58.197213    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72d805d0_d863_444e_a934_c37f9304205e.slice/crio-333c20b220be1bae5375b5378374dd209535b0b170945dc0f90db42d49bf7f7b WatchSource:0}: Error finding container 333c20b220be1bae5375b5378374dd209535b0b170945dc0f90db42d49bf7f7b: Status 404 returned error can't find the container with id 333c20b220be1bae5375b5378374dd209535b0b170945dc0f90db42d49bf7f7b
Sep 07 16:56:58.292948 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:58.292911    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96e71053-7215-446f-b880-5c7236d5ab72-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-bc6d9\" (UID: \"96e71053-7215-446f-b880-5c7236d5ab72\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bc6d9"
Sep 07 16:56:58.293155 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:58.293001    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ce4365f-988f-4113-bee7-d55fd58dbff3-metrics-tls\") pod \"dns-default-26spm\" (UID: \"5ce4365f-988f-4113-bee7-d55fd58dbff3\") " pod="openshift-dns/dns-default-26spm"
Sep 07 16:56:58.293155 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:58.293082    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 07 16:56:58.293155 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:58.293144    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96e71053-7215-446f-b880-5c7236d5ab72-cluster-monitoring-operator-tls podName:96e71053-7215-446f-b880-5c7236d5ab72 nodeName:}" failed. No retries permitted until 2026-09-07 16:56:59.293130244 +0000 UTC m=+36.324561013 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/96e71053-7215-446f-b880-5c7236d5ab72-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-bc6d9" (UID: "96e71053-7215-446f-b880-5c7236d5ab72") : secret "cluster-monitoring-operator-tls" not found
Sep 07 16:56:58.293155 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:58.293143    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 16:56:58.293435 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:58.293198    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ce4365f-988f-4113-bee7-d55fd58dbff3-metrics-tls podName:5ce4365f-988f-4113-bee7-d55fd58dbff3 nodeName:}" failed. No retries permitted until 2026-09-07 16:56:59.293182111 +0000 UTC m=+36.324612881 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ce4365f-988f-4113-bee7-d55fd58dbff3-metrics-tls") pod "dns-default-26spm" (UID: "5ce4365f-988f-4113-bee7-d55fd58dbff3") : secret "dns-default-metrics-tls" not found
Sep 07 16:56:58.890217 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:58.890175    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-mnjbb" event={"ID":"72d805d0-d863-444e-a934-c37f9304205e","Type":"ContainerStarted","Data":"333c20b220be1bae5375b5378374dd209535b0b170945dc0f90db42d49bf7f7b"}
Sep 07 16:56:58.891711 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:58.891682    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-r987z" event={"ID":"231f4bfa-55eb-4533-a0b0-f6d845f5fe0f","Type":"ContainerStarted","Data":"2903e2634b6a32497c569dbe0439fc4a1071f0a5a3654decfa515ffe7b51aa0c"}
Sep 07 16:56:58.892999 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:58.892974    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-f6srd" event={"ID":"24750b4e-c0bc-4c3c-a256-6ca251306d06","Type":"ContainerStarted","Data":"635f5f6ccb31571ace42cb4fdf01a1617a91c7013bf6c6cc4ae4fcba7ad0c22f"}
Sep 07 16:56:58.894252 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:58.894210    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cbxtz" event={"ID":"379961e8-79b6-4026-9fdd-1f914d83870d","Type":"ContainerStarted","Data":"e772a5319addb60a6ec9c00c0a2d743b7652e42be93fc27ca3ddbb83a95eb20b"}
Sep 07 16:56:58.895479 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:58.895446    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-fkmqj" event={"ID":"3dc65911-abc9-4e9c-95ee-3f766159f1c3","Type":"ContainerStarted","Data":"adcc16cebfb1d1385e824a399ea728d4d8d1d47666d9a5838ffd261cc6736491"}
Sep 07 16:56:58.896706 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:58.896683    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-n42x6" event={"ID":"37c768a7-bec4-47dd-870e-1a7686e4b268","Type":"ContainerStarted","Data":"9500ac229a1e82631edfb8a30a5c1583c6964155e8d4c45108ce233b6870b1ee"}
Sep 07 16:56:58.897870 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:58.897844    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-cmlx2" event={"ID":"f23afbe6-ab97-47a4-ac01-f2fd36cc0e6b","Type":"ContainerStarted","Data":"60fc34af0a9fe76234f9ebe6e788602014d2491bf5696546c59311a7aedff18d"}
Sep 07 16:56:59.105346 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:59.105308    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0fe9fce-f35b-42eb-b819-23e313bfbfea-registry-tls\") pod \"image-registry-76767cd44d-9lpwv\" (UID: \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\") " pod="openshift-image-registry/image-registry-76767cd44d-9lpwv"
Sep 07 16:56:59.105542 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:59.105503    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 16:56:59.105542 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:59.105522    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76767cd44d-9lpwv: secret "image-registry-tls" not found
Sep 07 16:56:59.105660 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:59.105591    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0fe9fce-f35b-42eb-b819-23e313bfbfea-registry-tls podName:b0fe9fce-f35b-42eb-b819-23e313bfbfea nodeName:}" failed. No retries permitted until 2026-09-07 16:57:01.10557524 +0000 UTC m=+38.137006016 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b0fe9fce-f35b-42eb-b819-23e313bfbfea-registry-tls") pod "image-registry-76767cd44d-9lpwv" (UID: "b0fe9fce-f35b-42eb-b819-23e313bfbfea") : secret "image-registry-tls" not found
Sep 07 16:56:59.206004 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:59.205922    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc156935-53d3-4cc8-9698-3e3cc2a1fd73-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-z6w5g\" (UID: \"fc156935-53d3-4cc8-9698-3e3cc2a1fd73\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-z6w5g"
Sep 07 16:56:59.206004 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:59.205972    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-service-ca-bundle\") pod \"router-default-868d865496-l5lhw\" (UID: \"fcf33d4f-f41e-4380-be30-ba07d4b8dd16\") " pod="openshift-ingress/router-default-868d865496-l5lhw"
Sep 07 16:56:59.206183 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:59.206060    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-metrics-certs\") pod \"router-default-868d865496-l5lhw\" (UID: \"fcf33d4f-f41e-4380-be30-ba07d4b8dd16\") " pod="openshift-ingress/router-default-868d865496-l5lhw"
Sep 07 16:56:59.206183 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:59.206100    2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 07 16:56:59.206183 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:59.206172    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 07 16:56:59.206345 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:59.206184    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc156935-53d3-4cc8-9698-3e3cc2a1fd73-samples-operator-tls podName:fc156935-53d3-4cc8-9698-3e3cc2a1fd73 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:01.20616595 +0000 UTC m=+38.237596724 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fc156935-53d3-4cc8-9698-3e3cc2a1fd73-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-z6w5g" (UID: "fc156935-53d3-4cc8-9698-3e3cc2a1fd73") : secret "samples-operator-tls" not found
Sep 07 16:56:59.206345 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:59.206199    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-service-ca-bundle podName:fcf33d4f-f41e-4380-be30-ba07d4b8dd16 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:01.206193272 +0000 UTC m=+38.237624040 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-service-ca-bundle") pod "router-default-868d865496-l5lhw" (UID: "fcf33d4f-f41e-4380-be30-ba07d4b8dd16") : configmap references non-existent config key: service-ca.crt
Sep 07 16:56:59.206345 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:59.206213    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-metrics-certs podName:fcf33d4f-f41e-4380-be30-ba07d4b8dd16 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:01.20620525 +0000 UTC m=+38.237636019 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-metrics-certs") pod "router-default-868d865496-l5lhw" (UID: "fcf33d4f-f41e-4380-be30-ba07d4b8dd16") : secret "router-metrics-certs-default" not found
Sep 07 16:56:59.306713 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:59.306680    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ce4365f-988f-4113-bee7-d55fd58dbff3-metrics-tls\") pod \"dns-default-26spm\" (UID: \"5ce4365f-988f-4113-bee7-d55fd58dbff3\") " pod="openshift-dns/dns-default-26spm"
Sep 07 16:56:59.306892 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:56:59.306819    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96e71053-7215-446f-b880-5c7236d5ab72-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-bc6d9\" (UID: \"96e71053-7215-446f-b880-5c7236d5ab72\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bc6d9"
Sep 07 16:56:59.306892 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:59.306845    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 16:56:59.306991 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:59.306923    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ce4365f-988f-4113-bee7-d55fd58dbff3-metrics-tls podName:5ce4365f-988f-4113-bee7-d55fd58dbff3 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:01.306902816 +0000 UTC m=+38.338333592 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ce4365f-988f-4113-bee7-d55fd58dbff3-metrics-tls") pod "dns-default-26spm" (UID: "5ce4365f-988f-4113-bee7-d55fd58dbff3") : secret "dns-default-metrics-tls" not found
Sep 07 16:56:59.306991 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:59.306936    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 07 16:56:59.307075 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:56:59.306994    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96e71053-7215-446f-b880-5c7236d5ab72-cluster-monitoring-operator-tls podName:96e71053-7215-446f-b880-5c7236d5ab72 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:01.30697771 +0000 UTC m=+38.338408481 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/96e71053-7215-446f-b880-5c7236d5ab72-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-bc6d9" (UID: "96e71053-7215-446f-b880-5c7236d5ab72") : secret "cluster-monitoring-operator-tls" not found
Sep 07 16:57:00.916530 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:00.916495    2558 generic.go:356] "Generic (PLEG): container finished" podID="e526a4b1-0e57-478e-ad59-7f160bbdbcc1" containerID="339d407ea9a084c1ad3c7b6c44d47b981da3e0b4a92c8b9da2fd53eb84e40fa5" exitCode=0
Sep 07 16:57:00.917273 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:00.916575    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9xhzz" event={"ID":"e526a4b1-0e57-478e-ad59-7f160bbdbcc1","Type":"ContainerDied","Data":"339d407ea9a084c1ad3c7b6c44d47b981da3e0b4a92c8b9da2fd53eb84e40fa5"}
Sep 07 16:57:01.129712 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:01.129613    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0fe9fce-f35b-42eb-b819-23e313bfbfea-registry-tls\") pod \"image-registry-76767cd44d-9lpwv\" (UID: \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\") " pod="openshift-image-registry/image-registry-76767cd44d-9lpwv"
Sep 07 16:57:01.129893 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:01.129785    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 16:57:01.129893 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:01.129809    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76767cd44d-9lpwv: secret "image-registry-tls" not found
Sep 07 16:57:01.129893 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:01.129871    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0fe9fce-f35b-42eb-b819-23e313bfbfea-registry-tls podName:b0fe9fce-f35b-42eb-b819-23e313bfbfea nodeName:}" failed. No retries permitted until 2026-09-07 16:57:05.12985178 +0000 UTC m=+42.161282551 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b0fe9fce-f35b-42eb-b819-23e313bfbfea-registry-tls") pod "image-registry-76767cd44d-9lpwv" (UID: "b0fe9fce-f35b-42eb-b819-23e313bfbfea") : secret "image-registry-tls" not found
Sep 07 16:57:01.232037 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:01.231059    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-metrics-certs\") pod \"router-default-868d865496-l5lhw\" (UID: \"fcf33d4f-f41e-4380-be30-ba07d4b8dd16\") " pod="openshift-ingress/router-default-868d865496-l5lhw"
Sep 07 16:57:01.232037 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:01.231187    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc156935-53d3-4cc8-9698-3e3cc2a1fd73-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-z6w5g\" (UID: \"fc156935-53d3-4cc8-9698-3e3cc2a1fd73\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-z6w5g"
Sep 07 16:57:01.232037 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:01.231231    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-service-ca-bundle\") pod \"router-default-868d865496-l5lhw\" (UID: \"fcf33d4f-f41e-4380-be30-ba07d4b8dd16\") " pod="openshift-ingress/router-default-868d865496-l5lhw"
Sep 07 16:57:01.232037 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:01.231392    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-service-ca-bundle podName:fcf33d4f-f41e-4380-be30-ba07d4b8dd16 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:05.231372043 +0000 UTC m=+42.262802817 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-service-ca-bundle") pod "router-default-868d865496-l5lhw" (UID: "fcf33d4f-f41e-4380-be30-ba07d4b8dd16") : configmap references non-existent config key: service-ca.crt
Sep 07 16:57:01.232037 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:01.231809    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 07 16:57:01.232037 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:01.231862    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-metrics-certs podName:fcf33d4f-f41e-4380-be30-ba07d4b8dd16 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:05.231846473 +0000 UTC m=+42.263277242 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-metrics-certs") pod "router-default-868d865496-l5lhw" (UID: "fcf33d4f-f41e-4380-be30-ba07d4b8dd16") : secret "router-metrics-certs-default" not found
Sep 07 16:57:01.232037 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:01.231923    2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 07 16:57:01.232037 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:01.231956    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc156935-53d3-4cc8-9698-3e3cc2a1fd73-samples-operator-tls podName:fc156935-53d3-4cc8-9698-3e3cc2a1fd73 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:05.231945358 +0000 UTC m=+42.263376134 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fc156935-53d3-4cc8-9698-3e3cc2a1fd73-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-z6w5g" (UID: "fc156935-53d3-4cc8-9698-3e3cc2a1fd73") : secret "samples-operator-tls" not found
Sep 07 16:57:01.333093 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:01.332211    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96e71053-7215-446f-b880-5c7236d5ab72-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-bc6d9\" (UID: \"96e71053-7215-446f-b880-5c7236d5ab72\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bc6d9"
Sep 07 16:57:01.333093 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:01.332324    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ce4365f-988f-4113-bee7-d55fd58dbff3-metrics-tls\") pod \"dns-default-26spm\" (UID: \"5ce4365f-988f-4113-bee7-d55fd58dbff3\") " pod="openshift-dns/dns-default-26spm"
Sep 07 16:57:01.333093 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:01.332472    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 16:57:01.333093 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:01.332530    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ce4365f-988f-4113-bee7-d55fd58dbff3-metrics-tls podName:5ce4365f-988f-4113-bee7-d55fd58dbff3 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:05.332514503 +0000 UTC m=+42.363945277 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ce4365f-988f-4113-bee7-d55fd58dbff3-metrics-tls") pod "dns-default-26spm" (UID: "5ce4365f-988f-4113-bee7-d55fd58dbff3") : secret "dns-default-metrics-tls" not found
Sep 07 16:57:01.333093 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:01.332974    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 07 16:57:01.333093 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:01.333024    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96e71053-7215-446f-b880-5c7236d5ab72-cluster-monitoring-operator-tls podName:96e71053-7215-446f-b880-5c7236d5ab72 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:05.333008963 +0000 UTC m=+42.364439738 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/96e71053-7215-446f-b880-5c7236d5ab72-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-bc6d9" (UID: "96e71053-7215-446f-b880-5c7236d5ab72") : secret "cluster-monitoring-operator-tls" not found
Sep 07 16:57:01.930100 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:01.929847    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9xhzz" event={"ID":"e526a4b1-0e57-478e-ad59-7f160bbdbcc1","Type":"ContainerStarted","Data":"46905e5b1b32dc34ef37e810183165cd6d6b771ccd8cb3652d796b3e82e2bb02"}
Sep 07 16:57:02.936714 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:02.936676    2558 generic.go:356] "Generic (PLEG): container finished" podID="e526a4b1-0e57-478e-ad59-7f160bbdbcc1" containerID="46905e5b1b32dc34ef37e810183165cd6d6b771ccd8cb3652d796b3e82e2bb02" exitCode=0
Sep 07 16:57:02.937172 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:02.936760    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9xhzz" event={"ID":"e526a4b1-0e57-478e-ad59-7f160bbdbcc1","Type":"ContainerDied","Data":"46905e5b1b32dc34ef37e810183165cd6d6b771ccd8cb3652d796b3e82e2bb02"}
Sep 07 16:57:05.164557 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:05.164513    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0fe9fce-f35b-42eb-b819-23e313bfbfea-registry-tls\") pod \"image-registry-76767cd44d-9lpwv\" (UID: \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\") " pod="openshift-image-registry/image-registry-76767cd44d-9lpwv"
Sep 07 16:57:05.164993 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:05.164693    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 16:57:05.164993 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:05.164715    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76767cd44d-9lpwv: secret "image-registry-tls" not found
Sep 07 16:57:05.164993 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:05.164778    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0fe9fce-f35b-42eb-b819-23e313bfbfea-registry-tls podName:b0fe9fce-f35b-42eb-b819-23e313bfbfea nodeName:}" failed. No retries permitted until 2026-09-07 16:57:13.16476208 +0000 UTC m=+50.196192849 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b0fe9fce-f35b-42eb-b819-23e313bfbfea-registry-tls") pod "image-registry-76767cd44d-9lpwv" (UID: "b0fe9fce-f35b-42eb-b819-23e313bfbfea") : secret "image-registry-tls" not found
Sep 07 16:57:05.265712 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:05.265664    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-metrics-certs\") pod \"router-default-868d865496-l5lhw\" (UID: \"fcf33d4f-f41e-4380-be30-ba07d4b8dd16\") " pod="openshift-ingress/router-default-868d865496-l5lhw"
Sep 07 16:57:05.265895 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:05.265775    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc156935-53d3-4cc8-9698-3e3cc2a1fd73-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-z6w5g\" (UID: \"fc156935-53d3-4cc8-9698-3e3cc2a1fd73\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-z6w5g"
Sep 07 16:57:05.265895 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:05.265821    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-service-ca-bundle\") pod \"router-default-868d865496-l5lhw\" (UID: \"fcf33d4f-f41e-4380-be30-ba07d4b8dd16\") " pod="openshift-ingress/router-default-868d865496-l5lhw"
Sep 07 16:57:05.265895 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:05.265835    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 07 16:57:05.266068 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:05.265911    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-metrics-certs podName:fcf33d4f-f41e-4380-be30-ba07d4b8dd16 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:13.265891387 +0000 UTC m=+50.297322157 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-metrics-certs") pod "router-default-868d865496-l5lhw" (UID: "fcf33d4f-f41e-4380-be30-ba07d4b8dd16") : secret "router-metrics-certs-default" not found
Sep 07 16:57:05.266068 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:05.265916    2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 07 16:57:05.266068 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:05.265974    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc156935-53d3-4cc8-9698-3e3cc2a1fd73-samples-operator-tls podName:fc156935-53d3-4cc8-9698-3e3cc2a1fd73 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:13.265958245 +0000 UTC m=+50.297389028 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fc156935-53d3-4cc8-9698-3e3cc2a1fd73-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-z6w5g" (UID: "fc156935-53d3-4cc8-9698-3e3cc2a1fd73") : secret "samples-operator-tls" not found
Sep 07 16:57:05.266068 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:05.266007    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-service-ca-bundle podName:fcf33d4f-f41e-4380-be30-ba07d4b8dd16 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:13.26599676 +0000 UTC m=+50.297427528 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-service-ca-bundle") pod "router-default-868d865496-l5lhw" (UID: "fcf33d4f-f41e-4380-be30-ba07d4b8dd16") : configmap references non-existent config key: service-ca.crt
Sep 07 16:57:05.366518 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:05.366461    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ce4365f-988f-4113-bee7-d55fd58dbff3-metrics-tls\") pod \"dns-default-26spm\" (UID: \"5ce4365f-988f-4113-bee7-d55fd58dbff3\") " pod="openshift-dns/dns-default-26spm"
Sep 07 16:57:05.366703 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:05.366616    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96e71053-7215-446f-b880-5c7236d5ab72-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-bc6d9\" (UID: \"96e71053-7215-446f-b880-5c7236d5ab72\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bc6d9"
Sep 07 16:57:05.366703 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:05.366640    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 16:57:05.366796 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:05.366710    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ce4365f-988f-4113-bee7-d55fd58dbff3-metrics-tls podName:5ce4365f-988f-4113-bee7-d55fd58dbff3 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:13.366691301 +0000 UTC m=+50.398122072 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ce4365f-988f-4113-bee7-d55fd58dbff3-metrics-tls") pod "dns-default-26spm" (UID: "5ce4365f-988f-4113-bee7-d55fd58dbff3") : secret "dns-default-metrics-tls" not found
Sep 07 16:57:05.366796 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:05.366750    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 07 16:57:05.366796 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:05.366790    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96e71053-7215-446f-b880-5c7236d5ab72-cluster-monitoring-operator-tls podName:96e71053-7215-446f-b880-5c7236d5ab72 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:13.366777982 +0000 UTC m=+50.398208751 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/96e71053-7215-446f-b880-5c7236d5ab72-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-bc6d9" (UID: "96e71053-7215-446f-b880-5c7236d5ab72") : secret "cluster-monitoring-operator-tls" not found
Sep 07 16:57:07.952213 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:07.951548    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cbxtz" event={"ID":"379961e8-79b6-4026-9fdd-1f914d83870d","Type":"ContainerStarted","Data":"82e2bc500d7142f136d6bb33ebbe3da47570c542bee85c86f3b104c796c213cf"}
Sep 07 16:57:07.953995 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:07.953133    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-fkmqj" event={"ID":"3dc65911-abc9-4e9c-95ee-3f766159f1c3","Type":"ContainerStarted","Data":"1dd39136f9a88af2898a202d3ed8521758da55aaf949d878299066113cfeabc4"}
Sep 07 16:57:07.955021 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:07.954984    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-n42x6" event={"ID":"37c768a7-bec4-47dd-870e-1a7686e4b268","Type":"ContainerStarted","Data":"36c63ef6fc7b34ce5b5cc457928301451c49e9134fb238510806c73831164174"}
Sep 07 16:57:07.956651 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:07.956625    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-cmlx2" event={"ID":"f23afbe6-ab97-47a4-ac01-f2fd36cc0e6b","Type":"ContainerStarted","Data":"b1691f40837405f9d1a3e0b6c48879f9bc56ca06d1ee434590d4746818b2a32f"}
Sep 07 16:57:07.958159 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:07.958135    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-mnjbb" event={"ID":"72d805d0-d863-444e-a934-c37f9304205e","Type":"ContainerStarted","Data":"9875cdf17d6f424f435c8a9fe65ce5a9626955e15e0c91b23fbb80416ad88d51"}
Sep 07 16:57:07.960117 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:07.959796    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-r987z" event={"ID":"231f4bfa-55eb-4533-a0b0-f6d845f5fe0f","Type":"ContainerStarted","Data":"3b4fd2ee7f29e3b2955a3a9293945de35a4e35f4a12141bc236c2448ff7cd6b5"}
Sep 07 16:57:07.961827 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:07.961808    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-f6srd_24750b4e-c0bc-4c3c-a256-6ca251306d06/console-operator/0.log"
Sep 07 16:57:07.961909 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:07.961848    2558 generic.go:356] "Generic (PLEG): container finished" podID="24750b4e-c0bc-4c3c-a256-6ca251306d06" containerID="78387eb079f6b17a99886500db586cab18bc38d9d9f4252af38cdc000d3091cc" exitCode=255
Sep 07 16:57:07.961980 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:07.961925    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-f6srd" event={"ID":"24750b4e-c0bc-4c3c-a256-6ca251306d06","Type":"ContainerDied","Data":"78387eb079f6b17a99886500db586cab18bc38d9d9f4252af38cdc000d3091cc"}
Sep 07 16:57:07.962119 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:07.962096    2558 scope.go:117] "RemoveContainer" containerID="78387eb079f6b17a99886500db586cab18bc38d9d9f4252af38cdc000d3091cc"
Sep 07 16:57:07.966230 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:07.966195    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9xhzz" event={"ID":"e526a4b1-0e57-478e-ad59-7f160bbdbcc1","Type":"ContainerStarted","Data":"ba1a90707372fe8adfcd4e7dbceaf90f2b6788e88eba194f5842d59ffacc6e23"}
Sep 07 16:57:08.009606 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:08.009444    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cbxtz" podStartSLOduration=1.7207572519999998 podStartE2EDuration="11.009418944s" totalImagesPullingTime="9.288661692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:56:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:07.9723051 +0000 UTC m=+45.003735892" watchObservedRunningTime="2026-09-07 16:57:08.009418944 +0000 UTC m=+45.040849736"
Sep 07 16:57:08.037914 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:08.037864    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9xhzz" podStartSLOduration=13.414582854 podStartE2EDuration="44.037847924s" totalImagesPullingTime="30.62326507s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:56:24 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:08.010326449 +0000 UTC m=+45.041757239" watchObservedRunningTime="2026-09-07 16:57:08.037847924 +0000 UTC m=+45.069278715"
Sep 07 16:57:08.038548 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:08.038523    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-r987z" podStartSLOduration=9.655166908 podStartE2EDuration="19.038515647s" totalImagesPullingTime="9.383348739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:56:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:08.037649603 +0000 UTC m=+45.069080394" watchObservedRunningTime="2026-09-07 16:57:08.038515647 +0000 UTC m=+45.069946435"
Sep 07 16:57:08.083275 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:08.083194    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-n42x6" podStartSLOduration=9.708304941 podStartE2EDuration="19.083171153s" totalImagesPullingTime="9.374866212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:56:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:08.080179469 +0000 UTC m=+45.111610261" watchObservedRunningTime="2026-09-07 16:57:08.083171153 +0000 UTC m=+45.114601944"
Sep 07 16:57:08.158430 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:08.155804    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-cmlx2" podStartSLOduration=9.919574296 podStartE2EDuration="19.155781142s" totalImagesPullingTime="9.236206846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:56:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:08.153489599 +0000 UTC m=+45.184920395" watchObservedRunningTime="2026-09-07 16:57:08.155781142 +0000 UTC m=+45.187211936"
Sep 07 16:57:08.218783 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:08.218676    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-fkmqj" podStartSLOduration=9.907696081 podStartE2EDuration="19.218657935s" totalImagesPullingTime="9.310961854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:56:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:08.187616946 +0000 UTC m=+45.219047737" watchObservedRunningTime="2026-09-07 16:57:08.218657935 +0000 UTC m=+45.250088726"
Sep 07 16:57:08.219356 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:08.219324    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-mnjbb" podStartSLOduration=9.963911179 podStartE2EDuration="19.219308585s" totalImagesPullingTime="9.255397406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:56:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:08.217859433 +0000 UTC m=+45.249290226" watchObservedRunningTime="2026-09-07 16:57:08.219308585 +0000 UTC m=+45.250739372"
Sep 07 16:57:08.970716 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:08.970676    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-f6srd_24750b4e-c0bc-4c3c-a256-6ca251306d06/console-operator/1.log"
Sep 07 16:57:08.971229 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:08.971214    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-f6srd_24750b4e-c0bc-4c3c-a256-6ca251306d06/console-operator/0.log"
Sep 07 16:57:08.971316 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:08.971259    2558 generic.go:356] "Generic (PLEG): container finished" podID="24750b4e-c0bc-4c3c-a256-6ca251306d06" containerID="882b18884aba1f257be1ba431bc1c25cf77f8bc59ff36c5abb60b6b7465aa471" exitCode=255
Sep 07 16:57:08.971353 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:08.971339    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-f6srd" event={"ID":"24750b4e-c0bc-4c3c-a256-6ca251306d06","Type":"ContainerDied","Data":"882b18884aba1f257be1ba431bc1c25cf77f8bc59ff36c5abb60b6b7465aa471"}
Sep 07 16:57:08.971434 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:08.971421    2558 scope.go:117] "RemoveContainer" containerID="78387eb079f6b17a99886500db586cab18bc38d9d9f4252af38cdc000d3091cc"
Sep 07 16:57:08.971667 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:08.971645    2558 scope.go:117] "RemoveContainer" containerID="882b18884aba1f257be1ba431bc1c25cf77f8bc59ff36c5abb60b6b7465aa471"
Sep 07 16:57:08.971940 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:08.971850    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-f6srd_openshift-console-operator(24750b4e-c0bc-4c3c-a256-6ca251306d06)\"" pod="openshift-console-operator/console-operator-85b454874b-f6srd" podUID="24750b4e-c0bc-4c3c-a256-6ca251306d06"
Sep 07 16:57:09.810727 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:09.810696    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nh4xg"]
Sep 07 16:57:09.840314 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:09.840282    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nh4xg"
Sep 07 16:57:09.844444 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:09.844422    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 07 16:57:09.844874 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:09.844858    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kv5rt\""
Sep 07 16:57:09.845400 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:09.845377    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 07 16:57:09.847447 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:09.847426    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nh4xg"]
Sep 07 16:57:09.910525 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:09.910491    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/483bf37d-ca55-477b-a045-5d411f45a9b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nh4xg\" (UID: \"483bf37d-ca55-477b-a045-5d411f45a9b3\") " pod="openshift-insights/insights-runtime-extractor-nh4xg"
Sep 07 16:57:09.910673 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:09.910539    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/483bf37d-ca55-477b-a045-5d411f45a9b3-data-volume\") pod \"insights-runtime-extractor-nh4xg\" (UID: \"483bf37d-ca55-477b-a045-5d411f45a9b3\") " pod="openshift-insights/insights-runtime-extractor-nh4xg"
Sep 07 16:57:09.910673 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:09.910586    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/483bf37d-ca55-477b-a045-5d411f45a9b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nh4xg\" (UID: \"483bf37d-ca55-477b-a045-5d411f45a9b3\") " pod="openshift-insights/insights-runtime-extractor-nh4xg"
Sep 07 16:57:09.910673 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:09.910632    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wng9g\" (UniqueName: \"kubernetes.io/projected/483bf37d-ca55-477b-a045-5d411f45a9b3-kube-api-access-wng9g\") pod \"insights-runtime-extractor-nh4xg\" (UID: \"483bf37d-ca55-477b-a045-5d411f45a9b3\") " pod="openshift-insights/insights-runtime-extractor-nh4xg"
Sep 07 16:57:09.910774 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:09.910717    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/483bf37d-ca55-477b-a045-5d411f45a9b3-crio-socket\") pod \"insights-runtime-extractor-nh4xg\" (UID: \"483bf37d-ca55-477b-a045-5d411f45a9b3\") " pod="openshift-insights/insights-runtime-extractor-nh4xg"
Sep 07 16:57:09.976582 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:09.976547    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-f6srd_24750b4e-c0bc-4c3c-a256-6ca251306d06/console-operator/1.log"
Sep 07 16:57:09.977019 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:09.976961    2558 scope.go:117] "RemoveContainer" containerID="882b18884aba1f257be1ba431bc1c25cf77f8bc59ff36c5abb60b6b7465aa471"
Sep 07 16:57:09.977134 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:09.977114    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-f6srd_openshift-console-operator(24750b4e-c0bc-4c3c-a256-6ca251306d06)\"" pod="openshift-console-operator/console-operator-85b454874b-f6srd" podUID="24750b4e-c0bc-4c3c-a256-6ca251306d06"
Sep 07 16:57:10.012088 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:10.012051    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/483bf37d-ca55-477b-a045-5d411f45a9b3-data-volume\") pod \"insights-runtime-extractor-nh4xg\" (UID: \"483bf37d-ca55-477b-a045-5d411f45a9b3\") " pod="openshift-insights/insights-runtime-extractor-nh4xg"
Sep 07 16:57:10.012266 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:10.012190    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/483bf37d-ca55-477b-a045-5d411f45a9b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nh4xg\" (UID: \"483bf37d-ca55-477b-a045-5d411f45a9b3\") " pod="openshift-insights/insights-runtime-extractor-nh4xg"
Sep 07 16:57:10.012322 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:10.012281    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wng9g\" (UniqueName: \"kubernetes.io/projected/483bf37d-ca55-477b-a045-5d411f45a9b3-kube-api-access-wng9g\") pod \"insights-runtime-extractor-nh4xg\" (UID: \"483bf37d-ca55-477b-a045-5d411f45a9b3\") " pod="openshift-insights/insights-runtime-extractor-nh4xg"
Sep 07 16:57:10.012322 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:10.012309    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 16:57:10.012399 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:10.012380    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/483bf37d-ca55-477b-a045-5d411f45a9b3-kube-rbac-proxy-cm podName:483bf37d-ca55-477b-a045-5d411f45a9b3 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:10.512362799 +0000 UTC m=+47.543793584 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/483bf37d-ca55-477b-a045-5d411f45a9b3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nh4xg" (UID: "483bf37d-ca55-477b-a045-5d411f45a9b3") : configmap "kube-rbac-proxy" not found
Sep 07 16:57:10.012455 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:10.012401    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/483bf37d-ca55-477b-a045-5d411f45a9b3-crio-socket\") pod \"insights-runtime-extractor-nh4xg\" (UID: \"483bf37d-ca55-477b-a045-5d411f45a9b3\") " pod="openshift-insights/insights-runtime-extractor-nh4xg"
Sep 07 16:57:10.012542 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:10.012515    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/483bf37d-ca55-477b-a045-5d411f45a9b3-data-volume\") pod \"insights-runtime-extractor-nh4xg\" (UID: \"483bf37d-ca55-477b-a045-5d411f45a9b3\") " pod="openshift-insights/insights-runtime-extractor-nh4xg"
Sep 07 16:57:10.012656 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:10.012544    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/483bf37d-ca55-477b-a045-5d411f45a9b3-crio-socket\") pod \"insights-runtime-extractor-nh4xg\" (UID: \"483bf37d-ca55-477b-a045-5d411f45a9b3\") " pod="openshift-insights/insights-runtime-extractor-nh4xg"
Sep 07 16:57:10.012656 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:10.012613    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/483bf37d-ca55-477b-a045-5d411f45a9b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nh4xg\" (UID: \"483bf37d-ca55-477b-a045-5d411f45a9b3\") " pod="openshift-insights/insights-runtime-extractor-nh4xg"
Sep 07 16:57:10.012774 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:10.012759    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 16:57:10.012828 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:10.012818    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/483bf37d-ca55-477b-a045-5d411f45a9b3-insights-runtime-extractor-tls podName:483bf37d-ca55-477b-a045-5d411f45a9b3 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:10.512802489 +0000 UTC m=+47.544233258 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/483bf37d-ca55-477b-a045-5d411f45a9b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nh4xg" (UID: "483bf37d-ca55-477b-a045-5d411f45a9b3") : secret "insights-runtime-extractor-tls" not found
Sep 07 16:57:10.024004 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:10.023975    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wng9g\" (UniqueName: \"kubernetes.io/projected/483bf37d-ca55-477b-a045-5d411f45a9b3-kube-api-access-wng9g\") pod \"insights-runtime-extractor-nh4xg\" (UID: \"483bf37d-ca55-477b-a045-5d411f45a9b3\") " pod="openshift-insights/insights-runtime-extractor-nh4xg"
Sep 07 16:57:10.517033 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:10.516987    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/483bf37d-ca55-477b-a045-5d411f45a9b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nh4xg\" (UID: \"483bf37d-ca55-477b-a045-5d411f45a9b3\") " pod="openshift-insights/insights-runtime-extractor-nh4xg"
Sep 07 16:57:10.517214 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:10.517155    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 16:57:10.517214 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:10.517176    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/483bf37d-ca55-477b-a045-5d411f45a9b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nh4xg\" (UID: \"483bf37d-ca55-477b-a045-5d411f45a9b3\") " pod="openshift-insights/insights-runtime-extractor-nh4xg"
Sep 07 16:57:10.517350 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:10.517229    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/483bf37d-ca55-477b-a045-5d411f45a9b3-insights-runtime-extractor-tls podName:483bf37d-ca55-477b-a045-5d411f45a9b3 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:11.517215162 +0000 UTC m=+48.548645931 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/483bf37d-ca55-477b-a045-5d411f45a9b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nh4xg" (UID: "483bf37d-ca55-477b-a045-5d411f45a9b3") : secret "insights-runtime-extractor-tls" not found
Sep 07 16:57:10.517350 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:10.517303    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 16:57:10.517454 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:10.517360    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/483bf37d-ca55-477b-a045-5d411f45a9b3-kube-rbac-proxy-cm podName:483bf37d-ca55-477b-a045-5d411f45a9b3 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:11.517347792 +0000 UTC m=+48.548778577 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/483bf37d-ca55-477b-a045-5d411f45a9b3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nh4xg" (UID: "483bf37d-ca55-477b-a045-5d411f45a9b3") : configmap "kube-rbac-proxy" not found
Sep 07 16:57:11.525218 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:11.525178    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/483bf37d-ca55-477b-a045-5d411f45a9b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nh4xg\" (UID: \"483bf37d-ca55-477b-a045-5d411f45a9b3\") " pod="openshift-insights/insights-runtime-extractor-nh4xg"
Sep 07 16:57:11.525698 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:11.525256    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/483bf37d-ca55-477b-a045-5d411f45a9b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nh4xg\" (UID: \"483bf37d-ca55-477b-a045-5d411f45a9b3\") " pod="openshift-insights/insights-runtime-extractor-nh4xg"
Sep 07 16:57:11.525698 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:11.525358    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 16:57:11.525698 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:11.525361    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 16:57:11.525698 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:11.525419    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/483bf37d-ca55-477b-a045-5d411f45a9b3-kube-rbac-proxy-cm podName:483bf37d-ca55-477b-a045-5d411f45a9b3 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:13.525405776 +0000 UTC m=+50.556836544 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/483bf37d-ca55-477b-a045-5d411f45a9b3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nh4xg" (UID: "483bf37d-ca55-477b-a045-5d411f45a9b3") : configmap "kube-rbac-proxy" not found
Sep 07 16:57:11.525698 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:11.525433    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/483bf37d-ca55-477b-a045-5d411f45a9b3-insights-runtime-extractor-tls podName:483bf37d-ca55-477b-a045-5d411f45a9b3 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:13.525426274 +0000 UTC m=+50.556857043 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/483bf37d-ca55-477b-a045-5d411f45a9b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nh4xg" (UID: "483bf37d-ca55-477b-a045-5d411f45a9b3") : secret "insights-runtime-extractor-tls" not found
Sep 07 16:57:12.178364 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:12.178337    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hj7sr_4fd644cb-0777-45a8-94a9-129dd37858f1/dns-node-resolver/0.log"
Sep 07 16:57:13.178437 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:13.178411    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vnzgb_a477d932-fad5-4317-bfd7-2c5f56eb234f/node-ca/0.log"
Sep 07 16:57:13.239314 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:13.239278    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0fe9fce-f35b-42eb-b819-23e313bfbfea-registry-tls\") pod \"image-registry-76767cd44d-9lpwv\" (UID: \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\") " pod="openshift-image-registry/image-registry-76767cd44d-9lpwv"
Sep 07 16:57:13.239474 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:13.239431    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 16:57:13.239474 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:13.239445    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76767cd44d-9lpwv: secret "image-registry-tls" not found
Sep 07 16:57:13.239541 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:13.239498    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0fe9fce-f35b-42eb-b819-23e313bfbfea-registry-tls podName:b0fe9fce-f35b-42eb-b819-23e313bfbfea nodeName:}" failed. No retries permitted until 2026-09-07 16:57:29.239481623 +0000 UTC m=+66.270912406 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b0fe9fce-f35b-42eb-b819-23e313bfbfea-registry-tls") pod "image-registry-76767cd44d-9lpwv" (UID: "b0fe9fce-f35b-42eb-b819-23e313bfbfea") : secret "image-registry-tls" not found
Sep 07 16:57:13.340623 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:13.340588    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-metrics-certs\") pod \"router-default-868d865496-l5lhw\" (UID: \"fcf33d4f-f41e-4380-be30-ba07d4b8dd16\") " pod="openshift-ingress/router-default-868d865496-l5lhw"
Sep 07 16:57:13.340793 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:13.340739    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 07 16:57:13.340793 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:13.340778    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc156935-53d3-4cc8-9698-3e3cc2a1fd73-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-z6w5g\" (UID: \"fc156935-53d3-4cc8-9698-3e3cc2a1fd73\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-z6w5g"
Sep 07 16:57:13.340863 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:13.340799    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-metrics-certs podName:fcf33d4f-f41e-4380-be30-ba07d4b8dd16 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:29.340785366 +0000 UTC m=+66.372216135 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-metrics-certs") pod "router-default-868d865496-l5lhw" (UID: "fcf33d4f-f41e-4380-be30-ba07d4b8dd16") : secret "router-metrics-certs-default" not found
Sep 07 16:57:13.340908 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:13.340866    2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 07 16:57:13.340953 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:13.340905    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-service-ca-bundle\") pod \"router-default-868d865496-l5lhw\" (UID: \"fcf33d4f-f41e-4380-be30-ba07d4b8dd16\") " pod="openshift-ingress/router-default-868d865496-l5lhw"
Sep 07 16:57:13.340953 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:13.340921    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc156935-53d3-4cc8-9698-3e3cc2a1fd73-samples-operator-tls podName:fc156935-53d3-4cc8-9698-3e3cc2a1fd73 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:29.340905283 +0000 UTC m=+66.372336052 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fc156935-53d3-4cc8-9698-3e3cc2a1fd73-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-z6w5g" (UID: "fc156935-53d3-4cc8-9698-3e3cc2a1fd73") : secret "samples-operator-tls" not found
Sep 07 16:57:13.341032 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:13.340977    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-service-ca-bundle podName:fcf33d4f-f41e-4380-be30-ba07d4b8dd16 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:29.340967606 +0000 UTC m=+66.372398375 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-service-ca-bundle") pod "router-default-868d865496-l5lhw" (UID: "fcf33d4f-f41e-4380-be30-ba07d4b8dd16") : configmap references non-existent config key: service-ca.crt
Sep 07 16:57:13.441963 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:13.441887    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ce4365f-988f-4113-bee7-d55fd58dbff3-metrics-tls\") pod \"dns-default-26spm\" (UID: \"5ce4365f-988f-4113-bee7-d55fd58dbff3\") " pod="openshift-dns/dns-default-26spm"
Sep 07 16:57:13.442115 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:13.441988    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96e71053-7215-446f-b880-5c7236d5ab72-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-bc6d9\" (UID: \"96e71053-7215-446f-b880-5c7236d5ab72\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bc6d9"
Sep 07 16:57:13.442115 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:13.442031    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 16:57:13.442115 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:13.442071    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 07 16:57:13.442115 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:13.442094    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ce4365f-988f-4113-bee7-d55fd58dbff3-metrics-tls podName:5ce4365f-988f-4113-bee7-d55fd58dbff3 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:29.442077941 +0000 UTC m=+66.473508711 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ce4365f-988f-4113-bee7-d55fd58dbff3-metrics-tls") pod "dns-default-26spm" (UID: "5ce4365f-988f-4113-bee7-d55fd58dbff3") : secret "dns-default-metrics-tls" not found
Sep 07 16:57:13.442115 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:13.442110    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96e71053-7215-446f-b880-5c7236d5ab72-cluster-monitoring-operator-tls podName:96e71053-7215-446f-b880-5c7236d5ab72 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:29.442099788 +0000 UTC m=+66.473530557 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/96e71053-7215-446f-b880-5c7236d5ab72-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-bc6d9" (UID: "96e71053-7215-446f-b880-5c7236d5ab72") : secret "cluster-monitoring-operator-tls" not found
Sep 07 16:57:13.542490 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:13.542451    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/483bf37d-ca55-477b-a045-5d411f45a9b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nh4xg\" (UID: \"483bf37d-ca55-477b-a045-5d411f45a9b3\") " pod="openshift-insights/insights-runtime-extractor-nh4xg"
Sep 07 16:57:13.542696 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:13.542516    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/483bf37d-ca55-477b-a045-5d411f45a9b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nh4xg\" (UID: \"483bf37d-ca55-477b-a045-5d411f45a9b3\") " pod="openshift-insights/insights-runtime-extractor-nh4xg"
Sep 07 16:57:13.542696 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:13.542620    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 16:57:13.542811 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:13.542703    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/483bf37d-ca55-477b-a045-5d411f45a9b3-insights-runtime-extractor-tls podName:483bf37d-ca55-477b-a045-5d411f45a9b3 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:17.542683383 +0000 UTC m=+54.574114165 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/483bf37d-ca55-477b-a045-5d411f45a9b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nh4xg" (UID: "483bf37d-ca55-477b-a045-5d411f45a9b3") : secret "insights-runtime-extractor-tls" not found
Sep 07 16:57:13.543025 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:13.543002    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/483bf37d-ca55-477b-a045-5d411f45a9b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nh4xg\" (UID: \"483bf37d-ca55-477b-a045-5d411f45a9b3\") " pod="openshift-insights/insights-runtime-extractor-nh4xg"
Sep 07 16:57:13.582305 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:13.582280    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cbxtz_379961e8-79b6-4026-9fdd-1f914d83870d/serve-healthcheck-canary/0.log"
Sep 07 16:57:14.379086 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:14.379039    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-r987z_231f4bfa-55eb-4533-a0b0-f6d845f5fe0f/kube-storage-version-migrator-operator/0.log"
Sep 07 16:57:17.578636 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:17.578599    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/483bf37d-ca55-477b-a045-5d411f45a9b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nh4xg\" (UID: \"483bf37d-ca55-477b-a045-5d411f45a9b3\") " pod="openshift-insights/insights-runtime-extractor-nh4xg"
Sep 07 16:57:17.579315 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:17.578805    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 16:57:17.579315 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:17.578893    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/483bf37d-ca55-477b-a045-5d411f45a9b3-insights-runtime-extractor-tls podName:483bf37d-ca55-477b-a045-5d411f45a9b3 nodeName:}" failed. No retries permitted until 2026-09-07 16:57:25.578869485 +0000 UTC m=+62.610300254 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/483bf37d-ca55-477b-a045-5d411f45a9b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nh4xg" (UID: "483bf37d-ca55-477b-a045-5d411f45a9b3") : secret "insights-runtime-extractor-tls" not found
Sep 07 16:57:17.816821 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:17.816782    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-f6srd"
Sep 07 16:57:17.816997 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:17.816844    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-f6srd"
Sep 07 16:57:17.817186 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:17.817174    2558 scope.go:117] "RemoveContainer" containerID="882b18884aba1f257be1ba431bc1c25cf77f8bc59ff36c5abb60b6b7465aa471"
Sep 07 16:57:17.817368 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:57:17.817348    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-f6srd_openshift-console-operator(24750b4e-c0bc-4c3c-a256-6ca251306d06)\"" pod="openshift-console-operator/console-operator-85b454874b-f6srd" podUID="24750b4e-c0bc-4c3c-a256-6ca251306d06"
Sep 07 16:57:22.877101 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:22.877072    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fwj7s"
Sep 07 16:57:25.648576 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:25.648522    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/483bf37d-ca55-477b-a045-5d411f45a9b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nh4xg\" (UID: \"483bf37d-ca55-477b-a045-5d411f45a9b3\") " pod="openshift-insights/insights-runtime-extractor-nh4xg"
Sep 07 16:57:25.650897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:25.650871    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/483bf37d-ca55-477b-a045-5d411f45a9b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nh4xg\" (UID: \"483bf37d-ca55-477b-a045-5d411f45a9b3\") " pod="openshift-insights/insights-runtime-extractor-nh4xg"
Sep 07 16:57:25.752381 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:25.752350    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kv5rt\""
Sep 07 16:57:25.759734 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:25.759710    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nh4xg"
Sep 07 16:57:26.030955 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:26.030873    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nh4xg"]
Sep 07 16:57:26.034141 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:57:26.034116    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod483bf37d_ca55_477b_a045_5d411f45a9b3.slice/crio-edc442e5a67c6cee7f25fa6e579d93814f0056f36f9c76f780d0785bf5b87c3f WatchSource:0}: Error finding container edc442e5a67c6cee7f25fa6e579d93814f0056f36f9c76f780d0785bf5b87c3f: Status 404 returned error can't find the container with id edc442e5a67c6cee7f25fa6e579d93814f0056f36f9c76f780d0785bf5b87c3f
Sep 07 16:57:27.032039 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:27.031950    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nh4xg" event={"ID":"483bf37d-ca55-477b-a045-5d411f45a9b3","Type":"ContainerStarted","Data":"3bff01e13648220280d81469144d07d35bdce0158d30a0af17fa71cef2aecfc5"}
Sep 07 16:57:27.032039 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:27.032013    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nh4xg" event={"ID":"483bf37d-ca55-477b-a045-5d411f45a9b3","Type":"ContainerStarted","Data":"b3a18d2601cb45feb02afaf6e5d98b122b3949a61496724f54ab77411e7bf416"}
Sep 07 16:57:27.032459 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:27.032042    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nh4xg" event={"ID":"483bf37d-ca55-477b-a045-5d411f45a9b3","Type":"ContainerStarted","Data":"edc442e5a67c6cee7f25fa6e579d93814f0056f36f9c76f780d0785bf5b87c3f"}
Sep 07 16:57:28.272716 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:28.272676    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be68761b-c682-40af-af90-5816b2b5e637-metrics-certs\") pod \"network-metrics-daemon-wgp2q\" (UID: \"be68761b-c682-40af-af90-5816b2b5e637\") " pod="openshift-multus/network-metrics-daemon-wgp2q"
Sep 07 16:57:28.275681 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:28.275661    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 07 16:57:28.285019 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:28.284998    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be68761b-c682-40af-af90-5816b2b5e637-metrics-certs\") pod \"network-metrics-daemon-wgp2q\" (UID: \"be68761b-c682-40af-af90-5816b2b5e637\") " pod="openshift-multus/network-metrics-daemon-wgp2q"
Sep 07 16:57:28.373400 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:28.373349    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3475a555-fcbb-4145-bf0a-91a8d6b0099b-original-pull-secret\") pod \"global-pull-secret-syncer-tfbtz\" (UID: \"3475a555-fcbb-4145-bf0a-91a8d6b0099b\") " pod="kube-system/global-pull-secret-syncer-tfbtz"
Sep 07 16:57:28.376585 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:28.376564    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 07 16:57:28.386476 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:28.386458    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3475a555-fcbb-4145-bf0a-91a8d6b0099b-original-pull-secret\") pod \"global-pull-secret-syncer-tfbtz\" (UID: \"3475a555-fcbb-4145-bf0a-91a8d6b0099b\") " pod="kube-system/global-pull-secret-syncer-tfbtz"
Sep 07 16:57:28.474423 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:28.474334    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z9wv\" (UniqueName: \"kubernetes.io/projected/b1a3d666-c0a6-4510-a0c2-5ae3c552097b-kube-api-access-8z9wv\") pod \"network-check-target-br7j9\" (UID: \"b1a3d666-c0a6-4510-a0c2-5ae3c552097b\") " pod="openshift-network-diagnostics/network-check-target-br7j9"
Sep 07 16:57:28.476828 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:28.476800    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z9wv\" (UniqueName: \"kubernetes.io/projected/b1a3d666-c0a6-4510-a0c2-5ae3c552097b-kube-api-access-8z9wv\") pod \"network-check-target-br7j9\" (UID: \"b1a3d666-c0a6-4510-a0c2-5ae3c552097b\") " pod="openshift-network-diagnostics/network-check-target-br7j9"
Sep 07 16:57:28.515576 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:28.515553    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lxz8c\""
Sep 07 16:57:28.522147 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:28.522126    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bvnj8\""
Sep 07 16:57:28.523147 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:28.523132    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-br7j9"
Sep 07 16:57:28.527053 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:28.527035    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfbtz"
Sep 07 16:57:28.530641 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:28.530623    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgp2q"
Sep 07 16:57:28.800323 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:28.800295    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tfbtz"]
Sep 07 16:57:28.802479 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:57:28.802452    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3475a555_fcbb_4145_bf0a_91a8d6b0099b.slice/crio-5837333da8d0d7d41003947718b167f9e5cfb63aa7df80795f5273d080409909 WatchSource:0}: Error finding container 5837333da8d0d7d41003947718b167f9e5cfb63aa7df80795f5273d080409909: Status 404 returned error can't find the container with id 5837333da8d0d7d41003947718b167f9e5cfb63aa7df80795f5273d080409909
Sep 07 16:57:28.804617 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:28.804598    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-br7j9"]
Sep 07 16:57:28.807320 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:28.807295    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wgp2q"]
Sep 07 16:57:28.808068 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:57:28.808049    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1a3d666_c0a6_4510_a0c2_5ae3c552097b.slice/crio-98f1453926bd833c5891c4c3fd3b0711ca22b7652df6f9441e70594e29cfc20d WatchSource:0}: Error finding container 98f1453926bd833c5891c4c3fd3b0711ca22b7652df6f9441e70594e29cfc20d: Status 404 returned error can't find the container with id 98f1453926bd833c5891c4c3fd3b0711ca22b7652df6f9441e70594e29cfc20d
Sep 07 16:57:28.810726 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:57:28.810711    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe68761b_c682_40af_af90_5816b2b5e637.slice/crio-a3410909c696ca490fb3088fa9961f4cf30165850dc9135fbb19107346c2093f WatchSource:0}: Error finding container a3410909c696ca490fb3088fa9961f4cf30165850dc9135fbb19107346c2093f: Status 404 returned error can't find the container with id a3410909c696ca490fb3088fa9961f4cf30165850dc9135fbb19107346c2093f
Sep 07 16:57:29.043153 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:29.043117    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wgp2q" event={"ID":"be68761b-c682-40af-af90-5816b2b5e637","Type":"ContainerStarted","Data":"a3410909c696ca490fb3088fa9961f4cf30165850dc9135fbb19107346c2093f"}
Sep 07 16:57:29.044382 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:29.044357    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tfbtz" event={"ID":"3475a555-fcbb-4145-bf0a-91a8d6b0099b","Type":"ContainerStarted","Data":"5837333da8d0d7d41003947718b167f9e5cfb63aa7df80795f5273d080409909"}
Sep 07 16:57:29.045752 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:29.045733    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-br7j9" event={"ID":"b1a3d666-c0a6-4510-a0c2-5ae3c552097b","Type":"ContainerStarted","Data":"e4a8ef7ec0c91a98187df691dc76fc3e182a77584a6e2183a0d35c87e0725861"}
Sep 07 16:57:29.045851 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:29.045770    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-br7j9" event={"ID":"b1a3d666-c0a6-4510-a0c2-5ae3c552097b","Type":"ContainerStarted","Data":"98f1453926bd833c5891c4c3fd3b0711ca22b7652df6f9441e70594e29cfc20d"}
Sep 07 16:57:29.045851 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:29.045820    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-br7j9"
Sep 07 16:57:29.047692 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:29.047676    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nh4xg" event={"ID":"483bf37d-ca55-477b-a045-5d411f45a9b3","Type":"ContainerStarted","Data":"5d944fddc352e9b20b282f22a8eab5ed43ccf9d3cae84891313b8f7b7af8aeec"}
Sep 07 16:57:29.063705 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:29.063619    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-br7j9" podStartSLOduration=65.063605567 podStartE2EDuration="1m5.063605567s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:56:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:29.062427933 +0000 UTC m=+66.093858736" watchObservedRunningTime="2026-09-07 16:57:29.063605567 +0000 UTC m=+66.095036412"
Sep 07 16:57:29.282769 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:29.282729    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0fe9fce-f35b-42eb-b819-23e313bfbfea-registry-tls\") pod \"image-registry-76767cd44d-9lpwv\" (UID: \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\") " pod="openshift-image-registry/image-registry-76767cd44d-9lpwv"
Sep 07 16:57:29.285596 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:29.285571    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0fe9fce-f35b-42eb-b819-23e313bfbfea-registry-tls\") pod \"image-registry-76767cd44d-9lpwv\" (UID: \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\") " pod="openshift-image-registry/image-registry-76767cd44d-9lpwv"
Sep 07 16:57:29.383366 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:29.383324    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-service-ca-bundle\") pod \"router-default-868d865496-l5lhw\" (UID: \"fcf33d4f-f41e-4380-be30-ba07d4b8dd16\") " pod="openshift-ingress/router-default-868d865496-l5lhw"
Sep 07 16:57:29.383565 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:29.383420    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-metrics-certs\") pod \"router-default-868d865496-l5lhw\" (UID: \"fcf33d4f-f41e-4380-be30-ba07d4b8dd16\") " pod="openshift-ingress/router-default-868d865496-l5lhw"
Sep 07 16:57:29.383565 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:29.383482    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc156935-53d3-4cc8-9698-3e3cc2a1fd73-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-z6w5g\" (UID: \"fc156935-53d3-4cc8-9698-3e3cc2a1fd73\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-z6w5g"
Sep 07 16:57:29.384632 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:29.384598    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-service-ca-bundle\") pod \"router-default-868d865496-l5lhw\" (UID: \"fcf33d4f-f41e-4380-be30-ba07d4b8dd16\") " pod="openshift-ingress/router-default-868d865496-l5lhw"
Sep 07 16:57:29.386854 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:29.386822    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc156935-53d3-4cc8-9698-3e3cc2a1fd73-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-z6w5g\" (UID: \"fc156935-53d3-4cc8-9698-3e3cc2a1fd73\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-z6w5g"
Sep 07 16:57:29.386969 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:29.386919    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcf33d4f-f41e-4380-be30-ba07d4b8dd16-metrics-certs\") pod \"router-default-868d865496-l5lhw\" (UID: \"fcf33d4f-f41e-4380-be30-ba07d4b8dd16\") " pod="openshift-ingress/router-default-868d865496-l5lhw"
Sep 07 16:57:29.484213 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:29.484163    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ce4365f-988f-4113-bee7-d55fd58dbff3-metrics-tls\") pod \"dns-default-26spm\" (UID: \"5ce4365f-988f-4113-bee7-d55fd58dbff3\") " pod="openshift-dns/dns-default-26spm"
Sep 07 16:57:29.484409 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:29.484380    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96e71053-7215-446f-b880-5c7236d5ab72-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-bc6d9\" (UID: \"96e71053-7215-446f-b880-5c7236d5ab72\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bc6d9"
Sep 07 16:57:29.487228 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:29.487197    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ce4365f-988f-4113-bee7-d55fd58dbff3-metrics-tls\") pod \"dns-default-26spm\" (UID: \"5ce4365f-988f-4113-bee7-d55fd58dbff3\") " pod="openshift-dns/dns-default-26spm"
Sep 07 16:57:29.487608 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:29.487563    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96e71053-7215-446f-b880-5c7236d5ab72-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-bc6d9\" (UID: \"96e71053-7215-446f-b880-5c7236d5ab72\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bc6d9"
Sep 07 16:57:29.519492 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:29.519460    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-g564b\""
Sep 07 16:57:29.526918 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:29.526826    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76767cd44d-9lpwv"
Sep 07 16:57:29.574056 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:29.574023    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-dtsjw\""
Sep 07 16:57:29.582489 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:29.582459    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-868d865496-l5lhw"
Sep 07 16:57:29.587042 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:29.586956    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-c7m2z\""
Sep 07 16:57:29.594862 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:29.594835    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-z6w5g"
Sep 07 16:57:29.626095 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:29.626057    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-cw9q9\""
Sep 07 16:57:29.633504 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:29.633444    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bc6d9"
Sep 07 16:57:29.670470 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:29.670441    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-96tzd\""
Sep 07 16:57:29.677865 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:29.677834    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-26spm"
Sep 07 16:57:30.054375 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:30.054319    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wgp2q" event={"ID":"be68761b-c682-40af-af90-5816b2b5e637","Type":"ContainerStarted","Data":"43e47c15f426dc34c1b343a179761b153b22248641436ce9d31a98fe1434d8d8"}
Sep 07 16:57:30.061197 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:30.061150    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nh4xg" podStartSLOduration=19.057401347 podStartE2EDuration="21.061126472s" totalImagesPullingTime="2.003725125s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:57:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:29.089499594 +0000 UTC m=+66.120930384" watchObservedRunningTime="2026-09-07 16:57:30.061126472 +0000 UTC m=+67.092557263"
Sep 07 16:57:30.063938 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:30.062351    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76767cd44d-9lpwv"]
Sep 07 16:57:30.064777 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:30.064710    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-26spm"]
Sep 07 16:57:30.067016 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:57:30.066993    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0fe9fce_f35b_42eb_b819_23e313bfbfea.slice/crio-8d2069c920b7723a3f39f866028e2c84929caa3e8e97a00345249fb9cb6b0824 WatchSource:0}: Error finding container 8d2069c920b7723a3f39f866028e2c84929caa3e8e97a00345249fb9cb6b0824: Status 404 returned error can't find the container with id 8d2069c920b7723a3f39f866028e2c84929caa3e8e97a00345249fb9cb6b0824
Sep 07 16:57:30.068254 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:57:30.068214    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ce4365f_988f_4113_bee7_d55fd58dbff3.slice/crio-14d0ce35d4cc148f1a6b09a7b506e0edb285271502c8faa3469bbaec0521883c WatchSource:0}: Error finding container 14d0ce35d4cc148f1a6b09a7b506e0edb285271502c8faa3469bbaec0521883c: Status 404 returned error can't find the container with id 14d0ce35d4cc148f1a6b09a7b506e0edb285271502c8faa3469bbaec0521883c
Sep 07 16:57:30.083769 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:30.083739    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-868d865496-l5lhw"]
Sep 07 16:57:30.088535 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:57:30.088491    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcf33d4f_f41e_4380_be30_ba07d4b8dd16.slice/crio-2c02a8f7ccb168a3de285d1f91c4dad66ee69dfd72936b7abc4b2bfccce75ab1 WatchSource:0}: Error finding container 2c02a8f7ccb168a3de285d1f91c4dad66ee69dfd72936b7abc4b2bfccce75ab1: Status 404 returned error can't find the container with id 2c02a8f7ccb168a3de285d1f91c4dad66ee69dfd72936b7abc4b2bfccce75ab1
Sep 07 16:57:30.095997 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:30.095815    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-z6w5g"]
Sep 07 16:57:30.097429 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:30.097381    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bc6d9"]
Sep 07 16:57:30.339838 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:30.339766    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784995bd7d-jwq8q"]
Sep 07 16:57:30.343971 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:30.343949    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784995bd7d-jwq8q"
Sep 07 16:57:30.347655 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:30.347461    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 07 16:57:30.347655 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:30.347531    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 07 16:57:30.347655 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:30.347533    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 07 16:57:30.347655 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:30.347539    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 07 16:57:30.347944 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:30.347827    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 07 16:57:30.347944 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:30.347896    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 07 16:57:30.348897 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:30.348872    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 07 16:57:30.375339 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:30.375293    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784995bd7d-jwq8q"]
Sep 07 16:57:30.494588 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:30.494431    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a521fdf1-1375-4bc9-baa8-fd64292c1c7f-hub\") pod \"cluster-proxy-proxy-agent-784995bd7d-jwq8q\" (UID: \"a521fdf1-1375-4bc9-baa8-fd64292c1c7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784995bd7d-jwq8q"
Sep 07 16:57:30.494588 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:30.494487    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a521fdf1-1375-4bc9-baa8-fd64292c1c7f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-784995bd7d-jwq8q\" (UID: \"a521fdf1-1375-4bc9-baa8-fd64292c1c7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784995bd7d-jwq8q"
Sep 07 16:57:30.494588 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:30.494521    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whs62\" (UniqueName: \"kubernetes.io/projected/a521fdf1-1375-4bc9-baa8-fd64292c1c7f-kube-api-access-whs62\") pod \"cluster-proxy-proxy-agent-784995bd7d-jwq8q\" (UID: \"a521fdf1-1375-4bc9-baa8-fd64292c1c7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784995bd7d-jwq8q"
Sep 07 16:57:30.494588 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:30.494583    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a521fdf1-1375-4bc9-baa8-fd64292c1c7f-ca\") pod \"cluster-proxy-proxy-agent-784995bd7d-jwq8q\" (UID: \"a521fdf1-1375-4bc9-baa8-fd64292c1c7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784995bd7d-jwq8q"
Sep 07 16:57:30.495013 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:30.494613    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a521fdf1-1375-4bc9-baa8-fd64292c1c7f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-784995bd7d-jwq8q\" (UID: \"a521fdf1-1375-4bc9-baa8-fd64292c1c7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784995bd7d-jwq8q"
Sep 07 16:57:30.495013 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:30.494648    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a521fdf1-1375-4bc9-baa8-fd64292c1c7f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-784995bd7d-jwq8q\" (UID: \"a521fdf1-1375-4bc9-baa8-fd64292c1c7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784995bd7d-jwq8q"
Sep 07 16:57:30.596056 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:30.595060    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a521fdf1-1375-4bc9-baa8-fd64292c1c7f-ca\") pod \"cluster-proxy-proxy-agent-784995bd7d-jwq8q\" (UID: \"a521fdf1-1375-4bc9-baa8-fd64292c1c7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784995bd7d-jwq8q"
Sep 07 16:57:30.596056 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:30.595107    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a521fdf1-1375-4bc9-baa8-fd64292c1c7f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-784995bd7d-jwq8q\" (UID: \"a521fdf1-1375-4bc9-baa8-fd64292c1c7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784995bd7d-jwq8q"
Sep 07 16:57:30.596056 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:30.595143    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a521fdf1-1375-4bc9-baa8-fd64292c1c7f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-784995bd7d-jwq8q\" (UID: \"a521fdf1-1375-4bc9-baa8-fd64292c1c7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784995bd7d-jwq8q"
Sep 07 16:57:30.596056 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:30.595191    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a521fdf1-1375-4bc9-baa8-fd64292c1c7f-hub\") pod \"cluster-proxy-proxy-agent-784995bd7d-jwq8q\" (UID: \"a521fdf1-1375-4bc9-baa8-fd64292c1c7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784995bd7d-jwq8q"
Sep 07 16:57:30.596056 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:30.595226    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a521fdf1-1375-4bc9-baa8-fd64292c1c7f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-784995bd7d-jwq8q\" (UID: \"a521fdf1-1375-4bc9-baa8-fd64292c1c7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784995bd7d-jwq8q"
Sep 07 16:57:30.596056 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:30.595278    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whs62\" (UniqueName: \"kubernetes.io/projected/a521fdf1-1375-4bc9-baa8-fd64292c1c7f-kube-api-access-whs62\") pod \"cluster-proxy-proxy-agent-784995bd7d-jwq8q\" (UID: \"a521fdf1-1375-4bc9-baa8-fd64292c1c7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784995bd7d-jwq8q"
Sep 07 16:57:30.597029 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:30.596939    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a521fdf1-1375-4bc9-baa8-fd64292c1c7f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-784995bd7d-jwq8q\" (UID: \"a521fdf1-1375-4bc9-baa8-fd64292c1c7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784995bd7d-jwq8q"
Sep 07 16:57:30.598706 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:30.598664    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a521fdf1-1375-4bc9-baa8-fd64292c1c7f-ca\") pod \"cluster-proxy-proxy-agent-784995bd7d-jwq8q\" (UID: \"a521fdf1-1375-4bc9-baa8-fd64292c1c7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784995bd7d-jwq8q"
Sep 07 16:57:30.598853 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:30.598828    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a521fdf1-1375-4bc9-baa8-fd64292c1c7f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-784995bd7d-jwq8q\" (UID: \"a521fdf1-1375-4bc9-baa8-fd64292c1c7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784995bd7d-jwq8q"
Sep 07 16:57:30.600718 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:30.600642    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a521fdf1-1375-4bc9-baa8-fd64292c1c7f-hub\") pod \"cluster-proxy-proxy-agent-784995bd7d-jwq8q\" (UID: \"a521fdf1-1375-4bc9-baa8-fd64292c1c7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784995bd7d-jwq8q"
Sep 07 16:57:30.601136 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:30.601112    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a521fdf1-1375-4bc9-baa8-fd64292c1c7f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-784995bd7d-jwq8q\" (UID: \"a521fdf1-1375-4bc9-baa8-fd64292c1c7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784995bd7d-jwq8q"
Sep 07 16:57:30.609218 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:30.609168    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whs62\" (UniqueName: \"kubernetes.io/projected/a521fdf1-1375-4bc9-baa8-fd64292c1c7f-kube-api-access-whs62\") pod \"cluster-proxy-proxy-agent-784995bd7d-jwq8q\" (UID: \"a521fdf1-1375-4bc9-baa8-fd64292c1c7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784995bd7d-jwq8q"
Sep 07 16:57:30.667247 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:30.667211    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784995bd7d-jwq8q"
Sep 07 16:57:30.977709 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:30.977575    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784995bd7d-jwq8q"]
Sep 07 16:57:30.984139 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:57:30.983408    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda521fdf1_1375_4bc9_baa8_fd64292c1c7f.slice/crio-6abe6a5e1610f706cdcc4a13acf73061b9561ff8de994b74a792efaf219a5ce1 WatchSource:0}: Error finding container 6abe6a5e1610f706cdcc4a13acf73061b9561ff8de994b74a792efaf219a5ce1: Status 404 returned error can't find the container with id 6abe6a5e1610f706cdcc4a13acf73061b9561ff8de994b74a792efaf219a5ce1
Sep 07 16:57:31.064822 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:31.064779    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-z6w5g" event={"ID":"fc156935-53d3-4cc8-9698-3e3cc2a1fd73","Type":"ContainerStarted","Data":"d9782d77357434314c8800b607071d1f08ae816cac13502c3456cd8ccc64bc99"}
Sep 07 16:57:31.068448 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:31.068414    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76767cd44d-9lpwv" event={"ID":"b0fe9fce-f35b-42eb-b819-23e313bfbfea","Type":"ContainerStarted","Data":"d4732b525e31ec70bf6bbbd17e97143e4b4c0c1035138a883523ee9a837e9dde"}
Sep 07 16:57:31.068596 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:31.068471    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76767cd44d-9lpwv" event={"ID":"b0fe9fce-f35b-42eb-b819-23e313bfbfea","Type":"ContainerStarted","Data":"8d2069c920b7723a3f39f866028e2c84929caa3e8e97a00345249fb9cb6b0824"}
Sep 07 16:57:31.069310 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:31.069289    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-76767cd44d-9lpwv"
Sep 07 16:57:31.072363 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:31.072338    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-26spm" event={"ID":"5ce4365f-988f-4113-bee7-d55fd58dbff3","Type":"ContainerStarted","Data":"14d0ce35d4cc148f1a6b09a7b506e0edb285271502c8faa3469bbaec0521883c"}
Sep 07 16:57:31.074140 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:31.074100    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784995bd7d-jwq8q" event={"ID":"a521fdf1-1375-4bc9-baa8-fd64292c1c7f","Type":"ContainerStarted","Data":"6abe6a5e1610f706cdcc4a13acf73061b9561ff8de994b74a792efaf219a5ce1"}
Sep 07 16:57:31.075913 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:31.075847    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bc6d9" event={"ID":"96e71053-7215-446f-b880-5c7236d5ab72","Type":"ContainerStarted","Data":"dbbd420ecb67e0a10a7e1c41ea209bde1c1eb093be40454fef0964a3b793ce83"}
Sep 07 16:57:31.077885 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:31.077813    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-868d865496-l5lhw" event={"ID":"fcf33d4f-f41e-4380-be30-ba07d4b8dd16","Type":"ContainerStarted","Data":"8a002c52e1f6b1398f43413bb85b0dd54501233a1f06fd319bec7e42df964612"}
Sep 07 16:57:31.077885 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:31.077853    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-868d865496-l5lhw" event={"ID":"fcf33d4f-f41e-4380-be30-ba07d4b8dd16","Type":"ContainerStarted","Data":"2c02a8f7ccb168a3de285d1f91c4dad66ee69dfd72936b7abc4b2bfccce75ab1"}
Sep 07 16:57:31.082225 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:31.081711    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wgp2q" event={"ID":"be68761b-c682-40af-af90-5816b2b5e637","Type":"ContainerStarted","Data":"c49f64f82d31d3992edf5f0983d86b97662a3ede50ad36a7497460d496bdeaa5"}
Sep 07 16:57:31.094915 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:31.094389    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-76767cd44d-9lpwv" podStartSLOduration=67.094370613 podStartE2EDuration="1m7.094370613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:56:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:31.092101881 +0000 UTC m=+68.123532676" watchObservedRunningTime="2026-09-07 16:57:31.094370613 +0000 UTC m=+68.125801408"
Sep 07 16:57:31.117267 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:31.116695    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wgp2q" podStartSLOduration=67.15777203 podStartE2EDuration="1m8.116544614s" totalImagesPullingTime="958.772584ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:56:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:31.115299354 +0000 UTC m=+68.146730147" watchObservedRunningTime="2026-09-07 16:57:31.116544614 +0000 UTC m=+68.147975409"
Sep 07 16:57:31.149896 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:31.148949    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-868d865496-l5lhw" podStartSLOduration=42.148925141 podStartE2EDuration="42.148925141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:56:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:31.148604055 +0000 UTC m=+68.180034849" watchObservedRunningTime="2026-09-07 16:57:31.148925141 +0000 UTC m=+68.180355930"
Sep 07 16:57:31.585209 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:31.583808    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-868d865496-l5lhw"
Sep 07 16:57:31.588582 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:31.587513    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-868d865496-l5lhw"
Sep 07 16:57:32.088042 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:32.088009    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-868d865496-l5lhw"
Sep 07 16:57:32.089560 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:32.089533    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-868d865496-l5lhw"
Sep 07 16:57:33.591254 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:33.590422    2558 scope.go:117] "RemoveContainer" containerID="882b18884aba1f257be1ba431bc1c25cf77f8bc59ff36c5abb60b6b7465aa471"
Sep 07 16:57:38.115677 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:38.115633    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tfbtz" event={"ID":"3475a555-fcbb-4145-bf0a-91a8d6b0099b","Type":"ContainerStarted","Data":"cd5ac0d70ede9df3e5fc27174c5608847d5101a893f7449ba87e3802fab88624"}
Sep 07 16:57:38.117379 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:38.117354    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-z6w5g" event={"ID":"fc156935-53d3-4cc8-9698-3e3cc2a1fd73","Type":"ContainerStarted","Data":"125ef9ed815ffa069352131accd3ddf810069ea6759f8cef74caa23de16d7548"}
Sep 07 16:57:38.117492 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:38.117400    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-z6w5g" event={"ID":"fc156935-53d3-4cc8-9698-3e3cc2a1fd73","Type":"ContainerStarted","Data":"be901ac723a00302adcc9d0beeac3b96b22ff6137180abf07b5d022eb02ed180"}
Sep 07 16:57:38.119270 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:38.119229    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-26spm" event={"ID":"5ce4365f-988f-4113-bee7-d55fd58dbff3","Type":"ContainerStarted","Data":"2f3e8d92643650229562be8a8b0202642c968ee95ddaa30781ce9af45e6f2caf"}
Sep 07 16:57:38.119370 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:38.119291    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-26spm" event={"ID":"5ce4365f-988f-4113-bee7-d55fd58dbff3","Type":"ContainerStarted","Data":"52c9f804af0b8e68113331d1562707e07e5eed372c866b016054a16960b6fb81"}
Sep 07 16:57:38.119370 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:38.119321    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-26spm"
Sep 07 16:57:38.121489 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:38.121469    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784995bd7d-jwq8q" event={"ID":"a521fdf1-1375-4bc9-baa8-fd64292c1c7f","Type":"ContainerStarted","Data":"4f501b6b68f1579c272f0ff5ad05d5247d3c423a7552204c3a38ad9af525f807"}
Sep 07 16:57:38.121584 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:38.121502    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784995bd7d-jwq8q" event={"ID":"a521fdf1-1375-4bc9-baa8-fd64292c1c7f","Type":"ContainerStarted","Data":"63bd113a39c27c9dfd1c44bea75a57a4599e99f5218a09d003fadc38cbcb704f"}
Sep 07 16:57:38.121584 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:38.121519    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784995bd7d-jwq8q" event={"ID":"a521fdf1-1375-4bc9-baa8-fd64292c1c7f","Type":"ContainerStarted","Data":"dd12052415a3051136df696136f5fe08f238a2fdb65468bcecc06f9abf47484d"}
Sep 07 16:57:38.123388 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:38.123372    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-f6srd_24750b4e-c0bc-4c3c-a256-6ca251306d06/console-operator/1.log"
Sep 07 16:57:38.123464 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:38.123452    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-f6srd" event={"ID":"24750b4e-c0bc-4c3c-a256-6ca251306d06","Type":"ContainerStarted","Data":"6b135b4bfc89af37bdd8163f47b0477889686699cf665208a8b07076c1d5ad86"}
Sep 07 16:57:38.123690 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:38.123673    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-f6srd"
Sep 07 16:57:38.125166 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:38.125147    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bc6d9" event={"ID":"96e71053-7215-446f-b880-5c7236d5ab72","Type":"ContainerStarted","Data":"3c2b5086c1e79dc0e4d544159591dd11aaeaf1d2c6f64dac2c63af64796baeea"}
Sep 07 16:57:38.128908 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:38.128889    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-f6srd"
Sep 07 16:57:38.170485 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:38.170429    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tfbtz" podStartSLOduration=65.719649943 podStartE2EDuration="1m14.170406891s" totalImagesPullingTime="8.450756948s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:56:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:38.137808265 +0000 UTC m=+75.169239057" watchObservedRunningTime="2026-09-07 16:57:38.170406891 +0000 UTC m=+75.201837678"
Sep 07 16:57:38.170894 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:38.170856    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-z6w5g" podStartSLOduration=42.06319342 podStartE2EDuration="49.170844747s" totalImagesPullingTime="7.107651327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:56:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:38.170393551 +0000 UTC m=+75.201824345" watchObservedRunningTime="2026-09-07 16:57:38.170844747 +0000 UTC m=+75.202275537"
Sep 07 16:57:38.211937 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:38.211848    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bc6d9" podStartSLOduration=42.070943962 podStartE2EDuration="49.211832691s" totalImagesPullingTime="7.140888729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:56:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:38.211488081 +0000 UTC m=+75.242918871" watchObservedRunningTime="2026-09-07 16:57:38.211832691 +0000 UTC m=+75.243263482"
Sep 07 16:57:38.249491 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:38.249443    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784995bd7d-jwq8q" podStartSLOduration=1.558764735 podStartE2EDuration="8.249426601s" totalImagesPullingTime="6.690661866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:57:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:38.24770218 +0000 UTC m=+75.279132972" watchObservedRunningTime="2026-09-07 16:57:38.249426601 +0000 UTC m=+75.280857392"
Sep 07 16:57:38.291273 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:38.291201    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-26spm" podStartSLOduration=34.11039801 podStartE2EDuration="41.291186737s" totalImagesPullingTime="7.180788727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:56:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:38.289346269 +0000 UTC m=+75.320777061" watchObservedRunningTime="2026-09-07 16:57:38.291186737 +0000 UTC m=+75.322617525"
Sep 07 16:57:38.323528 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:38.319745    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-f6srd" podStartSLOduration=40.014583477 podStartE2EDuration="49.319717139s" totalImagesPullingTime="9.305133662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:56:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:38.318570488 +0000 UTC m=+75.350001283" watchObservedRunningTime="2026-09-07 16:57:38.319717139 +0000 UTC m=+75.351147931"
Sep 07 16:57:47.818206 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:47.818096    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kw2pf"]
Sep 07 16:57:47.821052 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:47.821032    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kw2pf"
Sep 07 16:57:47.826800 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:47.826778    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 07 16:57:47.826906 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:47.826853    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 07 16:57:47.827938 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:47.827786    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 07 16:57:47.831018 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:47.830997    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 07 16:57:47.831126 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:47.831047    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ghqrn\""
Sep 07 16:57:47.937584 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:47.937551    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eeade69a-8b74-4e5d-b851-9f36d7af50f5-metrics-client-ca\") pod \"node-exporter-kw2pf\" (UID: \"eeade69a-8b74-4e5d-b851-9f36d7af50f5\") " pod="openshift-monitoring/node-exporter-kw2pf"
Sep 07 16:57:47.937584 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:47.937584    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eeade69a-8b74-4e5d-b851-9f36d7af50f5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kw2pf\" (UID: \"eeade69a-8b74-4e5d-b851-9f36d7af50f5\") " pod="openshift-monitoring/node-exporter-kw2pf"
Sep 07 16:57:47.937822 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:47.937614    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/eeade69a-8b74-4e5d-b851-9f36d7af50f5-root\") pod \"node-exporter-kw2pf\" (UID: \"eeade69a-8b74-4e5d-b851-9f36d7af50f5\") " pod="openshift-monitoring/node-exporter-kw2pf"
Sep 07 16:57:47.937822 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:47.937628    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/eeade69a-8b74-4e5d-b851-9f36d7af50f5-node-exporter-accelerators-collector-config\") pod \"node-exporter-kw2pf\" (UID: \"eeade69a-8b74-4e5d-b851-9f36d7af50f5\") " pod="openshift-monitoring/node-exporter-kw2pf"
Sep 07 16:57:47.937822 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:47.937676    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eeade69a-8b74-4e5d-b851-9f36d7af50f5-sys\") pod \"node-exporter-kw2pf\" (UID: \"eeade69a-8b74-4e5d-b851-9f36d7af50f5\") " pod="openshift-monitoring/node-exporter-kw2pf"
Sep 07 16:57:47.937822 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:47.937704    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/eeade69a-8b74-4e5d-b851-9f36d7af50f5-node-exporter-textfile\") pod \"node-exporter-kw2pf\" (UID: \"eeade69a-8b74-4e5d-b851-9f36d7af50f5\") " pod="openshift-monitoring/node-exporter-kw2pf"
Sep 07 16:57:47.937822 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:47.937727    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnxsv\" (UniqueName: \"kubernetes.io/projected/eeade69a-8b74-4e5d-b851-9f36d7af50f5-kube-api-access-wnxsv\") pod \"node-exporter-kw2pf\" (UID: \"eeade69a-8b74-4e5d-b851-9f36d7af50f5\") " pod="openshift-monitoring/node-exporter-kw2pf"
Sep 07 16:57:47.937822 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:47.937768    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/eeade69a-8b74-4e5d-b851-9f36d7af50f5-node-exporter-wtmp\") pod \"node-exporter-kw2pf\" (UID: \"eeade69a-8b74-4e5d-b851-9f36d7af50f5\") " pod="openshift-monitoring/node-exporter-kw2pf"
Sep 07 16:57:47.937822 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:47.937816    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eeade69a-8b74-4e5d-b851-9f36d7af50f5-node-exporter-tls\") pod \"node-exporter-kw2pf\" (UID: \"eeade69a-8b74-4e5d-b851-9f36d7af50f5\") " pod="openshift-monitoring/node-exporter-kw2pf"
Sep 07 16:57:48.038750 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:48.038713    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/eeade69a-8b74-4e5d-b851-9f36d7af50f5-root\") pod \"node-exporter-kw2pf\" (UID: \"eeade69a-8b74-4e5d-b851-9f36d7af50f5\") " pod="openshift-monitoring/node-exporter-kw2pf"
Sep 07 16:57:48.038750 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:48.038748    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/eeade69a-8b74-4e5d-b851-9f36d7af50f5-node-exporter-accelerators-collector-config\") pod \"node-exporter-kw2pf\" (UID: \"eeade69a-8b74-4e5d-b851-9f36d7af50f5\") " pod="openshift-monitoring/node-exporter-kw2pf"
Sep 07 16:57:48.038985 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:48.038767    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eeade69a-8b74-4e5d-b851-9f36d7af50f5-sys\") pod \"node-exporter-kw2pf\" (UID: \"eeade69a-8b74-4e5d-b851-9f36d7af50f5\") " pod="openshift-monitoring/node-exporter-kw2pf"
Sep 07 16:57:48.038985 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:48.038785    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/eeade69a-8b74-4e5d-b851-9f36d7af50f5-node-exporter-textfile\") pod \"node-exporter-kw2pf\" (UID: \"eeade69a-8b74-4e5d-b851-9f36d7af50f5\") " pod="openshift-monitoring/node-exporter-kw2pf"
Sep 07 16:57:48.038985 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:48.038805    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnxsv\" (UniqueName: \"kubernetes.io/projected/eeade69a-8b74-4e5d-b851-9f36d7af50f5-kube-api-access-wnxsv\") pod \"node-exporter-kw2pf\" (UID: \"eeade69a-8b74-4e5d-b851-9f36d7af50f5\") " pod="openshift-monitoring/node-exporter-kw2pf"
Sep 07 16:57:48.038985 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:48.038846    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/eeade69a-8b74-4e5d-b851-9f36d7af50f5-root\") pod \"node-exporter-kw2pf\" (UID: \"eeade69a-8b74-4e5d-b851-9f36d7af50f5\") " pod="openshift-monitoring/node-exporter-kw2pf"
Sep 07 16:57:48.038985 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:48.038876    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/eeade69a-8b74-4e5d-b851-9f36d7af50f5-node-exporter-wtmp\") pod \"node-exporter-kw2pf\" (UID: \"eeade69a-8b74-4e5d-b851-9f36d7af50f5\") " pod="openshift-monitoring/node-exporter-kw2pf"
Sep 07 16:57:48.038985 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:48.038906    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eeade69a-8b74-4e5d-b851-9f36d7af50f5-node-exporter-tls\") pod \"node-exporter-kw2pf\" (UID: \"eeade69a-8b74-4e5d-b851-9f36d7af50f5\") " pod="openshift-monitoring/node-exporter-kw2pf"
Sep 07 16:57:48.038985 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:48.038854    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eeade69a-8b74-4e5d-b851-9f36d7af50f5-sys\") pod \"node-exporter-kw2pf\" (UID: \"eeade69a-8b74-4e5d-b851-9f36d7af50f5\") " pod="openshift-monitoring/node-exporter-kw2pf"
Sep 07 16:57:48.038985 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:48.038983    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eeade69a-8b74-4e5d-b851-9f36d7af50f5-metrics-client-ca\") pod \"node-exporter-kw2pf\" (UID: \"eeade69a-8b74-4e5d-b851-9f36d7af50f5\") " pod="openshift-monitoring/node-exporter-kw2pf"
Sep 07 16:57:48.039349 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:48.039006    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eeade69a-8b74-4e5d-b851-9f36d7af50f5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kw2pf\" (UID: \"eeade69a-8b74-4e5d-b851-9f36d7af50f5\") " pod="openshift-monitoring/node-exporter-kw2pf"
Sep 07 16:57:48.039349 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:48.039011    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/eeade69a-8b74-4e5d-b851-9f36d7af50f5-node-exporter-wtmp\") pod \"node-exporter-kw2pf\" (UID: \"eeade69a-8b74-4e5d-b851-9f36d7af50f5\") " pod="openshift-monitoring/node-exporter-kw2pf"
Sep 07 16:57:48.039349 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:48.039175    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/eeade69a-8b74-4e5d-b851-9f36d7af50f5-node-exporter-textfile\") pod \"node-exporter-kw2pf\" (UID: \"eeade69a-8b74-4e5d-b851-9f36d7af50f5\") " pod="openshift-monitoring/node-exporter-kw2pf"
Sep 07 16:57:48.039447 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:48.039395    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/eeade69a-8b74-4e5d-b851-9f36d7af50f5-node-exporter-accelerators-collector-config\") pod \"node-exporter-kw2pf\" (UID: \"eeade69a-8b74-4e5d-b851-9f36d7af50f5\") " pod="openshift-monitoring/node-exporter-kw2pf"
Sep 07 16:57:48.044056 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:48.040119    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eeade69a-8b74-4e5d-b851-9f36d7af50f5-metrics-client-ca\") pod \"node-exporter-kw2pf\" (UID: \"eeade69a-8b74-4e5d-b851-9f36d7af50f5\") " pod="openshift-monitoring/node-exporter-kw2pf"
Sep 07 16:57:48.044754 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:48.044726    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eeade69a-8b74-4e5d-b851-9f36d7af50f5-node-exporter-tls\") pod \"node-exporter-kw2pf\" (UID: \"eeade69a-8b74-4e5d-b851-9f36d7af50f5\") " pod="openshift-monitoring/node-exporter-kw2pf"
Sep 07 16:57:48.045954 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:48.045934    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eeade69a-8b74-4e5d-b851-9f36d7af50f5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kw2pf\" (UID: \"eeade69a-8b74-4e5d-b851-9f36d7af50f5\") " pod="openshift-monitoring/node-exporter-kw2pf"
Sep 07 16:57:48.052558 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:48.052531    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnxsv\" (UniqueName: \"kubernetes.io/projected/eeade69a-8b74-4e5d-b851-9f36d7af50f5-kube-api-access-wnxsv\") pod \"node-exporter-kw2pf\" (UID: \"eeade69a-8b74-4e5d-b851-9f36d7af50f5\") " pod="openshift-monitoring/node-exporter-kw2pf"
Sep 07 16:57:48.130369 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:48.130345    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kw2pf"
Sep 07 16:57:48.133301 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:48.133276    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-26spm"
Sep 07 16:57:48.140370 ip-10-0-131-84 kubenswrapper[2558]: W0907 16:57:48.140345    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeade69a_8b74_4e5d_b851_9f36d7af50f5.slice/crio-fed061f00cca105fa98e6358a9076abb1c3d30ce4278b3171d39dbe11fac8f66 WatchSource:0}: Error finding container fed061f00cca105fa98e6358a9076abb1c3d30ce4278b3171d39dbe11fac8f66: Status 404 returned error can't find the container with id fed061f00cca105fa98e6358a9076abb1c3d30ce4278b3171d39dbe11fac8f66
Sep 07 16:57:48.165015 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:48.164986    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kw2pf" event={"ID":"eeade69a-8b74-4e5d-b851-9f36d7af50f5","Type":"ContainerStarted","Data":"fed061f00cca105fa98e6358a9076abb1c3d30ce4278b3171d39dbe11fac8f66"}
Sep 07 16:57:49.170479 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:49.170439    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kw2pf" event={"ID":"eeade69a-8b74-4e5d-b851-9f36d7af50f5","Type":"ContainerStarted","Data":"6559158c50e577ced6ac9cf09e49e763b5d86a85c86e2c90eb47688028fb5eeb"}
Sep 07 16:57:50.175387 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:50.175354    2558 generic.go:356] "Generic (PLEG): container finished" podID="eeade69a-8b74-4e5d-b851-9f36d7af50f5" containerID="6559158c50e577ced6ac9cf09e49e763b5d86a85c86e2c90eb47688028fb5eeb" exitCode=0
Sep 07 16:57:50.175758 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:50.175447    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kw2pf" event={"ID":"eeade69a-8b74-4e5d-b851-9f36d7af50f5","Type":"ContainerDied","Data":"6559158c50e577ced6ac9cf09e49e763b5d86a85c86e2c90eb47688028fb5eeb"}
Sep 07 16:57:51.181892 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:51.181854    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kw2pf" event={"ID":"eeade69a-8b74-4e5d-b851-9f36d7af50f5","Type":"ContainerStarted","Data":"22e232d3bbbf84360dbea80b6433940cafe750d60ee1c7e7f9e60df825e52f29"}
Sep 07 16:57:51.182314 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:51.181924    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kw2pf" event={"ID":"eeade69a-8b74-4e5d-b851-9f36d7af50f5","Type":"ContainerStarted","Data":"f088b28dd06518a62b009a39cff9c22b5a6072cb8c29cd9236cb38d75b00c9ef"}
Sep 07 16:57:51.233859 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:51.233812    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kw2pf" podStartSLOduration=3.233978251 podStartE2EDuration="4.233793627s" totalImagesPullingTime="934.646567ms" totalInitContainerRuntime="65.168809ms" isStatefulPod=true podCreationTimestamp="2026-09-07 16:57:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:57:51.233182798 +0000 UTC m=+88.264613588" watchObservedRunningTime="2026-09-07 16:57:51.233793627 +0000 UTC m=+88.265224418"
Sep 07 16:57:52.320544 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:52.320501    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76767cd44d-9lpwv"]
Sep 07 16:57:52.326074 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:57:52.326049    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-76767cd44d-9lpwv"
Sep 07 16:58:00.057043 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:00.057007    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-br7j9"
Sep 07 16:58:17.341075 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:17.341026    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-76767cd44d-9lpwv" podUID="b0fe9fce-f35b-42eb-b819-23e313bfbfea" containerName="registry" containerID="cri-o://d4732b525e31ec70bf6bbbd17e97143e4b4c0c1035138a883523ee9a837e9dde" gracePeriod=30
Sep 07 16:58:17.583851 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:17.583820    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76767cd44d-9lpwv"
Sep 07 16:58:17.733909 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:17.733864    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b0fe9fce-f35b-42eb-b819-23e313bfbfea-ca-trust-extracted\") pod \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\" (UID: \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\") "
Sep 07 16:58:17.733909 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:17.733912    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqkw7\" (UniqueName: \"kubernetes.io/projected/b0fe9fce-f35b-42eb-b819-23e313bfbfea-kube-api-access-hqkw7\") pod \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\" (UID: \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\") "
Sep 07 16:58:17.734158 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:17.733938    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0fe9fce-f35b-42eb-b819-23e313bfbfea-bound-sa-token\") pod \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\" (UID: \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\") "
Sep 07 16:58:17.734158 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:17.733958    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b0fe9fce-f35b-42eb-b819-23e313bfbfea-trusted-ca\") pod \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\" (UID: \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\") "
Sep 07 16:58:17.734158 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:17.733978    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b0fe9fce-f35b-42eb-b819-23e313bfbfea-image-registry-private-configuration\") pod \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\" (UID: \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\") "
Sep 07 16:58:17.734158 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:17.733999    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b0fe9fce-f35b-42eb-b819-23e313bfbfea-registry-certificates\") pod \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\" (UID: \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\") "
Sep 07 16:58:17.734158 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:17.734079    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0fe9fce-f35b-42eb-b819-23e313bfbfea-registry-tls\") pod \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\" (UID: \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\") "
Sep 07 16:58:17.734158 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:17.734142    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b0fe9fce-f35b-42eb-b819-23e313bfbfea-installation-pull-secrets\") pod \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\" (UID: \"b0fe9fce-f35b-42eb-b819-23e313bfbfea\") "
Sep 07 16:58:17.734557 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:17.734505    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0fe9fce-f35b-42eb-b819-23e313bfbfea-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b0fe9fce-f35b-42eb-b819-23e313bfbfea" (UID: "b0fe9fce-f35b-42eb-b819-23e313bfbfea"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 16:58:17.734557 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:17.734541    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0fe9fce-f35b-42eb-b819-23e313bfbfea-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b0fe9fce-f35b-42eb-b819-23e313bfbfea" (UID: "b0fe9fce-f35b-42eb-b819-23e313bfbfea"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 16:58:17.736583 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:17.736546    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0fe9fce-f35b-42eb-b819-23e313bfbfea-kube-api-access-hqkw7" (OuterVolumeSpecName: "kube-api-access-hqkw7") pod "b0fe9fce-f35b-42eb-b819-23e313bfbfea" (UID: "b0fe9fce-f35b-42eb-b819-23e313bfbfea"). InnerVolumeSpecName "kube-api-access-hqkw7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 16:58:17.736747 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:17.736724    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0fe9fce-f35b-42eb-b819-23e313bfbfea-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b0fe9fce-f35b-42eb-b819-23e313bfbfea" (UID: "b0fe9fce-f35b-42eb-b819-23e313bfbfea"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 16:58:17.736807 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:17.736750    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0fe9fce-f35b-42eb-b819-23e313bfbfea-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b0fe9fce-f35b-42eb-b819-23e313bfbfea" (UID: "b0fe9fce-f35b-42eb-b819-23e313bfbfea"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 16:58:17.736851 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:17.736826    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0fe9fce-f35b-42eb-b819-23e313bfbfea-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b0fe9fce-f35b-42eb-b819-23e313bfbfea" (UID: "b0fe9fce-f35b-42eb-b819-23e313bfbfea"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 16:58:17.736900 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:17.736881    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0fe9fce-f35b-42eb-b819-23e313bfbfea-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b0fe9fce-f35b-42eb-b819-23e313bfbfea" (UID: "b0fe9fce-f35b-42eb-b819-23e313bfbfea"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 16:58:17.744754 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:17.744729    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0fe9fce-f35b-42eb-b819-23e313bfbfea-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b0fe9fce-f35b-42eb-b819-23e313bfbfea" (UID: "b0fe9fce-f35b-42eb-b819-23e313bfbfea"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 16:58:17.835435 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:17.835398    2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b0fe9fce-f35b-42eb-b819-23e313bfbfea-ca-trust-extracted\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 16:58:17.835435 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:17.835428    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqkw7\" (UniqueName: \"kubernetes.io/projected/b0fe9fce-f35b-42eb-b819-23e313bfbfea-kube-api-access-hqkw7\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 16:58:17.835435 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:17.835439    2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0fe9fce-f35b-42eb-b819-23e313bfbfea-bound-sa-token\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 16:58:17.835675 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:17.835447    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b0fe9fce-f35b-42eb-b819-23e313bfbfea-trusted-ca\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 16:58:17.835675 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:17.835457    2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b0fe9fce-f35b-42eb-b819-23e313bfbfea-image-registry-private-configuration\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 16:58:17.835675 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:17.835465    2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b0fe9fce-f35b-42eb-b819-23e313bfbfea-registry-certificates\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 16:58:17.835675 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:17.835473    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0fe9fce-f35b-42eb-b819-23e313bfbfea-registry-tls\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 16:58:17.835675 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:17.835482    2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b0fe9fce-f35b-42eb-b819-23e313bfbfea-installation-pull-secrets\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 16:58:18.286999 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:18.286963    2558 generic.go:356] "Generic (PLEG): container finished" podID="b0fe9fce-f35b-42eb-b819-23e313bfbfea" containerID="d4732b525e31ec70bf6bbbd17e97143e4b4c0c1035138a883523ee9a837e9dde" exitCode=0
Sep 07 16:58:18.287157 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:18.287009    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76767cd44d-9lpwv"
Sep 07 16:58:18.287157 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:18.287042    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76767cd44d-9lpwv" event={"ID":"b0fe9fce-f35b-42eb-b819-23e313bfbfea","Type":"ContainerDied","Data":"d4732b525e31ec70bf6bbbd17e97143e4b4c0c1035138a883523ee9a837e9dde"}
Sep 07 16:58:18.287157 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:18.287090    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76767cd44d-9lpwv" event={"ID":"b0fe9fce-f35b-42eb-b819-23e313bfbfea","Type":"ContainerDied","Data":"8d2069c920b7723a3f39f866028e2c84929caa3e8e97a00345249fb9cb6b0824"}
Sep 07 16:58:18.287157 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:18.287110    2558 scope.go:117] "RemoveContainer" containerID="d4732b525e31ec70bf6bbbd17e97143e4b4c0c1035138a883523ee9a837e9dde"
Sep 07 16:58:18.289074 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:18.289047    2558 generic.go:356] "Generic (PLEG): container finished" podID="37c768a7-bec4-47dd-870e-1a7686e4b268" containerID="36c63ef6fc7b34ce5b5cc457928301451c49e9134fb238510806c73831164174" exitCode=0
Sep 07 16:58:18.289198 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:18.289120    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-n42x6" event={"ID":"37c768a7-bec4-47dd-870e-1a7686e4b268","Type":"ContainerDied","Data":"36c63ef6fc7b34ce5b5cc457928301451c49e9134fb238510806c73831164174"}
Sep 07 16:58:18.289429 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:18.289412    2558 scope.go:117] "RemoveContainer" containerID="36c63ef6fc7b34ce5b5cc457928301451c49e9134fb238510806c73831164174"
Sep 07 16:58:18.298704 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:18.298684    2558 scope.go:117] "RemoveContainer" containerID="d4732b525e31ec70bf6bbbd17e97143e4b4c0c1035138a883523ee9a837e9dde"
Sep 07 16:58:18.298948 ip-10-0-131-84 kubenswrapper[2558]: E0907 16:58:18.298927    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4732b525e31ec70bf6bbbd17e97143e4b4c0c1035138a883523ee9a837e9dde\": container with ID starting with d4732b525e31ec70bf6bbbd17e97143e4b4c0c1035138a883523ee9a837e9dde not found: ID does not exist" containerID="d4732b525e31ec70bf6bbbd17e97143e4b4c0c1035138a883523ee9a837e9dde"
Sep 07 16:58:18.299017 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:18.298960    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4732b525e31ec70bf6bbbd17e97143e4b4c0c1035138a883523ee9a837e9dde"} err="failed to get container status \"d4732b525e31ec70bf6bbbd17e97143e4b4c0c1035138a883523ee9a837e9dde\": rpc error: code = NotFound desc = could not find container \"d4732b525e31ec70bf6bbbd17e97143e4b4c0c1035138a883523ee9a837e9dde\": container with ID starting with d4732b525e31ec70bf6bbbd17e97143e4b4c0c1035138a883523ee9a837e9dde not found: ID does not exist"
Sep 07 16:58:18.339268 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:18.338296    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76767cd44d-9lpwv"]
Sep 07 16:58:18.351930 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:18.351883    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-76767cd44d-9lpwv"]
Sep 07 16:58:19.294656 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:19.294626    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-n42x6" event={"ID":"37c768a7-bec4-47dd-870e-1a7686e4b268","Type":"ContainerStarted","Data":"9068ac51473d7fa7f0617b4e9657a4b9674020e1c112a08ea824c1f0224c3e43"}
Sep 07 16:58:19.592391 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:19.592313    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0fe9fce-f35b-42eb-b819-23e313bfbfea" path="/var/lib/kubelet/pods/b0fe9fce-f35b-42eb-b819-23e313bfbfea/volumes"
Sep 07 16:58:33.347301 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:33.347264    2558 generic.go:356] "Generic (PLEG): container finished" podID="231f4bfa-55eb-4533-a0b0-f6d845f5fe0f" containerID="3b4fd2ee7f29e3b2955a3a9293945de35a4e35f4a12141bc236c2448ff7cd6b5" exitCode=0
Sep 07 16:58:33.347705 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:33.347336    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-r987z" event={"ID":"231f4bfa-55eb-4533-a0b0-f6d845f5fe0f","Type":"ContainerDied","Data":"3b4fd2ee7f29e3b2955a3a9293945de35a4e35f4a12141bc236c2448ff7cd6b5"}
Sep 07 16:58:33.347705 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:33.347641    2558 scope.go:117] "RemoveContainer" containerID="3b4fd2ee7f29e3b2955a3a9293945de35a4e35f4a12141bc236c2448ff7cd6b5"
Sep 07 16:58:34.352799 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:34.352765    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-r987z" event={"ID":"231f4bfa-55eb-4533-a0b0-f6d845f5fe0f","Type":"ContainerStarted","Data":"428fdb372b3abfaacf800ce21ae097fb4b5ab47d810ae2bf1fb215caf5afc7cc"}
Sep 07 16:58:39.375134 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:39.375100    2558 generic.go:356] "Generic (PLEG): container finished" podID="3dc65911-abc9-4e9c-95ee-3f766159f1c3" containerID="1dd39136f9a88af2898a202d3ed8521758da55aaf949d878299066113cfeabc4" exitCode=0
Sep 07 16:58:39.375529 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:39.375150    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-fkmqj" event={"ID":"3dc65911-abc9-4e9c-95ee-3f766159f1c3","Type":"ContainerDied","Data":"1dd39136f9a88af2898a202d3ed8521758da55aaf949d878299066113cfeabc4"}
Sep 07 16:58:39.375529 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:39.375501    2558 scope.go:117] "RemoveContainer" containerID="1dd39136f9a88af2898a202d3ed8521758da55aaf949d878299066113cfeabc4"
Sep 07 16:58:40.380729 ip-10-0-131-84 kubenswrapper[2558]: I0907 16:58:40.380695    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-fkmqj" event={"ID":"3dc65911-abc9-4e9c-95ee-3f766159f1c3","Type":"ContainerStarted","Data":"c18f669fd529915b7d335baefc1a4a5fa2880634dafed2884139b0ac0a5cc5ad"}
Sep 07 17:01:23.524682 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:23.524650    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-f6srd_24750b4e-c0bc-4c3c-a256-6ca251306d06/console-operator/1.log"
Sep 07 17:01:23.529337 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:23.529315    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-f6srd_24750b4e-c0bc-4c3c-a256-6ca251306d06/console-operator/1.log"
Sep 07 17:01:23.532676 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:23.532655    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwj7s_9b97dbca-7e8f-4e05-9cc4-8f42785f01e7/ovn-acl-logging/0.log"
Sep 07 17:01:23.536571 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:23.536550    2558 kubelet.go:1648] "Image garbage collection succeeded"
Sep 07 17:01:23.538076 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:23.538055    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwj7s_9b97dbca-7e8f-4e05-9cc4-8f42785f01e7/ovn-acl-logging/0.log"
Sep 07 17:01:27.979811 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:27.979777    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-ddqvr"]
Sep 07 17:01:27.982089 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:27.980045    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0fe9fce-f35b-42eb-b819-23e313bfbfea" containerName="registry"
Sep 07 17:01:27.982089 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:27.980058    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0fe9fce-f35b-42eb-b819-23e313bfbfea" containerName="registry"
Sep 07 17:01:27.982089 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:27.980114    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0fe9fce-f35b-42eb-b819-23e313bfbfea" containerName="registry"
Sep 07 17:01:27.983055 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:27.983040    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-ddqvr"
Sep 07 17:01:27.987201 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:27.987179    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 07 17:01:27.987367 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:27.987350    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lcg49\""
Sep 07 17:01:27.987475 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:27.987433    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 07 17:01:27.987574 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:27.987557    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 07 17:01:27.988023 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:27.988007    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 07 17:01:28.029576 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:28.029546    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-ddqvr"]
Sep 07 17:01:28.066507 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:28.066476    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93400a1d-edf8-4e7b-8dd6-e7947111f6ce-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-ddqvr\" (UID: \"93400a1d-edf8-4e7b-8dd6-e7947111f6ce\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-ddqvr"
Sep 07 17:01:28.066637 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:28.066519    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/93400a1d-edf8-4e7b-8dd6-e7947111f6ce-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-ddqvr\" (UID: \"93400a1d-edf8-4e7b-8dd6-e7947111f6ce\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-ddqvr"
Sep 07 17:01:28.066637 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:28.066542    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93400a1d-edf8-4e7b-8dd6-e7947111f6ce-tmp\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-ddqvr\" (UID: \"93400a1d-edf8-4e7b-8dd6-e7947111f6ce\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-ddqvr"
Sep 07 17:01:28.066713 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:28.066637    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/93400a1d-edf8-4e7b-8dd6-e7947111f6ce-manifests\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-ddqvr\" (UID: \"93400a1d-edf8-4e7b-8dd6-e7947111f6ce\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-ddqvr"
Sep 07 17:01:28.066713 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:28.066703    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2j8q\" (UniqueName: \"kubernetes.io/projected/93400a1d-edf8-4e7b-8dd6-e7947111f6ce-kube-api-access-k2j8q\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-ddqvr\" (UID: \"93400a1d-edf8-4e7b-8dd6-e7947111f6ce\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-ddqvr"
Sep 07 17:01:28.167928 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:28.167876    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/93400a1d-edf8-4e7b-8dd6-e7947111f6ce-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-ddqvr\" (UID: \"93400a1d-edf8-4e7b-8dd6-e7947111f6ce\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-ddqvr"
Sep 07 17:01:28.168131 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:28.167945    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93400a1d-edf8-4e7b-8dd6-e7947111f6ce-tmp\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-ddqvr\" (UID: \"93400a1d-edf8-4e7b-8dd6-e7947111f6ce\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-ddqvr"
Sep 07 17:01:28.168131 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:28.167992    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/93400a1d-edf8-4e7b-8dd6-e7947111f6ce-manifests\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-ddqvr\" (UID: \"93400a1d-edf8-4e7b-8dd6-e7947111f6ce\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-ddqvr"
Sep 07 17:01:28.168131 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:28.168048    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2j8q\" (UniqueName: \"kubernetes.io/projected/93400a1d-edf8-4e7b-8dd6-e7947111f6ce-kube-api-access-k2j8q\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-ddqvr\" (UID: \"93400a1d-edf8-4e7b-8dd6-e7947111f6ce\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-ddqvr"
Sep 07 17:01:28.168131 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:28.168086    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93400a1d-edf8-4e7b-8dd6-e7947111f6ce-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-ddqvr\" (UID: \"93400a1d-edf8-4e7b-8dd6-e7947111f6ce\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-ddqvr"
Sep 07 17:01:28.168503 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:28.168469    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/93400a1d-edf8-4e7b-8dd6-e7947111f6ce-manifests\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-ddqvr\" (UID: \"93400a1d-edf8-4e7b-8dd6-e7947111f6ce\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-ddqvr"
Sep 07 17:01:28.170202 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:28.170170    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93400a1d-edf8-4e7b-8dd6-e7947111f6ce-tmp\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-ddqvr\" (UID: \"93400a1d-edf8-4e7b-8dd6-e7947111f6ce\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-ddqvr"
Sep 07 17:01:28.175483 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:28.170767    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/93400a1d-edf8-4e7b-8dd6-e7947111f6ce-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-ddqvr\" (UID: \"93400a1d-edf8-4e7b-8dd6-e7947111f6ce\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-ddqvr"
Sep 07 17:01:28.175483 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:28.170913    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93400a1d-edf8-4e7b-8dd6-e7947111f6ce-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-ddqvr\" (UID: \"93400a1d-edf8-4e7b-8dd6-e7947111f6ce\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-ddqvr"
Sep 07 17:01:28.187431 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:28.187409    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2j8q\" (UniqueName: \"kubernetes.io/projected/93400a1d-edf8-4e7b-8dd6-e7947111f6ce-kube-api-access-k2j8q\") pod \"opendatahub-operator-controller-manager-6f6f7795c7-ddqvr\" (UID: \"93400a1d-edf8-4e7b-8dd6-e7947111f6ce\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-ddqvr"
Sep 07 17:01:28.293281 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:28.293156    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-ddqvr"
Sep 07 17:01:28.588703 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:28.588674    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-ddqvr"]
Sep 07 17:01:28.591164 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:01:28.591131    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93400a1d_edf8_4e7b_8dd6_e7947111f6ce.slice/crio-a60910ffd3fa9c774af51924d08a3ea65f215bc49dddac64bf37a2f506a9de5f WatchSource:0}: Error finding container a60910ffd3fa9c774af51924d08a3ea65f215bc49dddac64bf37a2f506a9de5f: Status 404 returned error can't find the container with id a60910ffd3fa9c774af51924d08a3ea65f215bc49dddac64bf37a2f506a9de5f
Sep 07 17:01:28.592851 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:28.592832    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 17:01:28.972878 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:28.972843    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-ddqvr" event={"ID":"93400a1d-edf8-4e7b-8dd6-e7947111f6ce","Type":"ContainerStarted","Data":"a60910ffd3fa9c774af51924d08a3ea65f215bc49dddac64bf37a2f506a9de5f"}
Sep 07 17:01:31.988009 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:31.987927    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-ddqvr" event={"ID":"93400a1d-edf8-4e7b-8dd6-e7947111f6ce","Type":"ContainerStarted","Data":"8b6920dbb4d0eb839ca0ea289c9786fe25646c6c758fa9c785d07372f033646b"}
Sep 07 17:01:32.993027 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:32.992994    2558 generic.go:356] "Generic (PLEG): container finished" podID="93400a1d-edf8-4e7b-8dd6-e7947111f6ce" containerID="8b6920dbb4d0eb839ca0ea289c9786fe25646c6c758fa9c785d07372f033646b" exitCode=0
Sep 07 17:01:32.993464 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:32.993087    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-ddqvr" event={"ID":"93400a1d-edf8-4e7b-8dd6-e7947111f6ce","Type":"ContainerDied","Data":"8b6920dbb4d0eb839ca0ea289c9786fe25646c6c758fa9c785d07372f033646b"}
Sep 07 17:01:34.004248 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:34.004176    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-ddqvr" event={"ID":"93400a1d-edf8-4e7b-8dd6-e7947111f6ce","Type":"ContainerStarted","Data":"6e37a531e817f957b1a487bd5e3bb113bc897652379e873e2bcbabebbc329525"}
Sep 07 17:01:34.004690 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:34.004475    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-ddqvr"
Sep 07 17:01:45.010837 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:45.010794    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-ddqvr"
Sep 07 17:01:45.038571 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:45.038519    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6f6f7795c7-ddqvr" podStartSLOduration=13.605063183 podStartE2EDuration="18.038503319s" totalImagesPullingTime="3.346927818s" totalInitContainerRuntime="1.086512318s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:01:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:01:34.044934292 +0000 UTC m=+311.076365085" watchObservedRunningTime="2026-09-07 17:01:45.038503319 +0000 UTC m=+322.069934109"
Sep 07 17:01:48.616001 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:48.615965    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5b977b55fb-l74k5"]
Sep 07 17:01:48.619131 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:48.619110    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b977b55fb-l74k5"
Sep 07 17:01:48.624038 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:48.624008    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 07 17:01:48.624151 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:48.624035    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 07 17:01:48.624151 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:48.624121    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-dxvzh\""
Sep 07 17:01:48.637526 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:48.637505    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b977b55fb-l74k5"]
Sep 07 17:01:48.737488 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:48.737453    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvcnq\" (UniqueName: \"kubernetes.io/projected/db528ab7-14df-446e-b347-33cd95589e50-kube-api-access-pvcnq\") pod \"kube-auth-proxy-5b977b55fb-l74k5\" (UID: \"db528ab7-14df-446e-b347-33cd95589e50\") " pod="openshift-ingress/kube-auth-proxy-5b977b55fb-l74k5"
Sep 07 17:01:48.737650 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:48.737501    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db528ab7-14df-446e-b347-33cd95589e50-tmp\") pod \"kube-auth-proxy-5b977b55fb-l74k5\" (UID: \"db528ab7-14df-446e-b347-33cd95589e50\") " pod="openshift-ingress/kube-auth-proxy-5b977b55fb-l74k5"
Sep 07 17:01:48.737650 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:48.737530    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db528ab7-14df-446e-b347-33cd95589e50-tls-certs\") pod \"kube-auth-proxy-5b977b55fb-l74k5\" (UID: \"db528ab7-14df-446e-b347-33cd95589e50\") " pod="openshift-ingress/kube-auth-proxy-5b977b55fb-l74k5"
Sep 07 17:01:48.838286 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:48.838227    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvcnq\" (UniqueName: \"kubernetes.io/projected/db528ab7-14df-446e-b347-33cd95589e50-kube-api-access-pvcnq\") pod \"kube-auth-proxy-5b977b55fb-l74k5\" (UID: \"db528ab7-14df-446e-b347-33cd95589e50\") " pod="openshift-ingress/kube-auth-proxy-5b977b55fb-l74k5"
Sep 07 17:01:48.838462 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:48.838394    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db528ab7-14df-446e-b347-33cd95589e50-tmp\") pod \"kube-auth-proxy-5b977b55fb-l74k5\" (UID: \"db528ab7-14df-446e-b347-33cd95589e50\") " pod="openshift-ingress/kube-auth-proxy-5b977b55fb-l74k5"
Sep 07 17:01:48.838462 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:48.838436    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db528ab7-14df-446e-b347-33cd95589e50-tls-certs\") pod \"kube-auth-proxy-5b977b55fb-l74k5\" (UID: \"db528ab7-14df-446e-b347-33cd95589e50\") " pod="openshift-ingress/kube-auth-proxy-5b977b55fb-l74k5"
Sep 07 17:01:48.840658 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:48.840633    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db528ab7-14df-446e-b347-33cd95589e50-tmp\") pod \"kube-auth-proxy-5b977b55fb-l74k5\" (UID: \"db528ab7-14df-446e-b347-33cd95589e50\") " pod="openshift-ingress/kube-auth-proxy-5b977b55fb-l74k5"
Sep 07 17:01:48.840971 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:48.840950    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db528ab7-14df-446e-b347-33cd95589e50-tls-certs\") pod \"kube-auth-proxy-5b977b55fb-l74k5\" (UID: \"db528ab7-14df-446e-b347-33cd95589e50\") " pod="openshift-ingress/kube-auth-proxy-5b977b55fb-l74k5"
Sep 07 17:01:48.861556 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:48.861523    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvcnq\" (UniqueName: \"kubernetes.io/projected/db528ab7-14df-446e-b347-33cd95589e50-kube-api-access-pvcnq\") pod \"kube-auth-proxy-5b977b55fb-l74k5\" (UID: \"db528ab7-14df-446e-b347-33cd95589e50\") " pod="openshift-ingress/kube-auth-proxy-5b977b55fb-l74k5"
Sep 07 17:01:48.928544 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:48.928463    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b977b55fb-l74k5"
Sep 07 17:01:49.205182 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:49.205113    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b977b55fb-l74k5"]
Sep 07 17:01:49.208286 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:01:49.208254    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb528ab7_14df_446e_b347_33cd95589e50.slice/crio-1a614f0ababf8cd246c5adfcfc3cae71dcb3897441815241f32ccd6e84cdc3ce WatchSource:0}: Error finding container 1a614f0ababf8cd246c5adfcfc3cae71dcb3897441815241f32ccd6e84cdc3ce: Status 404 returned error can't find the container with id 1a614f0ababf8cd246c5adfcfc3cae71dcb3897441815241f32ccd6e84cdc3ce
Sep 07 17:01:50.070123 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:50.070080    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b977b55fb-l74k5" event={"ID":"db528ab7-14df-446e-b347-33cd95589e50","Type":"ContainerStarted","Data":"1a614f0ababf8cd246c5adfcfc3cae71dcb3897441815241f32ccd6e84cdc3ce"}
Sep 07 17:01:50.538554 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:50.538516    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6rllt"]
Sep 07 17:01:50.543710 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:50.543685    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6rllt"
Sep 07 17:01:50.547290 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:50.547195    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-zbwww\""
Sep 07 17:01:50.547422 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:50.547377    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 07 17:01:50.547784 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:50.547724    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 07 17:01:50.547895 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:50.547870    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 07 17:01:50.548277 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:50.548094    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 07 17:01:50.570999 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:50.570850    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6rllt"]
Sep 07 17:01:50.653986 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:50.653947    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/752f2389-1c48-4697-8229-1612d9341c74-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-6rllt\" (UID: \"752f2389-1c48-4697-8229-1612d9341c74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6rllt"
Sep 07 17:01:50.654165 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:50.654034    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/752f2389-1c48-4697-8229-1612d9341c74-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-6rllt\" (UID: \"752f2389-1c48-4697-8229-1612d9341c74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6rllt"
Sep 07 17:01:50.654165 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:50.654075    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk89j\" (UniqueName: \"kubernetes.io/projected/752f2389-1c48-4697-8229-1612d9341c74-kube-api-access-tk89j\") pod \"istiod-openshift-gateway-7b7995d5cd-6rllt\" (UID: \"752f2389-1c48-4697-8229-1612d9341c74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6rllt"
Sep 07 17:01:50.654165 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:50.654130    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/752f2389-1c48-4697-8229-1612d9341c74-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-6rllt\" (UID: \"752f2389-1c48-4697-8229-1612d9341c74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6rllt"
Sep 07 17:01:50.654356 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:50.654254    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/752f2389-1c48-4697-8229-1612d9341c74-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-6rllt\" (UID: \"752f2389-1c48-4697-8229-1612d9341c74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6rllt"
Sep 07 17:01:50.654356 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:50.654296    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/752f2389-1c48-4697-8229-1612d9341c74-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-6rllt\" (UID: \"752f2389-1c48-4697-8229-1612d9341c74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6rllt"
Sep 07 17:01:50.654356 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:50.654323    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/752f2389-1c48-4697-8229-1612d9341c74-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-6rllt\" (UID: \"752f2389-1c48-4697-8229-1612d9341c74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6rllt"
Sep 07 17:01:50.755519 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:50.755487    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/752f2389-1c48-4697-8229-1612d9341c74-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-6rllt\" (UID: \"752f2389-1c48-4697-8229-1612d9341c74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6rllt"
Sep 07 17:01:50.755716 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:50.755567    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/752f2389-1c48-4697-8229-1612d9341c74-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-6rllt\" (UID: \"752f2389-1c48-4697-8229-1612d9341c74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6rllt"
Sep 07 17:01:50.755716 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:50.755599    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/752f2389-1c48-4697-8229-1612d9341c74-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-6rllt\" (UID: \"752f2389-1c48-4697-8229-1612d9341c74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6rllt"
Sep 07 17:01:50.755716 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:50.755624    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/752f2389-1c48-4697-8229-1612d9341c74-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-6rllt\" (UID: \"752f2389-1c48-4697-8229-1612d9341c74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6rllt"
Sep 07 17:01:50.755716 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:50.755682    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/752f2389-1c48-4697-8229-1612d9341c74-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-6rllt\" (UID: \"752f2389-1c48-4697-8229-1612d9341c74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6rllt"
Sep 07 17:01:50.755716 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:50.755710    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/752f2389-1c48-4697-8229-1612d9341c74-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-6rllt\" (UID: \"752f2389-1c48-4697-8229-1612d9341c74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6rllt"
Sep 07 17:01:50.755980 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:50.755741    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk89j\" (UniqueName: \"kubernetes.io/projected/752f2389-1c48-4697-8229-1612d9341c74-kube-api-access-tk89j\") pod \"istiod-openshift-gateway-7b7995d5cd-6rllt\" (UID: \"752f2389-1c48-4697-8229-1612d9341c74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6rllt"
Sep 07 17:01:50.756554 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:50.756500    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/752f2389-1c48-4697-8229-1612d9341c74-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-6rllt\" (UID: \"752f2389-1c48-4697-8229-1612d9341c74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6rllt"
Sep 07 17:01:50.758801 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:50.758776    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/752f2389-1c48-4697-8229-1612d9341c74-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-6rllt\" (UID: \"752f2389-1c48-4697-8229-1612d9341c74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6rllt"
Sep 07 17:01:50.758910 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:50.758875    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/752f2389-1c48-4697-8229-1612d9341c74-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-6rllt\" (UID: \"752f2389-1c48-4697-8229-1612d9341c74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6rllt"
Sep 07 17:01:50.759230 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:50.759187    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/752f2389-1c48-4697-8229-1612d9341c74-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-6rllt\" (UID: \"752f2389-1c48-4697-8229-1612d9341c74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6rllt"
Sep 07 17:01:50.759864 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:50.759839    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/752f2389-1c48-4697-8229-1612d9341c74-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-6rllt\" (UID: \"752f2389-1c48-4697-8229-1612d9341c74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6rllt"
Sep 07 17:01:50.773439 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:50.773411    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk89j\" (UniqueName: \"kubernetes.io/projected/752f2389-1c48-4697-8229-1612d9341c74-kube-api-access-tk89j\") pod \"istiod-openshift-gateway-7b7995d5cd-6rllt\" (UID: \"752f2389-1c48-4697-8229-1612d9341c74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6rllt"
Sep 07 17:01:50.779634 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:50.779609    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/752f2389-1c48-4697-8229-1612d9341c74-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-6rllt\" (UID: \"752f2389-1c48-4697-8229-1612d9341c74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6rllt"
Sep 07 17:01:50.856908 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:50.856877    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6rllt"
Sep 07 17:01:52.081308 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:52.081273    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b977b55fb-l74k5" event={"ID":"db528ab7-14df-446e-b347-33cd95589e50","Type":"ContainerStarted","Data":"a18e7c850358b44bbd0acb1de6a345caea41abcb87cbf32752afc913bd44bfc4"}
Sep 07 17:01:52.102228 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:52.102180    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5b977b55fb-l74k5" podStartSLOduration=1.390920234 podStartE2EDuration="4.102165708s" totalImagesPullingTime="2.711245474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:01:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:01:52.102042633 +0000 UTC m=+329.133473425" watchObservedRunningTime="2026-09-07 17:01:52.102165708 +0000 UTC m=+329.133596499"
Sep 07 17:01:52.133303 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:52.133278    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6rllt"]
Sep 07 17:01:52.135774 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:01:52.135743    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod752f2389_1c48_4697_8229_1612d9341c74.slice/crio-6d4eac4b4043c69bfd39cab17561f16f59dda3d1da15f23e34125b7693f5e698 WatchSource:0}: Error finding container 6d4eac4b4043c69bfd39cab17561f16f59dda3d1da15f23e34125b7693f5e698: Status 404 returned error can't find the container with id 6d4eac4b4043c69bfd39cab17561f16f59dda3d1da15f23e34125b7693f5e698
Sep 07 17:01:53.087044 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:53.087002    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6rllt" event={"ID":"752f2389-1c48-4697-8229-1612d9341c74","Type":"ContainerStarted","Data":"6d4eac4b4043c69bfd39cab17561f16f59dda3d1da15f23e34125b7693f5e698"}
Sep 07 17:01:58.894459 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:58.894422    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fpl6h"]
Sep 07 17:01:58.899227 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:58.899197    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-fpl6h"
Sep 07 17:01:58.902010 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:58.901990    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-b6fjt\""
Sep 07 17:01:58.902142 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:58.901989    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 07 17:01:58.908822 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:58.908795    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fpl6h"]
Sep 07 17:01:59.031080 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:59.031045    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/953d4e8b-0139-44b7-947e-9a06fc7af205-cert\") pod \"odh-model-controller-7998c67dc4-fpl6h\" (UID: \"953d4e8b-0139-44b7-947e-9a06fc7af205\") " pod="opendatahub/odh-model-controller-7998c67dc4-fpl6h"
Sep 07 17:01:59.031232 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:59.031109    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dlc7\" (UniqueName: \"kubernetes.io/projected/953d4e8b-0139-44b7-947e-9a06fc7af205-kube-api-access-4dlc7\") pod \"odh-model-controller-7998c67dc4-fpl6h\" (UID: \"953d4e8b-0139-44b7-947e-9a06fc7af205\") " pod="opendatahub/odh-model-controller-7998c67dc4-fpl6h"
Sep 07 17:01:59.131980 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:59.131942    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dlc7\" (UniqueName: \"kubernetes.io/projected/953d4e8b-0139-44b7-947e-9a06fc7af205-kube-api-access-4dlc7\") pod \"odh-model-controller-7998c67dc4-fpl6h\" (UID: \"953d4e8b-0139-44b7-947e-9a06fc7af205\") " pod="opendatahub/odh-model-controller-7998c67dc4-fpl6h"
Sep 07 17:01:59.132164 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:59.132108    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/953d4e8b-0139-44b7-947e-9a06fc7af205-cert\") pod \"odh-model-controller-7998c67dc4-fpl6h\" (UID: \"953d4e8b-0139-44b7-947e-9a06fc7af205\") " pod="opendatahub/odh-model-controller-7998c67dc4-fpl6h"
Sep 07 17:01:59.135218 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:59.135189    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/953d4e8b-0139-44b7-947e-9a06fc7af205-cert\") pod \"odh-model-controller-7998c67dc4-fpl6h\" (UID: \"953d4e8b-0139-44b7-947e-9a06fc7af205\") " pod="opendatahub/odh-model-controller-7998c67dc4-fpl6h"
Sep 07 17:01:59.140597 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:59.140573    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dlc7\" (UniqueName: \"kubernetes.io/projected/953d4e8b-0139-44b7-947e-9a06fc7af205-kube-api-access-4dlc7\") pod \"odh-model-controller-7998c67dc4-fpl6h\" (UID: \"953d4e8b-0139-44b7-947e-9a06fc7af205\") " pod="opendatahub/odh-model-controller-7998c67dc4-fpl6h"
Sep 07 17:01:59.213703 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:59.213620    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-fpl6h"
Sep 07 17:01:59.495737 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:01:59.495628    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fpl6h"]
Sep 07 17:01:59.501165 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:01:59.501140    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod953d4e8b_0139_44b7_947e_9a06fc7af205.slice/crio-73514eace3e6571dd11d6b5538e6dbbbd2519ea4a36e8c34b6f73b7f8e258dc8 WatchSource:0}: Error finding container 73514eace3e6571dd11d6b5538e6dbbbd2519ea4a36e8c34b6f73b7f8e258dc8: Status 404 returned error can't find the container with id 73514eace3e6571dd11d6b5538e6dbbbd2519ea4a36e8c34b6f73b7f8e258dc8
Sep 07 17:02:00.124324 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:00.124282    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-fpl6h" event={"ID":"953d4e8b-0139-44b7-947e-9a06fc7af205","Type":"ContainerStarted","Data":"73514eace3e6571dd11d6b5538e6dbbbd2519ea4a36e8c34b6f73b7f8e258dc8"}
Sep 07 17:02:02.810852 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:02.809779    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:02:02.810852 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:02.809871    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:02:03.141555 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:03.141516    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6rllt" event={"ID":"752f2389-1c48-4697-8229-1612d9341c74","Type":"ContainerStarted","Data":"ac2c5c5a20c57fb51efb65182800e4b0afbff752978ecad4811e0a3c56c0586d"}
Sep 07 17:02:03.141747 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:03.141615    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6rllt"
Sep 07 17:02:03.143322 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:03.143288    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-fpl6h" event={"ID":"953d4e8b-0139-44b7-947e-9a06fc7af205","Type":"ContainerStarted","Data":"7a038f5b33618c0937aeb39fa070d033faaf8984a8d8503f34aae0ad7f5d15e8"}
Sep 07 17:02:03.143457 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:03.143343    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-fpl6h"
Sep 07 17:02:03.143686 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:03.143658    2558 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-6rllt container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 07 17:02:03.143777 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:03.143708    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6rllt" podUID="752f2389-1c48-4697-8229-1612d9341c74" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 07 17:02:03.164334 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:03.164267    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6rllt" podStartSLOduration=2.492710752 podStartE2EDuration="13.164230972s" totalImagesPullingTime="10.67152022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:01:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:02:03.161649913 +0000 UTC m=+340.193080705" watchObservedRunningTime="2026-09-07 17:02:03.164230972 +0000 UTC m=+340.195661764"
Sep 07 17:02:03.179455 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:03.179378    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-fpl6h" podStartSLOduration=1.818256273 podStartE2EDuration="5.179357451s" totalImagesPullingTime="3.361101178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:01:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:02:03.178915736 +0000 UTC m=+340.210346527" watchObservedRunningTime="2026-09-07 17:02:03.179357451 +0000 UTC m=+340.210788256"
Sep 07 17:02:03.987024 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:03.986978    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g"]
Sep 07 17:02:03.990155 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:03.990135    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g"
Sep 07 17:02:03.992996 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:03.992962    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-2c5mv\""
Sep 07 17:02:04.015793 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:04.015763    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g"]
Sep 07 17:02:04.148984 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:04.148952    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6rllt"
Sep 07 17:02:04.174744 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:04.174695    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79fd7621-ac15-4c0f-b9ac-15667195a26e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g\" (UID: \"79fd7621-ac15-4c0f-b9ac-15667195a26e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g"
Sep 07 17:02:04.174951 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:04.174756    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79fd7621-ac15-4c0f-b9ac-15667195a26e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g\" (UID: \"79fd7621-ac15-4c0f-b9ac-15667195a26e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g"
Sep 07 17:02:04.174951 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:04.174789    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79fd7621-ac15-4c0f-b9ac-15667195a26e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g\" (UID: \"79fd7621-ac15-4c0f-b9ac-15667195a26e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g"
Sep 07 17:02:04.174951 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:04.174854    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79fd7621-ac15-4c0f-b9ac-15667195a26e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g\" (UID: \"79fd7621-ac15-4c0f-b9ac-15667195a26e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g"
Sep 07 17:02:04.174951 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:04.174913    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79fd7621-ac15-4c0f-b9ac-15667195a26e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g\" (UID: \"79fd7621-ac15-4c0f-b9ac-15667195a26e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g"
Sep 07 17:02:04.175151 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:04.174970    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqs9k\" (UniqueName: \"kubernetes.io/projected/79fd7621-ac15-4c0f-b9ac-15667195a26e-kube-api-access-cqs9k\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g\" (UID: \"79fd7621-ac15-4c0f-b9ac-15667195a26e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g"
Sep 07 17:02:04.175151 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:04.175041    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79fd7621-ac15-4c0f-b9ac-15667195a26e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g\" (UID: \"79fd7621-ac15-4c0f-b9ac-15667195a26e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g"
Sep 07 17:02:04.175151 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:04.175107    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79fd7621-ac15-4c0f-b9ac-15667195a26e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g\" (UID: \"79fd7621-ac15-4c0f-b9ac-15667195a26e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g"
Sep 07 17:02:04.175303 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:04.175159    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79fd7621-ac15-4c0f-b9ac-15667195a26e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g\" (UID: \"79fd7621-ac15-4c0f-b9ac-15667195a26e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g"
Sep 07 17:02:04.275699 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:04.275588    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79fd7621-ac15-4c0f-b9ac-15667195a26e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g\" (UID: \"79fd7621-ac15-4c0f-b9ac-15667195a26e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g"
Sep 07 17:02:04.275699 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:04.275691    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqs9k\" (UniqueName: \"kubernetes.io/projected/79fd7621-ac15-4c0f-b9ac-15667195a26e-kube-api-access-cqs9k\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g\" (UID: \"79fd7621-ac15-4c0f-b9ac-15667195a26e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g"
Sep 07 17:02:04.275968 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:04.275725    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79fd7621-ac15-4c0f-b9ac-15667195a26e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g\" (UID: \"79fd7621-ac15-4c0f-b9ac-15667195a26e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g"
Sep 07 17:02:04.275968 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:04.275802    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79fd7621-ac15-4c0f-b9ac-15667195a26e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g\" (UID: \"79fd7621-ac15-4c0f-b9ac-15667195a26e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g"
Sep 07 17:02:04.275968 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:04.275870    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79fd7621-ac15-4c0f-b9ac-15667195a26e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g\" (UID: \"79fd7621-ac15-4c0f-b9ac-15667195a26e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g"
Sep 07 17:02:04.275968 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:04.275917    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79fd7621-ac15-4c0f-b9ac-15667195a26e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g\" (UID: \"79fd7621-ac15-4c0f-b9ac-15667195a26e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g"
Sep 07 17:02:04.275968 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:04.275944    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79fd7621-ac15-4c0f-b9ac-15667195a26e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g\" (UID: \"79fd7621-ac15-4c0f-b9ac-15667195a26e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g"
Sep 07 17:02:04.276415 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:04.275971    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79fd7621-ac15-4c0f-b9ac-15667195a26e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g\" (UID: \"79fd7621-ac15-4c0f-b9ac-15667195a26e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g"
Sep 07 17:02:04.276415 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:04.276009    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79fd7621-ac15-4c0f-b9ac-15667195a26e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g\" (UID: \"79fd7621-ac15-4c0f-b9ac-15667195a26e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g"
Sep 07 17:02:04.276415 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:04.276060    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79fd7621-ac15-4c0f-b9ac-15667195a26e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g\" (UID: \"79fd7621-ac15-4c0f-b9ac-15667195a26e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g"
Sep 07 17:02:04.276415 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:04.276360    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79fd7621-ac15-4c0f-b9ac-15667195a26e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g\" (UID: \"79fd7621-ac15-4c0f-b9ac-15667195a26e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g"
Sep 07 17:02:04.276731 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:04.276712    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79fd7621-ac15-4c0f-b9ac-15667195a26e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g\" (UID: \"79fd7621-ac15-4c0f-b9ac-15667195a26e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g"
Sep 07 17:02:04.276877 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:04.276844    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79fd7621-ac15-4c0f-b9ac-15667195a26e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g\" (UID: \"79fd7621-ac15-4c0f-b9ac-15667195a26e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g"
Sep 07 17:02:04.277013 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:04.276993    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79fd7621-ac15-4c0f-b9ac-15667195a26e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g\" (UID: \"79fd7621-ac15-4c0f-b9ac-15667195a26e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g"
Sep 07 17:02:04.278837 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:04.278777    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79fd7621-ac15-4c0f-b9ac-15667195a26e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g\" (UID: \"79fd7621-ac15-4c0f-b9ac-15667195a26e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g"
Sep 07 17:02:04.279123 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:04.279100    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79fd7621-ac15-4c0f-b9ac-15667195a26e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g\" (UID: \"79fd7621-ac15-4c0f-b9ac-15667195a26e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g"
Sep 07 17:02:04.301990 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:04.301963    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79fd7621-ac15-4c0f-b9ac-15667195a26e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g\" (UID: \"79fd7621-ac15-4c0f-b9ac-15667195a26e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g"
Sep 07 17:02:04.310873 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:04.310837    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqs9k\" (UniqueName: \"kubernetes.io/projected/79fd7621-ac15-4c0f-b9ac-15667195a26e-kube-api-access-cqs9k\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g\" (UID: \"79fd7621-ac15-4c0f-b9ac-15667195a26e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g"
Sep 07 17:02:04.602100 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:04.602018    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g"
Sep 07 17:02:04.882566 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:04.882539    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g"]
Sep 07 17:02:04.884957 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:02:04.884922    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79fd7621_ac15_4c0f_b9ac_15667195a26e.slice/crio-9c74db7dfc9bd85f5b4e7bc2ab7abce66e4eed7af1c0e33fdcf60580c37fe3fd WatchSource:0}: Error finding container 9c74db7dfc9bd85f5b4e7bc2ab7abce66e4eed7af1c0e33fdcf60580c37fe3fd: Status 404 returned error can't find the container with id 9c74db7dfc9bd85f5b4e7bc2ab7abce66e4eed7af1c0e33fdcf60580c37fe3fd
Sep 07 17:02:05.153408 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:05.153327    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g" event={"ID":"79fd7621-ac15-4c0f-b9ac-15667195a26e","Type":"ContainerStarted","Data":"9c74db7dfc9bd85f5b4e7bc2ab7abce66e4eed7af1c0e33fdcf60580c37fe3fd"}
Sep 07 17:02:07.826114 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:07.826060    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:02:07.826480 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:07.826184    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:02:07.826480 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:07.826230    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:02:08.170706 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:08.170665    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g" event={"ID":"79fd7621-ac15-4c0f-b9ac-15667195a26e","Type":"ContainerStarted","Data":"6fe2ffc9f334957685ea0459fc77010f80212fbbc2e581437b895a472195a3c0"}
Sep 07 17:02:08.196255 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:08.196177    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g" podStartSLOduration=2.258117234 podStartE2EDuration="5.196161776s" totalImagesPullingTime="2.938044542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:02:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:02:08.193747439 +0000 UTC m=+345.225178256" watchObservedRunningTime="2026-09-07 17:02:08.196161776 +0000 UTC m=+345.227592567"
Sep 07 17:02:08.604711 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:08.604671    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g"
Sep 07 17:02:08.609800 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:08.609771    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g"
Sep 07 17:02:09.175168 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:09.175140    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g"
Sep 07 17:02:09.176249 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:09.176219    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g"
Sep 07 17:02:10.657092 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:10.657062    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9b5nj"]
Sep 07 17:02:10.660592 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:10.660565    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9b5nj"
Sep 07 17:02:10.664139 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:10.664116    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-jpkn9\""
Sep 07 17:02:10.664404 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:10.664388    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 07 17:02:10.676978 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:10.676956    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-l667g"]
Sep 07 17:02:10.680101 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:10.680076    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l667g"
Sep 07 17:02:10.680858 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:10.680838    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9b5nj"]
Sep 07 17:02:10.683138 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:10.683119    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 07 17:02:10.683252 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:10.683155    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-54rnb\""
Sep 07 17:02:10.700806 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:10.700779    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-l667g"]
Sep 07 17:02:10.725778 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:10.725744    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3dabb2db-254b-47a8-9aa3-42860d1a91cd-cert\") pod \"kserve-controller-manager-d6f4b65b8-9b5nj\" (UID: \"3dabb2db-254b-47a8-9aa3-42860d1a91cd\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9b5nj"
Sep 07 17:02:10.725778 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:10.725777    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s77xz\" (UniqueName: \"kubernetes.io/projected/3dabb2db-254b-47a8-9aa3-42860d1a91cd-kube-api-access-s77xz\") pod \"kserve-controller-manager-d6f4b65b8-9b5nj\" (UID: \"3dabb2db-254b-47a8-9aa3-42860d1a91cd\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9b5nj"
Sep 07 17:02:10.827218 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:10.827167    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97m4d\" (UniqueName: \"kubernetes.io/projected/6dc35201-0282-4160-8c00-99a7ce9e5101-kube-api-access-97m4d\") pod \"llmisvc-controller-manager-777c6bd7d5-l667g\" (UID: \"6dc35201-0282-4160-8c00-99a7ce9e5101\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l667g"
Sep 07 17:02:10.827390 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:10.827289    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3dabb2db-254b-47a8-9aa3-42860d1a91cd-cert\") pod \"kserve-controller-manager-d6f4b65b8-9b5nj\" (UID: \"3dabb2db-254b-47a8-9aa3-42860d1a91cd\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9b5nj"
Sep 07 17:02:10.827390 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:10.827313    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6dc35201-0282-4160-8c00-99a7ce9e5101-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-l667g\" (UID: \"6dc35201-0282-4160-8c00-99a7ce9e5101\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l667g"
Sep 07 17:02:10.827390 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:10.827329    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s77xz\" (UniqueName: \"kubernetes.io/projected/3dabb2db-254b-47a8-9aa3-42860d1a91cd-kube-api-access-s77xz\") pod \"kserve-controller-manager-d6f4b65b8-9b5nj\" (UID: \"3dabb2db-254b-47a8-9aa3-42860d1a91cd\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9b5nj"
Sep 07 17:02:10.827513 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:02:10.827404    2558 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 07 17:02:10.827513 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:02:10.827470    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dabb2db-254b-47a8-9aa3-42860d1a91cd-cert podName:3dabb2db-254b-47a8-9aa3-42860d1a91cd nodeName:}" failed. No retries permitted until 2026-09-07 17:02:11.327454827 +0000 UTC m=+348.358885596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3dabb2db-254b-47a8-9aa3-42860d1a91cd-cert") pod "kserve-controller-manager-d6f4b65b8-9b5nj" (UID: "3dabb2db-254b-47a8-9aa3-42860d1a91cd") : secret "kserve-webhook-server-cert" not found
Sep 07 17:02:10.841806 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:10.841781    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s77xz\" (UniqueName: \"kubernetes.io/projected/3dabb2db-254b-47a8-9aa3-42860d1a91cd-kube-api-access-s77xz\") pod \"kserve-controller-manager-d6f4b65b8-9b5nj\" (UID: \"3dabb2db-254b-47a8-9aa3-42860d1a91cd\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9b5nj"
Sep 07 17:02:10.928053 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:10.927971    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6dc35201-0282-4160-8c00-99a7ce9e5101-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-l667g\" (UID: \"6dc35201-0282-4160-8c00-99a7ce9e5101\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l667g"
Sep 07 17:02:10.928207 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:10.928056    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97m4d\" (UniqueName: \"kubernetes.io/projected/6dc35201-0282-4160-8c00-99a7ce9e5101-kube-api-access-97m4d\") pod \"llmisvc-controller-manager-777c6bd7d5-l667g\" (UID: \"6dc35201-0282-4160-8c00-99a7ce9e5101\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l667g"
Sep 07 17:02:10.928207 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:02:10.928123    2558 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 07 17:02:10.928207 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:02:10.928206    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc35201-0282-4160-8c00-99a7ce9e5101-cert podName:6dc35201-0282-4160-8c00-99a7ce9e5101 nodeName:}" failed. No retries permitted until 2026-09-07 17:02:11.4281811 +0000 UTC m=+348.459611869 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6dc35201-0282-4160-8c00-99a7ce9e5101-cert") pod "llmisvc-controller-manager-777c6bd7d5-l667g" (UID: "6dc35201-0282-4160-8c00-99a7ce9e5101") : secret "llmisvc-webhook-server-cert" not found
Sep 07 17:02:10.941569 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:10.941545    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97m4d\" (UniqueName: \"kubernetes.io/projected/6dc35201-0282-4160-8c00-99a7ce9e5101-kube-api-access-97m4d\") pod \"llmisvc-controller-manager-777c6bd7d5-l667g\" (UID: \"6dc35201-0282-4160-8c00-99a7ce9e5101\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l667g"
Sep 07 17:02:11.331464 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:11.331356    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3dabb2db-254b-47a8-9aa3-42860d1a91cd-cert\") pod \"kserve-controller-manager-d6f4b65b8-9b5nj\" (UID: \"3dabb2db-254b-47a8-9aa3-42860d1a91cd\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9b5nj"
Sep 07 17:02:11.333937 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:11.333902    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3dabb2db-254b-47a8-9aa3-42860d1a91cd-cert\") pod \"kserve-controller-manager-d6f4b65b8-9b5nj\" (UID: \"3dabb2db-254b-47a8-9aa3-42860d1a91cd\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9b5nj"
Sep 07 17:02:11.432419 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:11.432374    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6dc35201-0282-4160-8c00-99a7ce9e5101-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-l667g\" (UID: \"6dc35201-0282-4160-8c00-99a7ce9e5101\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l667g"
Sep 07 17:02:11.434738 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:11.434713    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6dc35201-0282-4160-8c00-99a7ce9e5101-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-l667g\" (UID: \"6dc35201-0282-4160-8c00-99a7ce9e5101\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l667g"
Sep 07 17:02:11.570169 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:11.570134    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9b5nj"
Sep 07 17:02:11.589558 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:11.589494    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l667g"
Sep 07 17:02:11.853751 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:11.853726    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9b5nj"]
Sep 07 17:02:11.855648 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:02:11.855606    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dabb2db_254b_47a8_9aa3_42860d1a91cd.slice/crio-2023087a53bc07b156e28340f387451f2f22fc2bdba0c662a5fe81bac9215517 WatchSource:0}: Error finding container 2023087a53bc07b156e28340f387451f2f22fc2bdba0c662a5fe81bac9215517: Status 404 returned error can't find the container with id 2023087a53bc07b156e28340f387451f2f22fc2bdba0c662a5fe81bac9215517
Sep 07 17:02:11.892205 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:11.892157    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-l667g"]
Sep 07 17:02:12.189610 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:12.189516    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l667g" event={"ID":"6dc35201-0282-4160-8c00-99a7ce9e5101","Type":"ContainerStarted","Data":"f2f4e6e7bcbbbdc4317f9b036da9f86798826ed3b0592ee47744dcaf0c934319"}
Sep 07 17:02:12.190747 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:12.190720    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9b5nj" event={"ID":"3dabb2db-254b-47a8-9aa3-42860d1a91cd","Type":"ContainerStarted","Data":"2023087a53bc07b156e28340f387451f2f22fc2bdba0c662a5fe81bac9215517"}
Sep 07 17:02:13.512500 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:13.512470    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6rllt"]
Sep 07 17:02:13.512930 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:13.512699    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6rllt" podUID="752f2389-1c48-4697-8229-1612d9341c74" containerName="discovery" containerID="cri-o://ac2c5c5a20c57fb51efb65182800e4b0afbff752978ecad4811e0a3c56c0586d" gracePeriod=30
Sep 07 17:02:14.150166 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:14.150138    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-fpl6h"
Sep 07 17:02:14.217042 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:14.216794    2558 generic.go:356] "Generic (PLEG): container finished" podID="752f2389-1c48-4697-8229-1612d9341c74" containerID="ac2c5c5a20c57fb51efb65182800e4b0afbff752978ecad4811e0a3c56c0586d" exitCode=0
Sep 07 17:02:14.217042 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:14.216929    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6rllt" event={"ID":"752f2389-1c48-4697-8229-1612d9341c74","Type":"ContainerDied","Data":"ac2c5c5a20c57fb51efb65182800e4b0afbff752978ecad4811e0a3c56c0586d"}
Sep 07 17:02:14.217042 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:14.216984    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6rllt" event={"ID":"752f2389-1c48-4697-8229-1612d9341c74","Type":"ContainerDied","Data":"6d4eac4b4043c69bfd39cab17561f16f59dda3d1da15f23e34125b7693f5e698"}
Sep 07 17:02:14.217042 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:14.217006    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6d4eac4b4043c69bfd39cab17561f16f59dda3d1da15f23e34125b7693f5e698"
Sep 07 17:02:14.217541 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:14.217518    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6rllt"
Sep 07 17:02:14.219055 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:14.219025    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9b5nj" event={"ID":"3dabb2db-254b-47a8-9aa3-42860d1a91cd","Type":"ContainerStarted","Data":"2d7d2057043b200d92edcca1ecd7a709d5afc9425b89d45abb86a054d025488a"}
Sep 07 17:02:14.219176 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:14.219096    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9b5nj"
Sep 07 17:02:14.260795 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:14.260728    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9b5nj" podStartSLOduration=2.024967165 podStartE2EDuration="4.260711598s" totalImagesPullingTime="2.235744433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:02:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:02:14.25849484 +0000 UTC m=+351.289925639" watchObservedRunningTime="2026-09-07 17:02:14.260711598 +0000 UTC m=+351.292142388"
Sep 07 17:02:14.352332 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:14.352248    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tk89j\" (UniqueName: \"kubernetes.io/projected/752f2389-1c48-4697-8229-1612d9341c74-kube-api-access-tk89j\") pod \"752f2389-1c48-4697-8229-1612d9341c74\" (UID: \"752f2389-1c48-4697-8229-1612d9341c74\") "
Sep 07 17:02:14.352332 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:14.352301    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/752f2389-1c48-4697-8229-1612d9341c74-cacerts\") pod \"752f2389-1c48-4697-8229-1612d9341c74\" (UID: \"752f2389-1c48-4697-8229-1612d9341c74\") "
Sep 07 17:02:14.352566 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:14.352357    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/752f2389-1c48-4697-8229-1612d9341c74-istio-csr-dns-cert\") pod \"752f2389-1c48-4697-8229-1612d9341c74\" (UID: \"752f2389-1c48-4697-8229-1612d9341c74\") "
Sep 07 17:02:14.352566 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:14.352385    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/752f2389-1c48-4697-8229-1612d9341c74-istio-token\") pod \"752f2389-1c48-4697-8229-1612d9341c74\" (UID: \"752f2389-1c48-4697-8229-1612d9341c74\") "
Sep 07 17:02:14.352566 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:14.352435    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/752f2389-1c48-4697-8229-1612d9341c74-istio-kubeconfig\") pod \"752f2389-1c48-4697-8229-1612d9341c74\" (UID: \"752f2389-1c48-4697-8229-1612d9341c74\") "
Sep 07 17:02:14.352566 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:14.352469    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/752f2389-1c48-4697-8229-1612d9341c74-istio-csr-ca-configmap\") pod \"752f2389-1c48-4697-8229-1612d9341c74\" (UID: \"752f2389-1c48-4697-8229-1612d9341c74\") "
Sep 07 17:02:14.352566 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:14.352493    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/752f2389-1c48-4697-8229-1612d9341c74-local-certs\") pod \"752f2389-1c48-4697-8229-1612d9341c74\" (UID: \"752f2389-1c48-4697-8229-1612d9341c74\") "
Sep 07 17:02:14.353058 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:14.353015    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/752f2389-1c48-4697-8229-1612d9341c74-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "752f2389-1c48-4697-8229-1612d9341c74" (UID: "752f2389-1c48-4697-8229-1612d9341c74"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:02:14.355707 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:14.355479    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/752f2389-1c48-4697-8229-1612d9341c74-cacerts" (OuterVolumeSpecName: "cacerts") pod "752f2389-1c48-4697-8229-1612d9341c74" (UID: "752f2389-1c48-4697-8229-1612d9341c74"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:02:14.356052 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:14.356016    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/752f2389-1c48-4697-8229-1612d9341c74-istio-token" (OuterVolumeSpecName: "istio-token") pod "752f2389-1c48-4697-8229-1612d9341c74" (UID: "752f2389-1c48-4697-8229-1612d9341c74"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:02:14.356149 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:14.356057    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/752f2389-1c48-4697-8229-1612d9341c74-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "752f2389-1c48-4697-8229-1612d9341c74" (UID: "752f2389-1c48-4697-8229-1612d9341c74"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:02:14.356149 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:14.356081    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/752f2389-1c48-4697-8229-1612d9341c74-local-certs" (OuterVolumeSpecName: "local-certs") pod "752f2389-1c48-4697-8229-1612d9341c74" (UID: "752f2389-1c48-4697-8229-1612d9341c74"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:02:14.356387 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:14.356357    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/752f2389-1c48-4697-8229-1612d9341c74-kube-api-access-tk89j" (OuterVolumeSpecName: "kube-api-access-tk89j") pod "752f2389-1c48-4697-8229-1612d9341c74" (UID: "752f2389-1c48-4697-8229-1612d9341c74"). InnerVolumeSpecName "kube-api-access-tk89j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:02:14.356654 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:14.356632    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/752f2389-1c48-4697-8229-1612d9341c74-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "752f2389-1c48-4697-8229-1612d9341c74" (UID: "752f2389-1c48-4697-8229-1612d9341c74"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:02:14.453915 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:14.453882    2558 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/752f2389-1c48-4697-8229-1612d9341c74-istio-kubeconfig\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:02:14.453915 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:14.453913    2558 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/752f2389-1c48-4697-8229-1612d9341c74-istio-csr-ca-configmap\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:02:14.453915 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:14.453922    2558 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/752f2389-1c48-4697-8229-1612d9341c74-local-certs\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:02:14.454165 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:14.453933    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tk89j\" (UniqueName: \"kubernetes.io/projected/752f2389-1c48-4697-8229-1612d9341c74-kube-api-access-tk89j\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:02:14.454165 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:14.453946    2558 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/752f2389-1c48-4697-8229-1612d9341c74-cacerts\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:02:14.454165 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:14.453959    2558 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/752f2389-1c48-4697-8229-1612d9341c74-istio-csr-dns-cert\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:02:14.454165 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:14.453973    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/752f2389-1c48-4697-8229-1612d9341c74-istio-token\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:02:15.224576 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:15.224533    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l667g" event={"ID":"6dc35201-0282-4160-8c00-99a7ce9e5101","Type":"ContainerStarted","Data":"39e45c4d618759b8f7aa37c2e3a86424a32df1f4d28f7fe59ffe6b25d7c06253"}
Sep 07 17:02:15.224989 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:15.224582    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6rllt"
Sep 07 17:02:15.224989 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:15.224889    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l667g"
Sep 07 17:02:15.250609 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:15.250546    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l667g" podStartSLOduration=2.350032233 podStartE2EDuration="5.250526499s" totalImagesPullingTime="2.900494266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:02:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:02:15.248268856 +0000 UTC m=+352.279699647" watchObservedRunningTime="2026-09-07 17:02:15.250526499 +0000 UTC m=+352.281957293"
Sep 07 17:02:15.268478 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:15.268441    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6rllt"]
Sep 07 17:02:15.271910 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:15.271872    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6rllt"]
Sep 07 17:02:15.594610 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:15.594540    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="752f2389-1c48-4697-8229-1612d9341c74" path="/var/lib/kubelet/pods/752f2389-1c48-4697-8229-1612d9341c74/volumes"
Sep 07 17:02:45.230490 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:45.230458    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9b5nj"
Sep 07 17:02:47.235340 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:47.235306    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l667g"
Sep 07 17:02:53.392135 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:53.392097    2558 generic.go:356] "Generic (PLEG): container finished" podID="3dabb2db-254b-47a8-9aa3-42860d1a91cd" containerID="2d7d2057043b200d92edcca1ecd7a709d5afc9425b89d45abb86a054d025488a" exitCode=1
Sep 07 17:02:53.392587 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:53.392171    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9b5nj" event={"ID":"3dabb2db-254b-47a8-9aa3-42860d1a91cd","Type":"ContainerDied","Data":"2d7d2057043b200d92edcca1ecd7a709d5afc9425b89d45abb86a054d025488a"}
Sep 07 17:02:53.392587 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:53.392497    2558 scope.go:117] "RemoveContainer" containerID="2d7d2057043b200d92edcca1ecd7a709d5afc9425b89d45abb86a054d025488a"
Sep 07 17:02:54.397856 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:54.397822    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9b5nj" event={"ID":"3dabb2db-254b-47a8-9aa3-42860d1a91cd","Type":"ContainerStarted","Data":"a1732926733ff8253523f6b9592ffdd4688f7affb6bd9e2ffcc59d0a7b52cc90"}
Sep 07 17:02:54.398219 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:02:54.398028    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9b5nj"
Sep 07 17:03:25.407663 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:03:25.407620    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9b5nj"
Sep 07 17:03:57.186416 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:03:57.186337    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-qg2z4"]
Sep 07 17:03:57.186858 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:03:57.186636    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="752f2389-1c48-4697-8229-1612d9341c74" containerName="discovery"
Sep 07 17:03:57.186858 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:03:57.186648    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="752f2389-1c48-4697-8229-1612d9341c74" containerName="discovery"
Sep 07 17:03:57.186858 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:03:57.186710    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="752f2389-1c48-4697-8229-1612d9341c74" containerName="discovery"
Sep 07 17:03:57.189453 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:03:57.189431    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-qg2z4"
Sep 07 17:03:57.192202 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:03:57.192166    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-cxgwx\""
Sep 07 17:03:57.192793 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:03:57.192775    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 07 17:03:57.192845 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:03:57.192797    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 07 17:03:57.204774 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:03:57.204752    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-qg2z4"]
Sep 07 17:03:57.312532 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:03:57.312495    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m76lb\" (UniqueName: \"kubernetes.io/projected/28d1d893-cb6b-4a8c-a40b-fd36d2b8d2e2-kube-api-access-m76lb\") pod \"authorino-operator-68d88948d8-qg2z4\" (UID: \"28d1d893-cb6b-4a8c-a40b-fd36d2b8d2e2\") " pod="kuadrant-system/authorino-operator-68d88948d8-qg2z4"
Sep 07 17:03:57.413394 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:03:57.413358    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m76lb\" (UniqueName: \"kubernetes.io/projected/28d1d893-cb6b-4a8c-a40b-fd36d2b8d2e2-kube-api-access-m76lb\") pod \"authorino-operator-68d88948d8-qg2z4\" (UID: \"28d1d893-cb6b-4a8c-a40b-fd36d2b8d2e2\") " pod="kuadrant-system/authorino-operator-68d88948d8-qg2z4"
Sep 07 17:03:57.427783 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:03:57.427754    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m76lb\" (UniqueName: \"kubernetes.io/projected/28d1d893-cb6b-4a8c-a40b-fd36d2b8d2e2-kube-api-access-m76lb\") pod \"authorino-operator-68d88948d8-qg2z4\" (UID: \"28d1d893-cb6b-4a8c-a40b-fd36d2b8d2e2\") " pod="kuadrant-system/authorino-operator-68d88948d8-qg2z4"
Sep 07 17:03:57.499757 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:03:57.499657    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-qg2z4"
Sep 07 17:03:57.785483 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:03:57.785459    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-qg2z4"]
Sep 07 17:03:57.787912 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:03:57.787887    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28d1d893_cb6b_4a8c_a40b_fd36d2b8d2e2.slice/crio-6f902b9ba920108c0edbce0776bca254a483ec951c82a382ec441ff777053b0f WatchSource:0}: Error finding container 6f902b9ba920108c0edbce0776bca254a483ec951c82a382ec441ff777053b0f: Status 404 returned error can't find the container with id 6f902b9ba920108c0edbce0776bca254a483ec951c82a382ec441ff777053b0f
Sep 07 17:03:58.677643 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:03:58.677599    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-qg2z4" event={"ID":"28d1d893-cb6b-4a8c-a40b-fd36d2b8d2e2","Type":"ContainerStarted","Data":"6f902b9ba920108c0edbce0776bca254a483ec951c82a382ec441ff777053b0f"}
Sep 07 17:04:00.689570 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:00.689532    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-qg2z4" event={"ID":"28d1d893-cb6b-4a8c-a40b-fd36d2b8d2e2","Type":"ContainerStarted","Data":"d9f1e707602ee5f2d20da1e62d1ad92c0aaad0e5fd49a7509012ee16ede90bd8"}
Sep 07 17:04:00.689977 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:00.689615    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-qg2z4"
Sep 07 17:04:00.716127 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:00.716075    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-qg2z4" podStartSLOduration=1.0329605609999999 podStartE2EDuration="3.716058093s" totalImagesPullingTime="2.683097532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:03:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:04:00.714429353 +0000 UTC m=+457.745860145" watchObservedRunningTime="2026-09-07 17:04:00.716058093 +0000 UTC m=+457.747488883"
Sep 07 17:04:01.499427 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:01.499395    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dqjjz"]
Sep 07 17:04:01.502697 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:01.502679    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dqjjz"
Sep 07 17:04:01.506358 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:01.506332    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-clssw\""
Sep 07 17:04:01.526745 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:01.526710    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dqjjz"]
Sep 07 17:04:01.548480 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:01.548447    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b13d77ff-c681-49e7-8253-0695887321bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-dqjjz\" (UID: \"b13d77ff-c681-49e7-8253-0695887321bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dqjjz"
Sep 07 17:04:01.548652 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:01.548493    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcpvh\" (UniqueName: \"kubernetes.io/projected/b13d77ff-c681-49e7-8253-0695887321bb-kube-api-access-qcpvh\") pod \"kuadrant-operator-controller-manager-58fc56757c-dqjjz\" (UID: \"b13d77ff-c681-49e7-8253-0695887321bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dqjjz"
Sep 07 17:04:01.648908 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:01.648869    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b13d77ff-c681-49e7-8253-0695887321bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-dqjjz\" (UID: \"b13d77ff-c681-49e7-8253-0695887321bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dqjjz"
Sep 07 17:04:01.648908 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:01.648915    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcpvh\" (UniqueName: \"kubernetes.io/projected/b13d77ff-c681-49e7-8253-0695887321bb-kube-api-access-qcpvh\") pod \"kuadrant-operator-controller-manager-58fc56757c-dqjjz\" (UID: \"b13d77ff-c681-49e7-8253-0695887321bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dqjjz"
Sep 07 17:04:01.649287 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:01.649262    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b13d77ff-c681-49e7-8253-0695887321bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-dqjjz\" (UID: \"b13d77ff-c681-49e7-8253-0695887321bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dqjjz"
Sep 07 17:04:01.658898 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:01.658867    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcpvh\" (UniqueName: \"kubernetes.io/projected/b13d77ff-c681-49e7-8253-0695887321bb-kube-api-access-qcpvh\") pod \"kuadrant-operator-controller-manager-58fc56757c-dqjjz\" (UID: \"b13d77ff-c681-49e7-8253-0695887321bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dqjjz"
Sep 07 17:04:01.812268 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:01.812149    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dqjjz"
Sep 07 17:04:02.094867 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:02.094829    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dqjjz"]
Sep 07 17:04:02.096089 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:04:02.096060    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb13d77ff_c681_49e7_8253_0695887321bb.slice/crio-2a075d6a01ab6ba69d17932b89a3dcf0ec059378c9b5003be182fce12353b003 WatchSource:0}: Error finding container 2a075d6a01ab6ba69d17932b89a3dcf0ec059378c9b5003be182fce12353b003: Status 404 returned error can't find the container with id 2a075d6a01ab6ba69d17932b89a3dcf0ec059378c9b5003be182fce12353b003
Sep 07 17:04:02.700369 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:02.700332    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dqjjz" event={"ID":"b13d77ff-c681-49e7-8253-0695887321bb","Type":"ContainerStarted","Data":"2a075d6a01ab6ba69d17932b89a3dcf0ec059378c9b5003be182fce12353b003"}
Sep 07 17:04:03.800280 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:03.800224    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-5hpfd"]
Sep 07 17:04:03.804740 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:03.804719    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-5hpfd"
Sep 07 17:04:03.807477 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:03.807456    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-w25h9\""
Sep 07 17:04:03.808021 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:03.807999    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 07 17:04:03.820931 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:03.820905    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-5hpfd"]
Sep 07 17:04:03.868489 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:03.868436    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ww5g\" (UniqueName: \"kubernetes.io/projected/37a62ba3-3ee0-420b-a540-32f60d43b3d8-kube-api-access-4ww5g\") pod \"dns-operator-controller-manager-5985564776-5hpfd\" (UID: \"37a62ba3-3ee0-420b-a540-32f60d43b3d8\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-5hpfd"
Sep 07 17:04:03.969529 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:03.969487    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ww5g\" (UniqueName: \"kubernetes.io/projected/37a62ba3-3ee0-420b-a540-32f60d43b3d8-kube-api-access-4ww5g\") pod \"dns-operator-controller-manager-5985564776-5hpfd\" (UID: \"37a62ba3-3ee0-420b-a540-32f60d43b3d8\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-5hpfd"
Sep 07 17:04:03.986226 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:03.986193    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ww5g\" (UniqueName: \"kubernetes.io/projected/37a62ba3-3ee0-420b-a540-32f60d43b3d8-kube-api-access-4ww5g\") pod \"dns-operator-controller-manager-5985564776-5hpfd\" (UID: \"37a62ba3-3ee0-420b-a540-32f60d43b3d8\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-5hpfd"
Sep 07 17:04:04.114865 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:04.114827    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-5hpfd"
Sep 07 17:04:04.414184 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:04.414105    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-5hpfd"]
Sep 07 17:04:04.418000 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:04:04.417969    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37a62ba3_3ee0_420b_a540_32f60d43b3d8.slice/crio-cb082fab7ae1f3f911f1d26787ad6a1095c866a8f855bda88dde46ae41f1b4fe WatchSource:0}: Error finding container cb082fab7ae1f3f911f1d26787ad6a1095c866a8f855bda88dde46ae41f1b4fe: Status 404 returned error can't find the container with id cb082fab7ae1f3f911f1d26787ad6a1095c866a8f855bda88dde46ae41f1b4fe
Sep 07 17:04:04.709787 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:04.709706    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-5hpfd" event={"ID":"37a62ba3-3ee0-420b-a540-32f60d43b3d8","Type":"ContainerStarted","Data":"cb082fab7ae1f3f911f1d26787ad6a1095c866a8f855bda88dde46ae41f1b4fe"}
Sep 07 17:04:05.754971 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:05.754935    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lcw4h"]
Sep 07 17:04:05.759836 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:05.759814    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lcw4h"
Sep 07 17:04:05.762677 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:05.762657    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-bfhql\""
Sep 07 17:04:05.776876 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:05.776843    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lcw4h"]
Sep 07 17:04:05.786906 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:05.786885    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb2xz\" (UniqueName: \"kubernetes.io/projected/e2348386-0062-4192-a897-5f914768f800-kube-api-access-mb2xz\") pod \"limitador-operator-controller-manager-6c549b6d85-lcw4h\" (UID: \"e2348386-0062-4192-a897-5f914768f800\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lcw4h"
Sep 07 17:04:05.887377 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:05.887341    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb2xz\" (UniqueName: \"kubernetes.io/projected/e2348386-0062-4192-a897-5f914768f800-kube-api-access-mb2xz\") pod \"limitador-operator-controller-manager-6c549b6d85-lcw4h\" (UID: \"e2348386-0062-4192-a897-5f914768f800\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lcw4h"
Sep 07 17:04:05.897709 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:05.897676    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb2xz\" (UniqueName: \"kubernetes.io/projected/e2348386-0062-4192-a897-5f914768f800-kube-api-access-mb2xz\") pod \"limitador-operator-controller-manager-6c549b6d85-lcw4h\" (UID: \"e2348386-0062-4192-a897-5f914768f800\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lcw4h"
Sep 07 17:04:06.072854 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:06.072769    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lcw4h"
Sep 07 17:04:07.275500 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:07.275420    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lcw4h"]
Sep 07 17:04:07.278679 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:04:07.278653    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2348386_0062_4192_a897_5f914768f800.slice/crio-1cf1fc86d9f3f7f6e5d8c099f4338aab54c7613644b043ea6db2ee87e1d0b329 WatchSource:0}: Error finding container 1cf1fc86d9f3f7f6e5d8c099f4338aab54c7613644b043ea6db2ee87e1d0b329: Status 404 returned error can't find the container with id 1cf1fc86d9f3f7f6e5d8c099f4338aab54c7613644b043ea6db2ee87e1d0b329
Sep 07 17:04:07.729024 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:07.728969    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lcw4h" event={"ID":"e2348386-0062-4192-a897-5f914768f800","Type":"ContainerStarted","Data":"1cf1fc86d9f3f7f6e5d8c099f4338aab54c7613644b043ea6db2ee87e1d0b329"}
Sep 07 17:04:07.731054 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:07.731009    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dqjjz" event={"ID":"b13d77ff-c681-49e7-8253-0695887321bb","Type":"ContainerStarted","Data":"1f2611987bb3afa988faa192b8353159f866b0d9b8082676f3e650ac29972016"}
Sep 07 17:04:07.731198 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:07.731153    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dqjjz"
Sep 07 17:04:07.753352 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:07.753301    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dqjjz" podStartSLOduration=1.771422002 podStartE2EDuration="6.753284076s" totalImagesPullingTime="4.981862074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:04:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:04:07.75197226 +0000 UTC m=+464.783403062" watchObservedRunningTime="2026-09-07 17:04:07.753284076 +0000 UTC m=+464.784714848"
Sep 07 17:04:08.736693 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:08.736659    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-5hpfd" event={"ID":"37a62ba3-3ee0-420b-a540-32f60d43b3d8","Type":"ContainerStarted","Data":"c326ab81cabc4e564fff7fba728127dddb52e2adacd8ee1bc4e8f421d31c4ec5"}
Sep 07 17:04:08.754631 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:08.754574    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-5985564776-5hpfd" podStartSLOduration=1.536468035 podStartE2EDuration="5.754548641s" totalImagesPullingTime="4.218080606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:04:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:04:08.753414446 +0000 UTC m=+465.784845242" watchObservedRunningTime="2026-09-07 17:04:08.754548641 +0000 UTC m=+465.785979433"
Sep 07 17:04:09.741396 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:09.741358    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-5hpfd"
Sep 07 17:04:09.915081 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:09.915047    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-8dt2n"]
Sep 07 17:04:09.919233 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:09.919211    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-8dt2n"
Sep 07 17:04:09.922111 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:09.922084    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 07 17:04:09.922111 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:09.922104    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qm5ll\""
Sep 07 17:04:09.922693 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:09.922675    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 07 17:04:09.927801 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:09.927773    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-8dt2n"]
Sep 07 17:04:10.023961 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:10.023878    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/35f46763-9a47-4394-9453-12577eb35b3f-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-8dt2n\" (UID: \"35f46763-9a47-4394-9453-12577eb35b3f\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-8dt2n"
Sep 07 17:04:10.024132 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:10.023969    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8b7s\" (UniqueName: \"kubernetes.io/projected/35f46763-9a47-4394-9453-12577eb35b3f-kube-api-access-s8b7s\") pod \"kuadrant-console-plugin-598f86468b-8dt2n\" (UID: \"35f46763-9a47-4394-9453-12577eb35b3f\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-8dt2n"
Sep 07 17:04:10.024132 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:10.024014    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/35f46763-9a47-4394-9453-12577eb35b3f-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-8dt2n\" (UID: \"35f46763-9a47-4394-9453-12577eb35b3f\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-8dt2n"
Sep 07 17:04:10.125077 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:10.125041    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8b7s\" (UniqueName: \"kubernetes.io/projected/35f46763-9a47-4394-9453-12577eb35b3f-kube-api-access-s8b7s\") pod \"kuadrant-console-plugin-598f86468b-8dt2n\" (UID: \"35f46763-9a47-4394-9453-12577eb35b3f\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-8dt2n"
Sep 07 17:04:10.125288 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:10.125096    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/35f46763-9a47-4394-9453-12577eb35b3f-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-8dt2n\" (UID: \"35f46763-9a47-4394-9453-12577eb35b3f\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-8dt2n"
Sep 07 17:04:10.125288 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:10.125159    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/35f46763-9a47-4394-9453-12577eb35b3f-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-8dt2n\" (UID: \"35f46763-9a47-4394-9453-12577eb35b3f\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-8dt2n"
Sep 07 17:04:10.126057 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:10.126029    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/35f46763-9a47-4394-9453-12577eb35b3f-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-8dt2n\" (UID: \"35f46763-9a47-4394-9453-12577eb35b3f\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-8dt2n"
Sep 07 17:04:10.128282 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:10.128259    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/35f46763-9a47-4394-9453-12577eb35b3f-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-8dt2n\" (UID: \"35f46763-9a47-4394-9453-12577eb35b3f\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-8dt2n"
Sep 07 17:04:10.133715 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:10.133689    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8b7s\" (UniqueName: \"kubernetes.io/projected/35f46763-9a47-4394-9453-12577eb35b3f-kube-api-access-s8b7s\") pod \"kuadrant-console-plugin-598f86468b-8dt2n\" (UID: \"35f46763-9a47-4394-9453-12577eb35b3f\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-8dt2n"
Sep 07 17:04:10.232624 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:10.232584    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-8dt2n"
Sep 07 17:04:10.747201 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:10.747156    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lcw4h" event={"ID":"e2348386-0062-4192-a897-5f914768f800","Type":"ContainerStarted","Data":"2e0b5fd7e577df017bf175510bbb9c57b75023adbe4ef418f65a939db49c3300"}
Sep 07 17:04:10.747651 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:10.747419    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lcw4h"
Sep 07 17:04:10.767138 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:10.767089    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lcw4h" podStartSLOduration=2.469714365 podStartE2EDuration="5.767072899s" totalImagesPullingTime="3.297358534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:04:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:04:10.765091995 +0000 UTC m=+467.796522788" watchObservedRunningTime="2026-09-07 17:04:10.767072899 +0000 UTC m=+467.798503689"
Sep 07 17:04:10.788337 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:10.788313    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-8dt2n"]
Sep 07 17:04:10.790305 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:04:10.790281    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod35f46763_9a47_4394_9453_12577eb35b3f.slice/crio-15543f4427905bb7da59d2ac897b4d2c6f0ac5957edb4f73d430370fd0e343f8 WatchSource:0}: Error finding container 15543f4427905bb7da59d2ac897b4d2c6f0ac5957edb4f73d430370fd0e343f8: Status 404 returned error can't find the container with id 15543f4427905bb7da59d2ac897b4d2c6f0ac5957edb4f73d430370fd0e343f8
Sep 07 17:04:11.697171 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:11.697136    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-qg2z4"
Sep 07 17:04:11.756658 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:11.756519    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-8dt2n" event={"ID":"35f46763-9a47-4394-9453-12577eb35b3f","Type":"ContainerStarted","Data":"15543f4427905bb7da59d2ac897b4d2c6f0ac5957edb4f73d430370fd0e343f8"}
Sep 07 17:04:15.777617 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:15.777519    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-8dt2n" event={"ID":"35f46763-9a47-4394-9453-12577eb35b3f","Type":"ContainerStarted","Data":"9cd611ebfae4c24d46061091ed03b17f3da9b25de4c05f0e1b6d7834930b62f0"}
Sep 07 17:04:15.797846 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:15.797797    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-8dt2n" podStartSLOduration=2.080202975 podStartE2EDuration="6.797779875s" totalImagesPullingTime="4.7175769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:04:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:04:15.796912245 +0000 UTC m=+472.828343037" watchObservedRunningTime="2026-09-07 17:04:15.797779875 +0000 UTC m=+472.829210670"
Sep 07 17:04:18.738987 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:18.738951    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dqjjz"
Sep 07 17:04:20.749289 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:20.749258    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-5hpfd"
Sep 07 17:04:20.830545 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:20.830508    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dqjjz"]
Sep 07 17:04:20.830766 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:20.830744    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dqjjz" podUID="b13d77ff-c681-49e7-8253-0695887321bb" containerName="manager" containerID="cri-o://1f2611987bb3afa988faa192b8353159f866b0d9b8082676f3e650ac29972016" gracePeriod=2
Sep 07 17:04:20.833577 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:04:20.833542    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-dqjjz\" is forbidden: User \"system:node:ip-10-0-131-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-84.ec2.internal' and this object" podUID="b13d77ff-c681-49e7-8253-0695887321bb" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dqjjz"
Sep 07 17:04:20.834410 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:20.834384    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dqjjz"]
Sep 07 17:04:20.854687 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:20.854655    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lcw4h"]
Sep 07 17:04:20.854905 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:20.854877    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lcw4h" podUID="e2348386-0062-4192-a897-5f914768f800" containerName="manager" containerID="cri-o://2e0b5fd7e577df017bf175510bbb9c57b75023adbe4ef418f65a939db49c3300" gracePeriod=2
Sep 07 17:04:20.856956 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:20.856931    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lcw4h"
Sep 07 17:04:20.857863 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:20.857838    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-z9sxr"]
Sep 07 17:04:20.858354 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:20.858335    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b13d77ff-c681-49e7-8253-0695887321bb" containerName="manager"
Sep 07 17:04:20.858506 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:20.858459    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b13d77ff-c681-49e7-8253-0695887321bb" containerName="manager"
Sep 07 17:04:20.860054 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:20.858897    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b13d77ff-c681-49e7-8253-0695887321bb" containerName="manager"
Sep 07 17:04:20.863135 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:20.863114    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lcw4h"]
Sep 07 17:04:20.863278 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:20.863262    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-z9sxr"
Sep 07 17:04:20.865740 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:04:20.865708    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-dqjjz\" is forbidden: User \"system:node:ip-10-0-131-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-84.ec2.internal' and this object" podUID="b13d77ff-c681-49e7-8253-0695887321bb" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dqjjz"
Sep 07 17:04:20.875954 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:20.875923    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-z9sxr"]
Sep 07 17:04:20.892309 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:20.892285    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fl9sb"]
Sep 07 17:04:20.892608 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:20.892596    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2348386-0062-4192-a897-5f914768f800" containerName="manager"
Sep 07 17:04:20.892645 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:20.892609    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2348386-0062-4192-a897-5f914768f800" containerName="manager"
Sep 07 17:04:20.892679 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:20.892674    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2348386-0062-4192-a897-5f914768f800" containerName="manager"
Sep 07 17:04:20.895875 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:20.895853    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fl9sb"
Sep 07 17:04:20.897564 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:20.897543    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fl9sb"]
Sep 07 17:04:20.916479 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:04:20.916451    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-lcw4h\" is forbidden: User \"system:node:ip-10-0-131-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-84.ec2.internal' and this object" podUID="e2348386-0062-4192-a897-5f914768f800" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lcw4h"
Sep 07 17:04:20.919215 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:04:20.919191    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-dqjjz\" is forbidden: User \"system:node:ip-10-0-131-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-84.ec2.internal' and this object" podUID="b13d77ff-c681-49e7-8253-0695887321bb" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dqjjz"
Sep 07 17:04:20.921635 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:04:20.921615    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-lcw4h\" is forbidden: User \"system:node:ip-10-0-131-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-84.ec2.internal' and this object" podUID="e2348386-0062-4192-a897-5f914768f800" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lcw4h"
Sep 07 17:04:20.922967 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:20.922950    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8vhc\" (UniqueName: \"kubernetes.io/projected/71a48d2a-2414-4dc0-8ce5-959cdb56408e-kube-api-access-t8vhc\") pod \"kuadrant-operator-controller-manager-58fc56757c-z9sxr\" (UID: \"71a48d2a-2414-4dc0-8ce5-959cdb56408e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-z9sxr"
Sep 07 17:04:20.923014 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:20.923000    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/71a48d2a-2414-4dc0-8ce5-959cdb56408e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-z9sxr\" (UID: \"71a48d2a-2414-4dc0-8ce5-959cdb56408e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-z9sxr"
Sep 07 17:04:20.949951 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:04:20.949917    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-dqjjz\" is forbidden: User \"system:node:ip-10-0-131-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-84.ec2.internal' and this object" podUID="b13d77ff-c681-49e7-8253-0695887321bb" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dqjjz"
Sep 07 17:04:21.023922 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.023862    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/71a48d2a-2414-4dc0-8ce5-959cdb56408e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-z9sxr\" (UID: \"71a48d2a-2414-4dc0-8ce5-959cdb56408e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-z9sxr"
Sep 07 17:04:21.024077 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.023971    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7d65\" (UniqueName: \"kubernetes.io/projected/e005c58a-0024-4ff3-ab1b-d0e6543a9885-kube-api-access-r7d65\") pod \"limitador-operator-controller-manager-6c549b6d85-fl9sb\" (UID: \"e005c58a-0024-4ff3-ab1b-d0e6543a9885\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fl9sb"
Sep 07 17:04:21.024077 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.024020    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8vhc\" (UniqueName: \"kubernetes.io/projected/71a48d2a-2414-4dc0-8ce5-959cdb56408e-kube-api-access-t8vhc\") pod \"kuadrant-operator-controller-manager-58fc56757c-z9sxr\" (UID: \"71a48d2a-2414-4dc0-8ce5-959cdb56408e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-z9sxr"
Sep 07 17:04:21.024382 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.024334    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/71a48d2a-2414-4dc0-8ce5-959cdb56408e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-z9sxr\" (UID: \"71a48d2a-2414-4dc0-8ce5-959cdb56408e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-z9sxr"
Sep 07 17:04:21.034675 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.034644    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8vhc\" (UniqueName: \"kubernetes.io/projected/71a48d2a-2414-4dc0-8ce5-959cdb56408e-kube-api-access-t8vhc\") pod \"kuadrant-operator-controller-manager-58fc56757c-z9sxr\" (UID: \"71a48d2a-2414-4dc0-8ce5-959cdb56408e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-z9sxr"
Sep 07 17:04:21.093478 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.093444    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dqjjz"
Sep 07 17:04:21.096080 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.096038    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lcw4h"
Sep 07 17:04:21.096443 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:04:21.096420    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-lcw4h\" is forbidden: User \"system:node:ip-10-0-131-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-84.ec2.internal' and this object" podUID="e2348386-0062-4192-a897-5f914768f800" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lcw4h"
Sep 07 17:04:21.099408 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:04:21.099386    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-dqjjz\" is forbidden: User \"system:node:ip-10-0-131-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-84.ec2.internal' and this object" podUID="b13d77ff-c681-49e7-8253-0695887321bb" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dqjjz"
Sep 07 17:04:21.102068 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:04:21.102045    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-lcw4h\" is forbidden: User \"system:node:ip-10-0-131-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-84.ec2.internal' and this object" podUID="e2348386-0062-4192-a897-5f914768f800" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lcw4h"
Sep 07 17:04:21.104295 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:04:21.104276    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-dqjjz\" is forbidden: User \"system:node:ip-10-0-131-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-84.ec2.internal' and this object" podUID="b13d77ff-c681-49e7-8253-0695887321bb" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dqjjz"
Sep 07 17:04:21.125255 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.125206    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7d65\" (UniqueName: \"kubernetes.io/projected/e005c58a-0024-4ff3-ab1b-d0e6543a9885-kube-api-access-r7d65\") pod \"limitador-operator-controller-manager-6c549b6d85-fl9sb\" (UID: \"e005c58a-0024-4ff3-ab1b-d0e6543a9885\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fl9sb"
Sep 07 17:04:21.145600 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.145566    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7d65\" (UniqueName: \"kubernetes.io/projected/e005c58a-0024-4ff3-ab1b-d0e6543a9885-kube-api-access-r7d65\") pod \"limitador-operator-controller-manager-6c549b6d85-fl9sb\" (UID: \"e005c58a-0024-4ff3-ab1b-d0e6543a9885\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fl9sb"
Sep 07 17:04:21.225748 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.225714    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mb2xz\" (UniqueName: \"kubernetes.io/projected/e2348386-0062-4192-a897-5f914768f800-kube-api-access-mb2xz\") pod \"e2348386-0062-4192-a897-5f914768f800\" (UID: \"e2348386-0062-4192-a897-5f914768f800\") "
Sep 07 17:04:21.225898 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.225786    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b13d77ff-c681-49e7-8253-0695887321bb-extensions-socket-volume\") pod \"b13d77ff-c681-49e7-8253-0695887321bb\" (UID: \"b13d77ff-c681-49e7-8253-0695887321bb\") "
Sep 07 17:04:21.225898 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.225811    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qcpvh\" (UniqueName: \"kubernetes.io/projected/b13d77ff-c681-49e7-8253-0695887321bb-kube-api-access-qcpvh\") pod \"b13d77ff-c681-49e7-8253-0695887321bb\" (UID: \"b13d77ff-c681-49e7-8253-0695887321bb\") "
Sep 07 17:04:21.226408 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.226377    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b13d77ff-c681-49e7-8253-0695887321bb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b13d77ff-c681-49e7-8253-0695887321bb" (UID: "b13d77ff-c681-49e7-8253-0695887321bb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:04:21.228008 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.227984    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b13d77ff-c681-49e7-8253-0695887321bb-kube-api-access-qcpvh" (OuterVolumeSpecName: "kube-api-access-qcpvh") pod "b13d77ff-c681-49e7-8253-0695887321bb" (UID: "b13d77ff-c681-49e7-8253-0695887321bb"). InnerVolumeSpecName "kube-api-access-qcpvh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:04:21.228008 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.227998    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2348386-0062-4192-a897-5f914768f800-kube-api-access-mb2xz" (OuterVolumeSpecName: "kube-api-access-mb2xz") pod "e2348386-0062-4192-a897-5f914768f800" (UID: "e2348386-0062-4192-a897-5f914768f800"). InnerVolumeSpecName "kube-api-access-mb2xz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:04:21.284131 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.284052    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-z9sxr"
Sep 07 17:04:21.289155 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.289133    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fl9sb"
Sep 07 17:04:21.327074 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.326992    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mb2xz\" (UniqueName: \"kubernetes.io/projected/e2348386-0062-4192-a897-5f914768f800-kube-api-access-mb2xz\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:04:21.327074 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.327034    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b13d77ff-c681-49e7-8253-0695887321bb-extensions-socket-volume\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:04:21.327386 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.327298    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qcpvh\" (UniqueName: \"kubernetes.io/projected/b13d77ff-c681-49e7-8253-0695887321bb-kube-api-access-qcpvh\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:04:21.575688 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.575660    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-z9sxr"]
Sep 07 17:04:21.576726 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:04:21.576704    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71a48d2a_2414_4dc0_8ce5_959cdb56408e.slice/crio-0174aa1c44cc13fc97c7811d442da355cf287511a57641b17be3e57a975e5e83 WatchSource:0}: Error finding container 0174aa1c44cc13fc97c7811d442da355cf287511a57641b17be3e57a975e5e83: Status 404 returned error can't find the container with id 0174aa1c44cc13fc97c7811d442da355cf287511a57641b17be3e57a975e5e83
Sep 07 17:04:21.577789 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.577765    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fl9sb"]
Sep 07 17:04:21.579428 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:04:21.579401    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode005c58a_0024_4ff3_ab1b_d0e6543a9885.slice/crio-0f8a81163a07672a88a440c5297485962e190f918de2a2a600ac8ee6767cffa2 WatchSource:0}: Error finding container 0f8a81163a07672a88a440c5297485962e190f918de2a2a600ac8ee6767cffa2: Status 404 returned error can't find the container with id 0f8a81163a07672a88a440c5297485962e190f918de2a2a600ac8ee6767cffa2
Sep 07 17:04:21.595103 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.595075    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b13d77ff-c681-49e7-8253-0695887321bb" path="/var/lib/kubelet/pods/b13d77ff-c681-49e7-8253-0695887321bb/volumes"
Sep 07 17:04:21.595560 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.595543    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2348386-0062-4192-a897-5f914768f800" path="/var/lib/kubelet/pods/e2348386-0062-4192-a897-5f914768f800/volumes"
Sep 07 17:04:21.810181 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.810147    2558 generic.go:356] "Generic (PLEG): container finished" podID="b13d77ff-c681-49e7-8253-0695887321bb" containerID="1f2611987bb3afa988faa192b8353159f866b0d9b8082676f3e650ac29972016" exitCode=0
Sep 07 17:04:21.810619 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.810210    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dqjjz"
Sep 07 17:04:21.810619 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.810266    2558 scope.go:117] "RemoveContainer" containerID="1f2611987bb3afa988faa192b8353159f866b0d9b8082676f3e650ac29972016"
Sep 07 17:04:21.812313 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.812285    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fl9sb" event={"ID":"e005c58a-0024-4ff3-ab1b-d0e6543a9885","Type":"ContainerStarted","Data":"ac0886f07bed227adb2d0a396ba2da803cfb3ce8f0e09cfcd419a165c12fd4a5"}
Sep 07 17:04:21.812439 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.812344    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fl9sb" event={"ID":"e005c58a-0024-4ff3-ab1b-d0e6543a9885","Type":"ContainerStarted","Data":"0f8a81163a07672a88a440c5297485962e190f918de2a2a600ac8ee6767cffa2"}
Sep 07 17:04:21.812439 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.812402    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fl9sb"
Sep 07 17:04:21.814110 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.814082    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-z9sxr" event={"ID":"71a48d2a-2414-4dc0-8ce5-959cdb56408e","Type":"ContainerStarted","Data":"3ee800626a5d21fe7df07288164c4c14200451ce567a655815f938f293955cc2"}
Sep 07 17:04:21.814212 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.814117    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-z9sxr" event={"ID":"71a48d2a-2414-4dc0-8ce5-959cdb56408e","Type":"ContainerStarted","Data":"0174aa1c44cc13fc97c7811d442da355cf287511a57641b17be3e57a975e5e83"}
Sep 07 17:04:21.814212 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.814157    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-z9sxr"
Sep 07 17:04:21.815425 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.815403    2558 generic.go:356] "Generic (PLEG): container finished" podID="e2348386-0062-4192-a897-5f914768f800" containerID="2e0b5fd7e577df017bf175510bbb9c57b75023adbe4ef418f65a939db49c3300" exitCode=0
Sep 07 17:04:21.815498 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.815448    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lcw4h"
Sep 07 17:04:21.819748 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.819735    2558 scope.go:117] "RemoveContainer" containerID="1f2611987bb3afa988faa192b8353159f866b0d9b8082676f3e650ac29972016"
Sep 07 17:04:21.819999 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:04:21.819982    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f2611987bb3afa988faa192b8353159f866b0d9b8082676f3e650ac29972016\": container with ID starting with 1f2611987bb3afa988faa192b8353159f866b0d9b8082676f3e650ac29972016 not found: ID does not exist" containerID="1f2611987bb3afa988faa192b8353159f866b0d9b8082676f3e650ac29972016"
Sep 07 17:04:21.820033 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.820008    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f2611987bb3afa988faa192b8353159f866b0d9b8082676f3e650ac29972016"} err="failed to get container status \"1f2611987bb3afa988faa192b8353159f866b0d9b8082676f3e650ac29972016\": rpc error: code = NotFound desc = could not find container \"1f2611987bb3afa988faa192b8353159f866b0d9b8082676f3e650ac29972016\": container with ID starting with 1f2611987bb3afa988faa192b8353159f866b0d9b8082676f3e650ac29972016 not found: ID does not exist"
Sep 07 17:04:21.820033 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.820024    2558 scope.go:117] "RemoveContainer" containerID="2e0b5fd7e577df017bf175510bbb9c57b75023adbe4ef418f65a939db49c3300"
Sep 07 17:04:21.827116 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.827099    2558 scope.go:117] "RemoveContainer" containerID="2e0b5fd7e577df017bf175510bbb9c57b75023adbe4ef418f65a939db49c3300"
Sep 07 17:04:21.827392 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:04:21.827374    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e0b5fd7e577df017bf175510bbb9c57b75023adbe4ef418f65a939db49c3300\": container with ID starting with 2e0b5fd7e577df017bf175510bbb9c57b75023adbe4ef418f65a939db49c3300 not found: ID does not exist" containerID="2e0b5fd7e577df017bf175510bbb9c57b75023adbe4ef418f65a939db49c3300"
Sep 07 17:04:21.827442 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.827397    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e0b5fd7e577df017bf175510bbb9c57b75023adbe4ef418f65a939db49c3300"} err="failed to get container status \"2e0b5fd7e577df017bf175510bbb9c57b75023adbe4ef418f65a939db49c3300\": rpc error: code = NotFound desc = could not find container \"2e0b5fd7e577df017bf175510bbb9c57b75023adbe4ef418f65a939db49c3300\": container with ID starting with 2e0b5fd7e577df017bf175510bbb9c57b75023adbe4ef418f65a939db49c3300 not found: ID does not exist"
Sep 07 17:04:21.834533 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.834498    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fl9sb" podStartSLOduration=1.834485757 podStartE2EDuration="1.834485757s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:04:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:04:21.832493774 +0000 UTC m=+478.863924567" watchObservedRunningTime="2026-09-07 17:04:21.834485757 +0000 UTC m=+478.865916593"
Sep 07 17:04:21.861054 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:21.860994    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-z9sxr" podStartSLOduration=1.860970659 podStartE2EDuration="1.860970659s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:04:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:04:21.859745642 +0000 UTC m=+478.891176432" watchObservedRunningTime="2026-09-07 17:04:21.860970659 +0000 UTC m=+478.892401451"
Sep 07 17:04:32.825355 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:32.825322    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fl9sb"
Sep 07 17:04:32.825823 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:32.825393    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-z9sxr"
Sep 07 17:04:39.166068 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:39.166032    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-z9sxr"]
Sep 07 17:04:39.166503 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:39.166258    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-z9sxr" podUID="71a48d2a-2414-4dc0-8ce5-959cdb56408e" containerName="manager" containerID="cri-o://3ee800626a5d21fe7df07288164c4c14200451ce567a655815f938f293955cc2" gracePeriod=10
Sep 07 17:04:39.414801 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:39.414771    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-z9sxr"
Sep 07 17:04:39.583574 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:39.583491    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/71a48d2a-2414-4dc0-8ce5-959cdb56408e-extensions-socket-volume\") pod \"71a48d2a-2414-4dc0-8ce5-959cdb56408e\" (UID: \"71a48d2a-2414-4dc0-8ce5-959cdb56408e\") "
Sep 07 17:04:39.583574 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:39.583537    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8vhc\" (UniqueName: \"kubernetes.io/projected/71a48d2a-2414-4dc0-8ce5-959cdb56408e-kube-api-access-t8vhc\") pod \"71a48d2a-2414-4dc0-8ce5-959cdb56408e\" (UID: \"71a48d2a-2414-4dc0-8ce5-959cdb56408e\") "
Sep 07 17:04:39.583976 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:39.583941    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71a48d2a-2414-4dc0-8ce5-959cdb56408e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "71a48d2a-2414-4dc0-8ce5-959cdb56408e" (UID: "71a48d2a-2414-4dc0-8ce5-959cdb56408e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:04:39.585637 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:39.585611    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71a48d2a-2414-4dc0-8ce5-959cdb56408e-kube-api-access-t8vhc" (OuterVolumeSpecName: "kube-api-access-t8vhc") pod "71a48d2a-2414-4dc0-8ce5-959cdb56408e" (UID: "71a48d2a-2414-4dc0-8ce5-959cdb56408e"). InnerVolumeSpecName "kube-api-access-t8vhc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:04:39.685140 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:39.685107    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/71a48d2a-2414-4dc0-8ce5-959cdb56408e-extensions-socket-volume\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:04:39.685140 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:39.685133    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8vhc\" (UniqueName: \"kubernetes.io/projected/71a48d2a-2414-4dc0-8ce5-959cdb56408e-kube-api-access-t8vhc\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:04:39.911027 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:39.910988    2558 generic.go:356] "Generic (PLEG): container finished" podID="71a48d2a-2414-4dc0-8ce5-959cdb56408e" containerID="3ee800626a5d21fe7df07288164c4c14200451ce567a655815f938f293955cc2" exitCode=0
Sep 07 17:04:39.911228 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:39.911035    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-z9sxr"
Sep 07 17:04:39.911228 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:39.911037    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-z9sxr" event={"ID":"71a48d2a-2414-4dc0-8ce5-959cdb56408e","Type":"ContainerDied","Data":"3ee800626a5d21fe7df07288164c4c14200451ce567a655815f938f293955cc2"}
Sep 07 17:04:39.911228 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:39.911173    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-z9sxr" event={"ID":"71a48d2a-2414-4dc0-8ce5-959cdb56408e","Type":"ContainerDied","Data":"0174aa1c44cc13fc97c7811d442da355cf287511a57641b17be3e57a975e5e83"}
Sep 07 17:04:39.911228 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:39.911209    2558 scope.go:117] "RemoveContainer" containerID="3ee800626a5d21fe7df07288164c4c14200451ce567a655815f938f293955cc2"
Sep 07 17:04:39.920025 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:39.920003    2558 scope.go:117] "RemoveContainer" containerID="3ee800626a5d21fe7df07288164c4c14200451ce567a655815f938f293955cc2"
Sep 07 17:04:39.920329 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:04:39.920308    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ee800626a5d21fe7df07288164c4c14200451ce567a655815f938f293955cc2\": container with ID starting with 3ee800626a5d21fe7df07288164c4c14200451ce567a655815f938f293955cc2 not found: ID does not exist" containerID="3ee800626a5d21fe7df07288164c4c14200451ce567a655815f938f293955cc2"
Sep 07 17:04:39.920398 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:39.920346    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ee800626a5d21fe7df07288164c4c14200451ce567a655815f938f293955cc2"} err="failed to get container status \"3ee800626a5d21fe7df07288164c4c14200451ce567a655815f938f293955cc2\": rpc error: code = NotFound desc = could not find container \"3ee800626a5d21fe7df07288164c4c14200451ce567a655815f938f293955cc2\": container with ID starting with 3ee800626a5d21fe7df07288164c4c14200451ce567a655815f938f293955cc2 not found: ID does not exist"
Sep 07 17:04:39.930306 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:39.930279    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-z9sxr"]
Sep 07 17:04:39.934381 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:39.934357    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-z9sxr"]
Sep 07 17:04:41.593208 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:41.593177    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71a48d2a-2414-4dc0-8ce5-959cdb56408e" path="/var/lib/kubelet/pods/71a48d2a-2414-4dc0-8ce5-959cdb56408e/volumes"
Sep 07 17:04:55.596264 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:55.596214    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz"]
Sep 07 17:04:55.596640 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:55.596574    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71a48d2a-2414-4dc0-8ce5-959cdb56408e" containerName="manager"
Sep 07 17:04:55.596640 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:55.596586    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="71a48d2a-2414-4dc0-8ce5-959cdb56408e" containerName="manager"
Sep 07 17:04:55.596719 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:55.596645    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="71a48d2a-2414-4dc0-8ce5-959cdb56408e" containerName="manager"
Sep 07 17:04:55.603937 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:55.603915    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz"
Sep 07 17:04:55.606459 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:55.606438    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-djltz\""
Sep 07 17:04:55.611847 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:55.611576    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz"]
Sep 07 17:04:55.614809 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:55.614779    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c7d1bab-dd03-424b-a348-0576b99f691f-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wk6hz\" (UID: \"9c7d1bab-dd03-424b-a348-0576b99f691f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz"
Sep 07 17:04:55.614904 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:55.614834    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v8kd\" (UniqueName: \"kubernetes.io/projected/9c7d1bab-dd03-424b-a348-0576b99f691f-kube-api-access-2v8kd\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wk6hz\" (UID: \"9c7d1bab-dd03-424b-a348-0576b99f691f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz"
Sep 07 17:04:55.614904 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:55.614871    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c7d1bab-dd03-424b-a348-0576b99f691f-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wk6hz\" (UID: \"9c7d1bab-dd03-424b-a348-0576b99f691f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz"
Sep 07 17:04:55.614904 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:55.614897    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c7d1bab-dd03-424b-a348-0576b99f691f-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wk6hz\" (UID: \"9c7d1bab-dd03-424b-a348-0576b99f691f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz"
Sep 07 17:04:55.615003 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:55.614954    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c7d1bab-dd03-424b-a348-0576b99f691f-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wk6hz\" (UID: \"9c7d1bab-dd03-424b-a348-0576b99f691f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz"
Sep 07 17:04:55.615003 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:55.614998    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c7d1bab-dd03-424b-a348-0576b99f691f-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wk6hz\" (UID: \"9c7d1bab-dd03-424b-a348-0576b99f691f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz"
Sep 07 17:04:55.615072 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:55.615024    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c7d1bab-dd03-424b-a348-0576b99f691f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wk6hz\" (UID: \"9c7d1bab-dd03-424b-a348-0576b99f691f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz"
Sep 07 17:04:55.615128 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:55.615071    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c7d1bab-dd03-424b-a348-0576b99f691f-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wk6hz\" (UID: \"9c7d1bab-dd03-424b-a348-0576b99f691f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz"
Sep 07 17:04:55.615180 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:55.615147    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c7d1bab-dd03-424b-a348-0576b99f691f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wk6hz\" (UID: \"9c7d1bab-dd03-424b-a348-0576b99f691f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz"
Sep 07 17:04:55.716486 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:55.716448    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c7d1bab-dd03-424b-a348-0576b99f691f-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wk6hz\" (UID: \"9c7d1bab-dd03-424b-a348-0576b99f691f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz"
Sep 07 17:04:55.716486 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:55.716490    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v8kd\" (UniqueName: \"kubernetes.io/projected/9c7d1bab-dd03-424b-a348-0576b99f691f-kube-api-access-2v8kd\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wk6hz\" (UID: \"9c7d1bab-dd03-424b-a348-0576b99f691f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz"
Sep 07 17:04:55.716714 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:55.716608    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c7d1bab-dd03-424b-a348-0576b99f691f-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wk6hz\" (UID: \"9c7d1bab-dd03-424b-a348-0576b99f691f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz"
Sep 07 17:04:55.716714 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:55.716639    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c7d1bab-dd03-424b-a348-0576b99f691f-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wk6hz\" (UID: \"9c7d1bab-dd03-424b-a348-0576b99f691f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz"
Sep 07 17:04:55.716714 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:55.716674    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c7d1bab-dd03-424b-a348-0576b99f691f-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wk6hz\" (UID: \"9c7d1bab-dd03-424b-a348-0576b99f691f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz"
Sep 07 17:04:55.716923 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:55.716718    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c7d1bab-dd03-424b-a348-0576b99f691f-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wk6hz\" (UID: \"9c7d1bab-dd03-424b-a348-0576b99f691f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz"
Sep 07 17:04:55.716923 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:55.716744    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c7d1bab-dd03-424b-a348-0576b99f691f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wk6hz\" (UID: \"9c7d1bab-dd03-424b-a348-0576b99f691f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz"
Sep 07 17:04:55.716923 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:55.716767    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c7d1bab-dd03-424b-a348-0576b99f691f-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wk6hz\" (UID: \"9c7d1bab-dd03-424b-a348-0576b99f691f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz"
Sep 07 17:04:55.716923 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:55.716812    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c7d1bab-dd03-424b-a348-0576b99f691f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wk6hz\" (UID: \"9c7d1bab-dd03-424b-a348-0576b99f691f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz"
Sep 07 17:04:55.716923 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:55.716852    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c7d1bab-dd03-424b-a348-0576b99f691f-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wk6hz\" (UID: \"9c7d1bab-dd03-424b-a348-0576b99f691f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz"
Sep 07 17:04:55.717147 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:55.716990    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c7d1bab-dd03-424b-a348-0576b99f691f-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wk6hz\" (UID: \"9c7d1bab-dd03-424b-a348-0576b99f691f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz"
Sep 07 17:04:55.717147 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:55.717047    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c7d1bab-dd03-424b-a348-0576b99f691f-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wk6hz\" (UID: \"9c7d1bab-dd03-424b-a348-0576b99f691f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz"
Sep 07 17:04:55.717147 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:55.717086    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c7d1bab-dd03-424b-a348-0576b99f691f-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wk6hz\" (UID: \"9c7d1bab-dd03-424b-a348-0576b99f691f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz"
Sep 07 17:04:55.717626 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:55.717599    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c7d1bab-dd03-424b-a348-0576b99f691f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wk6hz\" (UID: \"9c7d1bab-dd03-424b-a348-0576b99f691f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz"
Sep 07 17:04:55.719066 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:55.719045    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c7d1bab-dd03-424b-a348-0576b99f691f-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wk6hz\" (UID: \"9c7d1bab-dd03-424b-a348-0576b99f691f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz"
Sep 07 17:04:55.719384 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:55.719365    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c7d1bab-dd03-424b-a348-0576b99f691f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wk6hz\" (UID: \"9c7d1bab-dd03-424b-a348-0576b99f691f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz"
Sep 07 17:04:55.725180 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:55.725155    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c7d1bab-dd03-424b-a348-0576b99f691f-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wk6hz\" (UID: \"9c7d1bab-dd03-424b-a348-0576b99f691f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz"
Sep 07 17:04:55.725404 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:55.725386    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v8kd\" (UniqueName: \"kubernetes.io/projected/9c7d1bab-dd03-424b-a348-0576b99f691f-kube-api-access-2v8kd\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wk6hz\" (UID: \"9c7d1bab-dd03-424b-a348-0576b99f691f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz"
Sep 07 17:04:55.916486 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:55.916447    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz"
Sep 07 17:04:56.196502 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:56.196425    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz"]
Sep 07 17:04:56.200467 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:04:56.200439    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c7d1bab_dd03_424b_a348_0576b99f691f.slice/crio-d7cbf665c957c5c646a0c12005076297928af218eed3ad2e0c56d78cd2aceb00 WatchSource:0}: Error finding container d7cbf665c957c5c646a0c12005076297928af218eed3ad2e0c56d78cd2aceb00: Status 404 returned error can't find the container with id d7cbf665c957c5c646a0c12005076297928af218eed3ad2e0c56d78cd2aceb00
Sep 07 17:04:56.202733 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:56.202697    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:04:56.202792 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:56.202778    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:04:56.202835 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:56.202819    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:04:56.991597 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:56.991558    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz" event={"ID":"9c7d1bab-dd03-424b-a348-0576b99f691f","Type":"ContainerStarted","Data":"9bb6f13de7481935d1c5638b569c1fae634b4c13677f9b008584088d221f8e47"}
Sep 07 17:04:56.992018 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:56.991621    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz" event={"ID":"9c7d1bab-dd03-424b-a348-0576b99f691f","Type":"ContainerStarted","Data":"d7cbf665c957c5c646a0c12005076297928af218eed3ad2e0c56d78cd2aceb00"}
Sep 07 17:04:57.016429 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:57.016357    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz" podStartSLOduration=2.016335631 podStartE2EDuration="2.016335631s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:04:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:04:57.015645371 +0000 UTC m=+514.047076186" watchObservedRunningTime="2026-09-07 17:04:57.016335631 +0000 UTC m=+514.047766424"
Sep 07 17:04:57.917558 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:57.917517    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz"
Sep 07 17:04:57.922396 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:57.922369    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz"
Sep 07 17:04:57.999468 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:57.999431    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz"
Sep 07 17:04:58.002661 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:58.002632    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz"
Sep 07 17:04:58.132119 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:58.132086    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-qmxxq"]
Sep 07 17:04:58.135070 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:58.135053    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-qmxxq"
Sep 07 17:04:58.138560 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:58.138540    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 07 17:04:58.145503 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:58.145477    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-qmxxq"]
Sep 07 17:04:58.224155 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:58.224083    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-qmxxq"]
Sep 07 17:04:58.238138 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:58.238107    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twsnb\" (UniqueName: \"kubernetes.io/projected/452edc0d-2386-4f14-8ae0-793e4834094f-kube-api-access-twsnb\") pod \"limitador-limitador-859c4d96d6-qmxxq\" (UID: \"452edc0d-2386-4f14-8ae0-793e4834094f\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-qmxxq"
Sep 07 17:04:58.238138 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:58.238143    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/452edc0d-2386-4f14-8ae0-793e4834094f-config-file\") pod \"limitador-limitador-859c4d96d6-qmxxq\" (UID: \"452edc0d-2386-4f14-8ae0-793e4834094f\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-qmxxq"
Sep 07 17:04:58.338605 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:58.338570    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twsnb\" (UniqueName: \"kubernetes.io/projected/452edc0d-2386-4f14-8ae0-793e4834094f-kube-api-access-twsnb\") pod \"limitador-limitador-859c4d96d6-qmxxq\" (UID: \"452edc0d-2386-4f14-8ae0-793e4834094f\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-qmxxq"
Sep 07 17:04:58.338805 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:58.338615    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/452edc0d-2386-4f14-8ae0-793e4834094f-config-file\") pod \"limitador-limitador-859c4d96d6-qmxxq\" (UID: \"452edc0d-2386-4f14-8ae0-793e4834094f\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-qmxxq"
Sep 07 17:04:58.339519 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:58.339490    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/452edc0d-2386-4f14-8ae0-793e4834094f-config-file\") pod \"limitador-limitador-859c4d96d6-qmxxq\" (UID: \"452edc0d-2386-4f14-8ae0-793e4834094f\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-qmxxq"
Sep 07 17:04:58.347098 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:58.347073    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twsnb\" (UniqueName: \"kubernetes.io/projected/452edc0d-2386-4f14-8ae0-793e4834094f-kube-api-access-twsnb\") pod \"limitador-limitador-859c4d96d6-qmxxq\" (UID: \"452edc0d-2386-4f14-8ae0-793e4834094f\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-qmxxq"
Sep 07 17:04:58.446354 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:58.446314    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-qmxxq"
Sep 07 17:04:58.719869 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:58.719841    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-qmxxq"]
Sep 07 17:04:58.722321 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:04:58.722291    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod452edc0d_2386_4f14_8ae0_793e4834094f.slice/crio-1ed5bc658e79056362d393a9c368411684bc386770521627a9917887d88f1dba WatchSource:0}: Error finding container 1ed5bc658e79056362d393a9c368411684bc386770521627a9917887d88f1dba: Status 404 returned error can't find the container with id 1ed5bc658e79056362d393a9c368411684bc386770521627a9917887d88f1dba
Sep 07 17:04:58.967157 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:58.967119    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b54df94b4-nq8tt"]
Sep 07 17:04:58.971768 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:58.971744    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-nq8tt"
Sep 07 17:04:58.974175 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:58.974150    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ltmns\""
Sep 07 17:04:58.980803 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:58.980783    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-nq8tt"]
Sep 07 17:04:59.004434 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:59.004401    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-qmxxq" event={"ID":"452edc0d-2386-4f14-8ae0-793e4834094f","Type":"ContainerStarted","Data":"1ed5bc658e79056362d393a9c368411684bc386770521627a9917887d88f1dba"}
Sep 07 17:04:59.045588 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:59.045551    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6lgh\" (UniqueName: \"kubernetes.io/projected/69ed0537-58a0-4f8d-8b3e-010758972062-kube-api-access-m6lgh\") pod \"authorino-b54df94b4-nq8tt\" (UID: \"69ed0537-58a0-4f8d-8b3e-010758972062\") " pod="kuadrant-system/authorino-b54df94b4-nq8tt"
Sep 07 17:04:59.146200 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:59.146166    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6lgh\" (UniqueName: \"kubernetes.io/projected/69ed0537-58a0-4f8d-8b3e-010758972062-kube-api-access-m6lgh\") pod \"authorino-b54df94b4-nq8tt\" (UID: \"69ed0537-58a0-4f8d-8b3e-010758972062\") " pod="kuadrant-system/authorino-b54df94b4-nq8tt"
Sep 07 17:04:59.154688 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:59.154662    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6lgh\" (UniqueName: \"kubernetes.io/projected/69ed0537-58a0-4f8d-8b3e-010758972062-kube-api-access-m6lgh\") pod \"authorino-b54df94b4-nq8tt\" (UID: \"69ed0537-58a0-4f8d-8b3e-010758972062\") " pod="kuadrant-system/authorino-b54df94b4-nq8tt"
Sep 07 17:04:59.281956 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:59.281868    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-nq8tt"
Sep 07 17:04:59.550267 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:04:59.550217    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-nq8tt"]
Sep 07 17:04:59.552478 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:04:59.552450    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod69ed0537_58a0_4f8d_8b3e_010758972062.slice/crio-c55597f6f996b86f928137ebb822992223df03446ca6fb395f37f30b7501e451 WatchSource:0}: Error finding container c55597f6f996b86f928137ebb822992223df03446ca6fb395f37f30b7501e451: Status 404 returned error can't find the container with id c55597f6f996b86f928137ebb822992223df03446ca6fb395f37f30b7501e451
Sep 07 17:05:00.010163 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:00.010126    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-nq8tt" event={"ID":"69ed0537-58a0-4f8d-8b3e-010758972062","Type":"ContainerStarted","Data":"c55597f6f996b86f928137ebb822992223df03446ca6fb395f37f30b7501e451"}
Sep 07 17:05:01.017533 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:01.017497    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-qmxxq" event={"ID":"452edc0d-2386-4f14-8ae0-793e4834094f","Type":"ContainerStarted","Data":"c677b75fcefec7b14cc51e517500e1a797cbd83396e3ff428038a161c41e3cc3"}
Sep 07 17:05:01.017924 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:01.017652    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-qmxxq"
Sep 07 17:05:01.039250 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:01.039170    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-859c4d96d6-qmxxq" podStartSLOduration=1.706629588 podStartE2EDuration="3.039149986s" totalImagesPullingTime="1.332520398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:04:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:05:01.038976346 +0000 UTC m=+518.070407139" watchObservedRunningTime="2026-09-07 17:05:01.039149986 +0000 UTC m=+518.070580777"
Sep 07 17:05:02.024099 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:02.024058    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-nq8tt" event={"ID":"69ed0537-58a0-4f8d-8b3e-010758972062","Type":"ContainerStarted","Data":"d7863ddeb5c2d44fde85ee6bf2597b7e771df70f7016722f3068896893278d6b"}
Sep 07 17:05:02.044346 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:02.044290    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b54df94b4-nq8tt" podStartSLOduration=2.131883631 podStartE2EDuration="4.044275633s" totalImagesPullingTime="1.912392002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:04:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:05:02.042093195 +0000 UTC m=+519.073523986" watchObservedRunningTime="2026-09-07 17:05:02.044275633 +0000 UTC m=+519.075706425"
Sep 07 17:05:02.307231 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:02.307140    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-nq8tt"]
Sep 07 17:05:04.034359 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:04.034317    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b54df94b4-nq8tt" podUID="69ed0537-58a0-4f8d-8b3e-010758972062" containerName="authorino" containerID="cri-o://d7863ddeb5c2d44fde85ee6bf2597b7e771df70f7016722f3068896893278d6b" gracePeriod=30
Sep 07 17:05:04.287123 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:04.287062    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-nq8tt"
Sep 07 17:05:04.392154 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:04.392122    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6lgh\" (UniqueName: \"kubernetes.io/projected/69ed0537-58a0-4f8d-8b3e-010758972062-kube-api-access-m6lgh\") pod \"69ed0537-58a0-4f8d-8b3e-010758972062\" (UID: \"69ed0537-58a0-4f8d-8b3e-010758972062\") "
Sep 07 17:05:04.394210 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:04.394185    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69ed0537-58a0-4f8d-8b3e-010758972062-kube-api-access-m6lgh" (OuterVolumeSpecName: "kube-api-access-m6lgh") pod "69ed0537-58a0-4f8d-8b3e-010758972062" (UID: "69ed0537-58a0-4f8d-8b3e-010758972062"). InnerVolumeSpecName "kube-api-access-m6lgh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:05:04.493550 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:04.493503    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6lgh\" (UniqueName: \"kubernetes.io/projected/69ed0537-58a0-4f8d-8b3e-010758972062-kube-api-access-m6lgh\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:05:05.039767 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:05.039734    2558 generic.go:356] "Generic (PLEG): container finished" podID="69ed0537-58a0-4f8d-8b3e-010758972062" containerID="d7863ddeb5c2d44fde85ee6bf2597b7e771df70f7016722f3068896893278d6b" exitCode=0
Sep 07 17:05:05.040198 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:05.039775    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-nq8tt" event={"ID":"69ed0537-58a0-4f8d-8b3e-010758972062","Type":"ContainerDied","Data":"d7863ddeb5c2d44fde85ee6bf2597b7e771df70f7016722f3068896893278d6b"}
Sep 07 17:05:05.040198 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:05.039779    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-nq8tt"
Sep 07 17:05:05.040198 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:05.039802    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-nq8tt" event={"ID":"69ed0537-58a0-4f8d-8b3e-010758972062","Type":"ContainerDied","Data":"c55597f6f996b86f928137ebb822992223df03446ca6fb395f37f30b7501e451"}
Sep 07 17:05:05.040198 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:05.039818    2558 scope.go:117] "RemoveContainer" containerID="d7863ddeb5c2d44fde85ee6bf2597b7e771df70f7016722f3068896893278d6b"
Sep 07 17:05:05.048680 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:05.048662    2558 scope.go:117] "RemoveContainer" containerID="d7863ddeb5c2d44fde85ee6bf2597b7e771df70f7016722f3068896893278d6b"
Sep 07 17:05:05.048955 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:05:05.048936    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7863ddeb5c2d44fde85ee6bf2597b7e771df70f7016722f3068896893278d6b\": container with ID starting with d7863ddeb5c2d44fde85ee6bf2597b7e771df70f7016722f3068896893278d6b not found: ID does not exist" containerID="d7863ddeb5c2d44fde85ee6bf2597b7e771df70f7016722f3068896893278d6b"
Sep 07 17:05:05.049049 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:05.048961    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7863ddeb5c2d44fde85ee6bf2597b7e771df70f7016722f3068896893278d6b"} err="failed to get container status \"d7863ddeb5c2d44fde85ee6bf2597b7e771df70f7016722f3068896893278d6b\": rpc error: code = NotFound desc = could not find container \"d7863ddeb5c2d44fde85ee6bf2597b7e771df70f7016722f3068896893278d6b\": container with ID starting with d7863ddeb5c2d44fde85ee6bf2597b7e771df70f7016722f3068896893278d6b not found: ID does not exist"
Sep 07 17:05:05.068539 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:05.068510    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-nq8tt"]
Sep 07 17:05:05.070556 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:05.070537    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b54df94b4-nq8tt"]
Sep 07 17:05:05.596082 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:05.596046    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69ed0537-58a0-4f8d-8b3e-010758972062" path="/var/lib/kubelet/pods/69ed0537-58a0-4f8d-8b3e-010758972062/volumes"
Sep 07 17:05:12.025183 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:12.025150    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-qmxxq"
Sep 07 17:05:13.214822 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:13.214786    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-qmxxq"]
Sep 07 17:05:13.215303 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:13.214982    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-859c4d96d6-qmxxq" podUID="452edc0d-2386-4f14-8ae0-793e4834094f" containerName="limitador" containerID="cri-o://c677b75fcefec7b14cc51e517500e1a797cbd83396e3ff428038a161c41e3cc3" gracePeriod=30
Sep 07 17:05:13.763377 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:13.763350    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-qmxxq"
Sep 07 17:05:13.872461 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:13.872429    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/452edc0d-2386-4f14-8ae0-793e4834094f-config-file\") pod \"452edc0d-2386-4f14-8ae0-793e4834094f\" (UID: \"452edc0d-2386-4f14-8ae0-793e4834094f\") "
Sep 07 17:05:13.872620 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:13.872540    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twsnb\" (UniqueName: \"kubernetes.io/projected/452edc0d-2386-4f14-8ae0-793e4834094f-kube-api-access-twsnb\") pod \"452edc0d-2386-4f14-8ae0-793e4834094f\" (UID: \"452edc0d-2386-4f14-8ae0-793e4834094f\") "
Sep 07 17:05:13.872839 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:13.872819    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/452edc0d-2386-4f14-8ae0-793e4834094f-config-file" (OuterVolumeSpecName: "config-file") pod "452edc0d-2386-4f14-8ae0-793e4834094f" (UID: "452edc0d-2386-4f14-8ae0-793e4834094f"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:05:13.874480 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:13.874458    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/452edc0d-2386-4f14-8ae0-793e4834094f-kube-api-access-twsnb" (OuterVolumeSpecName: "kube-api-access-twsnb") pod "452edc0d-2386-4f14-8ae0-793e4834094f" (UID: "452edc0d-2386-4f14-8ae0-793e4834094f"). InnerVolumeSpecName "kube-api-access-twsnb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:05:13.973391 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:13.973347    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twsnb\" (UniqueName: \"kubernetes.io/projected/452edc0d-2386-4f14-8ae0-793e4834094f-kube-api-access-twsnb\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:05:13.973391 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:13.973383    2558 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/452edc0d-2386-4f14-8ae0-793e4834094f-config-file\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:05:14.086266 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:14.086207    2558 generic.go:356] "Generic (PLEG): container finished" podID="452edc0d-2386-4f14-8ae0-793e4834094f" containerID="c677b75fcefec7b14cc51e517500e1a797cbd83396e3ff428038a161c41e3cc3" exitCode=0
Sep 07 17:05:14.086441 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:14.086282    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-qmxxq"
Sep 07 17:05:14.086441 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:14.086296    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-qmxxq" event={"ID":"452edc0d-2386-4f14-8ae0-793e4834094f","Type":"ContainerDied","Data":"c677b75fcefec7b14cc51e517500e1a797cbd83396e3ff428038a161c41e3cc3"}
Sep 07 17:05:14.086441 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:14.086360    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-qmxxq" event={"ID":"452edc0d-2386-4f14-8ae0-793e4834094f","Type":"ContainerDied","Data":"1ed5bc658e79056362d393a9c368411684bc386770521627a9917887d88f1dba"}
Sep 07 17:05:14.086441 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:14.086389    2558 scope.go:117] "RemoveContainer" containerID="c677b75fcefec7b14cc51e517500e1a797cbd83396e3ff428038a161c41e3cc3"
Sep 07 17:05:14.095066 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:14.095046    2558 scope.go:117] "RemoveContainer" containerID="c677b75fcefec7b14cc51e517500e1a797cbd83396e3ff428038a161c41e3cc3"
Sep 07 17:05:14.095324 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:05:14.095305    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c677b75fcefec7b14cc51e517500e1a797cbd83396e3ff428038a161c41e3cc3\": container with ID starting with c677b75fcefec7b14cc51e517500e1a797cbd83396e3ff428038a161c41e3cc3 not found: ID does not exist" containerID="c677b75fcefec7b14cc51e517500e1a797cbd83396e3ff428038a161c41e3cc3"
Sep 07 17:05:14.095390 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:14.095331    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c677b75fcefec7b14cc51e517500e1a797cbd83396e3ff428038a161c41e3cc3"} err="failed to get container status \"c677b75fcefec7b14cc51e517500e1a797cbd83396e3ff428038a161c41e3cc3\": rpc error: code = NotFound desc = could not find container \"c677b75fcefec7b14cc51e517500e1a797cbd83396e3ff428038a161c41e3cc3\": container with ID starting with c677b75fcefec7b14cc51e517500e1a797cbd83396e3ff428038a161c41e3cc3 not found: ID does not exist"
Sep 07 17:05:14.107937 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:14.107914    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-qmxxq"]
Sep 07 17:05:14.112299 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:14.112278    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-qmxxq"]
Sep 07 17:05:14.674487 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:14.674453    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-xx86k"]
Sep 07 17:05:14.674888 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:14.674789    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69ed0537-58a0-4f8d-8b3e-010758972062" containerName="authorino"
Sep 07 17:05:14.674888 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:14.674799    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="69ed0537-58a0-4f8d-8b3e-010758972062" containerName="authorino"
Sep 07 17:05:14.674888 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:14.674812    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="452edc0d-2386-4f14-8ae0-793e4834094f" containerName="limitador"
Sep 07 17:05:14.674888 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:14.674817    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="452edc0d-2386-4f14-8ae0-793e4834094f" containerName="limitador"
Sep 07 17:05:14.674888 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:14.674866    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="452edc0d-2386-4f14-8ae0-793e4834094f" containerName="limitador"
Sep 07 17:05:14.674888 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:14.674876    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="69ed0537-58a0-4f8d-8b3e-010758972062" containerName="authorino"
Sep 07 17:05:14.679180 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:14.679158    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx86k"
Sep 07 17:05:14.681824 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:14.681802    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 17:05:14.681930 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:14.681835    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 07 17:05:14.681930 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:14.681836    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-9xhtl\""
Sep 07 17:05:14.682899 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:14.682884    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 07 17:05:14.687188 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:14.687168    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-xx86k"]
Sep 07 17:05:14.785632 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:14.780993    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlgqc\" (UniqueName: \"kubernetes.io/projected/bcd96fa7-a697-4903-ba6a-92181c1bcc5b-kube-api-access-rlgqc\") pod \"postgres-69fb4594cf-xx86k\" (UID: \"bcd96fa7-a697-4903-ba6a-92181c1bcc5b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx86k"
Sep 07 17:05:14.785632 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:14.781069    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bcd96fa7-a697-4903-ba6a-92181c1bcc5b-data\") pod \"postgres-69fb4594cf-xx86k\" (UID: \"bcd96fa7-a697-4903-ba6a-92181c1bcc5b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx86k"
Sep 07 17:05:14.882262 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:14.882183    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlgqc\" (UniqueName: \"kubernetes.io/projected/bcd96fa7-a697-4903-ba6a-92181c1bcc5b-kube-api-access-rlgqc\") pod \"postgres-69fb4594cf-xx86k\" (UID: \"bcd96fa7-a697-4903-ba6a-92181c1bcc5b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx86k"
Sep 07 17:05:14.882451 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:14.882288    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bcd96fa7-a697-4903-ba6a-92181c1bcc5b-data\") pod \"postgres-69fb4594cf-xx86k\" (UID: \"bcd96fa7-a697-4903-ba6a-92181c1bcc5b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx86k"
Sep 07 17:05:14.882697 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:14.882676    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bcd96fa7-a697-4903-ba6a-92181c1bcc5b-data\") pod \"postgres-69fb4594cf-xx86k\" (UID: \"bcd96fa7-a697-4903-ba6a-92181c1bcc5b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx86k"
Sep 07 17:05:14.891363 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:14.891340    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlgqc\" (UniqueName: \"kubernetes.io/projected/bcd96fa7-a697-4903-ba6a-92181c1bcc5b-kube-api-access-rlgqc\") pod \"postgres-69fb4594cf-xx86k\" (UID: \"bcd96fa7-a697-4903-ba6a-92181c1bcc5b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx86k"
Sep 07 17:05:14.990069 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:14.989966    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx86k"
Sep 07 17:05:15.261572 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:15.261546    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-xx86k"]
Sep 07 17:05:15.263494 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:05:15.263462    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcd96fa7_a697_4903_ba6a_92181c1bcc5b.slice/crio-f664d9a7ad31a2e85ed49afb375b44b86c5ccf6c61c10a860edbc74ad920e5d0 WatchSource:0}: Error finding container f664d9a7ad31a2e85ed49afb375b44b86c5ccf6c61c10a860edbc74ad920e5d0: Status 404 returned error can't find the container with id f664d9a7ad31a2e85ed49afb375b44b86c5ccf6c61c10a860edbc74ad920e5d0
Sep 07 17:05:15.594190 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:15.594097    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="452edc0d-2386-4f14-8ae0-793e4834094f" path="/var/lib/kubelet/pods/452edc0d-2386-4f14-8ae0-793e4834094f/volumes"
Sep 07 17:05:16.097593 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:16.097553    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx86k" event={"ID":"bcd96fa7-a697-4903-ba6a-92181c1bcc5b","Type":"ContainerStarted","Data":"f664d9a7ad31a2e85ed49afb375b44b86c5ccf6c61c10a860edbc74ad920e5d0"}
Sep 07 17:05:21.129918 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:21.129881    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx86k" event={"ID":"bcd96fa7-a697-4903-ba6a-92181c1bcc5b","Type":"ContainerStarted","Data":"19be2337b4772290a7b29f532e302bde46c52b6ecbbd89021e449e146a150c44"}
Sep 07 17:05:21.130309 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:21.130023    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx86k"
Sep 07 17:05:21.147855 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:21.147807    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx86k" podStartSLOduration=2.074415952 podStartE2EDuration="7.147792222s" totalImagesPullingTime="5.07337627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:05:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:05:21.146537453 +0000 UTC m=+538.177968246" watchObservedRunningTime="2026-09-07 17:05:21.147792222 +0000 UTC m=+538.179223013"
Sep 07 17:05:27.169164 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:27.169136    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx86k"
Sep 07 17:05:34.140149 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:34.140111    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5f9cb9585b-djcwn"]
Sep 07 17:05:34.162646 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:34.162612    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f9cb9585b-djcwn"]
Sep 07 17:05:34.162776 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:34.162727    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f9cb9585b-djcwn"
Sep 07 17:05:34.165690 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:34.165665    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 07 17:05:34.165847 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:34.165719    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8bspl\""
Sep 07 17:05:34.165910 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:34.165852    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 07 17:05:34.166803 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:34.166788    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 07 17:05:34.261365 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:34.261329    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e1e55a6-9b67-4d04-a76b-2b17b11368ee-metrics-certs\") pod \"maas-controller-5f9cb9585b-djcwn\" (UID: \"8e1e55a6-9b67-4d04-a76b-2b17b11368ee\") " pod="opendatahub/maas-controller-5f9cb9585b-djcwn"
Sep 07 17:05:34.261365 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:34.261367    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghzkz\" (UniqueName: \"kubernetes.io/projected/8e1e55a6-9b67-4d04-a76b-2b17b11368ee-kube-api-access-ghzkz\") pod \"maas-controller-5f9cb9585b-djcwn\" (UID: \"8e1e55a6-9b67-4d04-a76b-2b17b11368ee\") " pod="opendatahub/maas-controller-5f9cb9585b-djcwn"
Sep 07 17:05:34.261587 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:34.261457    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8e1e55a6-9b67-4d04-a76b-2b17b11368ee-webhook-cert\") pod \"maas-controller-5f9cb9585b-djcwn\" (UID: \"8e1e55a6-9b67-4d04-a76b-2b17b11368ee\") " pod="opendatahub/maas-controller-5f9cb9585b-djcwn"
Sep 07 17:05:34.324791 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:34.324752    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7fbf888cb7-zc6tl"]
Sep 07 17:05:34.326963 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:34.326942    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fbf888cb7-zc6tl"
Sep 07 17:05:34.340827 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:34.340800    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7fbf888cb7-zc6tl"]
Sep 07 17:05:34.362383 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:34.362345    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghzkz\" (UniqueName: \"kubernetes.io/projected/8e1e55a6-9b67-4d04-a76b-2b17b11368ee-kube-api-access-ghzkz\") pod \"maas-controller-5f9cb9585b-djcwn\" (UID: \"8e1e55a6-9b67-4d04-a76b-2b17b11368ee\") " pod="opendatahub/maas-controller-5f9cb9585b-djcwn"
Sep 07 17:05:34.362557 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:34.362404    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8e1e55a6-9b67-4d04-a76b-2b17b11368ee-webhook-cert\") pod \"maas-controller-5f9cb9585b-djcwn\" (UID: \"8e1e55a6-9b67-4d04-a76b-2b17b11368ee\") " pod="opendatahub/maas-controller-5f9cb9585b-djcwn"
Sep 07 17:05:34.362557 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:34.362464    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e1e55a6-9b67-4d04-a76b-2b17b11368ee-metrics-certs\") pod \"maas-controller-5f9cb9585b-djcwn\" (UID: \"8e1e55a6-9b67-4d04-a76b-2b17b11368ee\") " pod="opendatahub/maas-controller-5f9cb9585b-djcwn"
Sep 07 17:05:34.364941 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:34.364906    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e1e55a6-9b67-4d04-a76b-2b17b11368ee-metrics-certs\") pod \"maas-controller-5f9cb9585b-djcwn\" (UID: \"8e1e55a6-9b67-4d04-a76b-2b17b11368ee\") " pod="opendatahub/maas-controller-5f9cb9585b-djcwn"
Sep 07 17:05:34.365065 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:34.364991    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8e1e55a6-9b67-4d04-a76b-2b17b11368ee-webhook-cert\") pod \"maas-controller-5f9cb9585b-djcwn\" (UID: \"8e1e55a6-9b67-4d04-a76b-2b17b11368ee\") " pod="opendatahub/maas-controller-5f9cb9585b-djcwn"
Sep 07 17:05:34.371037 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:34.371013    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghzkz\" (UniqueName: \"kubernetes.io/projected/8e1e55a6-9b67-4d04-a76b-2b17b11368ee-kube-api-access-ghzkz\") pod \"maas-controller-5f9cb9585b-djcwn\" (UID: \"8e1e55a6-9b67-4d04-a76b-2b17b11368ee\") " pod="opendatahub/maas-controller-5f9cb9585b-djcwn"
Sep 07 17:05:34.463217 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:34.463133    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670-metrics-certs\") pod \"maas-controller-7fbf888cb7-zc6tl\" (UID: \"bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670\") " pod="opendatahub/maas-controller-7fbf888cb7-zc6tl"
Sep 07 17:05:34.463217 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:34.463193    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8g2k\" (UniqueName: \"kubernetes.io/projected/bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670-kube-api-access-v8g2k\") pod \"maas-controller-7fbf888cb7-zc6tl\" (UID: \"bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670\") " pod="opendatahub/maas-controller-7fbf888cb7-zc6tl"
Sep 07 17:05:34.463399 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:34.463345    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670-webhook-cert\") pod \"maas-controller-7fbf888cb7-zc6tl\" (UID: \"bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670\") " pod="opendatahub/maas-controller-7fbf888cb7-zc6tl"
Sep 07 17:05:34.473945 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:34.473925    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f9cb9585b-djcwn"
Sep 07 17:05:34.565414 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:34.564614    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8g2k\" (UniqueName: \"kubernetes.io/projected/bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670-kube-api-access-v8g2k\") pod \"maas-controller-7fbf888cb7-zc6tl\" (UID: \"bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670\") " pod="opendatahub/maas-controller-7fbf888cb7-zc6tl"
Sep 07 17:05:34.565414 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:34.564739    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670-webhook-cert\") pod \"maas-controller-7fbf888cb7-zc6tl\" (UID: \"bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670\") " pod="opendatahub/maas-controller-7fbf888cb7-zc6tl"
Sep 07 17:05:34.565414 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:34.564820    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670-metrics-certs\") pod \"maas-controller-7fbf888cb7-zc6tl\" (UID: \"bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670\") " pod="opendatahub/maas-controller-7fbf888cb7-zc6tl"
Sep 07 17:05:34.570936 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:34.570903    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670-metrics-certs\") pod \"maas-controller-7fbf888cb7-zc6tl\" (UID: \"bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670\") " pod="opendatahub/maas-controller-7fbf888cb7-zc6tl"
Sep 07 17:05:34.572056 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:34.572026    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670-webhook-cert\") pod \"maas-controller-7fbf888cb7-zc6tl\" (UID: \"bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670\") " pod="opendatahub/maas-controller-7fbf888cb7-zc6tl"
Sep 07 17:05:34.574862 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:34.574841    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8g2k\" (UniqueName: \"kubernetes.io/projected/bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670-kube-api-access-v8g2k\") pod \"maas-controller-7fbf888cb7-zc6tl\" (UID: \"bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670\") " pod="opendatahub/maas-controller-7fbf888cb7-zc6tl"
Sep 07 17:05:34.636864 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:34.636826    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fbf888cb7-zc6tl"
Sep 07 17:05:34.745047 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:34.745022    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f9cb9585b-djcwn"]
Sep 07 17:05:34.746810 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:05:34.746783    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e1e55a6_9b67_4d04_a76b_2b17b11368ee.slice/crio-2bcb61951dd9e3a050c445369439d4f7313f56565c740c160878c13828b3bbd3 WatchSource:0}: Error finding container 2bcb61951dd9e3a050c445369439d4f7313f56565c740c160878c13828b3bbd3: Status 404 returned error can't find the container with id 2bcb61951dd9e3a050c445369439d4f7313f56565c740c160878c13828b3bbd3
Sep 07 17:05:34.907198 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:34.907172    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7fbf888cb7-zc6tl"]
Sep 07 17:05:34.909645 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:05:34.909619    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfdf8166_06b2_4bf9_a54f_bc1b9c0bb670.slice/crio-c3f365422dd0c1b97a723f0383c7b8a8b7e8776d960aea4da55c20da4c65750d WatchSource:0}: Error finding container c3f365422dd0c1b97a723f0383c7b8a8b7e8776d960aea4da55c20da4c65750d: Status 404 returned error can't find the container with id c3f365422dd0c1b97a723f0383c7b8a8b7e8776d960aea4da55c20da4c65750d
Sep 07 17:05:35.205949 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:35.205914    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fbf888cb7-zc6tl" event={"ID":"bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670","Type":"ContainerStarted","Data":"c3f365422dd0c1b97a723f0383c7b8a8b7e8776d960aea4da55c20da4c65750d"}
Sep 07 17:05:35.207152 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:35.207116    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f9cb9585b-djcwn" event={"ID":"8e1e55a6-9b67-4d04-a76b-2b17b11368ee","Type":"ContainerStarted","Data":"2bcb61951dd9e3a050c445369439d4f7313f56565c740c160878c13828b3bbd3"}
Sep 07 17:05:38.224795 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:38.224758    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fbf888cb7-zc6tl" event={"ID":"bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670","Type":"ContainerStarted","Data":"18865e3f79a434f4ea186f495619585cc640ab90b1fb83d941cb37fe3ff10eca"}
Sep 07 17:05:38.225281 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:38.224818    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7fbf888cb7-zc6tl"
Sep 07 17:05:38.226282 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:38.226259    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f9cb9585b-djcwn" event={"ID":"8e1e55a6-9b67-4d04-a76b-2b17b11368ee","Type":"ContainerStarted","Data":"6759f7b5c7a3324c1fdf74d60acaa7df6681170fce7fd11bf249de963437eece"}
Sep 07 17:05:38.226389 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:38.226311    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5f9cb9585b-djcwn"
Sep 07 17:05:38.250322 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:38.250267    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7fbf888cb7-zc6tl" podStartSLOduration=1.852884651 podStartE2EDuration="4.250250177s" totalImagesPullingTime="2.397365526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:05:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:05:38.248744741 +0000 UTC m=+555.280175533" watchObservedRunningTime="2026-09-07 17:05:38.250250177 +0000 UTC m=+555.281680959"
Sep 07 17:05:38.283474 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:38.283423    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5f9cb9585b-djcwn" podStartSLOduration=1.71398461 podStartE2EDuration="4.283407653s" totalImagesPullingTime="2.569423043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:05:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:05:38.282056516 +0000 UTC m=+555.313487319" watchObservedRunningTime="2026-09-07 17:05:38.283407653 +0000 UTC m=+555.314838443"
Sep 07 17:05:49.234461 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:49.234431    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5f9cb9585b-djcwn"
Sep 07 17:05:49.234836 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:49.234499    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7fbf888cb7-zc6tl"
Sep 07 17:05:49.299073 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:49.299031    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f9cb9585b-djcwn"]
Sep 07 17:05:49.299837 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:49.299802    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5f9cb9585b-djcwn" podUID="8e1e55a6-9b67-4d04-a76b-2b17b11368ee" containerName="manager" containerID="cri-o://6759f7b5c7a3324c1fdf74d60acaa7df6681170fce7fd11bf249de963437eece" gracePeriod=30
Sep 07 17:05:49.548794 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:49.548764    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f9cb9585b-djcwn"
Sep 07 17:05:49.582036 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:49.582001    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8e1e55a6-9b67-4d04-a76b-2b17b11368ee-webhook-cert\") pod \"8e1e55a6-9b67-4d04-a76b-2b17b11368ee\" (UID: \"8e1e55a6-9b67-4d04-a76b-2b17b11368ee\") "
Sep 07 17:05:49.582202 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:49.582061    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e1e55a6-9b67-4d04-a76b-2b17b11368ee-metrics-certs\") pod \"8e1e55a6-9b67-4d04-a76b-2b17b11368ee\" (UID: \"8e1e55a6-9b67-4d04-a76b-2b17b11368ee\") "
Sep 07 17:05:49.582202 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:49.582093    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghzkz\" (UniqueName: \"kubernetes.io/projected/8e1e55a6-9b67-4d04-a76b-2b17b11368ee-kube-api-access-ghzkz\") pod \"8e1e55a6-9b67-4d04-a76b-2b17b11368ee\" (UID: \"8e1e55a6-9b67-4d04-a76b-2b17b11368ee\") "
Sep 07 17:05:49.584704 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:49.584670    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e1e55a6-9b67-4d04-a76b-2b17b11368ee-kube-api-access-ghzkz" (OuterVolumeSpecName: "kube-api-access-ghzkz") pod "8e1e55a6-9b67-4d04-a76b-2b17b11368ee" (UID: "8e1e55a6-9b67-4d04-a76b-2b17b11368ee"). InnerVolumeSpecName "kube-api-access-ghzkz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:05:49.584825 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:49.584705    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e1e55a6-9b67-4d04-a76b-2b17b11368ee-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8e1e55a6-9b67-4d04-a76b-2b17b11368ee" (UID: "8e1e55a6-9b67-4d04-a76b-2b17b11368ee"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:05:49.584825 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:49.584742    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e1e55a6-9b67-4d04-a76b-2b17b11368ee-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8e1e55a6-9b67-4d04-a76b-2b17b11368ee" (UID: "8e1e55a6-9b67-4d04-a76b-2b17b11368ee"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:05:49.682757 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:49.682726    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghzkz\" (UniqueName: \"kubernetes.io/projected/8e1e55a6-9b67-4d04-a76b-2b17b11368ee-kube-api-access-ghzkz\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:05:49.682757 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:49.682752    2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8e1e55a6-9b67-4d04-a76b-2b17b11368ee-webhook-cert\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:05:49.682757 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:49.682761    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e1e55a6-9b67-4d04-a76b-2b17b11368ee-metrics-certs\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:05:50.284611 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:50.284573    2558 generic.go:356] "Generic (PLEG): container finished" podID="8e1e55a6-9b67-4d04-a76b-2b17b11368ee" containerID="6759f7b5c7a3324c1fdf74d60acaa7df6681170fce7fd11bf249de963437eece" exitCode=0
Sep 07 17:05:50.285007 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:50.284622    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f9cb9585b-djcwn"
Sep 07 17:05:50.285007 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:50.284655    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f9cb9585b-djcwn" event={"ID":"8e1e55a6-9b67-4d04-a76b-2b17b11368ee","Type":"ContainerDied","Data":"6759f7b5c7a3324c1fdf74d60acaa7df6681170fce7fd11bf249de963437eece"}
Sep 07 17:05:50.285007 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:50.284707    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f9cb9585b-djcwn" event={"ID":"8e1e55a6-9b67-4d04-a76b-2b17b11368ee","Type":"ContainerDied","Data":"2bcb61951dd9e3a050c445369439d4f7313f56565c740c160878c13828b3bbd3"}
Sep 07 17:05:50.285007 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:50.284729    2558 scope.go:117] "RemoveContainer" containerID="6759f7b5c7a3324c1fdf74d60acaa7df6681170fce7fd11bf249de963437eece"
Sep 07 17:05:50.293348 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:50.293326    2558 scope.go:117] "RemoveContainer" containerID="6759f7b5c7a3324c1fdf74d60acaa7df6681170fce7fd11bf249de963437eece"
Sep 07 17:05:50.293644 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:05:50.293619    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6759f7b5c7a3324c1fdf74d60acaa7df6681170fce7fd11bf249de963437eece\": container with ID starting with 6759f7b5c7a3324c1fdf74d60acaa7df6681170fce7fd11bf249de963437eece not found: ID does not exist" containerID="6759f7b5c7a3324c1fdf74d60acaa7df6681170fce7fd11bf249de963437eece"
Sep 07 17:05:50.293744 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:50.293651    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6759f7b5c7a3324c1fdf74d60acaa7df6681170fce7fd11bf249de963437eece"} err="failed to get container status \"6759f7b5c7a3324c1fdf74d60acaa7df6681170fce7fd11bf249de963437eece\": rpc error: code = NotFound desc = could not find container \"6759f7b5c7a3324c1fdf74d60acaa7df6681170fce7fd11bf249de963437eece\": container with ID starting with 6759f7b5c7a3324c1fdf74d60acaa7df6681170fce7fd11bf249de963437eece not found: ID does not exist"
Sep 07 17:05:50.301550 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:50.301526    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f9cb9585b-djcwn"]
Sep 07 17:05:50.303042 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:50.303021    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5f9cb9585b-djcwn"]
Sep 07 17:05:51.594052 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:05:51.594020    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e1e55a6-9b67-4d04-a76b-2b17b11368ee" path="/var/lib/kubelet/pods/8e1e55a6-9b67-4d04-a76b-2b17b11368ee/volumes"
Sep 07 17:06:11.996442 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:11.996410    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-65dbf959f5-df2h6"]
Sep 07 17:06:11.996929 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:11.996761    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e1e55a6-9b67-4d04-a76b-2b17b11368ee" containerName="manager"
Sep 07 17:06:11.996929 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:11.996772    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e1e55a6-9b67-4d04-a76b-2b17b11368ee" containerName="manager"
Sep 07 17:06:11.996929 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:11.996852    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e1e55a6-9b67-4d04-a76b-2b17b11368ee" containerName="manager"
Sep 07 17:06:12.001104 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:12.001087    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-65dbf959f5-df2h6"
Sep 07 17:06:12.004924 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:12.004897    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 07 17:06:12.005034 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:12.004954    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 07 17:06:12.005034 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:12.005000    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-rggbk\""
Sep 07 17:06:12.013974 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:12.013947    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-65dbf959f5-df2h6"]
Sep 07 17:06:12.075615 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:12.075584    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2ns8\" (UniqueName: \"kubernetes.io/projected/2b771af0-80e0-463b-b45d-2c46461ed747-kube-api-access-j2ns8\") pod \"maas-api-65dbf959f5-df2h6\" (UID: \"2b771af0-80e0-463b-b45d-2c46461ed747\") " pod="odh-ai-gateway-infra/maas-api-65dbf959f5-df2h6"
Sep 07 17:06:12.075786 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:12.075635    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b771af0-80e0-463b-b45d-2c46461ed747-openshift-service-ca\") pod \"maas-api-65dbf959f5-df2h6\" (UID: \"2b771af0-80e0-463b-b45d-2c46461ed747\") " pod="odh-ai-gateway-infra/maas-api-65dbf959f5-df2h6"
Sep 07 17:06:12.075786 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:12.075666    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b771af0-80e0-463b-b45d-2c46461ed747-maas-api-tls\") pod \"maas-api-65dbf959f5-df2h6\" (UID: \"2b771af0-80e0-463b-b45d-2c46461ed747\") " pod="odh-ai-gateway-infra/maas-api-65dbf959f5-df2h6"
Sep 07 17:06:12.075786 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:12.075766    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b771af0-80e0-463b-b45d-2c46461ed747-metrics-certs\") pod \"maas-api-65dbf959f5-df2h6\" (UID: \"2b771af0-80e0-463b-b45d-2c46461ed747\") " pod="odh-ai-gateway-infra/maas-api-65dbf959f5-df2h6"
Sep 07 17:06:12.176253 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:12.176204    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b771af0-80e0-463b-b45d-2c46461ed747-metrics-certs\") pod \"maas-api-65dbf959f5-df2h6\" (UID: \"2b771af0-80e0-463b-b45d-2c46461ed747\") " pod="odh-ai-gateway-infra/maas-api-65dbf959f5-df2h6"
Sep 07 17:06:12.176418 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:12.176290    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2ns8\" (UniqueName: \"kubernetes.io/projected/2b771af0-80e0-463b-b45d-2c46461ed747-kube-api-access-j2ns8\") pod \"maas-api-65dbf959f5-df2h6\" (UID: \"2b771af0-80e0-463b-b45d-2c46461ed747\") " pod="odh-ai-gateway-infra/maas-api-65dbf959f5-df2h6"
Sep 07 17:06:12.176418 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:12.176323    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b771af0-80e0-463b-b45d-2c46461ed747-openshift-service-ca\") pod \"maas-api-65dbf959f5-df2h6\" (UID: \"2b771af0-80e0-463b-b45d-2c46461ed747\") " pod="odh-ai-gateway-infra/maas-api-65dbf959f5-df2h6"
Sep 07 17:06:12.176418 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:06:12.176344    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-metrics-tls: secret "maas-api-metrics-tls" not found
Sep 07 17:06:12.176418 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:06:12.176400    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b771af0-80e0-463b-b45d-2c46461ed747-metrics-certs podName:2b771af0-80e0-463b-b45d-2c46461ed747 nodeName:}" failed. No retries permitted until 2026-09-07 17:06:12.676385464 +0000 UTC m=+589.707816233 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b771af0-80e0-463b-b45d-2c46461ed747-metrics-certs") pod "maas-api-65dbf959f5-df2h6" (UID: "2b771af0-80e0-463b-b45d-2c46461ed747") : secret "maas-api-metrics-tls" not found
Sep 07 17:06:12.176636 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:12.176349    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b771af0-80e0-463b-b45d-2c46461ed747-maas-api-tls\") pod \"maas-api-65dbf959f5-df2h6\" (UID: \"2b771af0-80e0-463b-b45d-2c46461ed747\") " pod="odh-ai-gateway-infra/maas-api-65dbf959f5-df2h6"
Sep 07 17:06:12.177035 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:12.177011    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b771af0-80e0-463b-b45d-2c46461ed747-openshift-service-ca\") pod \"maas-api-65dbf959f5-df2h6\" (UID: \"2b771af0-80e0-463b-b45d-2c46461ed747\") " pod="odh-ai-gateway-infra/maas-api-65dbf959f5-df2h6"
Sep 07 17:06:12.178557 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:12.178541    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b771af0-80e0-463b-b45d-2c46461ed747-maas-api-tls\") pod \"maas-api-65dbf959f5-df2h6\" (UID: \"2b771af0-80e0-463b-b45d-2c46461ed747\") " pod="odh-ai-gateway-infra/maas-api-65dbf959f5-df2h6"
Sep 07 17:06:12.189179 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:12.189152    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2ns8\" (UniqueName: \"kubernetes.io/projected/2b771af0-80e0-463b-b45d-2c46461ed747-kube-api-access-j2ns8\") pod \"maas-api-65dbf959f5-df2h6\" (UID: \"2b771af0-80e0-463b-b45d-2c46461ed747\") " pod="odh-ai-gateway-infra/maas-api-65dbf959f5-df2h6"
Sep 07 17:06:12.536817 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:12.536782    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-d4wsh"]
Sep 07 17:06:12.539522 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:12.539500    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-d4wsh"
Sep 07 17:06:12.543082 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:12.543061    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-69dkk\""
Sep 07 17:06:12.543203 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:12.543080    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 07 17:06:12.556011 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:12.555987    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-d4wsh"]
Sep 07 17:06:12.680941 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:12.680901    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ecfe0367-8dc5-4314-9eb3-cb9d1b7e7087-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-d4wsh\" (UID: \"ecfe0367-8dc5-4314-9eb3-cb9d1b7e7087\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-d4wsh"
Sep 07 17:06:12.681097 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:12.680979    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd9l7\" (UniqueName: \"kubernetes.io/projected/ecfe0367-8dc5-4314-9eb3-cb9d1b7e7087-kube-api-access-sd9l7\") pod \"payload-processing-5b54b7fbb7-d4wsh\" (UID: \"ecfe0367-8dc5-4314-9eb3-cb9d1b7e7087\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-d4wsh"
Sep 07 17:06:12.681097 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:12.681009    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b771af0-80e0-463b-b45d-2c46461ed747-metrics-certs\") pod \"maas-api-65dbf959f5-df2h6\" (UID: \"2b771af0-80e0-463b-b45d-2c46461ed747\") " pod="odh-ai-gateway-infra/maas-api-65dbf959f5-df2h6"
Sep 07 17:06:12.683285 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:12.683258    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b771af0-80e0-463b-b45d-2c46461ed747-metrics-certs\") pod \"maas-api-65dbf959f5-df2h6\" (UID: \"2b771af0-80e0-463b-b45d-2c46461ed747\") " pod="odh-ai-gateway-infra/maas-api-65dbf959f5-df2h6"
Sep 07 17:06:12.781461 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:12.781421    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd9l7\" (UniqueName: \"kubernetes.io/projected/ecfe0367-8dc5-4314-9eb3-cb9d1b7e7087-kube-api-access-sd9l7\") pod \"payload-processing-5b54b7fbb7-d4wsh\" (UID: \"ecfe0367-8dc5-4314-9eb3-cb9d1b7e7087\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-d4wsh"
Sep 07 17:06:12.781667 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:12.781493    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ecfe0367-8dc5-4314-9eb3-cb9d1b7e7087-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-d4wsh\" (UID: \"ecfe0367-8dc5-4314-9eb3-cb9d1b7e7087\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-d4wsh"
Sep 07 17:06:12.782208 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:12.782188    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ecfe0367-8dc5-4314-9eb3-cb9d1b7e7087-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-d4wsh\" (UID: \"ecfe0367-8dc5-4314-9eb3-cb9d1b7e7087\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-d4wsh"
Sep 07 17:06:12.802616 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:12.802561    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd9l7\" (UniqueName: \"kubernetes.io/projected/ecfe0367-8dc5-4314-9eb3-cb9d1b7e7087-kube-api-access-sd9l7\") pod \"payload-processing-5b54b7fbb7-d4wsh\" (UID: \"ecfe0367-8dc5-4314-9eb3-cb9d1b7e7087\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-d4wsh"
Sep 07 17:06:12.849958 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:12.849923    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-d4wsh"
Sep 07 17:06:12.911999 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:12.911741    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-65dbf959f5-df2h6"
Sep 07 17:06:13.122060 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:13.122028    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-d4wsh"]
Sep 07 17:06:13.125192 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:06:13.125166    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecfe0367_8dc5_4314_9eb3_cb9d1b7e7087.slice/crio-e9667f39568b3722ae7cdd65354d2dd2bc6ec44f32e0bc18446401838f043a91 WatchSource:0}: Error finding container e9667f39568b3722ae7cdd65354d2dd2bc6ec44f32e0bc18446401838f043a91: Status 404 returned error can't find the container with id e9667f39568b3722ae7cdd65354d2dd2bc6ec44f32e0bc18446401838f043a91
Sep 07 17:06:13.195537 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:13.195509    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-65dbf959f5-df2h6"]
Sep 07 17:06:13.197352 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:06:13.197328    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b771af0_80e0_463b_b45d_2c46461ed747.slice/crio-27e2f5e82396fa3cd49d468b9c47aa58739202967471ae1c544b622d4558fd5a WatchSource:0}: Error finding container 27e2f5e82396fa3cd49d468b9c47aa58739202967471ae1c544b622d4558fd5a: Status 404 returned error can't find the container with id 27e2f5e82396fa3cd49d468b9c47aa58739202967471ae1c544b622d4558fd5a
Sep 07 17:06:13.409194 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:13.409094    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-d4wsh" event={"ID":"ecfe0367-8dc5-4314-9eb3-cb9d1b7e7087","Type":"ContainerStarted","Data":"e9667f39568b3722ae7cdd65354d2dd2bc6ec44f32e0bc18446401838f043a91"}
Sep 07 17:06:13.410338 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:13.410315    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-65dbf959f5-df2h6" event={"ID":"2b771af0-80e0-463b-b45d-2c46461ed747","Type":"ContainerStarted","Data":"27e2f5e82396fa3cd49d468b9c47aa58739202967471ae1c544b622d4558fd5a"}
Sep 07 17:06:17.437520 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:17.437488    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-65dbf959f5-df2h6" event={"ID":"2b771af0-80e0-463b-b45d-2c46461ed747","Type":"ContainerStarted","Data":"9de8902e05fccb6e606a681c6bda13f9636344b7304f091fafc648b6476e064a"}
Sep 07 17:06:17.438017 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:17.437640    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-65dbf959f5-df2h6"
Sep 07 17:06:17.439222 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:17.439189    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-d4wsh" event={"ID":"ecfe0367-8dc5-4314-9eb3-cb9d1b7e7087","Type":"ContainerStarted","Data":"b630ae7797f2c4160c5b9417668fb03f166deba1a98241046c2a521a2674fc8e"}
Sep 07 17:06:17.439378 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:17.439282    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-d4wsh"
Sep 07 17:06:17.460569 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:17.460500    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-65dbf959f5-df2h6" podStartSLOduration=3.080216235 podStartE2EDuration="6.460478621s" totalImagesPullingTime="3.380262386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:06:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:06:17.458870454 +0000 UTC m=+594.490301248" watchObservedRunningTime="2026-09-07 17:06:17.460478621 +0000 UTC m=+594.491909415"
Sep 07 17:06:17.479897 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:17.479838    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-d4wsh" podStartSLOduration=1.98035216 podStartE2EDuration="5.479821781s" totalImagesPullingTime="3.499469621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:06:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:06:17.47768229 +0000 UTC m=+594.509113082" watchObservedRunningTime="2026-09-07 17:06:17.479821781 +0000 UTC m=+594.511252572"
Sep 07 17:06:22.466800 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:22.466766    2558 generic.go:356] "Generic (PLEG): container finished" podID="9c7d1bab-dd03-424b-a348-0576b99f691f" containerID="9bb6f13de7481935d1c5638b569c1fae634b4c13677f9b008584088d221f8e47" exitCode=0
Sep 07 17:06:22.467218 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:22.466839    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz" event={"ID":"9c7d1bab-dd03-424b-a348-0576b99f691f","Type":"ContainerDied","Data":"9bb6f13de7481935d1c5638b569c1fae634b4c13677f9b008584088d221f8e47"}
Sep 07 17:06:22.467332 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:22.467312    2558 scope.go:117] "RemoveContainer" containerID="9bb6f13de7481935d1c5638b569c1fae634b4c13677f9b008584088d221f8e47"
Sep 07 17:06:22.468350 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:22.468322    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:06:22.468411 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:22.468394    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:06:22.468450 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:22.468425    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:06:23.455679 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:23.455643    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-65dbf959f5-df2h6"
Sep 07 17:06:23.480840 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:23.480807    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz" event={"ID":"9c7d1bab-dd03-424b-a348-0576b99f691f","Type":"ContainerStarted","Data":"4329a030dde3711316849d5c415a01f8325911e3608538d8e20f7fcdb28be68d"}
Sep 07 17:06:23.586170 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:23.586134    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-f6srd_24750b4e-c0bc-4c3c-a256-6ca251306d06/console-operator/1.log"
Sep 07 17:06:23.586617 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:23.586598    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-f6srd_24750b4e-c0bc-4c3c-a256-6ca251306d06/console-operator/1.log"
Sep 07 17:06:23.596033 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:23.596010    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwj7s_9b97dbca-7e8f-4e05-9cc4-8f42785f01e7/ovn-acl-logging/0.log"
Sep 07 17:06:23.596679 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:23.596660    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwj7s_9b97dbca-7e8f-4e05-9cc4-8f42785f01e7/ovn-acl-logging/0.log"
Sep 07 17:06:23.916891 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:23.916852    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz"
Sep 07 17:06:23.918187 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:23.918158    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-wk6hz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Sep 07 17:06:23.918313 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:23.918218    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz" podUID="9c7d1bab-dd03-424b-a348-0576b99f691f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Sep 07 17:06:24.917320 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:24.917283    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-wk6hz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Sep 07 17:06:24.917699 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:24.917339    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz" podUID="9c7d1bab-dd03-424b-a348-0576b99f691f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Sep 07 17:06:25.917162 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:25.917125    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-wk6hz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Sep 07 17:06:25.917368 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:25.917183    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz" podUID="9c7d1bab-dd03-424b-a348-0576b99f691f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Sep 07 17:06:26.917209 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:26.917173    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-wk6hz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Sep 07 17:06:26.917379 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:26.917271    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz" podUID="9c7d1bab-dd03-424b-a348-0576b99f691f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Sep 07 17:06:27.917000 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:27.916961    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-wk6hz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Sep 07 17:06:27.917178 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:27.917019    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz" podUID="9c7d1bab-dd03-424b-a348-0576b99f691f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Sep 07 17:06:27.999555 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:27.999523    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz"
Sep 07 17:06:28.447509 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:28.447478    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-d4wsh"
Sep 07 17:06:28.917774 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:28.917735    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-wk6hz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Sep 07 17:06:28.917943 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:28.917794    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz" podUID="9c7d1bab-dd03-424b-a348-0576b99f691f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Sep 07 17:06:29.921317 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:29.921282    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz"
Sep 07 17:06:29.922274 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:29.922255    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz"
Sep 07 17:06:37.320445 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:37.320401    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm"]
Sep 07 17:06:37.323732 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:37.323714    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm"
Sep 07 17:06:37.326974 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:37.326947    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 07 17:06:37.327114 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:37.327055    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 07 17:06:37.327994 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:37.327974    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-v5fk9\""
Sep 07 17:06:37.328075 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:37.327977    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 07 17:06:37.336328 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:37.336303    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm"]
Sep 07 17:06:37.509987 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:37.509948    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d3d56d7-2474-4966-beed-e822dd423344-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm\" (UID: \"6d3d56d7-2474-4966-beed-e822dd423344\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm"
Sep 07 17:06:37.510165 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:37.510021    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d3d56d7-2474-4966-beed-e822dd423344-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm\" (UID: \"6d3d56d7-2474-4966-beed-e822dd423344\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm"
Sep 07 17:06:37.510165 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:37.510050    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdcrr\" (UniqueName: \"kubernetes.io/projected/6d3d56d7-2474-4966-beed-e822dd423344-kube-api-access-sdcrr\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm\" (UID: \"6d3d56d7-2474-4966-beed-e822dd423344\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm"
Sep 07 17:06:37.510165 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:37.510073    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d3d56d7-2474-4966-beed-e822dd423344-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm\" (UID: \"6d3d56d7-2474-4966-beed-e822dd423344\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm"
Sep 07 17:06:37.510165 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:37.510108    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d3d56d7-2474-4966-beed-e822dd423344-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm\" (UID: \"6d3d56d7-2474-4966-beed-e822dd423344\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm"
Sep 07 17:06:37.510327 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:37.510181    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d3d56d7-2474-4966-beed-e822dd423344-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm\" (UID: \"6d3d56d7-2474-4966-beed-e822dd423344\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm"
Sep 07 17:06:37.610732 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:37.610700    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d3d56d7-2474-4966-beed-e822dd423344-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm\" (UID: \"6d3d56d7-2474-4966-beed-e822dd423344\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm"
Sep 07 17:06:37.610887 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:37.610751    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d3d56d7-2474-4966-beed-e822dd423344-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm\" (UID: \"6d3d56d7-2474-4966-beed-e822dd423344\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm"
Sep 07 17:06:37.610887 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:37.610791    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d3d56d7-2474-4966-beed-e822dd423344-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm\" (UID: \"6d3d56d7-2474-4966-beed-e822dd423344\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm"
Sep 07 17:06:37.610887 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:37.610809    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdcrr\" (UniqueName: \"kubernetes.io/projected/6d3d56d7-2474-4966-beed-e822dd423344-kube-api-access-sdcrr\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm\" (UID: \"6d3d56d7-2474-4966-beed-e822dd423344\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm"
Sep 07 17:06:37.610887 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:37.610833    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d3d56d7-2474-4966-beed-e822dd423344-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm\" (UID: \"6d3d56d7-2474-4966-beed-e822dd423344\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm"
Sep 07 17:06:37.610887 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:37.610864    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d3d56d7-2474-4966-beed-e822dd423344-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm\" (UID: \"6d3d56d7-2474-4966-beed-e822dd423344\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm"
Sep 07 17:06:37.611168 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:37.611142    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d3d56d7-2474-4966-beed-e822dd423344-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm\" (UID: \"6d3d56d7-2474-4966-beed-e822dd423344\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm"
Sep 07 17:06:37.611229 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:37.611204    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d3d56d7-2474-4966-beed-e822dd423344-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm\" (UID: \"6d3d56d7-2474-4966-beed-e822dd423344\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm"
Sep 07 17:06:37.611324 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:37.611218    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d3d56d7-2474-4966-beed-e822dd423344-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm\" (UID: \"6d3d56d7-2474-4966-beed-e822dd423344\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm"
Sep 07 17:06:37.613210 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:37.613190    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d3d56d7-2474-4966-beed-e822dd423344-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm\" (UID: \"6d3d56d7-2474-4966-beed-e822dd423344\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm"
Sep 07 17:06:37.613327 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:37.613220    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d3d56d7-2474-4966-beed-e822dd423344-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm\" (UID: \"6d3d56d7-2474-4966-beed-e822dd423344\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm"
Sep 07 17:06:37.620007 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:37.619979    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdcrr\" (UniqueName: \"kubernetes.io/projected/6d3d56d7-2474-4966-beed-e822dd423344-kube-api-access-sdcrr\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm\" (UID: \"6d3d56d7-2474-4966-beed-e822dd423344\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm"
Sep 07 17:06:37.633939 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:37.633912    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm"
Sep 07 17:06:37.906468 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:37.906440    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm"]
Sep 07 17:06:37.908492 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:06:37.908457    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d3d56d7_2474_4966_beed_e822dd423344.slice/crio-2eae6db6b5be6e28a92a93ed8f77b255c9f133d05c1a48a006980979b46cc39b WatchSource:0}: Error finding container 2eae6db6b5be6e28a92a93ed8f77b255c9f133d05c1a48a006980979b46cc39b: Status 404 returned error can't find the container with id 2eae6db6b5be6e28a92a93ed8f77b255c9f133d05c1a48a006980979b46cc39b
Sep 07 17:06:37.909968 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:37.909934    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 17:06:38.556701 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:38.556666    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm" event={"ID":"6d3d56d7-2474-4966-beed-e822dd423344","Type":"ContainerStarted","Data":"2eae6db6b5be6e28a92a93ed8f77b255c9f133d05c1a48a006980979b46cc39b"}
Sep 07 17:06:39.563525 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:39.563488    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm" event={"ID":"6d3d56d7-2474-4966-beed-e822dd423344","Type":"ContainerStarted","Data":"1241c40cd65a21c9dfce660260f342abd40a94ae3f78ea7c2676ced89226e7ed"}
Sep 07 17:06:39.583670 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:39.583555    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm" podStartSLOduration=1.590148144 podStartE2EDuration="2.583534899s" totalImagesPullingTime="993.386755ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:06:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:06:39.58298534 +0000 UTC m=+616.614416133" watchObservedRunningTime="2026-09-07 17:06:39.583534899 +0000 UTC m=+616.614965692"
Sep 07 17:06:47.012363 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:47.012278    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-th5zw"]
Sep 07 17:06:47.014863 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:47.014847    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-th5zw"
Sep 07 17:06:47.018186 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:47.018159    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 07 17:06:47.036223 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:47.036183    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-th5zw"]
Sep 07 17:06:47.093982 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:47.093946    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3274daa-bb37-482c-8c33-46d1ac6b38f6-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-th5zw\" (UID: \"e3274daa-bb37-482c-8c33-46d1ac6b38f6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-th5zw"
Sep 07 17:06:47.094129 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:47.093987    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbwjs\" (UniqueName: \"kubernetes.io/projected/e3274daa-bb37-482c-8c33-46d1ac6b38f6-kube-api-access-mbwjs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-th5zw\" (UID: \"e3274daa-bb37-482c-8c33-46d1ac6b38f6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-th5zw"
Sep 07 17:06:47.094129 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:47.094017    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3274daa-bb37-482c-8c33-46d1ac6b38f6-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-th5zw\" (UID: \"e3274daa-bb37-482c-8c33-46d1ac6b38f6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-th5zw"
Sep 07 17:06:47.094129 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:47.094068    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3274daa-bb37-482c-8c33-46d1ac6b38f6-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-th5zw\" (UID: \"e3274daa-bb37-482c-8c33-46d1ac6b38f6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-th5zw"
Sep 07 17:06:47.094129 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:47.094108    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3274daa-bb37-482c-8c33-46d1ac6b38f6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-th5zw\" (UID: \"e3274daa-bb37-482c-8c33-46d1ac6b38f6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-th5zw"
Sep 07 17:06:47.094129 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:47.094125    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3274daa-bb37-482c-8c33-46d1ac6b38f6-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-th5zw\" (UID: \"e3274daa-bb37-482c-8c33-46d1ac6b38f6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-th5zw"
Sep 07 17:06:47.195061 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:47.195022    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3274daa-bb37-482c-8c33-46d1ac6b38f6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-th5zw\" (UID: \"e3274daa-bb37-482c-8c33-46d1ac6b38f6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-th5zw"
Sep 07 17:06:47.195320 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:47.195078    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3274daa-bb37-482c-8c33-46d1ac6b38f6-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-th5zw\" (UID: \"e3274daa-bb37-482c-8c33-46d1ac6b38f6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-th5zw"
Sep 07 17:06:47.195320 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:47.195178    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3274daa-bb37-482c-8c33-46d1ac6b38f6-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-th5zw\" (UID: \"e3274daa-bb37-482c-8c33-46d1ac6b38f6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-th5zw"
Sep 07 17:06:47.195320 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:47.195216    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbwjs\" (UniqueName: \"kubernetes.io/projected/e3274daa-bb37-482c-8c33-46d1ac6b38f6-kube-api-access-mbwjs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-th5zw\" (UID: \"e3274daa-bb37-482c-8c33-46d1ac6b38f6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-th5zw"
Sep 07 17:06:47.195320 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:47.195287    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3274daa-bb37-482c-8c33-46d1ac6b38f6-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-th5zw\" (UID: \"e3274daa-bb37-482c-8c33-46d1ac6b38f6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-th5zw"
Sep 07 17:06:47.195320 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:47.195313    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3274daa-bb37-482c-8c33-46d1ac6b38f6-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-th5zw\" (UID: \"e3274daa-bb37-482c-8c33-46d1ac6b38f6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-th5zw"
Sep 07 17:06:47.195611 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:47.195552    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3274daa-bb37-482c-8c33-46d1ac6b38f6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-th5zw\" (UID: \"e3274daa-bb37-482c-8c33-46d1ac6b38f6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-th5zw"
Sep 07 17:06:47.195714 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:47.195684    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3274daa-bb37-482c-8c33-46d1ac6b38f6-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-th5zw\" (UID: \"e3274daa-bb37-482c-8c33-46d1ac6b38f6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-th5zw"
Sep 07 17:06:47.195842 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:47.195825    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3274daa-bb37-482c-8c33-46d1ac6b38f6-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-th5zw\" (UID: \"e3274daa-bb37-482c-8c33-46d1ac6b38f6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-th5zw"
Sep 07 17:06:47.197641 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:47.197617    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3274daa-bb37-482c-8c33-46d1ac6b38f6-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-th5zw\" (UID: \"e3274daa-bb37-482c-8c33-46d1ac6b38f6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-th5zw"
Sep 07 17:06:47.198234 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:47.198212    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3274daa-bb37-482c-8c33-46d1ac6b38f6-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-th5zw\" (UID: \"e3274daa-bb37-482c-8c33-46d1ac6b38f6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-th5zw"
Sep 07 17:06:47.204781 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:47.204760    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbwjs\" (UniqueName: \"kubernetes.io/projected/e3274daa-bb37-482c-8c33-46d1ac6b38f6-kube-api-access-mbwjs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-th5zw\" (UID: \"e3274daa-bb37-482c-8c33-46d1ac6b38f6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-th5zw"
Sep 07 17:06:47.325463 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:47.325386    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-th5zw"
Sep 07 17:06:47.607713 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:47.607690    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-th5zw"]
Sep 07 17:06:47.609912 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:06:47.609887    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3274daa_bb37_482c_8c33_46d1ac6b38f6.slice/crio-b82169607dda606eebffd68c043a7ff626838b3be1be464f7f1370bb22b22604 WatchSource:0}: Error finding container b82169607dda606eebffd68c043a7ff626838b3be1be464f7f1370bb22b22604: Status 404 returned error can't find the container with id b82169607dda606eebffd68c043a7ff626838b3be1be464f7f1370bb22b22604
Sep 07 17:06:47.634349 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:47.634326    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm"
Sep 07 17:06:47.634478 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:47.634378    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm"
Sep 07 17:06:47.647128 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:47.647102    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm"
Sep 07 17:06:48.610116 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:48.610078    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-th5zw" event={"ID":"e3274daa-bb37-482c-8c33-46d1ac6b38f6","Type":"ContainerStarted","Data":"d27bc081e9978adb3d6e70df99c81ce55e255156f69a27ee5d92a5991be3915f"}
Sep 07 17:06:48.610595 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:48.610131    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-th5zw" event={"ID":"e3274daa-bb37-482c-8c33-46d1ac6b38f6","Type":"ContainerStarted","Data":"b82169607dda606eebffd68c043a7ff626838b3be1be464f7f1370bb22b22604"}
Sep 07 17:06:48.621722 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:48.621698    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm"
Sep 07 17:06:48.631159 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:48.631117    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-th5zw" podStartSLOduration=2.277332185 podStartE2EDuration="2.631103953s" totalImagesPullingTime="353.771768ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:06:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:06:48.630231118 +0000 UTC m=+625.661661909" watchObservedRunningTime="2026-09-07 17:06:48.631103953 +0000 UTC m=+625.662534757"
Sep 07 17:06:57.326008 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:57.325970    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-th5zw"
Sep 07 17:06:57.326515 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:57.326263    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-th5zw"
Sep 07 17:06:57.338624 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:57.338596    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-th5zw"
Sep 07 17:06:57.663332 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:06:57.663303    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-th5zw"
Sep 07 17:07:21.197776 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:07:21.197736    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-sfq5z"]
Sep 07 17:07:21.201747 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:07:21.201721    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfq5z"
Sep 07 17:07:21.205303 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:07:21.205279    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 07 17:07:21.215780 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:07:21.215751    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-sfq5z"]
Sep 07 17:07:21.301569 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:07:21.301537    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fefec1a-0e03-4a0c-963a-91ef300f74cb-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sfq5z\" (UID: \"0fefec1a-0e03-4a0c-963a-91ef300f74cb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfq5z"
Sep 07 17:07:21.301747 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:07:21.301617    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fefec1a-0e03-4a0c-963a-91ef300f74cb-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sfq5z\" (UID: \"0fefec1a-0e03-4a0c-963a-91ef300f74cb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfq5z"
Sep 07 17:07:21.301747 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:07:21.301647    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fefec1a-0e03-4a0c-963a-91ef300f74cb-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sfq5z\" (UID: \"0fefec1a-0e03-4a0c-963a-91ef300f74cb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfq5z"
Sep 07 17:07:21.301747 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:07:21.301681    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fefec1a-0e03-4a0c-963a-91ef300f74cb-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sfq5z\" (UID: \"0fefec1a-0e03-4a0c-963a-91ef300f74cb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfq5z"
Sep 07 17:07:21.301858 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:07:21.301753    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js8q7\" (UniqueName: \"kubernetes.io/projected/0fefec1a-0e03-4a0c-963a-91ef300f74cb-kube-api-access-js8q7\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sfq5z\" (UID: \"0fefec1a-0e03-4a0c-963a-91ef300f74cb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfq5z"
Sep 07 17:07:21.301858 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:07:21.301788    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fefec1a-0e03-4a0c-963a-91ef300f74cb-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sfq5z\" (UID: \"0fefec1a-0e03-4a0c-963a-91ef300f74cb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfq5z"
Sep 07 17:07:21.402889 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:07:21.402850    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fefec1a-0e03-4a0c-963a-91ef300f74cb-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sfq5z\" (UID: \"0fefec1a-0e03-4a0c-963a-91ef300f74cb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfq5z"
Sep 07 17:07:21.402889 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:07:21.402892    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fefec1a-0e03-4a0c-963a-91ef300f74cb-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sfq5z\" (UID: \"0fefec1a-0e03-4a0c-963a-91ef300f74cb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfq5z"
Sep 07 17:07:21.403126 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:07:21.402928    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fefec1a-0e03-4a0c-963a-91ef300f74cb-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sfq5z\" (UID: \"0fefec1a-0e03-4a0c-963a-91ef300f74cb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfq5z"
Sep 07 17:07:21.403126 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:07:21.402980    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-js8q7\" (UniqueName: \"kubernetes.io/projected/0fefec1a-0e03-4a0c-963a-91ef300f74cb-kube-api-access-js8q7\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sfq5z\" (UID: \"0fefec1a-0e03-4a0c-963a-91ef300f74cb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfq5z"
Sep 07 17:07:21.403126 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:07:21.403011    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fefec1a-0e03-4a0c-963a-91ef300f74cb-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sfq5z\" (UID: \"0fefec1a-0e03-4a0c-963a-91ef300f74cb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfq5z"
Sep 07 17:07:21.403126 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:07:21.403059    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fefec1a-0e03-4a0c-963a-91ef300f74cb-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sfq5z\" (UID: \"0fefec1a-0e03-4a0c-963a-91ef300f74cb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfq5z"
Sep 07 17:07:21.403378 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:07:21.403344    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fefec1a-0e03-4a0c-963a-91ef300f74cb-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sfq5z\" (UID: \"0fefec1a-0e03-4a0c-963a-91ef300f74cb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfq5z"
Sep 07 17:07:21.403435 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:07:21.403404    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fefec1a-0e03-4a0c-963a-91ef300f74cb-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sfq5z\" (UID: \"0fefec1a-0e03-4a0c-963a-91ef300f74cb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfq5z"
Sep 07 17:07:21.403435 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:07:21.403421    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fefec1a-0e03-4a0c-963a-91ef300f74cb-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sfq5z\" (UID: \"0fefec1a-0e03-4a0c-963a-91ef300f74cb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfq5z"
Sep 07 17:07:21.405360 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:07:21.405340    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fefec1a-0e03-4a0c-963a-91ef300f74cb-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sfq5z\" (UID: \"0fefec1a-0e03-4a0c-963a-91ef300f74cb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfq5z"
Sep 07 17:07:21.405530 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:07:21.405514    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fefec1a-0e03-4a0c-963a-91ef300f74cb-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sfq5z\" (UID: \"0fefec1a-0e03-4a0c-963a-91ef300f74cb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfq5z"
Sep 07 17:07:21.415701 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:07:21.415677    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-js8q7\" (UniqueName: \"kubernetes.io/projected/0fefec1a-0e03-4a0c-963a-91ef300f74cb-kube-api-access-js8q7\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sfq5z\" (UID: \"0fefec1a-0e03-4a0c-963a-91ef300f74cb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfq5z"
Sep 07 17:07:21.512857 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:07:21.512779    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfq5z"
Sep 07 17:07:21.794425 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:07:21.794398    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-sfq5z"]
Sep 07 17:07:21.796315 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:07:21.796285    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fefec1a_0e03_4a0c_963a_91ef300f74cb.slice/crio-d6e0824ae95609703625e6f9a4f0cdd3267245870e4088e60d3c17943ab151db WatchSource:0}: Error finding container d6e0824ae95609703625e6f9a4f0cdd3267245870e4088e60d3c17943ab151db: Status 404 returned error can't find the container with id d6e0824ae95609703625e6f9a4f0cdd3267245870e4088e60d3c17943ab151db
Sep 07 17:07:22.772918 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:07:22.772882    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfq5z" event={"ID":"0fefec1a-0e03-4a0c-963a-91ef300f74cb","Type":"ContainerStarted","Data":"0ecc2433c994ff170a035961def858d98d9e281c6c06c3aef7a0024d2c313730"}
Sep 07 17:07:22.773437 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:07:22.772945    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfq5z" event={"ID":"0fefec1a-0e03-4a0c-963a-91ef300f74cb","Type":"ContainerStarted","Data":"d6e0824ae95609703625e6f9a4f0cdd3267245870e4088e60d3c17943ab151db"}
Sep 07 17:07:22.800025 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:07:22.799974    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfq5z" podStartSLOduration=1.6345551299999999 podStartE2EDuration="1.799959873s" totalImagesPullingTime="165.404743ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:07:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:07:22.797646072 +0000 UTC m=+659.829076864" watchObservedRunningTime="2026-09-07 17:07:22.799959873 +0000 UTC m=+659.831390664"
Sep 07 17:07:31.513429 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:07:31.513390    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfq5z"
Sep 07 17:07:31.513817 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:07:31.513453    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfq5z"
Sep 07 17:07:31.526006 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:07:31.525983    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfq5z"
Sep 07 17:07:31.828868 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:07:31.828793    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfq5z"
Sep 07 17:08:23.611998 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:08:23.611923    2558 scope.go:117] "RemoveContainer" containerID="ac2c5c5a20c57fb51efb65182800e4b0afbff752978ecad4811e0a3c56c0586d"
Sep 07 17:08:48.461296 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:08:48.461230    2558 controller.go:195] "Failed to update lease" err="Put \"https://a180ad2b90363402289452fab9920906-d170e736a64b4892.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-131-84.ec2.internal?timeout=10s\": context deadline exceeded"
Sep 07 17:08:58.462118 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:08:58.462075    2558 controller.go:195] "Failed to update lease" err="Put \"https://a180ad2b90363402289452fab9920906-d170e736a64b4892.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-131-84.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Sep 07 17:09:08.462579 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:09:08.462541    2558 controller.go:195] "Failed to update lease" err="Put \"https://a180ad2b90363402289452fab9920906-d170e736a64b4892.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-131-84.ec2.internal?timeout=10s\": context deadline exceeded"
Sep 07 17:09:13.998488 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.998433    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.998488 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.998444    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.998488 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.998444    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.998488 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.998495    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.998488 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.998452    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999198 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.998539    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-bfhql\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999198 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.998547    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"default-dockercfg-v5fk9\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999198 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.998541    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999198 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.998550    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999198 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.998579    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999198 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.998580    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999198 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.998595    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999198 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.998592    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999198 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.998624    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999198 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.998644    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999198 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.998651    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999198 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.998665    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999198 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.998691    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999198 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.998712    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999198 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.998748    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999198 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.998775    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999198 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.998780    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:13.999198 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.998793    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-bkwc2\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000028 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.998817    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000028 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.998827    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-8lxfj\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000028 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.998833    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000028 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.998834    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000028 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.998839    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000028 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.998860    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-svt29\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000028 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.998871    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kv5rt\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000028 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.998879    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"router-dockercfg-dtsjw\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000028 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.998895    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000028 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.998904    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000028 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.998906    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"default-dockercfg-4ntwt\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000028 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.998935    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000028 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.998942    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000028 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.998949    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000028 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.998942    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"original-pull-secret\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000028 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.998968    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000028 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.998977    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000028 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.998970    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000642 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999008    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-4zz64\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000642 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999019    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000642 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999038    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000642 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999050    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000642 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999066    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000642 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999072    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000642 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999068    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000642 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999089    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-dockercfg-96tzd\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000642 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999091    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000642 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999124    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000642 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999147    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000642 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999147    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-g7mrx\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000642 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999156    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000642 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999167    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000642 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999190    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8bspl\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000642 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999200    2558 reflector.go:571] "Warning: watch ended with error" reflector="pkg/kubelet/config/apiserver.go:66" type="*v1.Pod" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000642 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999201    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.000642 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999208    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001370 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999224    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001370 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999224    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-jpkn9\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001370 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999256    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001370 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999284    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001370 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999320    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001370 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999338    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001370 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999361    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mgs26\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001370 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999370    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tw2bp\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001370 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999409    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001370 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:09:13.999420    2558 controller.go:195] "Failed to update lease" err="Put \"https://a180ad2b90363402289452fab9920906-d170e736a64b4892.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-131-84.ec2.internal?timeout=10s\": http2: client connection lost"
Sep 07 17:09:14.001370 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999436    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001370 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999456    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001370 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999477    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001370 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999483    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bvnj8\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001370 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999501    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001370 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999519    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001370 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999529    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-default\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001370 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999540    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001890 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999549    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-w25h9\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001890 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999558    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"maas-parameters\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001890 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999570    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001890 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999591    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7cjcl\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001890 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999599    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001890 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999622    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-rggbk\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001890 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999622    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-cw9q9\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001890 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999628    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"operator-dockercfg-sgxpt\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001890 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999634    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001890 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999645    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001890 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999652    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001890 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999669    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001890 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999672    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001890 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999679    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lxz8c\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001890 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999688    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001890 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999695    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001890 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999701    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.001890 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999710    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-djltz\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002412 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999716    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002412 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999721    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ghqrn\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002412 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999717    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002412 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999732    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002412 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999736    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002412 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999741    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002412 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999752    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lcg49\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002412 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999771    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-69dkk\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002412 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999771    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8ftzg\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002412 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999781    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002412 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999777    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002412 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999790    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002412 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999795    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002412 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999797    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002412 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999784    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002412 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999812    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002412 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999820    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-w78k6\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002412 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999819    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002924 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999839    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002924 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999844    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002924 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999856    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002924 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999865    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002924 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999871    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-2c5mv\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002924 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999859    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002924 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999888    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sm5qw\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002924 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999889    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002924 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999906    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002924 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999910    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002924 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999913    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-wpv88\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002924 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999889    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-dxvzh\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002924 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999924    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002924 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999933    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002924 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999939    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002924 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999943    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-9xhtl\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002924 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999948    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.002924 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999894    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003462 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999957    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003462 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999973    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003462 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999944    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003462 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999997    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"konnectivity-agent\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003462 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.000002    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003462 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.000010    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003462 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999855    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003462 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.000021    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qm5ll\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003462 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:13.999972    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003462 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.000022    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003462 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.000002    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003462 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.000053    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003462 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.000039    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"default-dockercfg-cfxjz\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003462 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.000038    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-cxgwx\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003462 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.000066    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6jtzt\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003462 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.000040    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-b6fjt\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003462 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.000055    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-54rnb\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003462 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.000057    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003971 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.000018    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003971 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.000071    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-c7m2z\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003971 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.000074    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003971 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.000022    2558 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.003971 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.000088    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 07 17:09:14.808619 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.808587    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 07 17:09:14.808619 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.808587    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 07 17:09:14.811816 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.811799    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8bspl\""
Sep 07 17:09:14.812074 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.812058    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-bfhql\""
Sep 07 17:09:14.817559 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.817542    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 07 17:09:14.823376 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.823361    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 07 17:09:14.823484 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.823453    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 07 17:09:14.823570 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.823554    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mgs26\""
Sep 07 17:09:14.838519 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.838500    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bvnj8\""
Sep 07 17:09:14.838673 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.838659    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 07 17:09:14.848363 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.848343    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 07 17:09:14.848651 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.848364    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 07 17:09:14.871921 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.871902    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 07 17:09:14.879681 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.879661    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 07 17:09:14.887549 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.887532    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 07 17:09:14.887972 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.887954    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-96tzd\""
Sep 07 17:09:14.893807 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.893786    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 07 17:09:14.894053 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.894038    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-rggbk\""
Sep 07 17:09:14.894296 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.894282    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-sgxpt\""
Sep 07 17:09:14.897647 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.897626    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-bkwc2\""
Sep 07 17:09:14.911564 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.911542    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 07 17:09:14.911923 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.911909    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-9xhtl\""
Sep 07 17:09:14.915576 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.915561    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 07 17:09:14.915837 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.915823    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 07 17:09:14.917001 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.916986    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 07 17:09:14.921774 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.921755    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 07 17:09:14.921863 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.921811    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 07 17:09:14.931114 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.931093    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 07 17:09:14.947102 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.947083    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 07 17:09:14.958916 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.958892    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 07 17:09:14.962324 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.962299    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4ntwt\""
Sep 07 17:09:14.965745 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.965730    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-wpv88\""
Sep 07 17:09:14.977090 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.977070    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-w25h9\""
Sep 07 17:09:14.979193 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.979180    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 07 17:09:14.982575 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.982559    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 07 17:09:14.991996 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.991976    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-djltz\""
Sep 07 17:09:14.992155 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.992141    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 07 17:09:14.993879 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.993865    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 17:09:14.995055 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.995041    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-b6fjt\""
Sep 07 17:09:14.998179 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:14.998163    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6jtzt\""
Sep 07 17:09:15.001059 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.001042    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 07 17:09:15.002561 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.002545    2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 17:09:15.005118 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.005094    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-jpkn9\""
Sep 07 17:09:15.005578 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.005563    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 07 17:09:15.007650 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.007633    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 07 17:09:15.021465 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.021444    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 07 17:09:15.030305 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.030288    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 07 17:09:15.032575 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.032560    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 07 17:09:15.048582 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.048564    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ghqrn\""
Sep 07 17:09:15.062357 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.062308    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-dxvzh\""
Sep 07 17:09:15.065365 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.065350    2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 07 17:09:15.069736 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.069722    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 07 17:09:15.070604 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.070580    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 07 17:09:15.071080 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.071064    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 07 17:09:15.078694 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.078678    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 07 17:09:15.078943 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.078928    2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 17:09:15.090146 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.090129    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 07 17:09:15.102117 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.102098    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 07 17:09:15.106757 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.106741    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 07 17:09:15.106822 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.106776    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 07 17:09:15.107221 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.107207    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-4zz64\""
Sep 07 17:09:15.108533 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.108521    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 07 17:09:15.124716 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.124692    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 07 17:09:15.126371 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.126352    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 07 17:09:15.127342 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.127327    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 07 17:09:15.131091 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.131075    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 07 17:09:15.131823 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.131809    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 07 17:09:15.144505 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.144488    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 07 17:09:15.156294 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.156277    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 07 17:09:15.162861 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.162843    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lcg49\""
Sep 07 17:09:15.173931 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.173914    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tw2bp\""
Sep 07 17:09:15.174072 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.174060    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 07 17:09:15.174555 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.174542    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-g7mrx\""
Sep 07 17:09:15.177796 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.177781    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 07 17:09:15.185372 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.185355    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-svt29\""
Sep 07 17:09:15.185498 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.185486    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 07 17:09:15.189723 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.189707    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 07 17:09:15.194037 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.194019    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 07 17:09:15.196070 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.196053    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 07 17:09:15.201673 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.201658    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 07 17:09:15.211184 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.211166    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 07 17:09:15.213143 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.213120    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 07 17:09:15.214376 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.214361    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-2c5mv\""
Sep 07 17:09:15.221991 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.221970    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-54rnb\""
Sep 07 17:09:15.228077 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.228059    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 07 17:09:15.229413 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.229398    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-c7m2z\""
Sep 07 17:09:15.245735 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.245718    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 07 17:09:15.257436 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.257417    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 07 17:09:15.257436 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.257426    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-8lxfj\""
Sep 07 17:09:15.257981 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.257965    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 07 17:09:15.258031 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.257972    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 07 17:09:15.262864 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.262850    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 07 17:09:15.267982 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.267965    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 07 17:09:15.293775 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.293755    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kv5rt\""
Sep 07 17:09:15.315280 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.315201    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 07 17:09:15.315280 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.315209    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8ftzg\""
Sep 07 17:09:15.321306 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.321284    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-w78k6\""
Sep 07 17:09:15.329944 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.329928    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-v5fk9\""
Sep 07 17:09:15.330219 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.330205    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 07 17:09:15.339028 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.339013    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 07 17:09:15.340628 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.340614    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-cxgwx\""
Sep 07 17:09:15.344604 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.344586    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 07 17:09:15.347092 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.347078    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 07 17:09:15.350034 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.350019    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 07 17:09:15.363679 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.363661    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 07 17:09:15.381502 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.381484    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 07 17:09:15.390930 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.390913    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 07 17:09:15.394098 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.394084    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 07 17:09:15.396309 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.396295    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 07 17:09:15.401220 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.401206    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 07 17:09:15.404893 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.404877    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 07 17:09:15.414752 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.414735    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 07 17:09:15.423927 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.423908    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 07 17:09:15.428270 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.428255    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 07 17:09:15.439120 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.439102    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 07 17:09:15.443583 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.443568    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-cw9q9\""
Sep 07 17:09:15.447035 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.447022    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 07 17:09:15.452162 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.452147    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 07 17:09:15.453114 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.453098    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 07 17:09:15.459722 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.459707    2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 17:09:15.463797 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.463782    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 07 17:09:15.474484 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.474469    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 07 17:09:15.477135 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.477118    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 07 17:09:15.478213 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.478197    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7cjcl\""
Sep 07 17:09:15.489590 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.489571    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lxz8c\""
Sep 07 17:09:15.494112 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.494097    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 07 17:09:15.499108 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.499089    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 07 17:09:15.507008 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.506986    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 07 17:09:15.507519 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.507503    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 07 17:09:15.507891 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.507875    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 07 17:09:15.512139 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.512122    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-69dkk\""
Sep 07 17:09:15.520545 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.520528    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 07 17:09:15.524785 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.524769    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 07 17:09:15.531098 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.531077    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-dtsjw\""
Sep 07 17:09:15.535647 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.535632    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 07 17:09:15.535782 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.535768    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 07 17:09:15.545845 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.545828    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 07 17:09:15.566125 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.566066    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 07 17:09:15.586725 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.586705    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qm5ll\""
Sep 07 17:09:15.605930 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.605909    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 07 17:09:15.626083 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.626064    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sm5qw\""
Sep 07 17:09:15.645966 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.645946    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 07 17:09:15.666223 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.666199    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 07 17:09:15.686997 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.686976    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 07 17:09:15.708854 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.708830    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 17:09:15.726819 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.726793    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 07 17:09:15.748760 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.748737    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 07 17:09:15.766539 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.766518    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cfxjz\""
Sep 07 17:09:15.786470 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.786442    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 07 17:09:15.806478 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.806452    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 07 17:09:15.826213 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.826141    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 07 17:09:15.846412 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.846386    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 07 17:09:15.866417 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:15.866388    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 07 17:09:28.690225 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:28.690192    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d495b56f5-fr6hb"]
Sep 07 17:09:28.693803 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:28.693783    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d495b56f5-fr6hb"
Sep 07 17:09:28.697201 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:28.697185    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ltmns\""
Sep 07 17:09:28.698202 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:28.698184    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 07 17:09:28.712780 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:28.712736    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d495b56f5-fr6hb"]
Sep 07 17:09:28.730781 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:28.730741    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdfjz\" (UniqueName: \"kubernetes.io/projected/455bd64c-3cf6-4ec7-a5ed-3f63af916bdb-kube-api-access-rdfjz\") pod \"authorino-5d495b56f5-fr6hb\" (UID: \"455bd64c-3cf6-4ec7-a5ed-3f63af916bdb\") " pod="kuadrant-system/authorino-5d495b56f5-fr6hb"
Sep 07 17:09:28.730957 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:28.730936    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/455bd64c-3cf6-4ec7-a5ed-3f63af916bdb-tls-cert\") pod \"authorino-5d495b56f5-fr6hb\" (UID: \"455bd64c-3cf6-4ec7-a5ed-3f63af916bdb\") " pod="kuadrant-system/authorino-5d495b56f5-fr6hb"
Sep 07 17:09:28.831680 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:28.831641    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdfjz\" (UniqueName: \"kubernetes.io/projected/455bd64c-3cf6-4ec7-a5ed-3f63af916bdb-kube-api-access-rdfjz\") pod \"authorino-5d495b56f5-fr6hb\" (UID: \"455bd64c-3cf6-4ec7-a5ed-3f63af916bdb\") " pod="kuadrant-system/authorino-5d495b56f5-fr6hb"
Sep 07 17:09:28.831842 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:28.831736    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/455bd64c-3cf6-4ec7-a5ed-3f63af916bdb-tls-cert\") pod \"authorino-5d495b56f5-fr6hb\" (UID: \"455bd64c-3cf6-4ec7-a5ed-3f63af916bdb\") " pod="kuadrant-system/authorino-5d495b56f5-fr6hb"
Sep 07 17:09:28.834205 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:28.834177    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/455bd64c-3cf6-4ec7-a5ed-3f63af916bdb-tls-cert\") pod \"authorino-5d495b56f5-fr6hb\" (UID: \"455bd64c-3cf6-4ec7-a5ed-3f63af916bdb\") " pod="kuadrant-system/authorino-5d495b56f5-fr6hb"
Sep 07 17:09:28.840981 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:28.840951    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdfjz\" (UniqueName: \"kubernetes.io/projected/455bd64c-3cf6-4ec7-a5ed-3f63af916bdb-kube-api-access-rdfjz\") pod \"authorino-5d495b56f5-fr6hb\" (UID: \"455bd64c-3cf6-4ec7-a5ed-3f63af916bdb\") " pod="kuadrant-system/authorino-5d495b56f5-fr6hb"
Sep 07 17:09:29.002925 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:29.002842    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d495b56f5-fr6hb"
Sep 07 17:09:29.273685 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:29.273654    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d495b56f5-fr6hb"]
Sep 07 17:09:29.274603 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:09:29.274572    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod455bd64c_3cf6_4ec7_a5ed_3f63af916bdb.slice/crio-097bd1bb26b5529192993a3942bd9e919334f2e1323de6c00f979db9aa7b248d WatchSource:0}: Error finding container 097bd1bb26b5529192993a3942bd9e919334f2e1323de6c00f979db9aa7b248d: Status 404 returned error can't find the container with id 097bd1bb26b5529192993a3942bd9e919334f2e1323de6c00f979db9aa7b248d
Sep 07 17:09:29.402328 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:29.402290    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d495b56f5-fr6hb" event={"ID":"455bd64c-3cf6-4ec7-a5ed-3f63af916bdb","Type":"ContainerStarted","Data":"097bd1bb26b5529192993a3942bd9e919334f2e1323de6c00f979db9aa7b248d"}
Sep 07 17:09:30.409658 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:30.409624    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d495b56f5-fr6hb" event={"ID":"455bd64c-3cf6-4ec7-a5ed-3f63af916bdb","Type":"ContainerStarted","Data":"68662a52d88261415be2fe9362ad4fe1b093e1ac2555bacab07a20f2bd526182"}
Sep 07 17:09:30.427032 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:30.426962    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d495b56f5-fr6hb" podStartSLOduration=1.703043626 podStartE2EDuration="2.426943584s" totalImagesPullingTime="723.899958ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:09:30.426606127 +0000 UTC m=+787.458036919" watchObservedRunningTime="2026-09-07 17:09:30.426943584 +0000 UTC m=+787.458374376"
Sep 07 17:09:56.486305 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:56.486208    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"]
Sep 07 17:09:56.490173 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:56.490151    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"
Sep 07 17:09:56.493419 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:56.493397    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-26ca81aa-openshift-default-dockercfg-h442g\""
Sep 07 17:09:56.504533 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:56.504511    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"]
Sep 07 17:09:56.568832 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:56.568796    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-workload-certs\") pod \"e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55\" (UID: \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\") " pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"
Sep 07 17:09:56.568832 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:56.568834    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-workload-socket\") pod \"e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55\" (UID: \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\") " pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"
Sep 07 17:09:56.569050 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:56.568890    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-istio-token\") pod \"e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55\" (UID: \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\") " pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"
Sep 07 17:09:56.569050 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:56.568908    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-istiod-ca-cert\") pod \"e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55\" (UID: \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\") " pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"
Sep 07 17:09:56.569050 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:56.568943    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-istio-envoy\") pod \"e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55\" (UID: \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\") " pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"
Sep 07 17:09:56.569050 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:56.568973    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-credential-socket\") pod \"e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55\" (UID: \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\") " pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"
Sep 07 17:09:56.569050 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:56.568999    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-istio-podinfo\") pod \"e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55\" (UID: \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\") " pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"
Sep 07 17:09:56.569300 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:56.569074    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bgsr\" (UniqueName: \"kubernetes.io/projected/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-kube-api-access-9bgsr\") pod \"e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55\" (UID: \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\") " pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"
Sep 07 17:09:56.569300 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:56.569118    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-istio-data\") pod \"e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55\" (UID: \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\") " pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"
Sep 07 17:09:56.670519 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:56.670485    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-istio-podinfo\") pod \"e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55\" (UID: \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\") " pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"
Sep 07 17:09:56.670688 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:56.670529    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bgsr\" (UniqueName: \"kubernetes.io/projected/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-kube-api-access-9bgsr\") pod \"e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55\" (UID: \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\") " pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"
Sep 07 17:09:56.670688 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:56.670571    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-istio-data\") pod \"e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55\" (UID: \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\") " pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"
Sep 07 17:09:56.670688 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:56.670628    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-workload-certs\") pod \"e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55\" (UID: \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\") " pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"
Sep 07 17:09:56.670688 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:56.670657    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-workload-socket\") pod \"e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55\" (UID: \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\") " pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"
Sep 07 17:09:56.670905 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:56.670719    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-istio-token\") pod \"e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55\" (UID: \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\") " pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"
Sep 07 17:09:56.670905 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:56.670744    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-istiod-ca-cert\") pod \"e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55\" (UID: \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\") " pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"
Sep 07 17:09:56.670905 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:56.670782    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-istio-envoy\") pod \"e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55\" (UID: \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\") " pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"
Sep 07 17:09:56.670905 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:56.670821    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-credential-socket\") pod \"e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55\" (UID: \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\") " pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"
Sep 07 17:09:56.671122 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:56.671054    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-istio-data\") pod \"e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55\" (UID: \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\") " pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"
Sep 07 17:09:56.671122 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:56.671109    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-workload-socket\") pod \"e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55\" (UID: \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\") " pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"
Sep 07 17:09:56.671302 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:56.671279    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-credential-socket\") pod \"e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55\" (UID: \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\") " pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"
Sep 07 17:09:56.671376 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:56.671313    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-workload-certs\") pod \"e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55\" (UID: \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\") " pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"
Sep 07 17:09:56.671589 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:56.671570    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-istiod-ca-cert\") pod \"e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55\" (UID: \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\") " pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"
Sep 07 17:09:56.672959 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:56.672934    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-istio-envoy\") pod \"e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55\" (UID: \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\") " pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"
Sep 07 17:09:56.673054 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:56.672994    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-istio-podinfo\") pod \"e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55\" (UID: \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\") " pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"
Sep 07 17:09:56.686802 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:56.686776    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-istio-token\") pod \"e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55\" (UID: \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\") " pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"
Sep 07 17:09:56.686802 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:56.686791    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bgsr\" (UniqueName: \"kubernetes.io/projected/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-kube-api-access-9bgsr\") pod \"e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55\" (UID: \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\") " pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"
Sep 07 17:09:56.800838 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:56.800751    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"
Sep 07 17:09:57.084206 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:57.084178    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"]
Sep 07 17:09:57.086216 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:09:57.086190    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38fce4c5_2b65_4fdf_98aa_5587bb8e825d.slice/crio-9dc14c04d6a2fcf54449cf283a792f787695b53dd29e514c386575452e784e18 WatchSource:0}: Error finding container 9dc14c04d6a2fcf54449cf283a792f787695b53dd29e514c386575452e784e18: Status 404 returned error can't find the container with id 9dc14c04d6a2fcf54449cf283a792f787695b53dd29e514c386575452e784e18
Sep 07 17:09:57.088880 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:57.088840    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:09:57.088975 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:57.088929    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:09:57.088975 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:57.088967    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:09:57.549017 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:57.548972    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55" event={"ID":"38fce4c5-2b65-4fdf-98aa-5587bb8e825d","Type":"ContainerStarted","Data":"cc04de31f08d13e2276206e2c4616b48cb12a97cccd1d1dc80d9c1bf14c73b4b"}
Sep 07 17:09:57.549505 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:57.549082    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55" event={"ID":"38fce4c5-2b65-4fdf-98aa-5587bb8e825d","Type":"ContainerStarted","Data":"9dc14c04d6a2fcf54449cf283a792f787695b53dd29e514c386575452e784e18"}
Sep 07 17:09:57.585123 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:57.585055    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55" podStartSLOduration=1.585033804 podStartE2EDuration="1.585033804s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:09:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:09:57.581469188 +0000 UTC m=+814.612899980" watchObservedRunningTime="2026-09-07 17:09:57.585033804 +0000 UTC m=+814.616464597"
Sep 07 17:09:57.801773 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:57.801693    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"
Sep 07 17:09:57.853919 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:57.853887    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"]
Sep 07 17:09:57.857701 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:57.857677    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"
Sep 07 17:09:57.861672 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:57.861645    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-3f5660-openshift-default-dockercfg-jsgvd\""
Sep 07 17:09:57.903032 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:57.902994    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"]
Sep 07 17:09:57.983638 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:57.983601    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-istio-envoy\") pod \"e2e-autores-3f5660-openshift-default-58f9996558-lztj9\" (UID: \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\") " pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"
Sep 07 17:09:57.983638 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:57.983645    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mtgt\" (UniqueName: \"kubernetes.io/projected/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-kube-api-access-2mtgt\") pod \"e2e-autores-3f5660-openshift-default-58f9996558-lztj9\" (UID: \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\") " pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"
Sep 07 17:09:57.983906 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:57.983676    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-istio-token\") pod \"e2e-autores-3f5660-openshift-default-58f9996558-lztj9\" (UID: \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\") " pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"
Sep 07 17:09:57.983906 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:57.983700    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-istio-podinfo\") pod \"e2e-autores-3f5660-openshift-default-58f9996558-lztj9\" (UID: \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\") " pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"
Sep 07 17:09:57.983906 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:57.983727    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-istio-data\") pod \"e2e-autores-3f5660-openshift-default-58f9996558-lztj9\" (UID: \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\") " pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"
Sep 07 17:09:57.983906 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:57.983776    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-credential-socket\") pod \"e2e-autores-3f5660-openshift-default-58f9996558-lztj9\" (UID: \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\") " pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"
Sep 07 17:09:57.983906 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:57.983806    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-istiod-ca-cert\") pod \"e2e-autores-3f5660-openshift-default-58f9996558-lztj9\" (UID: \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\") " pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"
Sep 07 17:09:57.983906 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:57.983877    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-workload-certs\") pod \"e2e-autores-3f5660-openshift-default-58f9996558-lztj9\" (UID: \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\") " pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"
Sep 07 17:09:57.984397 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:57.983965    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-workload-socket\") pod \"e2e-autores-3f5660-openshift-default-58f9996558-lztj9\" (UID: \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\") " pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"
Sep 07 17:09:58.085608 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:58.085503    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-workload-certs\") pod \"e2e-autores-3f5660-openshift-default-58f9996558-lztj9\" (UID: \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\") " pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"
Sep 07 17:09:58.085608 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:58.085550    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-workload-socket\") pod \"e2e-autores-3f5660-openshift-default-58f9996558-lztj9\" (UID: \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\") " pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"
Sep 07 17:09:58.085608 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:58.085604    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-istio-envoy\") pod \"e2e-autores-3f5660-openshift-default-58f9996558-lztj9\" (UID: \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\") " pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"
Sep 07 17:09:58.085913 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:58.085638    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mtgt\" (UniqueName: \"kubernetes.io/projected/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-kube-api-access-2mtgt\") pod \"e2e-autores-3f5660-openshift-default-58f9996558-lztj9\" (UID: \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\") " pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"
Sep 07 17:09:58.085913 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:58.085667    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-istio-token\") pod \"e2e-autores-3f5660-openshift-default-58f9996558-lztj9\" (UID: \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\") " pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"
Sep 07 17:09:58.085913 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:58.085703    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-istio-podinfo\") pod \"e2e-autores-3f5660-openshift-default-58f9996558-lztj9\" (UID: \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\") " pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"
Sep 07 17:09:58.085913 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:58.085741    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-istio-data\") pod \"e2e-autores-3f5660-openshift-default-58f9996558-lztj9\" (UID: \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\") " pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"
Sep 07 17:09:58.085913 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:58.085778    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-credential-socket\") pod \"e2e-autores-3f5660-openshift-default-58f9996558-lztj9\" (UID: \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\") " pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"
Sep 07 17:09:58.085913 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:58.085825    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-istiod-ca-cert\") pod \"e2e-autores-3f5660-openshift-default-58f9996558-lztj9\" (UID: \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\") " pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"
Sep 07 17:09:58.086221 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:58.086064    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-workload-socket\") pod \"e2e-autores-3f5660-openshift-default-58f9996558-lztj9\" (UID: \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\") " pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"
Sep 07 17:09:58.086221 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:58.086109    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-workload-certs\") pod \"e2e-autores-3f5660-openshift-default-58f9996558-lztj9\" (UID: \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\") " pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"
Sep 07 17:09:58.086381 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:58.086342    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-istio-data\") pod \"e2e-autores-3f5660-openshift-default-58f9996558-lztj9\" (UID: \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\") " pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"
Sep 07 17:09:58.086614 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:58.086592    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-credential-socket\") pod \"e2e-autores-3f5660-openshift-default-58f9996558-lztj9\" (UID: \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\") " pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"
Sep 07 17:09:58.086705 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:58.086611    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-istiod-ca-cert\") pod \"e2e-autores-3f5660-openshift-default-58f9996558-lztj9\" (UID: \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\") " pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"
Sep 07 17:09:58.088591 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:58.088563    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-istio-envoy\") pod \"e2e-autores-3f5660-openshift-default-58f9996558-lztj9\" (UID: \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\") " pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"
Sep 07 17:09:58.088887 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:58.088866    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-istio-podinfo\") pod \"e2e-autores-3f5660-openshift-default-58f9996558-lztj9\" (UID: \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\") " pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"
Sep 07 17:09:58.097290 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:58.097262    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-istio-token\") pod \"e2e-autores-3f5660-openshift-default-58f9996558-lztj9\" (UID: \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\") " pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"
Sep 07 17:09:58.097401 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:58.097374    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mtgt\" (UniqueName: \"kubernetes.io/projected/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-kube-api-access-2mtgt\") pod \"e2e-autores-3f5660-openshift-default-58f9996558-lztj9\" (UID: \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\") " pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"
Sep 07 17:09:58.170390 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:58.170354    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"
Sep 07 17:09:58.455330 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:58.455284    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"]
Sep 07 17:09:58.457430 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:09:58.457389    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38ef96d7_1405_4ddc_97f3_f50fbdc0ad01.slice/crio-dcc842e589da978379578db2a94591f88cfb3c376092731a667f7d2d20636215 WatchSource:0}: Error finding container dcc842e589da978379578db2a94591f88cfb3c376092731a667f7d2d20636215: Status 404 returned error can't find the container with id dcc842e589da978379578db2a94591f88cfb3c376092731a667f7d2d20636215
Sep 07 17:09:58.460327 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:58.460286    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:09:58.460409 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:58.460357    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:09:58.460409 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:58.460387    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:09:58.559733 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:58.559689    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9" event={"ID":"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01","Type":"ContainerStarted","Data":"3c0e0d43e7f7b1af628af7547ba02e4eddb742da0af75d9d6b32ad1cf1b6ea11"}
Sep 07 17:09:58.560134 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:58.559765    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9" event={"ID":"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01","Type":"ContainerStarted","Data":"dcc842e589da978379578db2a94591f88cfb3c376092731a667f7d2d20636215"}
Sep 07 17:09:58.593305 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:58.593227    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9" podStartSLOduration=1.593203662 podStartE2EDuration="1.593203662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:09:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:09:58.591465074 +0000 UTC m=+815.622895867" watchObservedRunningTime="2026-09-07 17:09:58.593203662 +0000 UTC m=+815.624634454"
Sep 07 17:09:58.815320 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:58.814557    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"
Sep 07 17:09:59.172456 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:59.172423    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"
Sep 07 17:09:59.173191 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:59.173164    2558 patch_prober.go:28] interesting pod/e2e-autores-3f5660-openshift-default-58f9996558-lztj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 07 17:09:59.173427 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:59.173399    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9" podUID="38ef96d7-1405-4ddc-97f3-f50fbdc0ad01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 07 17:09:59.565047 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:59.564960    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"
Sep 07 17:09:59.565737 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:09:59.565716    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"
Sep 07 17:10:00.176001 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:00.175968    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"
Sep 07 17:10:00.571571 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:00.571481    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"
Sep 07 17:10:00.572449 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:00.572428    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"
Sep 07 17:10:00.813882 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:00.813843    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz"]
Sep 07 17:10:00.821755 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:00.821677    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz"
Sep 07 17:10:00.824912 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:00.824889    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-26ca81aa-serving-cert\""
Sep 07 17:10:00.835268 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:00.835223    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz"]
Sep 07 17:10:00.919282 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:00.919223    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwmns\" (UniqueName: \"kubernetes.io/projected/9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b-kube-api-access-pwmns\") pod \"maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz\" (UID: \"9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz"
Sep 07 17:10:00.919483 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:00.919311    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b-metrics-certs\") pod \"maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz\" (UID: \"9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz"
Sep 07 17:10:00.919483 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:00.919343    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b-openshift-service-ca\") pod \"maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz\" (UID: \"9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz"
Sep 07 17:10:00.919483 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:00.919369    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b-maas-api-tls\") pod \"maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz\" (UID: \"9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz"
Sep 07 17:10:01.020100 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:01.020063    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b-metrics-certs\") pod \"maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz\" (UID: \"9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz"
Sep 07 17:10:01.020100 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:01.020104    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b-openshift-service-ca\") pod \"maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz\" (UID: \"9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz"
Sep 07 17:10:01.020397 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:01.020129    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b-maas-api-tls\") pod \"maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz\" (UID: \"9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz"
Sep 07 17:10:01.020397 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:01.020276    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwmns\" (UniqueName: \"kubernetes.io/projected/9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b-kube-api-access-pwmns\") pod \"maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz\" (UID: \"9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz"
Sep 07 17:10:01.020878 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:01.020851    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b-openshift-service-ca\") pod \"maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz\" (UID: \"9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz"
Sep 07 17:10:01.022655 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:01.022633    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b-maas-api-tls\") pod \"maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz\" (UID: \"9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz"
Sep 07 17:10:01.022754 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:01.022725    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b-metrics-certs\") pod \"maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz\" (UID: \"9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz"
Sep 07 17:10:01.033485 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:01.033453    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwmns\" (UniqueName: \"kubernetes.io/projected/9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b-kube-api-access-pwmns\") pod \"maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz\" (UID: \"9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz"
Sep 07 17:10:01.135647 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:01.135609    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz"
Sep 07 17:10:01.417432 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:01.417397    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz"]
Sep 07 17:10:01.418063 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:10:01.418037    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b6082f4_0428_4e56_9bd6_3fcb8b80ce6b.slice/crio-8830811176bbeba3611718f4ee7b601fd6b23941bada394848a444119e03a090 WatchSource:0}: Error finding container 8830811176bbeba3611718f4ee7b601fd6b23941bada394848a444119e03a090: Status 404 returned error can't find the container with id 8830811176bbeba3611718f4ee7b601fd6b23941bada394848a444119e03a090
Sep 07 17:10:01.578248 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:01.578211    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz" event={"ID":"9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b","Type":"ContainerStarted","Data":"8830811176bbeba3611718f4ee7b601fd6b23941bada394848a444119e03a090"}
Sep 07 17:10:02.587862 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:02.587824    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz" event={"ID":"9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b","Type":"ContainerStarted","Data":"5f049e74678954e07a1defcbbf61fd2cb10851eb89c9a910083885dbd42e3f08"}
Sep 07 17:10:02.588338 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:02.588199    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz"
Sep 07 17:10:02.607833 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:02.607778    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz" podStartSLOduration=2.30598444 podStartE2EDuration="2.607758175s" totalImagesPullingTime="301.773735ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:10:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:10:02.607578434 +0000 UTC m=+819.639009226" watchObservedRunningTime="2026-09-07 17:10:02.607758175 +0000 UTC m=+819.639188966"
Sep 07 17:10:08.607092 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:08.607062    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz"
Sep 07 17:10:15.607432 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:15.607385    2558 patch_prober.go:28] interesting pod/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 07 17:10:15.607809 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:15.607461    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55" podUID="38fce4c5-2b65-4fdf-98aa-5587bb8e825d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 07 17:10:18.690704 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:18.690674    2558 generic.go:356] "Generic (PLEG): container finished" podID="38fce4c5-2b65-4fdf-98aa-5587bb8e825d" containerID="cc04de31f08d13e2276206e2c4616b48cb12a97cccd1d1dc80d9c1bf14c73b4b" exitCode=0
Sep 07 17:10:18.691150 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:18.690756    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55" event={"ID":"38fce4c5-2b65-4fdf-98aa-5587bb8e825d","Type":"ContainerDied","Data":"cc04de31f08d13e2276206e2c4616b48cb12a97cccd1d1dc80d9c1bf14c73b4b"}
Sep 07 17:10:18.691217 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:18.691185    2558 scope.go:117] "RemoveContainer" containerID="cc04de31f08d13e2276206e2c4616b48cb12a97cccd1d1dc80d9c1bf14c73b4b"
Sep 07 17:10:18.692449 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:18.692417    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:10:18.692542 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:18.692523    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:10:18.692585 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:18.692574    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:10:18.692649 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:18.692631    2558 generic.go:356] "Generic (PLEG): container finished" podID="38ef96d7-1405-4ddc-97f3-f50fbdc0ad01" containerID="3c0e0d43e7f7b1af628af7547ba02e4eddb742da0af75d9d6b32ad1cf1b6ea11" exitCode=0
Sep 07 17:10:18.692689 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:18.692675    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9" event={"ID":"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01","Type":"ContainerDied","Data":"3c0e0d43e7f7b1af628af7547ba02e4eddb742da0af75d9d6b32ad1cf1b6ea11"}
Sep 07 17:10:18.693005 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:18.692992    2558 scope.go:117] "RemoveContainer" containerID="3c0e0d43e7f7b1af628af7547ba02e4eddb742da0af75d9d6b32ad1cf1b6ea11"
Sep 07 17:10:18.694534 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:18.694280    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:10:18.694534 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:18.694441    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:10:18.694689 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:18.694536    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:10:19.703124 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:19.703092    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9" event={"ID":"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01","Type":"ContainerStarted","Data":"7729441453bb3de9097a89f9ae4cc36c5baf86e72d7ebace12a989c1ecd5660c"}
Sep 07 17:10:19.705490 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:19.705463    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55" event={"ID":"38fce4c5-2b65-4fdf-98aa-5587bb8e825d","Type":"ContainerStarted","Data":"db4072099d9ef85b9abd1225c6d01a0d620682539fa6d76e8a6b7540f195d2c9"}
Sep 07 17:10:19.801399 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:19.801355    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"
Sep 07 17:10:19.801597 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:19.801535    2558 patch_prober.go:28] interesting pod/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 07 17:10:19.801656 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:19.801591    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55" podUID="38fce4c5-2b65-4fdf-98aa-5587bb8e825d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 07 17:10:20.170535 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:20.170485    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"
Sep 07 17:10:20.170968 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:20.170934    2558 patch_prober.go:28] interesting pod/e2e-autores-3f5660-openshift-default-58f9996558-lztj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 07 17:10:20.171076 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:20.170995    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9" podUID="38ef96d7-1405-4ddc-97f3-f50fbdc0ad01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 07 17:10:20.802337 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:20.802293    2558 patch_prober.go:28] interesting pod/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 07 17:10:20.802854 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:20.802377    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55" podUID="38fce4c5-2b65-4fdf-98aa-5587bb8e825d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 07 17:10:21.171587 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:21.171118    2558 patch_prober.go:28] interesting pod/e2e-autores-3f5660-openshift-default-58f9996558-lztj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 07 17:10:21.171587 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:21.171184    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9" podUID="38ef96d7-1405-4ddc-97f3-f50fbdc0ad01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 07 17:10:21.802194 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:21.802161    2558 patch_prober.go:28] interesting pod/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 07 17:10:21.802457 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:21.802432    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55" podUID="38fce4c5-2b65-4fdf-98aa-5587bb8e825d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 07 17:10:22.171000 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:22.170962    2558 patch_prober.go:28] interesting pod/e2e-autores-3f5660-openshift-default-58f9996558-lztj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 07 17:10:22.171301 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:22.171268    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9" podUID="38ef96d7-1405-4ddc-97f3-f50fbdc0ad01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 07 17:10:22.801457 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:22.801418    2558 patch_prober.go:28] interesting pod/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 07 17:10:22.801740 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:22.801711    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55" podUID="38fce4c5-2b65-4fdf-98aa-5587bb8e825d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 07 17:10:23.171505 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:23.171464    2558 patch_prober.go:28] interesting pod/e2e-autores-3f5660-openshift-default-58f9996558-lztj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 07 17:10:23.172097 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:23.172061    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9" podUID="38ef96d7-1405-4ddc-97f3-f50fbdc0ad01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 07 17:10:23.801655 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:23.801611    2558 patch_prober.go:28] interesting pod/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 07 17:10:23.801873 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:23.801676    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55" podUID="38fce4c5-2b65-4fdf-98aa-5587bb8e825d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 07 17:10:24.171899 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:24.171446    2558 patch_prober.go:28] interesting pod/e2e-autores-3f5660-openshift-default-58f9996558-lztj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 07 17:10:24.171899 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:24.171522    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9" podUID="38ef96d7-1405-4ddc-97f3-f50fbdc0ad01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 07 17:10:24.801640 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:24.801595    2558 patch_prober.go:28] interesting pod/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 07 17:10:24.801833 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:24.801669    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55" podUID="38fce4c5-2b65-4fdf-98aa-5587bb8e825d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 07 17:10:25.219615 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:25.219578    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"
Sep 07 17:10:25.220171 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:25.220069    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"
Sep 07 17:10:25.221137 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:25.221114    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"
Sep 07 17:10:25.805892 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:25.805862    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"
Sep 07 17:10:25.806205 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:25.806185    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"
Sep 07 17:10:25.806878 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:25.806859    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"
Sep 07 17:10:27.454173 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:27.454130    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9"]
Sep 07 17:10:27.457432 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:27.457407    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9"
Sep 07 17:10:27.461264 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:27.461229    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-3f5460-serving-cert\""
Sep 07 17:10:27.471158 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:27.471130    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9"]
Sep 07 17:10:27.498526 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:27.498497    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/515f4eb1-1821-4559-82cb-6cde04b70be7-maas-api-tls\") pod \"maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9\" (UID: \"515f4eb1-1821-4559-82cb-6cde04b70be7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9"
Sep 07 17:10:27.498704 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:27.498570    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/515f4eb1-1821-4559-82cb-6cde04b70be7-openshift-service-ca\") pod \"maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9\" (UID: \"515f4eb1-1821-4559-82cb-6cde04b70be7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9"
Sep 07 17:10:27.498704 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:27.498625    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/515f4eb1-1821-4559-82cb-6cde04b70be7-metrics-certs\") pod \"maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9\" (UID: \"515f4eb1-1821-4559-82cb-6cde04b70be7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9"
Sep 07 17:10:27.498704 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:27.498653    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbh86\" (UniqueName: \"kubernetes.io/projected/515f4eb1-1821-4559-82cb-6cde04b70be7-kube-api-access-dbh86\") pod \"maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9\" (UID: \"515f4eb1-1821-4559-82cb-6cde04b70be7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9"
Sep 07 17:10:27.599332 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:27.599297    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/515f4eb1-1821-4559-82cb-6cde04b70be7-maas-api-tls\") pod \"maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9\" (UID: \"515f4eb1-1821-4559-82cb-6cde04b70be7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9"
Sep 07 17:10:27.599527 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:27.599397    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/515f4eb1-1821-4559-82cb-6cde04b70be7-openshift-service-ca\") pod \"maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9\" (UID: \"515f4eb1-1821-4559-82cb-6cde04b70be7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9"
Sep 07 17:10:27.599527 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:10:27.599481    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-3f5460-serving-cert: secret "maas-api-e2e-inf-b-3f5460-serving-cert" not found
Sep 07 17:10:27.599667 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:10:27.599555    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/515f4eb1-1821-4559-82cb-6cde04b70be7-maas-api-tls podName:515f4eb1-1821-4559-82cb-6cde04b70be7 nodeName:}" failed. No retries permitted until 2026-09-07 17:10:28.099532191 +0000 UTC m=+845.130962965 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/515f4eb1-1821-4559-82cb-6cde04b70be7-maas-api-tls") pod "maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9" (UID: "515f4eb1-1821-4559-82cb-6cde04b70be7") : secret "maas-api-e2e-inf-b-3f5460-serving-cert" not found
Sep 07 17:10:27.599667 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:27.599484    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/515f4eb1-1821-4559-82cb-6cde04b70be7-metrics-certs\") pod \"maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9\" (UID: \"515f4eb1-1821-4559-82cb-6cde04b70be7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9"
Sep 07 17:10:27.599667 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:27.599637    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbh86\" (UniqueName: \"kubernetes.io/projected/515f4eb1-1821-4559-82cb-6cde04b70be7-kube-api-access-dbh86\") pod \"maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9\" (UID: \"515f4eb1-1821-4559-82cb-6cde04b70be7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9"
Sep 07 17:10:27.600471 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:27.600439    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/515f4eb1-1821-4559-82cb-6cde04b70be7-openshift-service-ca\") pod \"maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9\" (UID: \"515f4eb1-1821-4559-82cb-6cde04b70be7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9"
Sep 07 17:10:27.602267 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:27.602210    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/515f4eb1-1821-4559-82cb-6cde04b70be7-metrics-certs\") pod \"maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9\" (UID: \"515f4eb1-1821-4559-82cb-6cde04b70be7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9"
Sep 07 17:10:27.612089 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:27.612068    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbh86\" (UniqueName: \"kubernetes.io/projected/515f4eb1-1821-4559-82cb-6cde04b70be7-kube-api-access-dbh86\") pod \"maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9\" (UID: \"515f4eb1-1821-4559-82cb-6cde04b70be7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9"
Sep 07 17:10:28.104549 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:28.104515    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/515f4eb1-1821-4559-82cb-6cde04b70be7-maas-api-tls\") pod \"maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9\" (UID: \"515f4eb1-1821-4559-82cb-6cde04b70be7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9"
Sep 07 17:10:28.104718 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:10:28.104671    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-3f5460-serving-cert: secret "maas-api-e2e-inf-b-3f5460-serving-cert" not found
Sep 07 17:10:28.104769 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:10:28.104753    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/515f4eb1-1821-4559-82cb-6cde04b70be7-maas-api-tls podName:515f4eb1-1821-4559-82cb-6cde04b70be7 nodeName:}" failed. No retries permitted until 2026-09-07 17:10:29.10473647 +0000 UTC m=+846.136167255 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/515f4eb1-1821-4559-82cb-6cde04b70be7-maas-api-tls") pod "maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9" (UID: "515f4eb1-1821-4559-82cb-6cde04b70be7") : secret "maas-api-e2e-inf-b-3f5460-serving-cert" not found
Sep 07 17:10:28.255667 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:28.255628    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4-qkswh"]
Sep 07 17:10:28.258432 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:28.258411    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4-qkswh"
Sep 07 17:10:28.263176 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:28.263152    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-3f5460\""
Sep 07 17:10:28.275020 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:28.274997    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4-qkswh"]
Sep 07 17:10:28.307293 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:28.307264    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v62ld\" (UniqueName: \"kubernetes.io/projected/653e4aeb-5d5b-4728-82a7-0faae05a50b8-kube-api-access-v62ld\") pod \"payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4-qkswh\" (UID: \"653e4aeb-5d5b-4728-82a7-0faae05a50b8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4-qkswh"
Sep 07 17:10:28.307439 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:28.307301    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/653e4aeb-5d5b-4728-82a7-0faae05a50b8-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4-qkswh\" (UID: \"653e4aeb-5d5b-4728-82a7-0faae05a50b8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4-qkswh"
Sep 07 17:10:28.377987 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:28.377901    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-3f5460-68bd4c8b7f-lrzqc"]
Sep 07 17:10:28.381627 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:28.381599    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-3f5460-68bd4c8b7f-lrzqc"
Sep 07 17:10:28.386817 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:28.386792    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-3f5460-dockercfg-xxh5b\""
Sep 07 17:10:28.400794 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:28.400763    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-3f5460-68bd4c8b7f-lrzqc"]
Sep 07 17:10:28.408803 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:28.408777    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dbebceb2-18f8-4987-b23c-976f5f4ff58e-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-3f5460-68bd4c8b7f-lrzqc\" (UID: \"dbebceb2-18f8-4987-b23c-976f5f4ff58e\") " pod="openshift-ingress/payload-processing-e2e-inf-b-3f5460-68bd4c8b7f-lrzqc"
Sep 07 17:10:28.408942 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:28.408868    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v62ld\" (UniqueName: \"kubernetes.io/projected/653e4aeb-5d5b-4728-82a7-0faae05a50b8-kube-api-access-v62ld\") pod \"payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4-qkswh\" (UID: \"653e4aeb-5d5b-4728-82a7-0faae05a50b8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4-qkswh"
Sep 07 17:10:28.408942 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:28.408893    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7l8z\" (UniqueName: \"kubernetes.io/projected/dbebceb2-18f8-4987-b23c-976f5f4ff58e-kube-api-access-d7l8z\") pod \"payload-processing-e2e-inf-b-3f5460-68bd4c8b7f-lrzqc\" (UID: \"dbebceb2-18f8-4987-b23c-976f5f4ff58e\") " pod="openshift-ingress/payload-processing-e2e-inf-b-3f5460-68bd4c8b7f-lrzqc"
Sep 07 17:10:28.408942 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:28.408921    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/653e4aeb-5d5b-4728-82a7-0faae05a50b8-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4-qkswh\" (UID: \"653e4aeb-5d5b-4728-82a7-0faae05a50b8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4-qkswh"
Sep 07 17:10:28.409658 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:28.409635    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/653e4aeb-5d5b-4728-82a7-0faae05a50b8-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4-qkswh\" (UID: \"653e4aeb-5d5b-4728-82a7-0faae05a50b8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4-qkswh"
Sep 07 17:10:28.425057 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:28.425031    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v62ld\" (UniqueName: \"kubernetes.io/projected/653e4aeb-5d5b-4728-82a7-0faae05a50b8-kube-api-access-v62ld\") pod \"payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4-qkswh\" (UID: \"653e4aeb-5d5b-4728-82a7-0faae05a50b8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4-qkswh"
Sep 07 17:10:28.510834 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:28.510789    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dbebceb2-18f8-4987-b23c-976f5f4ff58e-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-3f5460-68bd4c8b7f-lrzqc\" (UID: \"dbebceb2-18f8-4987-b23c-976f5f4ff58e\") " pod="openshift-ingress/payload-processing-e2e-inf-b-3f5460-68bd4c8b7f-lrzqc"
Sep 07 17:10:28.511297 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:28.511040    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7l8z\" (UniqueName: \"kubernetes.io/projected/dbebceb2-18f8-4987-b23c-976f5f4ff58e-kube-api-access-d7l8z\") pod \"payload-processing-e2e-inf-b-3f5460-68bd4c8b7f-lrzqc\" (UID: \"dbebceb2-18f8-4987-b23c-976f5f4ff58e\") " pod="openshift-ingress/payload-processing-e2e-inf-b-3f5460-68bd4c8b7f-lrzqc"
Sep 07 17:10:28.511616 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:28.511596    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dbebceb2-18f8-4987-b23c-976f5f4ff58e-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-3f5460-68bd4c8b7f-lrzqc\" (UID: \"dbebceb2-18f8-4987-b23c-976f5f4ff58e\") " pod="openshift-ingress/payload-processing-e2e-inf-b-3f5460-68bd4c8b7f-lrzqc"
Sep 07 17:10:28.522710 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:28.522686    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7l8z\" (UniqueName: \"kubernetes.io/projected/dbebceb2-18f8-4987-b23c-976f5f4ff58e-kube-api-access-d7l8z\") pod \"payload-processing-e2e-inf-b-3f5460-68bd4c8b7f-lrzqc\" (UID: \"dbebceb2-18f8-4987-b23c-976f5f4ff58e\") " pod="openshift-ingress/payload-processing-e2e-inf-b-3f5460-68bd4c8b7f-lrzqc"
Sep 07 17:10:28.570208 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:28.570182    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4-qkswh"
Sep 07 17:10:28.697596 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:28.697560    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-3f5460-68bd4c8b7f-lrzqc"
Sep 07 17:10:28.865853 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:28.865816    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4-qkswh"]
Sep 07 17:10:28.872012 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:10:28.871987    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod653e4aeb_5d5b_4728_82a7_0faae05a50b8.slice/crio-36fa237df92e95ff777afc6f6e536ced2b6f1c83e549e585343c8cd47ee4853d WatchSource:0}: Error finding container 36fa237df92e95ff777afc6f6e536ced2b6f1c83e549e585343c8cd47ee4853d: Status 404 returned error can't find the container with id 36fa237df92e95ff777afc6f6e536ced2b6f1c83e549e585343c8cd47ee4853d
Sep 07 17:10:29.003411 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:10:29.003374    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbebceb2_18f8_4987_b23c_976f5f4ff58e.slice/crio-2ee3af1df365ddd603ab653516f65255aa966143b3c438ee1bdb6ab573a6906d WatchSource:0}: Error finding container 2ee3af1df365ddd603ab653516f65255aa966143b3c438ee1bdb6ab573a6906d: Status 404 returned error can't find the container with id 2ee3af1df365ddd603ab653516f65255aa966143b3c438ee1bdb6ab573a6906d
Sep 07 17:10:29.003543 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:29.003509    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-3f5460-68bd4c8b7f-lrzqc"]
Sep 07 17:10:29.118810 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:29.118777    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/515f4eb1-1821-4559-82cb-6cde04b70be7-maas-api-tls\") pod \"maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9\" (UID: \"515f4eb1-1821-4559-82cb-6cde04b70be7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9"
Sep 07 17:10:29.121113 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:29.121089    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/515f4eb1-1821-4559-82cb-6cde04b70be7-maas-api-tls\") pod \"maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9\" (UID: \"515f4eb1-1821-4559-82cb-6cde04b70be7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9"
Sep 07 17:10:29.268293 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:29.268193    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9"
Sep 07 17:10:29.576034 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:29.576004    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9"]
Sep 07 17:10:29.578486 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:10:29.578443    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod515f4eb1_1821_4559_82cb_6cde04b70be7.slice/crio-5f9a9a3abe7fcccb678d3b1ccf8b1f9d66864df4e53ef60e1c768c7074d94f85 WatchSource:0}: Error finding container 5f9a9a3abe7fcccb678d3b1ccf8b1f9d66864df4e53ef60e1c768c7074d94f85: Status 404 returned error can't find the container with id 5f9a9a3abe7fcccb678d3b1ccf8b1f9d66864df4e53ef60e1c768c7074d94f85
Sep 07 17:10:29.804606 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:29.804558    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9" event={"ID":"515f4eb1-1821-4559-82cb-6cde04b70be7","Type":"ContainerStarted","Data":"5f9a9a3abe7fcccb678d3b1ccf8b1f9d66864df4e53ef60e1c768c7074d94f85"}
Sep 07 17:10:29.806878 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:29.806842    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-3f5460-68bd4c8b7f-lrzqc" event={"ID":"dbebceb2-18f8-4987-b23c-976f5f4ff58e","Type":"ContainerStarted","Data":"7f0d931032c127eb2dae2e82364d0412242c19711dcfc9949d8ec5334bd3c5b2"}
Sep 07 17:10:29.807044 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:29.806899    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-3f5460-68bd4c8b7f-lrzqc" event={"ID":"dbebceb2-18f8-4987-b23c-976f5f4ff58e","Type":"ContainerStarted","Data":"2ee3af1df365ddd603ab653516f65255aa966143b3c438ee1bdb6ab573a6906d"}
Sep 07 17:10:29.807431 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:29.807375    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-3f5460-68bd4c8b7f-lrzqc"
Sep 07 17:10:29.810090 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:29.809656    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4-qkswh" event={"ID":"653e4aeb-5d5b-4728-82a7-0faae05a50b8","Type":"ContainerStarted","Data":"3b8504144a45eed69c16af23d301e209ba4eb7c40f7ac2a51517d0afd3847c91"}
Sep 07 17:10:29.810090 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:29.809704    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4-qkswh" event={"ID":"653e4aeb-5d5b-4728-82a7-0faae05a50b8","Type":"ContainerStarted","Data":"36fa237df92e95ff777afc6f6e536ced2b6f1c83e549e585343c8cd47ee4853d"}
Sep 07 17:10:29.810283 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:29.810223    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4-qkswh"
Sep 07 17:10:29.833187 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:29.833092    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-3f5460-68bd4c8b7f-lrzqc" podStartSLOduration=1.833077867 podStartE2EDuration="1.833077867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:10:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:10:29.831342768 +0000 UTC m=+846.862773560" watchObservedRunningTime="2026-09-07 17:10:29.833077867 +0000 UTC m=+846.864508657"
Sep 07 17:10:29.853762 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:29.852957    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4-qkswh" podStartSLOduration=1.852933874 podStartE2EDuration="1.852933874s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:10:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:10:29.851473538 +0000 UTC m=+846.882904322" watchObservedRunningTime="2026-09-07 17:10:29.852933874 +0000 UTC m=+846.884364669"
Sep 07 17:10:30.817586 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:30.817547    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9" event={"ID":"515f4eb1-1821-4559-82cb-6cde04b70be7","Type":"ContainerStarted","Data":"666f9bb5b30d6d38e4ae999328aa4806ed3e087ac7184204f5d769fece3fab1c"}
Sep 07 17:10:30.818061 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:30.817710    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9"
Sep 07 17:10:30.848801 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:30.848736    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9" podStartSLOduration=3.540572601 podStartE2EDuration="3.84871515s" totalImagesPullingTime="308.142549ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:10:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:10:30.846273328 +0000 UTC m=+847.877704121" watchObservedRunningTime="2026-09-07 17:10:30.84871515 +0000 UTC m=+847.880145943"
Sep 07 17:10:36.827986 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:36.827956    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9"
Sep 07 17:10:40.820452 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:40.820410    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-3f5460-68bd4c8b7f-lrzqc"
Sep 07 17:10:41.471079 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:41.471046    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz"]
Sep 07 17:10:41.471337 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:41.471313    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz" podUID="9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b" containerName="maas-api" containerID="cri-o://5f049e74678954e07a1defcbbf61fd2cb10851eb89c9a910083885dbd42e3f08" gracePeriod=30
Sep 07 17:10:41.730824 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:41.730765    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz"
Sep 07 17:10:41.825468 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:41.825439    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4-qkswh"
Sep 07 17:10:41.847074 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:41.847045    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b-openshift-service-ca\") pod \"9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b\" (UID: \"9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b\") "
Sep 07 17:10:41.847225 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:41.847102    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b-maas-api-tls\") pod \"9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b\" (UID: \"9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b\") "
Sep 07 17:10:41.847225 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:41.847171    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b-metrics-certs\") pod \"9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b\" (UID: \"9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b\") "
Sep 07 17:10:41.847225 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:41.847212    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwmns\" (UniqueName: \"kubernetes.io/projected/9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b-kube-api-access-pwmns\") pod \"9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b\" (UID: \"9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b\") "
Sep 07 17:10:41.847506 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:41.847461    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b" (UID: "9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:10:41.847618 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:41.847578    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b-openshift-service-ca\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:10:41.849417 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:41.849391    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b" (UID: "9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:10:41.849525 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:41.849391    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b" (UID: "9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:10:41.849525 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:41.849496    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b-kube-api-access-pwmns" (OuterVolumeSpecName: "kube-api-access-pwmns") pod "9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b" (UID: "9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b"). InnerVolumeSpecName "kube-api-access-pwmns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:10:41.879219 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:41.879187    2558 generic.go:356] "Generic (PLEG): container finished" podID="9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b" containerID="5f049e74678954e07a1defcbbf61fd2cb10851eb89c9a910083885dbd42e3f08" exitCode=0
Sep 07 17:10:41.879400 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:41.879231    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz"
Sep 07 17:10:41.879400 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:41.879284    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz" event={"ID":"9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b","Type":"ContainerDied","Data":"5f049e74678954e07a1defcbbf61fd2cb10851eb89c9a910083885dbd42e3f08"}
Sep 07 17:10:41.879400 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:41.879353    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz" event={"ID":"9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b","Type":"ContainerDied","Data":"8830811176bbeba3611718f4ee7b601fd6b23941bada394848a444119e03a090"}
Sep 07 17:10:41.879400 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:41.879394    2558 scope.go:117] "RemoveContainer" containerID="5f049e74678954e07a1defcbbf61fd2cb10851eb89c9a910083885dbd42e3f08"
Sep 07 17:10:41.891146 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:41.891119    2558 scope.go:117] "RemoveContainer" containerID="5f049e74678954e07a1defcbbf61fd2cb10851eb89c9a910083885dbd42e3f08"
Sep 07 17:10:41.891503 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:10:41.891475    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f049e74678954e07a1defcbbf61fd2cb10851eb89c9a910083885dbd42e3f08\": container with ID starting with 5f049e74678954e07a1defcbbf61fd2cb10851eb89c9a910083885dbd42e3f08 not found: ID does not exist" containerID="5f049e74678954e07a1defcbbf61fd2cb10851eb89c9a910083885dbd42e3f08"
Sep 07 17:10:41.891593 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:41.891514    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f049e74678954e07a1defcbbf61fd2cb10851eb89c9a910083885dbd42e3f08"} err="failed to get container status \"5f049e74678954e07a1defcbbf61fd2cb10851eb89c9a910083885dbd42e3f08\": rpc error: code = NotFound desc = could not find container \"5f049e74678954e07a1defcbbf61fd2cb10851eb89c9a910083885dbd42e3f08\": container with ID starting with 5f049e74678954e07a1defcbbf61fd2cb10851eb89c9a910083885dbd42e3f08 not found: ID does not exist"
Sep 07 17:10:41.920014 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:41.919988    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz"]
Sep 07 17:10:41.936116 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:41.936081    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-26ca81aa-7c596c7b8f-nn8sz"]
Sep 07 17:10:41.948800 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:41.948767    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b-maas-api-tls\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:10:41.948800 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:41.948797    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b-metrics-certs\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:10:41.948960 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:41.948810    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwmns\" (UniqueName: \"kubernetes.io/projected/9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b-kube-api-access-pwmns\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:10:42.056339 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:42.056256    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"]
Sep 07 17:10:42.056501 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:42.056465    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55" podUID="38fce4c5-2b65-4fdf-98aa-5587bb8e825d" containerName="istio-proxy" containerID="cri-o://db4072099d9ef85b9abd1225c6d01a0d620682539fa6d76e8a6b7540f195d2c9" gracePeriod=30
Sep 07 17:10:43.594439 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:43.594407    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b" path="/var/lib/kubelet/pods/9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b/volumes"
Sep 07 17:10:47.329517 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.329449    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"
Sep 07 17:10:47.403108 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.403077    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-workload-socket\") pod \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\" (UID: \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\") "
Sep 07 17:10:47.403310 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.403120    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-istio-token\") pod \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\" (UID: \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\") "
Sep 07 17:10:47.403310 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.403180    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-istio-podinfo\") pod \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\" (UID: \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\") "
Sep 07 17:10:47.403310 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.403201    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-credential-socket\") pod \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\" (UID: \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\") "
Sep 07 17:10:47.403496 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.403332    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-istiod-ca-cert\") pod \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\" (UID: \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\") "
Sep 07 17:10:47.403496 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.403385    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9bgsr\" (UniqueName: \"kubernetes.io/projected/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-kube-api-access-9bgsr\") pod \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\" (UID: \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\") "
Sep 07 17:10:47.403496 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.403415    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-istio-envoy\") pod \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\" (UID: \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\") "
Sep 07 17:10:47.403496 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.403418    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "38fce4c5-2b65-4fdf-98aa-5587bb8e825d" (UID: "38fce4c5-2b65-4fdf-98aa-5587bb8e825d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:10:47.403496 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.403451    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-istio-data\") pod \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\" (UID: \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\") "
Sep 07 17:10:47.403776 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.403522    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "38fce4c5-2b65-4fdf-98aa-5587bb8e825d" (UID: "38fce4c5-2b65-4fdf-98aa-5587bb8e825d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:10:47.403776 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.403532    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-workload-certs\") pod \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\" (UID: \"38fce4c5-2b65-4fdf-98aa-5587bb8e825d\") "
Sep 07 17:10:47.403892 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.403796    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "38fce4c5-2b65-4fdf-98aa-5587bb8e825d" (UID: "38fce4c5-2b65-4fdf-98aa-5587bb8e825d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:10:47.403948 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.403898    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-workload-socket\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:10:47.403948 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.403918    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-credential-socket\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:10:47.403948 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.403932    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-istiod-ca-cert\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:10:47.404101 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.404032    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-istio-data" (OuterVolumeSpecName: "istio-data") pod "38fce4c5-2b65-4fdf-98aa-5587bb8e825d" (UID: "38fce4c5-2b65-4fdf-98aa-5587bb8e825d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:10:47.404170 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.404122    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "38fce4c5-2b65-4fdf-98aa-5587bb8e825d" (UID: "38fce4c5-2b65-4fdf-98aa-5587bb8e825d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:10:47.405641 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.405617    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-kube-api-access-9bgsr" (OuterVolumeSpecName: "kube-api-access-9bgsr") pod "38fce4c5-2b65-4fdf-98aa-5587bb8e825d" (UID: "38fce4c5-2b65-4fdf-98aa-5587bb8e825d"). InnerVolumeSpecName "kube-api-access-9bgsr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:10:47.405902 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.405877    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "38fce4c5-2b65-4fdf-98aa-5587bb8e825d" (UID: "38fce4c5-2b65-4fdf-98aa-5587bb8e825d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 17:10:47.405902 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.405887    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-istio-token" (OuterVolumeSpecName: "istio-token") pod "38fce4c5-2b65-4fdf-98aa-5587bb8e825d" (UID: "38fce4c5-2b65-4fdf-98aa-5587bb8e825d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:10:47.406075 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.406052    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "38fce4c5-2b65-4fdf-98aa-5587bb8e825d" (UID: "38fce4c5-2b65-4fdf-98aa-5587bb8e825d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:10:47.504911 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.504872    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bgsr\" (UniqueName: \"kubernetes.io/projected/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-kube-api-access-9bgsr\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:10:47.504911 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.504906    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-istio-envoy\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:10:47.504911 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.504915    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-istio-data\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:10:47.505156 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.504922    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-workload-certs\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:10:47.505156 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.504931    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-istio-token\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:10:47.505156 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.504938    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38fce4c5-2b65-4fdf-98aa-5587bb8e825d-istio-podinfo\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:10:47.917779 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.917689    2558 generic.go:356] "Generic (PLEG): container finished" podID="38fce4c5-2b65-4fdf-98aa-5587bb8e825d" containerID="db4072099d9ef85b9abd1225c6d01a0d620682539fa6d76e8a6b7540f195d2c9" exitCode=0
Sep 07 17:10:47.917779 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.917755    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"
Sep 07 17:10:47.918008 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.917819    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55" event={"ID":"38fce4c5-2b65-4fdf-98aa-5587bb8e825d","Type":"ContainerDied","Data":"db4072099d9ef85b9abd1225c6d01a0d620682539fa6d76e8a6b7540f195d2c9"}
Sep 07 17:10:47.918008 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.917868    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55" event={"ID":"38fce4c5-2b65-4fdf-98aa-5587bb8e825d","Type":"ContainerDied","Data":"9dc14c04d6a2fcf54449cf283a792f787695b53dd29e514c386575452e784e18"}
Sep 07 17:10:47.918008 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.917897    2558 scope.go:117] "RemoveContainer" containerID="db4072099d9ef85b9abd1225c6d01a0d620682539fa6d76e8a6b7540f195d2c9"
Sep 07 17:10:47.921633 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.921607    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-f85216b6-89cc8ff78-t6g7m"]
Sep 07 17:10:47.922292 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.922271    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38fce4c5-2b65-4fdf-98aa-5587bb8e825d" containerName="istio-proxy"
Sep 07 17:10:47.922292 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.922293    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="38fce4c5-2b65-4fdf-98aa-5587bb8e825d" containerName="istio-proxy"
Sep 07 17:10:47.922480 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.922324    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b" containerName="maas-api"
Sep 07 17:10:47.922480 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.922335    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b" containerName="maas-api"
Sep 07 17:10:47.922480 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.922447    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="38fce4c5-2b65-4fdf-98aa-5587bb8e825d" containerName="istio-proxy"
Sep 07 17:10:47.922480 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.922458    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b6082f4-0428-4e56-9bd6-3fcb8b80ce6b" containerName="maas-api"
Sep 07 17:10:47.922480 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.922473    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="38fce4c5-2b65-4fdf-98aa-5587bb8e825d" containerName="istio-proxy"
Sep 07 17:10:47.927184 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.927162    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-f85216b6-89cc8ff78-t6g7m"
Sep 07 17:10:47.929920 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.929893    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-f85216b6-dockercfg-p2sbl\""
Sep 07 17:10:47.930369 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.930260    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-f85216b6\""
Sep 07 17:10:47.933301 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.933159    2558 scope.go:117] "RemoveContainer" containerID="cc04de31f08d13e2276206e2c4616b48cb12a97cccd1d1dc80d9c1bf14c73b4b"
Sep 07 17:10:47.940454 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.940428    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-f85216b6-89cc8ff78-t6g7m"]
Sep 07 17:10:47.954754 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.954620    2558 scope.go:117] "RemoveContainer" containerID="db4072099d9ef85b9abd1225c6d01a0d620682539fa6d76e8a6b7540f195d2c9"
Sep 07 17:10:47.955092 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:10:47.955061    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db4072099d9ef85b9abd1225c6d01a0d620682539fa6d76e8a6b7540f195d2c9\": container with ID starting with db4072099d9ef85b9abd1225c6d01a0d620682539fa6d76e8a6b7540f195d2c9 not found: ID does not exist" containerID="db4072099d9ef85b9abd1225c6d01a0d620682539fa6d76e8a6b7540f195d2c9"
Sep 07 17:10:47.955194 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.955106    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db4072099d9ef85b9abd1225c6d01a0d620682539fa6d76e8a6b7540f195d2c9"} err="failed to get container status \"db4072099d9ef85b9abd1225c6d01a0d620682539fa6d76e8a6b7540f195d2c9\": rpc error: code = NotFound desc = could not find container \"db4072099d9ef85b9abd1225c6d01a0d620682539fa6d76e8a6b7540f195d2c9\": container with ID starting with db4072099d9ef85b9abd1225c6d01a0d620682539fa6d76e8a6b7540f195d2c9 not found: ID does not exist"
Sep 07 17:10:47.955194 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.955134    2558 scope.go:117] "RemoveContainer" containerID="cc04de31f08d13e2276206e2c4616b48cb12a97cccd1d1dc80d9c1bf14c73b4b"
Sep 07 17:10:47.955542 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:10:47.955489    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc04de31f08d13e2276206e2c4616b48cb12a97cccd1d1dc80d9c1bf14c73b4b\": container with ID starting with cc04de31f08d13e2276206e2c4616b48cb12a97cccd1d1dc80d9c1bf14c73b4b not found: ID does not exist" containerID="cc04de31f08d13e2276206e2c4616b48cb12a97cccd1d1dc80d9c1bf14c73b4b"
Sep 07 17:10:47.955542 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.955531    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc04de31f08d13e2276206e2c4616b48cb12a97cccd1d1dc80d9c1bf14c73b4b"} err="failed to get container status \"cc04de31f08d13e2276206e2c4616b48cb12a97cccd1d1dc80d9c1bf14c73b4b\": rpc error: code = NotFound desc = could not find container \"cc04de31f08d13e2276206e2c4616b48cb12a97cccd1d1dc80d9c1bf14c73b4b\": container with ID starting with cc04de31f08d13e2276206e2c4616b48cb12a97cccd1d1dc80d9c1bf14c73b4b not found: ID does not exist"
Sep 07 17:10:47.956570 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.956544    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"]
Sep 07 17:10:47.965290 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:47.965258    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55"]
Sep 07 17:10:48.010376 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:48.010346    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c08994f7-54fc-4e2f-bc93-1f20a00a6fc6-plugins-config-volume\") pod \"payload-processing-e2e-migrate-f85216b6-89cc8ff78-t6g7m\" (UID: \"c08994f7-54fc-4e2f-bc93-1f20a00a6fc6\") " pod="openshift-ingress/payload-processing-e2e-migrate-f85216b6-89cc8ff78-t6g7m"
Sep 07 17:10:48.010541 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:48.010427    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zrr9\" (UniqueName: \"kubernetes.io/projected/c08994f7-54fc-4e2f-bc93-1f20a00a6fc6-kube-api-access-8zrr9\") pod \"payload-processing-e2e-migrate-f85216b6-89cc8ff78-t6g7m\" (UID: \"c08994f7-54fc-4e2f-bc93-1f20a00a6fc6\") " pod="openshift-ingress/payload-processing-e2e-migrate-f85216b6-89cc8ff78-t6g7m"
Sep 07 17:10:48.111302 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:48.111268    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c08994f7-54fc-4e2f-bc93-1f20a00a6fc6-plugins-config-volume\") pod \"payload-processing-e2e-migrate-f85216b6-89cc8ff78-t6g7m\" (UID: \"c08994f7-54fc-4e2f-bc93-1f20a00a6fc6\") " pod="openshift-ingress/payload-processing-e2e-migrate-f85216b6-89cc8ff78-t6g7m"
Sep 07 17:10:48.111475 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:48.111315    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zrr9\" (UniqueName: \"kubernetes.io/projected/c08994f7-54fc-4e2f-bc93-1f20a00a6fc6-kube-api-access-8zrr9\") pod \"payload-processing-e2e-migrate-f85216b6-89cc8ff78-t6g7m\" (UID: \"c08994f7-54fc-4e2f-bc93-1f20a00a6fc6\") " pod="openshift-ingress/payload-processing-e2e-migrate-f85216b6-89cc8ff78-t6g7m"
Sep 07 17:10:48.111954 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:48.111933    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c08994f7-54fc-4e2f-bc93-1f20a00a6fc6-plugins-config-volume\") pod \"payload-processing-e2e-migrate-f85216b6-89cc8ff78-t6g7m\" (UID: \"c08994f7-54fc-4e2f-bc93-1f20a00a6fc6\") " pod="openshift-ingress/payload-processing-e2e-migrate-f85216b6-89cc8ff78-t6g7m"
Sep 07 17:10:48.121369 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:48.121343    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zrr9\" (UniqueName: \"kubernetes.io/projected/c08994f7-54fc-4e2f-bc93-1f20a00a6fc6-kube-api-access-8zrr9\") pod \"payload-processing-e2e-migrate-f85216b6-89cc8ff78-t6g7m\" (UID: \"c08994f7-54fc-4e2f-bc93-1f20a00a6fc6\") " pod="openshift-ingress/payload-processing-e2e-migrate-f85216b6-89cc8ff78-t6g7m"
Sep 07 17:10:48.244659 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:48.244570    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-f85216b6-89cc8ff78-t6g7m"
Sep 07 17:10:48.532258 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:10:48.532214    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc08994f7_54fc_4e2f_bc93_1f20a00a6fc6.slice/crio-11c7b3b27b20ad1a3532a6317117d0b66d051722d606d0999910f977b4cee85e WatchSource:0}: Error finding container 11c7b3b27b20ad1a3532a6317117d0b66d051722d606d0999910f977b4cee85e: Status 404 returned error can't find the container with id 11c7b3b27b20ad1a3532a6317117d0b66d051722d606d0999910f977b4cee85e
Sep 07 17:10:48.534251 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:48.534211    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-f85216b6-89cc8ff78-t6g7m"]
Sep 07 17:10:48.935229 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:48.935186    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-f85216b6-89cc8ff78-t6g7m" event={"ID":"c08994f7-54fc-4e2f-bc93-1f20a00a6fc6","Type":"ContainerStarted","Data":"5f56c16b58e187591a4596724c49102546d5bb8ebca00a94651c9516c2612ebf"}
Sep 07 17:10:48.935458 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:48.935401    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-f85216b6-89cc8ff78-t6g7m"
Sep 07 17:10:48.935458 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:48.935434    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-f85216b6-89cc8ff78-t6g7m" event={"ID":"c08994f7-54fc-4e2f-bc93-1f20a00a6fc6","Type":"ContainerStarted","Data":"11c7b3b27b20ad1a3532a6317117d0b66d051722d606d0999910f977b4cee85e"}
Sep 07 17:10:48.971746 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:48.971692    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-f85216b6-89cc8ff78-t6g7m" podStartSLOduration=1.97167696 podStartE2EDuration="1.97167696s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:10:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:10:48.96887992 +0000 UTC m=+866.000310712" watchObservedRunningTime="2026-09-07 17:10:48.97167696 +0000 UTC m=+866.003107795"
Sep 07 17:10:49.595190 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:49.595156    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38fce4c5-2b65-4fdf-98aa-5587bb8e825d" path="/var/lib/kubelet/pods/38fce4c5-2b65-4fdf-98aa-5587bb8e825d/volumes"
Sep 07 17:10:59.943366 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:10:59.943337    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-f85216b6-89cc8ff78-t6g7m"
Sep 07 17:11:18.145308 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:18.145199    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-f85216b6-89cc8ff78-t6g7m"]
Sep 07 17:11:18.145859 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:18.145471    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-f85216b6-89cc8ff78-t6g7m" podUID="c08994f7-54fc-4e2f-bc93-1f20a00a6fc6" containerName="payload-processing" containerID="cri-o://5f56c16b58e187591a4596724c49102546d5bb8ebca00a94651c9516c2612ebf" gracePeriod=30
Sep 07 17:11:18.418054 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:18.418028    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-f85216b6-89cc8ff78-t6g7m"
Sep 07 17:11:18.522475 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:18.521538    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zrr9\" (UniqueName: \"kubernetes.io/projected/c08994f7-54fc-4e2f-bc93-1f20a00a6fc6-kube-api-access-8zrr9\") pod \"c08994f7-54fc-4e2f-bc93-1f20a00a6fc6\" (UID: \"c08994f7-54fc-4e2f-bc93-1f20a00a6fc6\") "
Sep 07 17:11:18.522475 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:18.521696    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c08994f7-54fc-4e2f-bc93-1f20a00a6fc6-plugins-config-volume\") pod \"c08994f7-54fc-4e2f-bc93-1f20a00a6fc6\" (UID: \"c08994f7-54fc-4e2f-bc93-1f20a00a6fc6\") "
Sep 07 17:11:18.522926 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:18.522881    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c08994f7-54fc-4e2f-bc93-1f20a00a6fc6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c08994f7-54fc-4e2f-bc93-1f20a00a6fc6" (UID: "c08994f7-54fc-4e2f-bc93-1f20a00a6fc6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:11:18.533442 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:18.533380    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c08994f7-54fc-4e2f-bc93-1f20a00a6fc6-kube-api-access-8zrr9" (OuterVolumeSpecName: "kube-api-access-8zrr9") pod "c08994f7-54fc-4e2f-bc93-1f20a00a6fc6" (UID: "c08994f7-54fc-4e2f-bc93-1f20a00a6fc6"). InnerVolumeSpecName "kube-api-access-8zrr9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:11:18.622920 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:18.622890    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zrr9\" (UniqueName: \"kubernetes.io/projected/c08994f7-54fc-4e2f-bc93-1f20a00a6fc6-kube-api-access-8zrr9\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:11:18.622920 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:18.622915    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c08994f7-54fc-4e2f-bc93-1f20a00a6fc6-plugins-config-volume\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:11:19.097351 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:19.097315    2558 generic.go:356] "Generic (PLEG): container finished" podID="c08994f7-54fc-4e2f-bc93-1f20a00a6fc6" containerID="5f56c16b58e187591a4596724c49102546d5bb8ebca00a94651c9516c2612ebf" exitCode=0
Sep 07 17:11:19.097540 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:19.097364    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-f85216b6-89cc8ff78-t6g7m"
Sep 07 17:11:19.097540 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:19.097400    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-f85216b6-89cc8ff78-t6g7m" event={"ID":"c08994f7-54fc-4e2f-bc93-1f20a00a6fc6","Type":"ContainerDied","Data":"5f56c16b58e187591a4596724c49102546d5bb8ebca00a94651c9516c2612ebf"}
Sep 07 17:11:19.097540 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:19.097455    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-f85216b6-89cc8ff78-t6g7m" event={"ID":"c08994f7-54fc-4e2f-bc93-1f20a00a6fc6","Type":"ContainerDied","Data":"11c7b3b27b20ad1a3532a6317117d0b66d051722d606d0999910f977b4cee85e"}
Sep 07 17:11:19.097540 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:19.097478    2558 scope.go:117] "RemoveContainer" containerID="5f56c16b58e187591a4596724c49102546d5bb8ebca00a94651c9516c2612ebf"
Sep 07 17:11:19.109152 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:19.109128    2558 scope.go:117] "RemoveContainer" containerID="5f56c16b58e187591a4596724c49102546d5bb8ebca00a94651c9516c2612ebf"
Sep 07 17:11:19.109626 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:11:19.109603    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f56c16b58e187591a4596724c49102546d5bb8ebca00a94651c9516c2612ebf\": container with ID starting with 5f56c16b58e187591a4596724c49102546d5bb8ebca00a94651c9516c2612ebf not found: ID does not exist" containerID="5f56c16b58e187591a4596724c49102546d5bb8ebca00a94651c9516c2612ebf"
Sep 07 17:11:19.109717 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:19.109632    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f56c16b58e187591a4596724c49102546d5bb8ebca00a94651c9516c2612ebf"} err="failed to get container status \"5f56c16b58e187591a4596724c49102546d5bb8ebca00a94651c9516c2612ebf\": rpc error: code = NotFound desc = could not find container \"5f56c16b58e187591a4596724c49102546d5bb8ebca00a94651c9516c2612ebf\": container with ID starting with 5f56c16b58e187591a4596724c49102546d5bb8ebca00a94651c9516c2612ebf not found: ID does not exist"
Sep 07 17:11:19.130622 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:19.130600    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-f85216b6-89cc8ff78-t6g7m"]
Sep 07 17:11:19.134806 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:19.134786    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-f85216b6-89cc8ff78-t6g7m"]
Sep 07 17:11:19.594807 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:19.594775    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c08994f7-54fc-4e2f-bc93-1f20a00a6fc6" path="/var/lib/kubelet/pods/c08994f7-54fc-4e2f-bc93-1f20a00a6fc6/volumes"
Sep 07 17:11:23.621793 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:23.621757    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-f6srd_24750b4e-c0bc-4c3c-a256-6ca251306d06/console-operator/1.log"
Sep 07 17:11:23.624002 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:23.623963    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-f6srd_24750b4e-c0bc-4c3c-a256-6ca251306d06/console-operator/1.log"
Sep 07 17:11:23.630272 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:23.630254    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwj7s_9b97dbca-7e8f-4e05-9cc4-8f42785f01e7/ovn-acl-logging/0.log"
Sep 07 17:11:23.631564 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:23.631544    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwj7s_9b97dbca-7e8f-4e05-9cc4-8f42785f01e7/ovn-acl-logging/0.log"
Sep 07 17:11:23.754065 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:23.754029    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d53e4343-67b6f49f58-n884s"]
Sep 07 17:11:23.754548 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:23.754530    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38fce4c5-2b65-4fdf-98aa-5587bb8e825d" containerName="istio-proxy"
Sep 07 17:11:23.754652 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:23.754550    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="38fce4c5-2b65-4fdf-98aa-5587bb8e825d" containerName="istio-proxy"
Sep 07 17:11:23.754652 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:23.754580    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c08994f7-54fc-4e2f-bc93-1f20a00a6fc6" containerName="payload-processing"
Sep 07 17:11:23.754652 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:23.754589    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c08994f7-54fc-4e2f-bc93-1f20a00a6fc6" containerName="payload-processing"
Sep 07 17:11:23.754805 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:23.754679    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c08994f7-54fc-4e2f-bc93-1f20a00a6fc6" containerName="payload-processing"
Sep 07 17:11:23.759011 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:23.758992    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-d53e4343-67b6f49f58-n884s"
Sep 07 17:11:23.764621 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:23.764578    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-d53e4343-dockercfg-wkzjg\""
Sep 07 17:11:23.764812 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:23.764792    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-d53e4343\""
Sep 07 17:11:23.766869 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:23.766847    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d53e4343-7fc9c55b4f-h7t9n"]
Sep 07 17:11:23.770087 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:23.770062    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d53e4343-7fc9c55b4f-h7t9n"
Sep 07 17:11:23.773502 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:23.773481    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d53e4343-67b6f49f58-n884s"]
Sep 07 17:11:23.812811 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:23.812776    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d53e4343-7fc9c55b4f-h7t9n"]
Sep 07 17:11:23.878026 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:23.877937    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zsjh\" (UniqueName: \"kubernetes.io/projected/a85a7c35-1cea-42a9-a400-f57ece04f2b5-kube-api-access-4zsjh\") pod \"payload-pre-processing-e2e-ait-d53e4343-67b6f49f58-n884s\" (UID: \"a85a7c35-1cea-42a9-a400-f57ece04f2b5\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d53e4343-67b6f49f58-n884s"
Sep 07 17:11:23.878026 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:23.877986    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a85a7c35-1cea-42a9-a400-f57ece04f2b5-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-d53e4343-67b6f49f58-n884s\" (UID: \"a85a7c35-1cea-42a9-a400-f57ece04f2b5\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d53e4343-67b6f49f58-n884s"
Sep 07 17:11:23.878221 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:23.878044    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4gld\" (UniqueName: \"kubernetes.io/projected/1a3f01e8-f61a-42e8-bf56-cd1842e747f8-kube-api-access-c4gld\") pod \"payload-processing-e2e-ait-d53e4343-7fc9c55b4f-h7t9n\" (UID: \"1a3f01e8-f61a-42e8-bf56-cd1842e747f8\") " pod="openshift-ingress/payload-processing-e2e-ait-d53e4343-7fc9c55b4f-h7t9n"
Sep 07 17:11:23.878221 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:23.878062    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a3f01e8-f61a-42e8-bf56-cd1842e747f8-plugins-config-volume\") pod \"payload-processing-e2e-ait-d53e4343-7fc9c55b4f-h7t9n\" (UID: \"1a3f01e8-f61a-42e8-bf56-cd1842e747f8\") " pod="openshift-ingress/payload-processing-e2e-ait-d53e4343-7fc9c55b4f-h7t9n"
Sep 07 17:11:23.979154 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:23.979114    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zsjh\" (UniqueName: \"kubernetes.io/projected/a85a7c35-1cea-42a9-a400-f57ece04f2b5-kube-api-access-4zsjh\") pod \"payload-pre-processing-e2e-ait-d53e4343-67b6f49f58-n884s\" (UID: \"a85a7c35-1cea-42a9-a400-f57ece04f2b5\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d53e4343-67b6f49f58-n884s"
Sep 07 17:11:23.979329 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:23.979164    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a85a7c35-1cea-42a9-a400-f57ece04f2b5-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-d53e4343-67b6f49f58-n884s\" (UID: \"a85a7c35-1cea-42a9-a400-f57ece04f2b5\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d53e4343-67b6f49f58-n884s"
Sep 07 17:11:23.979329 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:23.979274    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4gld\" (UniqueName: \"kubernetes.io/projected/1a3f01e8-f61a-42e8-bf56-cd1842e747f8-kube-api-access-c4gld\") pod \"payload-processing-e2e-ait-d53e4343-7fc9c55b4f-h7t9n\" (UID: \"1a3f01e8-f61a-42e8-bf56-cd1842e747f8\") " pod="openshift-ingress/payload-processing-e2e-ait-d53e4343-7fc9c55b4f-h7t9n"
Sep 07 17:11:23.979329 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:23.979305    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a3f01e8-f61a-42e8-bf56-cd1842e747f8-plugins-config-volume\") pod \"payload-processing-e2e-ait-d53e4343-7fc9c55b4f-h7t9n\" (UID: \"1a3f01e8-f61a-42e8-bf56-cd1842e747f8\") " pod="openshift-ingress/payload-processing-e2e-ait-d53e4343-7fc9c55b4f-h7t9n"
Sep 07 17:11:23.979964 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:23.979940    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a85a7c35-1cea-42a9-a400-f57ece04f2b5-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-d53e4343-67b6f49f58-n884s\" (UID: \"a85a7c35-1cea-42a9-a400-f57ece04f2b5\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d53e4343-67b6f49f58-n884s"
Sep 07 17:11:23.980075 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:23.980013    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a3f01e8-f61a-42e8-bf56-cd1842e747f8-plugins-config-volume\") pod \"payload-processing-e2e-ait-d53e4343-7fc9c55b4f-h7t9n\" (UID: \"1a3f01e8-f61a-42e8-bf56-cd1842e747f8\") " pod="openshift-ingress/payload-processing-e2e-ait-d53e4343-7fc9c55b4f-h7t9n"
Sep 07 17:11:23.988231 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:23.988197    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zsjh\" (UniqueName: \"kubernetes.io/projected/a85a7c35-1cea-42a9-a400-f57ece04f2b5-kube-api-access-4zsjh\") pod \"payload-pre-processing-e2e-ait-d53e4343-67b6f49f58-n884s\" (UID: \"a85a7c35-1cea-42a9-a400-f57ece04f2b5\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d53e4343-67b6f49f58-n884s"
Sep 07 17:11:23.988511 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:23.988492    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4gld\" (UniqueName: \"kubernetes.io/projected/1a3f01e8-f61a-42e8-bf56-cd1842e747f8-kube-api-access-c4gld\") pod \"payload-processing-e2e-ait-d53e4343-7fc9c55b4f-h7t9n\" (UID: \"1a3f01e8-f61a-42e8-bf56-cd1842e747f8\") " pod="openshift-ingress/payload-processing-e2e-ait-d53e4343-7fc9c55b4f-h7t9n"
Sep 07 17:11:24.070263 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:24.070198    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-d53e4343-67b6f49f58-n884s"
Sep 07 17:11:24.081090 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:24.081066    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d53e4343-7fc9c55b4f-h7t9n"
Sep 07 17:11:24.356392 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:24.356360    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d53e4343-67b6f49f58-n884s"]
Sep 07 17:11:24.357458 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:11:24.357422    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda85a7c35_1cea_42a9_a400_f57ece04f2b5.slice/crio-709dcd5d5577041076a8f86cc7a35f4d74ff648cc45460829ed39f9b4c98204b WatchSource:0}: Error finding container 709dcd5d5577041076a8f86cc7a35f4d74ff648cc45460829ed39f9b4c98204b: Status 404 returned error can't find the container with id 709dcd5d5577041076a8f86cc7a35f4d74ff648cc45460829ed39f9b4c98204b
Sep 07 17:11:24.375397 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:24.375376    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d53e4343-7fc9c55b4f-h7t9n"]
Sep 07 17:11:24.376567 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:11:24.376542    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a3f01e8_f61a_42e8_bf56_cd1842e747f8.slice/crio-a9c81dd649bc92241a5d379ef608a298e53251fa81f6c2df46d1355daed92f77 WatchSource:0}: Error finding container a9c81dd649bc92241a5d379ef608a298e53251fa81f6c2df46d1355daed92f77: Status 404 returned error can't find the container with id a9c81dd649bc92241a5d379ef608a298e53251fa81f6c2df46d1355daed92f77
Sep 07 17:11:25.134413 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:25.134375    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d53e4343-7fc9c55b4f-h7t9n" event={"ID":"1a3f01e8-f61a-42e8-bf56-cd1842e747f8","Type":"ContainerStarted","Data":"b6f89efcc312993ef43e66902c3d7dcb20c7260d00f9857327118b6e9aad0305"}
Sep 07 17:11:25.134876 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:25.134498    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-d53e4343-7fc9c55b4f-h7t9n"
Sep 07 17:11:25.134876 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:25.134526    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d53e4343-7fc9c55b4f-h7t9n" event={"ID":"1a3f01e8-f61a-42e8-bf56-cd1842e747f8","Type":"ContainerStarted","Data":"a9c81dd649bc92241a5d379ef608a298e53251fa81f6c2df46d1355daed92f77"}
Sep 07 17:11:25.136166 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:25.136134    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-d53e4343-67b6f49f58-n884s" event={"ID":"a85a7c35-1cea-42a9-a400-f57ece04f2b5","Type":"ContainerStarted","Data":"97d42d57ec67a5593609f0262036d72c65bf4c025938fcdadedada75acac966e"}
Sep 07 17:11:25.136316 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:25.136182    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-d53e4343-67b6f49f58-n884s" event={"ID":"a85a7c35-1cea-42a9-a400-f57ece04f2b5","Type":"ContainerStarted","Data":"709dcd5d5577041076a8f86cc7a35f4d74ff648cc45460829ed39f9b4c98204b"}
Sep 07 17:11:25.136316 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:25.136213    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-d53e4343-67b6f49f58-n884s"
Sep 07 17:11:25.154891 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:25.154839    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-d53e4343-7fc9c55b4f-h7t9n" podStartSLOduration=2.154823343 podStartE2EDuration="2.154823343s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:11:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:11:25.154119888 +0000 UTC m=+902.185550679" watchObservedRunningTime="2026-09-07 17:11:25.154823343 +0000 UTC m=+902.186254132"
Sep 07 17:11:25.175935 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:25.175891    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-d53e4343-67b6f49f58-n884s" podStartSLOduration=2.175878029 podStartE2EDuration="2.175878029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:11:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:11:25.175826429 +0000 UTC m=+902.207257230" watchObservedRunningTime="2026-09-07 17:11:25.175878029 +0000 UTC m=+902.207308821"
Sep 07 17:11:36.143893 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:36.143859    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-d53e4343-67b6f49f58-n884s"
Sep 07 17:11:36.144344 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:36.144026    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-d53e4343-7fc9c55b4f-h7t9n"
Sep 07 17:11:53.507930 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:53.507892    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d53e4343-7fc9c55b4f-h7t9n"]
Sep 07 17:11:53.508445 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:53.508157    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-d53e4343-7fc9c55b4f-h7t9n" podUID="1a3f01e8-f61a-42e8-bf56-cd1842e747f8" containerName="payload-processing" containerID="cri-o://b6f89efcc312993ef43e66902c3d7dcb20c7260d00f9857327118b6e9aad0305" gracePeriod=30
Sep 07 17:11:53.533775 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:53.533743    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d53e4343-67b6f49f58-n884s"]
Sep 07 17:11:53.534005 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:53.533980    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-d53e4343-67b6f49f58-n884s" podUID="a85a7c35-1cea-42a9-a400-f57ece04f2b5" containerName="payload-pre-processing" containerID="cri-o://97d42d57ec67a5593609f0262036d72c65bf4c025938fcdadedada75acac966e" gracePeriod=30
Sep 07 17:11:53.791551 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:53.791522    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d53e4343-7fc9c55b4f-h7t9n"
Sep 07 17:11:53.838955 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:53.838699    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-d53e4343-67b6f49f58-n884s"
Sep 07 17:11:53.858297 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:53.858229    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4gld\" (UniqueName: \"kubernetes.io/projected/1a3f01e8-f61a-42e8-bf56-cd1842e747f8-kube-api-access-c4gld\") pod \"1a3f01e8-f61a-42e8-bf56-cd1842e747f8\" (UID: \"1a3f01e8-f61a-42e8-bf56-cd1842e747f8\") "
Sep 07 17:11:53.858448 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:53.858383    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a3f01e8-f61a-42e8-bf56-cd1842e747f8-plugins-config-volume\") pod \"1a3f01e8-f61a-42e8-bf56-cd1842e747f8\" (UID: \"1a3f01e8-f61a-42e8-bf56-cd1842e747f8\") "
Sep 07 17:11:53.858803 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:53.858773    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a3f01e8-f61a-42e8-bf56-cd1842e747f8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1a3f01e8-f61a-42e8-bf56-cd1842e747f8" (UID: "1a3f01e8-f61a-42e8-bf56-cd1842e747f8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:11:53.860551 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:53.860527    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a3f01e8-f61a-42e8-bf56-cd1842e747f8-kube-api-access-c4gld" (OuterVolumeSpecName: "kube-api-access-c4gld") pod "1a3f01e8-f61a-42e8-bf56-cd1842e747f8" (UID: "1a3f01e8-f61a-42e8-bf56-cd1842e747f8"). InnerVolumeSpecName "kube-api-access-c4gld". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:11:53.959427 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:53.959393    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zsjh\" (UniqueName: \"kubernetes.io/projected/a85a7c35-1cea-42a9-a400-f57ece04f2b5-kube-api-access-4zsjh\") pod \"a85a7c35-1cea-42a9-a400-f57ece04f2b5\" (UID: \"a85a7c35-1cea-42a9-a400-f57ece04f2b5\") "
Sep 07 17:11:53.959624 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:53.959521    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a85a7c35-1cea-42a9-a400-f57ece04f2b5-plugins-config-volume\") pod \"a85a7c35-1cea-42a9-a400-f57ece04f2b5\" (UID: \"a85a7c35-1cea-42a9-a400-f57ece04f2b5\") "
Sep 07 17:11:53.959812 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:53.959789    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4gld\" (UniqueName: \"kubernetes.io/projected/1a3f01e8-f61a-42e8-bf56-cd1842e747f8-kube-api-access-c4gld\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:11:53.959899 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:53.959819    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a3f01e8-f61a-42e8-bf56-cd1842e747f8-plugins-config-volume\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:11:53.959963 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:53.959923    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a85a7c35-1cea-42a9-a400-f57ece04f2b5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a85a7c35-1cea-42a9-a400-f57ece04f2b5" (UID: "a85a7c35-1cea-42a9-a400-f57ece04f2b5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:11:53.961608 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:53.961582    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a85a7c35-1cea-42a9-a400-f57ece04f2b5-kube-api-access-4zsjh" (OuterVolumeSpecName: "kube-api-access-4zsjh") pod "a85a7c35-1cea-42a9-a400-f57ece04f2b5" (UID: "a85a7c35-1cea-42a9-a400-f57ece04f2b5"). InnerVolumeSpecName "kube-api-access-4zsjh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:11:54.061299 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:54.061193    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a85a7c35-1cea-42a9-a400-f57ece04f2b5-plugins-config-volume\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:11:54.061299 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:54.061221    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zsjh\" (UniqueName: \"kubernetes.io/projected/a85a7c35-1cea-42a9-a400-f57ece04f2b5-kube-api-access-4zsjh\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:11:54.299993 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:54.299962    2558 generic.go:356] "Generic (PLEG): container finished" podID="a85a7c35-1cea-42a9-a400-f57ece04f2b5" containerID="97d42d57ec67a5593609f0262036d72c65bf4c025938fcdadedada75acac966e" exitCode=0
Sep 07 17:11:54.300189 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:54.300005    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-d53e4343-67b6f49f58-n884s"
Sep 07 17:11:54.300189 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:54.300044    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-d53e4343-67b6f49f58-n884s" event={"ID":"a85a7c35-1cea-42a9-a400-f57ece04f2b5","Type":"ContainerDied","Data":"97d42d57ec67a5593609f0262036d72c65bf4c025938fcdadedada75acac966e"}
Sep 07 17:11:54.300189 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:54.300097    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-d53e4343-67b6f49f58-n884s" event={"ID":"a85a7c35-1cea-42a9-a400-f57ece04f2b5","Type":"ContainerDied","Data":"709dcd5d5577041076a8f86cc7a35f4d74ff648cc45460829ed39f9b4c98204b"}
Sep 07 17:11:54.300189 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:54.300121    2558 scope.go:117] "RemoveContainer" containerID="97d42d57ec67a5593609f0262036d72c65bf4c025938fcdadedada75acac966e"
Sep 07 17:11:54.301492 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:54.301467    2558 generic.go:356] "Generic (PLEG): container finished" podID="1a3f01e8-f61a-42e8-bf56-cd1842e747f8" containerID="b6f89efcc312993ef43e66902c3d7dcb20c7260d00f9857327118b6e9aad0305" exitCode=0
Sep 07 17:11:54.301586 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:54.301563    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d53e4343-7fc9c55b4f-h7t9n" event={"ID":"1a3f01e8-f61a-42e8-bf56-cd1842e747f8","Type":"ContainerDied","Data":"b6f89efcc312993ef43e66902c3d7dcb20c7260d00f9857327118b6e9aad0305"}
Sep 07 17:11:54.301586 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:54.301564    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d53e4343-7fc9c55b4f-h7t9n"
Sep 07 17:11:54.301729 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:54.301606    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d53e4343-7fc9c55b4f-h7t9n" event={"ID":"1a3f01e8-f61a-42e8-bf56-cd1842e747f8","Type":"ContainerDied","Data":"a9c81dd649bc92241a5d379ef608a298e53251fa81f6c2df46d1355daed92f77"}
Sep 07 17:11:54.309384 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:54.309278    2558 scope.go:117] "RemoveContainer" containerID="97d42d57ec67a5593609f0262036d72c65bf4c025938fcdadedada75acac966e"
Sep 07 17:11:54.309664 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:11:54.309639    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97d42d57ec67a5593609f0262036d72c65bf4c025938fcdadedada75acac966e\": container with ID starting with 97d42d57ec67a5593609f0262036d72c65bf4c025938fcdadedada75acac966e not found: ID does not exist" containerID="97d42d57ec67a5593609f0262036d72c65bf4c025938fcdadedada75acac966e"
Sep 07 17:11:54.309728 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:54.309674    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97d42d57ec67a5593609f0262036d72c65bf4c025938fcdadedada75acac966e"} err="failed to get container status \"97d42d57ec67a5593609f0262036d72c65bf4c025938fcdadedada75acac966e\": rpc error: code = NotFound desc = could not find container \"97d42d57ec67a5593609f0262036d72c65bf4c025938fcdadedada75acac966e\": container with ID starting with 97d42d57ec67a5593609f0262036d72c65bf4c025938fcdadedada75acac966e not found: ID does not exist"
Sep 07 17:11:54.309728 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:54.309689    2558 scope.go:117] "RemoveContainer" containerID="b6f89efcc312993ef43e66902c3d7dcb20c7260d00f9857327118b6e9aad0305"
Sep 07 17:11:54.318037 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:54.318021    2558 scope.go:117] "RemoveContainer" containerID="b6f89efcc312993ef43e66902c3d7dcb20c7260d00f9857327118b6e9aad0305"
Sep 07 17:11:54.318298 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:11:54.318276    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6f89efcc312993ef43e66902c3d7dcb20c7260d00f9857327118b6e9aad0305\": container with ID starting with b6f89efcc312993ef43e66902c3d7dcb20c7260d00f9857327118b6e9aad0305 not found: ID does not exist" containerID="b6f89efcc312993ef43e66902c3d7dcb20c7260d00f9857327118b6e9aad0305"
Sep 07 17:11:54.318368 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:54.318305    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6f89efcc312993ef43e66902c3d7dcb20c7260d00f9857327118b6e9aad0305"} err="failed to get container status \"b6f89efcc312993ef43e66902c3d7dcb20c7260d00f9857327118b6e9aad0305\": rpc error: code = NotFound desc = could not find container \"b6f89efcc312993ef43e66902c3d7dcb20c7260d00f9857327118b6e9aad0305\": container with ID starting with b6f89efcc312993ef43e66902c3d7dcb20c7260d00f9857327118b6e9aad0305 not found: ID does not exist"
Sep 07 17:11:54.327779 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:54.327751    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d53e4343-67b6f49f58-n884s"]
Sep 07 17:11:54.332748 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:54.332728    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d53e4343-67b6f49f58-n884s"]
Sep 07 17:11:54.350880 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:54.350837    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d53e4343-7fc9c55b4f-h7t9n"]
Sep 07 17:11:54.353518 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:54.353494    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d53e4343-7fc9c55b4f-h7t9n"]
Sep 07 17:11:55.594568 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:55.594536    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a3f01e8-f61a-42e8-bf56-cd1842e747f8" path="/var/lib/kubelet/pods/1a3f01e8-f61a-42e8-bf56-cd1842e747f8/volumes"
Sep 07 17:11:55.594950 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:11:55.594892    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a85a7c35-1cea-42a9-a400-f57ece04f2b5" path="/var/lib/kubelet/pods/a85a7c35-1cea-42a9-a400-f57ece04f2b5/volumes"
Sep 07 17:12:03.258347 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:03.258315    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"]
Sep 07 17:12:03.258772 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:03.258533    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9" podUID="38ef96d7-1405-4ddc-97f3-f50fbdc0ad01" containerName="istio-proxy" containerID="cri-o://7729441453bb3de9097a89f9ae4cc36c5baf86e72d7ebace12a989c1ecd5660c" gracePeriod=30
Sep 07 17:12:08.392091 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:08.392050    2558 generic.go:356] "Generic (PLEG): container finished" podID="38ef96d7-1405-4ddc-97f3-f50fbdc0ad01" containerID="7729441453bb3de9097a89f9ae4cc36c5baf86e72d7ebace12a989c1ecd5660c" exitCode=0
Sep 07 17:12:08.392484 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:08.392151    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9" event={"ID":"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01","Type":"ContainerDied","Data":"7729441453bb3de9097a89f9ae4cc36c5baf86e72d7ebace12a989c1ecd5660c"}
Sep 07 17:12:08.392484 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:08.392265    2558 scope.go:117] "RemoveContainer" containerID="3c0e0d43e7f7b1af628af7547ba02e4eddb742da0af75d9d6b32ad1cf1b6ea11"
Sep 07 17:12:08.550016 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:08.549981    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"
Sep 07 17:12:08.712459 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:08.712428    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mtgt\" (UniqueName: \"kubernetes.io/projected/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-kube-api-access-2mtgt\") pod \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\" (UID: \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\") "
Sep 07 17:12:08.712659 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:08.712474    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-workload-certs\") pod \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\" (UID: \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\") "
Sep 07 17:12:08.712659 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:08.712495    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-istio-envoy\") pod \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\" (UID: \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\") "
Sep 07 17:12:08.712659 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:08.712519    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-istio-data\") pod \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\" (UID: \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\") "
Sep 07 17:12:08.712659 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:08.712547    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-workload-socket\") pod \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\" (UID: \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\") "
Sep 07 17:12:08.712659 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:08.712590    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-istiod-ca-cert\") pod \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\" (UID: \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\") "
Sep 07 17:12:08.712659 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:08.712612    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-istio-token\") pod \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\" (UID: \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\") "
Sep 07 17:12:08.712659 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:08.712638    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-credential-socket\") pod \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\" (UID: \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\") "
Sep 07 17:12:08.713037 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:08.712776    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "38ef96d7-1405-4ddc-97f3-f50fbdc0ad01" (UID: "38ef96d7-1405-4ddc-97f3-f50fbdc0ad01"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:12:08.713037 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:08.712840    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-istio-podinfo\") pod \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\" (UID: \"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01\") "
Sep 07 17:12:08.713037 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:08.712921    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "38ef96d7-1405-4ddc-97f3-f50fbdc0ad01" (UID: "38ef96d7-1405-4ddc-97f3-f50fbdc0ad01"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:12:08.713037 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:08.712962    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "38ef96d7-1405-4ddc-97f3-f50fbdc0ad01" (UID: "38ef96d7-1405-4ddc-97f3-f50fbdc0ad01"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:12:08.713037 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:08.712973    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-istio-data" (OuterVolumeSpecName: "istio-data") pod "38ef96d7-1405-4ddc-97f3-f50fbdc0ad01" (UID: "38ef96d7-1405-4ddc-97f3-f50fbdc0ad01"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:12:08.713328 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:08.713056    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "38ef96d7-1405-4ddc-97f3-f50fbdc0ad01" (UID: "38ef96d7-1405-4ddc-97f3-f50fbdc0ad01"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:12:08.713660 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:08.713636    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-workload-socket\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:12:08.713768 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:08.713663    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-istiod-ca-cert\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:12:08.713768 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:08.713679    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-credential-socket\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:12:08.713768 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:08.713693    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-workload-certs\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:12:08.713768 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:08.713704    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-istio-data\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:12:08.714821 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:08.714795    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-kube-api-access-2mtgt" (OuterVolumeSpecName: "kube-api-access-2mtgt") pod "38ef96d7-1405-4ddc-97f3-f50fbdc0ad01" (UID: "38ef96d7-1405-4ddc-97f3-f50fbdc0ad01"). InnerVolumeSpecName "kube-api-access-2mtgt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:12:08.714932 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:08.714903    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-istio-token" (OuterVolumeSpecName: "istio-token") pod "38ef96d7-1405-4ddc-97f3-f50fbdc0ad01" (UID: "38ef96d7-1405-4ddc-97f3-f50fbdc0ad01"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:12:08.715036 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:08.715020    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "38ef96d7-1405-4ddc-97f3-f50fbdc0ad01" (UID: "38ef96d7-1405-4ddc-97f3-f50fbdc0ad01"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 17:12:08.715097 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:08.715082    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "38ef96d7-1405-4ddc-97f3-f50fbdc0ad01" (UID: "38ef96d7-1405-4ddc-97f3-f50fbdc0ad01"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:12:08.815486 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:08.815393    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-istio-podinfo\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:12:08.815486 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:08.815436    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mtgt\" (UniqueName: \"kubernetes.io/projected/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-kube-api-access-2mtgt\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:12:08.815486 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:08.815455    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-istio-envoy\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:12:08.815486 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:08.815469    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01-istio-token\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:12:09.206125 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.206092    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4-p2spc"]
Sep 07 17:12:09.206623 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.206604    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38ef96d7-1405-4ddc-97f3-f50fbdc0ad01" containerName="istio-proxy"
Sep 07 17:12:09.206623 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.206625    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="38ef96d7-1405-4ddc-97f3-f50fbdc0ad01" containerName="istio-proxy"
Sep 07 17:12:09.206788 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.206657    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a85a7c35-1cea-42a9-a400-f57ece04f2b5" containerName="payload-pre-processing"
Sep 07 17:12:09.206788 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.206665    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a85a7c35-1cea-42a9-a400-f57ece04f2b5" containerName="payload-pre-processing"
Sep 07 17:12:09.206788 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.206683    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a3f01e8-f61a-42e8-bf56-cd1842e747f8" containerName="payload-processing"
Sep 07 17:12:09.206788 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.206693    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a3f01e8-f61a-42e8-bf56-cd1842e747f8" containerName="payload-processing"
Sep 07 17:12:09.206788 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.206705    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38ef96d7-1405-4ddc-97f3-f50fbdc0ad01" containerName="istio-proxy"
Sep 07 17:12:09.206788 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.206713    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="38ef96d7-1405-4ddc-97f3-f50fbdc0ad01" containerName="istio-proxy"
Sep 07 17:12:09.207078 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.206807    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a3f01e8-f61a-42e8-bf56-cd1842e747f8" containerName="payload-processing"
Sep 07 17:12:09.207078 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.206821    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a85a7c35-1cea-42a9-a400-f57ece04f2b5" containerName="payload-pre-processing"
Sep 07 17:12:09.207078 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.206832    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="38ef96d7-1405-4ddc-97f3-f50fbdc0ad01" containerName="istio-proxy"
Sep 07 17:12:09.207078 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.206843    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="38ef96d7-1405-4ddc-97f3-f50fbdc0ad01" containerName="istio-proxy"
Sep 07 17:12:09.210526 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.210506    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4-p2spc"
Sep 07 17:12:09.213271 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.213215    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-3c1adc\""
Sep 07 17:12:09.213588 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.213567    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-3c1adc-dockercfg-468h4\""
Sep 07 17:12:09.225335 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.225308    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4-p2spc"]
Sep 07 17:12:09.320505 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.320465    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d373bf5d-764c-40b0-9270-941359ec5883-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4-p2spc\" (UID: \"d373bf5d-764c-40b0-9270-941359ec5883\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4-p2spc"
Sep 07 17:12:09.320676 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.320535    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpbtt\" (UniqueName: \"kubernetes.io/projected/d373bf5d-764c-40b0-9270-941359ec5883-kube-api-access-tpbtt\") pod \"payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4-p2spc\" (UID: \"d373bf5d-764c-40b0-9270-941359ec5883\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4-p2spc"
Sep 07 17:12:09.329337 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.329297    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-3c1adc-d86f58d49-5scwr"]
Sep 07 17:12:09.332905 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.332884    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-3c1adc-d86f58d49-5scwr"
Sep 07 17:12:09.344627 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.344600    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-3c1adc-d86f58d49-5scwr"]
Sep 07 17:12:09.402797 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.402757    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"
Sep 07 17:12:09.403591 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.402821    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9" event={"ID":"38ef96d7-1405-4ddc-97f3-f50fbdc0ad01","Type":"ContainerDied","Data":"dcc842e589da978379578db2a94591f88cfb3c376092731a667f7d2d20636215"}
Sep 07 17:12:09.403591 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.402881    2558 scope.go:117] "RemoveContainer" containerID="7729441453bb3de9097a89f9ae4cc36c5baf86e72d7ebace12a989c1ecd5660c"
Sep 07 17:12:09.421635 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.421609    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbzdb\" (UniqueName: \"kubernetes.io/projected/7a522831-e2f9-4823-83d8-f8bcb05118f9-kube-api-access-fbzdb\") pod \"payload-processing-e2e-explicit-3c1adc-d86f58d49-5scwr\" (UID: \"7a522831-e2f9-4823-83d8-f8bcb05118f9\") " pod="openshift-ingress/payload-processing-e2e-explicit-3c1adc-d86f58d49-5scwr"
Sep 07 17:12:09.421748 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.421664    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d373bf5d-764c-40b0-9270-941359ec5883-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4-p2spc\" (UID: \"d373bf5d-764c-40b0-9270-941359ec5883\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4-p2spc"
Sep 07 17:12:09.421748 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.421737    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a522831-e2f9-4823-83d8-f8bcb05118f9-plugins-config-volume\") pod \"payload-processing-e2e-explicit-3c1adc-d86f58d49-5scwr\" (UID: \"7a522831-e2f9-4823-83d8-f8bcb05118f9\") " pod="openshift-ingress/payload-processing-e2e-explicit-3c1adc-d86f58d49-5scwr"
Sep 07 17:12:09.421833 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.421778    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpbtt\" (UniqueName: \"kubernetes.io/projected/d373bf5d-764c-40b0-9270-941359ec5883-kube-api-access-tpbtt\") pod \"payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4-p2spc\" (UID: \"d373bf5d-764c-40b0-9270-941359ec5883\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4-p2spc"
Sep 07 17:12:09.422216 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.422200    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d373bf5d-764c-40b0-9270-941359ec5883-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4-p2spc\" (UID: \"d373bf5d-764c-40b0-9270-941359ec5883\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4-p2spc"
Sep 07 17:12:09.430670 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.430647    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpbtt\" (UniqueName: \"kubernetes.io/projected/d373bf5d-764c-40b0-9270-941359ec5883-kube-api-access-tpbtt\") pod \"payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4-p2spc\" (UID: \"d373bf5d-764c-40b0-9270-941359ec5883\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4-p2spc"
Sep 07 17:12:09.435444 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.435423    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"]
Sep 07 17:12:09.439422 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.439391    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9"]
Sep 07 17:12:09.521255 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.521155    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4-p2spc"
Sep 07 17:12:09.522635 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.522602    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbzdb\" (UniqueName: \"kubernetes.io/projected/7a522831-e2f9-4823-83d8-f8bcb05118f9-kube-api-access-fbzdb\") pod \"payload-processing-e2e-explicit-3c1adc-d86f58d49-5scwr\" (UID: \"7a522831-e2f9-4823-83d8-f8bcb05118f9\") " pod="openshift-ingress/payload-processing-e2e-explicit-3c1adc-d86f58d49-5scwr"
Sep 07 17:12:09.522803 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.522722    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a522831-e2f9-4823-83d8-f8bcb05118f9-plugins-config-volume\") pod \"payload-processing-e2e-explicit-3c1adc-d86f58d49-5scwr\" (UID: \"7a522831-e2f9-4823-83d8-f8bcb05118f9\") " pod="openshift-ingress/payload-processing-e2e-explicit-3c1adc-d86f58d49-5scwr"
Sep 07 17:12:09.523494 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.523472    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a522831-e2f9-4823-83d8-f8bcb05118f9-plugins-config-volume\") pod \"payload-processing-e2e-explicit-3c1adc-d86f58d49-5scwr\" (UID: \"7a522831-e2f9-4823-83d8-f8bcb05118f9\") " pod="openshift-ingress/payload-processing-e2e-explicit-3c1adc-d86f58d49-5scwr"
Sep 07 17:12:09.534517 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.534495    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbzdb\" (UniqueName: \"kubernetes.io/projected/7a522831-e2f9-4823-83d8-f8bcb05118f9-kube-api-access-fbzdb\") pod \"payload-processing-e2e-explicit-3c1adc-d86f58d49-5scwr\" (UID: \"7a522831-e2f9-4823-83d8-f8bcb05118f9\") " pod="openshift-ingress/payload-processing-e2e-explicit-3c1adc-d86f58d49-5scwr"
Sep 07 17:12:09.599122 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.599091    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38ef96d7-1405-4ddc-97f3-f50fbdc0ad01" path="/var/lib/kubelet/pods/38ef96d7-1405-4ddc-97f3-f50fbdc0ad01/volumes"
Sep 07 17:12:09.644461 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.644430    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-3c1adc-d86f58d49-5scwr"
Sep 07 17:12:09.807390 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.807362    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4-p2spc"]
Sep 07 17:12:09.808536 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:12:09.808508    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd373bf5d_764c_40b0_9270_941359ec5883.slice/crio-8a5923243e989bacaf23bdc44a65bebf5d9a493dcd4a47b11d8cd2f95026e338 WatchSource:0}: Error finding container 8a5923243e989bacaf23bdc44a65bebf5d9a493dcd4a47b11d8cd2f95026e338: Status 404 returned error can't find the container with id 8a5923243e989bacaf23bdc44a65bebf5d9a493dcd4a47b11d8cd2f95026e338
Sep 07 17:12:09.927372 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:09.927344    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-3c1adc-d86f58d49-5scwr"]
Sep 07 17:12:09.928744 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:12:09.928716    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a522831_e2f9_4823_83d8_f8bcb05118f9.slice/crio-bf7daf339433da84f23c11935091352d9a2454126a6c023d7743661890b8f855 WatchSource:0}: Error finding container bf7daf339433da84f23c11935091352d9a2454126a6c023d7743661890b8f855: Status 404 returned error can't find the container with id bf7daf339433da84f23c11935091352d9a2454126a6c023d7743661890b8f855
Sep 07 17:12:10.409805 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:10.409739    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4-p2spc" event={"ID":"d373bf5d-764c-40b0-9270-941359ec5883","Type":"ContainerStarted","Data":"b336e137fd6646a6f24958646d2340718af265ea47d2e39b2c8f4a0fc31e1a56"}
Sep 07 17:12:10.409805 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:10.409805    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4-p2spc" event={"ID":"d373bf5d-764c-40b0-9270-941359ec5883","Type":"ContainerStarted","Data":"8a5923243e989bacaf23bdc44a65bebf5d9a493dcd4a47b11d8cd2f95026e338"}
Sep 07 17:12:10.410384 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:10.409966    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4-p2spc"
Sep 07 17:12:10.411653 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:10.411629    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-3c1adc-d86f58d49-5scwr" event={"ID":"7a522831-e2f9-4823-83d8-f8bcb05118f9","Type":"ContainerStarted","Data":"ea5c2c456f728e8e3db5d631575869704c46c5da8bcd19d9519ec06d5fa588ee"}
Sep 07 17:12:10.411759 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:10.411670    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-3c1adc-d86f58d49-5scwr" event={"ID":"7a522831-e2f9-4823-83d8-f8bcb05118f9","Type":"ContainerStarted","Data":"bf7daf339433da84f23c11935091352d9a2454126a6c023d7743661890b8f855"}
Sep 07 17:12:10.411759 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:10.411740    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-3c1adc-d86f58d49-5scwr"
Sep 07 17:12:10.428846 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:10.428798    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4-p2spc" podStartSLOduration=1.428783761 podStartE2EDuration="1.428783761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:12:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:12:10.428094242 +0000 UTC m=+947.459525034" watchObservedRunningTime="2026-09-07 17:12:10.428783761 +0000 UTC m=+947.460214552"
Sep 07 17:12:10.451127 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:10.451060    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-3c1adc-d86f58d49-5scwr" podStartSLOduration=1.451041467 podStartE2EDuration="1.451041467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:12:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:12:10.448683388 +0000 UTC m=+947.480114182" watchObservedRunningTime="2026-09-07 17:12:10.451041467 +0000 UTC m=+947.482472258"
Sep 07 17:12:21.419705 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:21.419663    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4-p2spc"
Sep 07 17:12:21.420116 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:21.419778    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-3c1adc-d86f58d49-5scwr"
Sep 07 17:12:55.988621 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:55.988527    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-3c1adc-d86f58d49-5scwr"]
Sep 07 17:12:55.989201 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:55.988802    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-3c1adc-d86f58d49-5scwr" podUID="7a522831-e2f9-4823-83d8-f8bcb05118f9" containerName="payload-processing" containerID="cri-o://ea5c2c456f728e8e3db5d631575869704c46c5da8bcd19d9519ec06d5fa588ee" gracePeriod=30
Sep 07 17:12:55.997545 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:55.997501    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4-p2spc"]
Sep 07 17:12:55.997901 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:55.997794    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4-p2spc" podUID="d373bf5d-764c-40b0-9270-941359ec5883" containerName="payload-pre-processing" containerID="cri-o://b336e137fd6646a6f24958646d2340718af265ea47d2e39b2c8f4a0fc31e1a56" gracePeriod=30
Sep 07 17:12:56.285915 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:56.285885    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-3c1adc-d86f58d49-5scwr"
Sep 07 17:12:56.288793 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:56.288774    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4-p2spc"
Sep 07 17:12:56.462202 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:56.462167    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tpbtt\" (UniqueName: \"kubernetes.io/projected/d373bf5d-764c-40b0-9270-941359ec5883-kube-api-access-tpbtt\") pod \"d373bf5d-764c-40b0-9270-941359ec5883\" (UID: \"d373bf5d-764c-40b0-9270-941359ec5883\") "
Sep 07 17:12:56.462202 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:56.462199    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbzdb\" (UniqueName: \"kubernetes.io/projected/7a522831-e2f9-4823-83d8-f8bcb05118f9-kube-api-access-fbzdb\") pod \"7a522831-e2f9-4823-83d8-f8bcb05118f9\" (UID: \"7a522831-e2f9-4823-83d8-f8bcb05118f9\") "
Sep 07 17:12:56.462495 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:56.462260    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d373bf5d-764c-40b0-9270-941359ec5883-plugins-config-volume\") pod \"d373bf5d-764c-40b0-9270-941359ec5883\" (UID: \"d373bf5d-764c-40b0-9270-941359ec5883\") "
Sep 07 17:12:56.462495 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:56.462298    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a522831-e2f9-4823-83d8-f8bcb05118f9-plugins-config-volume\") pod \"7a522831-e2f9-4823-83d8-f8bcb05118f9\" (UID: \"7a522831-e2f9-4823-83d8-f8bcb05118f9\") "
Sep 07 17:12:56.462732 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:56.462703    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d373bf5d-764c-40b0-9270-941359ec5883-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d373bf5d-764c-40b0-9270-941359ec5883" (UID: "d373bf5d-764c-40b0-9270-941359ec5883"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:12:56.462783 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:56.462733    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a522831-e2f9-4823-83d8-f8bcb05118f9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7a522831-e2f9-4823-83d8-f8bcb05118f9" (UID: "7a522831-e2f9-4823-83d8-f8bcb05118f9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:12:56.464344 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:56.464322    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a522831-e2f9-4823-83d8-f8bcb05118f9-kube-api-access-fbzdb" (OuterVolumeSpecName: "kube-api-access-fbzdb") pod "7a522831-e2f9-4823-83d8-f8bcb05118f9" (UID: "7a522831-e2f9-4823-83d8-f8bcb05118f9"). InnerVolumeSpecName "kube-api-access-fbzdb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:12:56.464449 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:56.464429    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d373bf5d-764c-40b0-9270-941359ec5883-kube-api-access-tpbtt" (OuterVolumeSpecName: "kube-api-access-tpbtt") pod "d373bf5d-764c-40b0-9270-941359ec5883" (UID: "d373bf5d-764c-40b0-9270-941359ec5883"). InnerVolumeSpecName "kube-api-access-tpbtt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:12:56.563367 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:56.563281    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tpbtt\" (UniqueName: \"kubernetes.io/projected/d373bf5d-764c-40b0-9270-941359ec5883-kube-api-access-tpbtt\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:12:56.563367 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:56.563314    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbzdb\" (UniqueName: \"kubernetes.io/projected/7a522831-e2f9-4823-83d8-f8bcb05118f9-kube-api-access-fbzdb\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:12:56.563367 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:56.563324    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d373bf5d-764c-40b0-9270-941359ec5883-plugins-config-volume\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:12:56.563367 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:56.563332    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a522831-e2f9-4823-83d8-f8bcb05118f9-plugins-config-volume\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:12:56.665824 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:56.665786    2558 generic.go:356] "Generic (PLEG): container finished" podID="d373bf5d-764c-40b0-9270-941359ec5883" containerID="b336e137fd6646a6f24958646d2340718af265ea47d2e39b2c8f4a0fc31e1a56" exitCode=0
Sep 07 17:12:56.665996 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:56.665830    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4-p2spc"
Sep 07 17:12:56.665996 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:56.665873    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4-p2spc" event={"ID":"d373bf5d-764c-40b0-9270-941359ec5883","Type":"ContainerDied","Data":"b336e137fd6646a6f24958646d2340718af265ea47d2e39b2c8f4a0fc31e1a56"}
Sep 07 17:12:56.665996 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:56.665939    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4-p2spc" event={"ID":"d373bf5d-764c-40b0-9270-941359ec5883","Type":"ContainerDied","Data":"8a5923243e989bacaf23bdc44a65bebf5d9a493dcd4a47b11d8cd2f95026e338"}
Sep 07 17:12:56.665996 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:56.665971    2558 scope.go:117] "RemoveContainer" containerID="b336e137fd6646a6f24958646d2340718af265ea47d2e39b2c8f4a0fc31e1a56"
Sep 07 17:12:56.667272 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:56.667223    2558 generic.go:356] "Generic (PLEG): container finished" podID="7a522831-e2f9-4823-83d8-f8bcb05118f9" containerID="ea5c2c456f728e8e3db5d631575869704c46c5da8bcd19d9519ec06d5fa588ee" exitCode=0
Sep 07 17:12:56.667400 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:56.667307    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-3c1adc-d86f58d49-5scwr"
Sep 07 17:12:56.667400 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:56.667342    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-3c1adc-d86f58d49-5scwr" event={"ID":"7a522831-e2f9-4823-83d8-f8bcb05118f9","Type":"ContainerDied","Data":"ea5c2c456f728e8e3db5d631575869704c46c5da8bcd19d9519ec06d5fa588ee"}
Sep 07 17:12:56.667400 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:56.667376    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-3c1adc-d86f58d49-5scwr" event={"ID":"7a522831-e2f9-4823-83d8-f8bcb05118f9","Type":"ContainerDied","Data":"bf7daf339433da84f23c11935091352d9a2454126a6c023d7743661890b8f855"}
Sep 07 17:12:56.676465 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:56.676449    2558 scope.go:117] "RemoveContainer" containerID="b336e137fd6646a6f24958646d2340718af265ea47d2e39b2c8f4a0fc31e1a56"
Sep 07 17:12:56.676769 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:12:56.676749    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b336e137fd6646a6f24958646d2340718af265ea47d2e39b2c8f4a0fc31e1a56\": container with ID starting with b336e137fd6646a6f24958646d2340718af265ea47d2e39b2c8f4a0fc31e1a56 not found: ID does not exist" containerID="b336e137fd6646a6f24958646d2340718af265ea47d2e39b2c8f4a0fc31e1a56"
Sep 07 17:12:56.676831 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:56.676778    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b336e137fd6646a6f24958646d2340718af265ea47d2e39b2c8f4a0fc31e1a56"} err="failed to get container status \"b336e137fd6646a6f24958646d2340718af265ea47d2e39b2c8f4a0fc31e1a56\": rpc error: code = NotFound desc = could not find container \"b336e137fd6646a6f24958646d2340718af265ea47d2e39b2c8f4a0fc31e1a56\": container with ID starting with b336e137fd6646a6f24958646d2340718af265ea47d2e39b2c8f4a0fc31e1a56 not found: ID does not exist"
Sep 07 17:12:56.676831 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:56.676793    2558 scope.go:117] "RemoveContainer" containerID="ea5c2c456f728e8e3db5d631575869704c46c5da8bcd19d9519ec06d5fa588ee"
Sep 07 17:12:56.685287 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:56.685268    2558 scope.go:117] "RemoveContainer" containerID="ea5c2c456f728e8e3db5d631575869704c46c5da8bcd19d9519ec06d5fa588ee"
Sep 07 17:12:56.685564 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:12:56.685546    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea5c2c456f728e8e3db5d631575869704c46c5da8bcd19d9519ec06d5fa588ee\": container with ID starting with ea5c2c456f728e8e3db5d631575869704c46c5da8bcd19d9519ec06d5fa588ee not found: ID does not exist" containerID="ea5c2c456f728e8e3db5d631575869704c46c5da8bcd19d9519ec06d5fa588ee"
Sep 07 17:12:56.685615 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:56.685570    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea5c2c456f728e8e3db5d631575869704c46c5da8bcd19d9519ec06d5fa588ee"} err="failed to get container status \"ea5c2c456f728e8e3db5d631575869704c46c5da8bcd19d9519ec06d5fa588ee\": rpc error: code = NotFound desc = could not find container \"ea5c2c456f728e8e3db5d631575869704c46c5da8bcd19d9519ec06d5fa588ee\": container with ID starting with ea5c2c456f728e8e3db5d631575869704c46c5da8bcd19d9519ec06d5fa588ee not found: ID does not exist"
Sep 07 17:12:56.692583 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:56.692560    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4-p2spc"]
Sep 07 17:12:56.696101 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:56.696080    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4-p2spc"]
Sep 07 17:12:56.708874 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:56.708851    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-3c1adc-d86f58d49-5scwr"]
Sep 07 17:12:56.712539 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:56.712518    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-3c1adc-d86f58d49-5scwr"]
Sep 07 17:12:57.594828 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:57.594796    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a522831-e2f9-4823-83d8-f8bcb05118f9" path="/var/lib/kubelet/pods/7a522831-e2f9-4823-83d8-f8bcb05118f9/volumes"
Sep 07 17:12:57.595257 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:12:57.595201    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d373bf5d-764c-40b0-9270-941359ec5883" path="/var/lib/kubelet/pods/d373bf5d-764c-40b0-9270-941359ec5883/volumes"
Sep 07 17:13:50.377767 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.377726    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9"]
Sep 07 17:13:50.378361 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.377984    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9" podUID="515f4eb1-1821-4559-82cb-6cde04b70be7" containerName="maas-api" containerID="cri-o://666f9bb5b30d6d38e4ae999328aa4806ed3e087ac7184204f5d769fece3fab1c" gracePeriod=30
Sep 07 17:13:50.434085 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.434049    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-3f5460-68bd4c8b7f-lrzqc"]
Sep 07 17:13:50.434345 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.434297    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-3f5460-68bd4c8b7f-lrzqc" podUID="dbebceb2-18f8-4987-b23c-976f5f4ff58e" containerName="payload-processing" containerID="cri-o://7f0d931032c127eb2dae2e82364d0412242c19711dcfc9949d8ec5334bd3c5b2" gracePeriod=30
Sep 07 17:13:50.450114 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.446642    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4-qkswh"]
Sep 07 17:13:50.450114 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.446940    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4-qkswh" podUID="653e4aeb-5d5b-4728-82a7-0faae05a50b8" containerName="payload-pre-processing" containerID="cri-o://3b8504144a45eed69c16af23d301e209ba4eb7c40f7ac2a51517d0afd3847c91" gracePeriod=30
Sep 07 17:13:50.749559 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.749476    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-3f5460-68bd4c8b7f-lrzqc"
Sep 07 17:13:50.752511 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.752487    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4-qkswh"
Sep 07 17:13:50.836991 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.836968    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9"
Sep 07 17:13:50.867654 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.867612    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v62ld\" (UniqueName: \"kubernetes.io/projected/653e4aeb-5d5b-4728-82a7-0faae05a50b8-kube-api-access-v62ld\") pod \"653e4aeb-5d5b-4728-82a7-0faae05a50b8\" (UID: \"653e4aeb-5d5b-4728-82a7-0faae05a50b8\") "
Sep 07 17:13:50.867876 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.867665    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbh86\" (UniqueName: \"kubernetes.io/projected/515f4eb1-1821-4559-82cb-6cde04b70be7-kube-api-access-dbh86\") pod \"515f4eb1-1821-4559-82cb-6cde04b70be7\" (UID: \"515f4eb1-1821-4559-82cb-6cde04b70be7\") "
Sep 07 17:13:50.867876 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.867707    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7l8z\" (UniqueName: \"kubernetes.io/projected/dbebceb2-18f8-4987-b23c-976f5f4ff58e-kube-api-access-d7l8z\") pod \"dbebceb2-18f8-4987-b23c-976f5f4ff58e\" (UID: \"dbebceb2-18f8-4987-b23c-976f5f4ff58e\") "
Sep 07 17:13:50.867876 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.867793    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/515f4eb1-1821-4559-82cb-6cde04b70be7-openshift-service-ca\") pod \"515f4eb1-1821-4559-82cb-6cde04b70be7\" (UID: \"515f4eb1-1821-4559-82cb-6cde04b70be7\") "
Sep 07 17:13:50.867876 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.867825    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dbebceb2-18f8-4987-b23c-976f5f4ff58e-plugins-config-volume\") pod \"dbebceb2-18f8-4987-b23c-976f5f4ff58e\" (UID: \"dbebceb2-18f8-4987-b23c-976f5f4ff58e\") "
Sep 07 17:13:50.867876 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.867859    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/515f4eb1-1821-4559-82cb-6cde04b70be7-metrics-certs\") pod \"515f4eb1-1821-4559-82cb-6cde04b70be7\" (UID: \"515f4eb1-1821-4559-82cb-6cde04b70be7\") "
Sep 07 17:13:50.868196 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.867887    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/515f4eb1-1821-4559-82cb-6cde04b70be7-maas-api-tls\") pod \"515f4eb1-1821-4559-82cb-6cde04b70be7\" (UID: \"515f4eb1-1821-4559-82cb-6cde04b70be7\") "
Sep 07 17:13:50.868196 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.867930    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/653e4aeb-5d5b-4728-82a7-0faae05a50b8-plugins-config-volume\") pod \"653e4aeb-5d5b-4728-82a7-0faae05a50b8\" (UID: \"653e4aeb-5d5b-4728-82a7-0faae05a50b8\") "
Sep 07 17:13:50.868674 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.868649    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbebceb2-18f8-4987-b23c-976f5f4ff58e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dbebceb2-18f8-4987-b23c-976f5f4ff58e" (UID: "dbebceb2-18f8-4987-b23c-976f5f4ff58e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:13:50.869181 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.869141    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/653e4aeb-5d5b-4728-82a7-0faae05a50b8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "653e4aeb-5d5b-4728-82a7-0faae05a50b8" (UID: "653e4aeb-5d5b-4728-82a7-0faae05a50b8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:13:50.869323 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.869287    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/515f4eb1-1821-4559-82cb-6cde04b70be7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "515f4eb1-1821-4559-82cb-6cde04b70be7" (UID: "515f4eb1-1821-4559-82cb-6cde04b70be7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:13:50.872209 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.872077    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/515f4eb1-1821-4559-82cb-6cde04b70be7-kube-api-access-dbh86" (OuterVolumeSpecName: "kube-api-access-dbh86") pod "515f4eb1-1821-4559-82cb-6cde04b70be7" (UID: "515f4eb1-1821-4559-82cb-6cde04b70be7"). InnerVolumeSpecName "kube-api-access-dbh86". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:13:50.872209 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.872176    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbebceb2-18f8-4987-b23c-976f5f4ff58e-kube-api-access-d7l8z" (OuterVolumeSpecName: "kube-api-access-d7l8z") pod "dbebceb2-18f8-4987-b23c-976f5f4ff58e" (UID: "dbebceb2-18f8-4987-b23c-976f5f4ff58e"). InnerVolumeSpecName "kube-api-access-d7l8z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:13:50.872410 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.872263    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/515f4eb1-1821-4559-82cb-6cde04b70be7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "515f4eb1-1821-4559-82cb-6cde04b70be7" (UID: "515f4eb1-1821-4559-82cb-6cde04b70be7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:13:50.872410 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.872346    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/653e4aeb-5d5b-4728-82a7-0faae05a50b8-kube-api-access-v62ld" (OuterVolumeSpecName: "kube-api-access-v62ld") pod "653e4aeb-5d5b-4728-82a7-0faae05a50b8" (UID: "653e4aeb-5d5b-4728-82a7-0faae05a50b8"). InnerVolumeSpecName "kube-api-access-v62ld". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:13:50.873573 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.873551    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/515f4eb1-1821-4559-82cb-6cde04b70be7-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "515f4eb1-1821-4559-82cb-6cde04b70be7" (UID: "515f4eb1-1821-4559-82cb-6cde04b70be7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:13:50.956058 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.955974    2558 generic.go:356] "Generic (PLEG): container finished" podID="dbebceb2-18f8-4987-b23c-976f5f4ff58e" containerID="7f0d931032c127eb2dae2e82364d0412242c19711dcfc9949d8ec5334bd3c5b2" exitCode=0
Sep 07 17:13:50.956058 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.956017    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-3f5460-68bd4c8b7f-lrzqc"
Sep 07 17:13:50.956278 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.956064    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-3f5460-68bd4c8b7f-lrzqc" event={"ID":"dbebceb2-18f8-4987-b23c-976f5f4ff58e","Type":"ContainerDied","Data":"7f0d931032c127eb2dae2e82364d0412242c19711dcfc9949d8ec5334bd3c5b2"}
Sep 07 17:13:50.956278 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.956140    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-3f5460-68bd4c8b7f-lrzqc" event={"ID":"dbebceb2-18f8-4987-b23c-976f5f4ff58e","Type":"ContainerDied","Data":"2ee3af1df365ddd603ab653516f65255aa966143b3c438ee1bdb6ab573a6906d"}
Sep 07 17:13:50.956278 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.956200    2558 scope.go:117] "RemoveContainer" containerID="7f0d931032c127eb2dae2e82364d0412242c19711dcfc9949d8ec5334bd3c5b2"
Sep 07 17:13:50.957517 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.957457    2558 generic.go:356] "Generic (PLEG): container finished" podID="515f4eb1-1821-4559-82cb-6cde04b70be7" containerID="666f9bb5b30d6d38e4ae999328aa4806ed3e087ac7184204f5d769fece3fab1c" exitCode=0
Sep 07 17:13:50.957604 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.957518    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9"
Sep 07 17:13:50.957604 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.957516    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9" event={"ID":"515f4eb1-1821-4559-82cb-6cde04b70be7","Type":"ContainerDied","Data":"666f9bb5b30d6d38e4ae999328aa4806ed3e087ac7184204f5d769fece3fab1c"}
Sep 07 17:13:50.957699 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.957628    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9" event={"ID":"515f4eb1-1821-4559-82cb-6cde04b70be7","Type":"ContainerDied","Data":"5f9a9a3abe7fcccb678d3b1ccf8b1f9d66864df4e53ef60e1c768c7074d94f85"}
Sep 07 17:13:50.958965 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.958944    2558 generic.go:356] "Generic (PLEG): container finished" podID="653e4aeb-5d5b-4728-82a7-0faae05a50b8" containerID="3b8504144a45eed69c16af23d301e209ba4eb7c40f7ac2a51517d0afd3847c91" exitCode=0
Sep 07 17:13:50.959100 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.958993    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4-qkswh"
Sep 07 17:13:50.959100 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.959020    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4-qkswh" event={"ID":"653e4aeb-5d5b-4728-82a7-0faae05a50b8","Type":"ContainerDied","Data":"3b8504144a45eed69c16af23d301e209ba4eb7c40f7ac2a51517d0afd3847c91"}
Sep 07 17:13:50.959100 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.959067    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4-qkswh" event={"ID":"653e4aeb-5d5b-4728-82a7-0faae05a50b8","Type":"ContainerDied","Data":"36fa237df92e95ff777afc6f6e536ced2b6f1c83e549e585343c8cd47ee4853d"}
Sep 07 17:13:50.971172 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.969890    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v62ld\" (UniqueName: \"kubernetes.io/projected/653e4aeb-5d5b-4728-82a7-0faae05a50b8-kube-api-access-v62ld\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:13:50.971172 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.969920    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbh86\" (UniqueName: \"kubernetes.io/projected/515f4eb1-1821-4559-82cb-6cde04b70be7-kube-api-access-dbh86\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:13:50.971172 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.969936    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7l8z\" (UniqueName: \"kubernetes.io/projected/dbebceb2-18f8-4987-b23c-976f5f4ff58e-kube-api-access-d7l8z\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:13:50.971172 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.969959    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/515f4eb1-1821-4559-82cb-6cde04b70be7-openshift-service-ca\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:13:50.971172 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.969975    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dbebceb2-18f8-4987-b23c-976f5f4ff58e-plugins-config-volume\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:13:50.971172 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.969990    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/515f4eb1-1821-4559-82cb-6cde04b70be7-metrics-certs\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:13:50.971172 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.970005    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/515f4eb1-1821-4559-82cb-6cde04b70be7-maas-api-tls\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:13:50.971172 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.970023    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/653e4aeb-5d5b-4728-82a7-0faae05a50b8-plugins-config-volume\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:13:50.973705 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.973678    2558 scope.go:117] "RemoveContainer" containerID="7f0d931032c127eb2dae2e82364d0412242c19711dcfc9949d8ec5334bd3c5b2"
Sep 07 17:13:50.974104 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:13:50.974069    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f0d931032c127eb2dae2e82364d0412242c19711dcfc9949d8ec5334bd3c5b2\": container with ID starting with 7f0d931032c127eb2dae2e82364d0412242c19711dcfc9949d8ec5334bd3c5b2 not found: ID does not exist" containerID="7f0d931032c127eb2dae2e82364d0412242c19711dcfc9949d8ec5334bd3c5b2"
Sep 07 17:13:50.974264 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.974113    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f0d931032c127eb2dae2e82364d0412242c19711dcfc9949d8ec5334bd3c5b2"} err="failed to get container status \"7f0d931032c127eb2dae2e82364d0412242c19711dcfc9949d8ec5334bd3c5b2\": rpc error: code = NotFound desc = could not find container \"7f0d931032c127eb2dae2e82364d0412242c19711dcfc9949d8ec5334bd3c5b2\": container with ID starting with 7f0d931032c127eb2dae2e82364d0412242c19711dcfc9949d8ec5334bd3c5b2 not found: ID does not exist"
Sep 07 17:13:50.974264 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.974135    2558 scope.go:117] "RemoveContainer" containerID="666f9bb5b30d6d38e4ae999328aa4806ed3e087ac7184204f5d769fece3fab1c"
Sep 07 17:13:50.982644 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.982629    2558 scope.go:117] "RemoveContainer" containerID="666f9bb5b30d6d38e4ae999328aa4806ed3e087ac7184204f5d769fece3fab1c"
Sep 07 17:13:50.982890 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:13:50.982870    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"666f9bb5b30d6d38e4ae999328aa4806ed3e087ac7184204f5d769fece3fab1c\": container with ID starting with 666f9bb5b30d6d38e4ae999328aa4806ed3e087ac7184204f5d769fece3fab1c not found: ID does not exist" containerID="666f9bb5b30d6d38e4ae999328aa4806ed3e087ac7184204f5d769fece3fab1c"
Sep 07 17:13:50.982956 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.982897    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"666f9bb5b30d6d38e4ae999328aa4806ed3e087ac7184204f5d769fece3fab1c"} err="failed to get container status \"666f9bb5b30d6d38e4ae999328aa4806ed3e087ac7184204f5d769fece3fab1c\": rpc error: code = NotFound desc = could not find container \"666f9bb5b30d6d38e4ae999328aa4806ed3e087ac7184204f5d769fece3fab1c\": container with ID starting with 666f9bb5b30d6d38e4ae999328aa4806ed3e087ac7184204f5d769fece3fab1c not found: ID does not exist"
Sep 07 17:13:50.982956 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.982913    2558 scope.go:117] "RemoveContainer" containerID="3b8504144a45eed69c16af23d301e209ba4eb7c40f7ac2a51517d0afd3847c91"
Sep 07 17:13:50.990635 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.990594    2558 scope.go:117] "RemoveContainer" containerID="3b8504144a45eed69c16af23d301e209ba4eb7c40f7ac2a51517d0afd3847c91"
Sep 07 17:13:50.990906 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:13:50.990885    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b8504144a45eed69c16af23d301e209ba4eb7c40f7ac2a51517d0afd3847c91\": container with ID starting with 3b8504144a45eed69c16af23d301e209ba4eb7c40f7ac2a51517d0afd3847c91 not found: ID does not exist" containerID="3b8504144a45eed69c16af23d301e209ba4eb7c40f7ac2a51517d0afd3847c91"
Sep 07 17:13:50.990987 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.990917    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b8504144a45eed69c16af23d301e209ba4eb7c40f7ac2a51517d0afd3847c91"} err="failed to get container status \"3b8504144a45eed69c16af23d301e209ba4eb7c40f7ac2a51517d0afd3847c91\": rpc error: code = NotFound desc = could not find container \"3b8504144a45eed69c16af23d301e209ba4eb7c40f7ac2a51517d0afd3847c91\": container with ID starting with 3b8504144a45eed69c16af23d301e209ba4eb7c40f7ac2a51517d0afd3847c91 not found: ID does not exist"
Sep 07 17:13:50.992483 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.992464    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-3f5460-68bd4c8b7f-lrzqc"]
Sep 07 17:13:50.995116 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:50.995097    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-3f5460-68bd4c8b7f-lrzqc"]
Sep 07 17:13:51.006039 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:51.006017    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4-qkswh"]
Sep 07 17:13:51.008483 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:51.008460    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4-qkswh"]
Sep 07 17:13:51.022224 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:51.022203    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9"]
Sep 07 17:13:51.028275 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:51.028253    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3f5460-7545bdbcd6-p7tn9"]
Sep 07 17:13:51.594929 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:51.594897    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="515f4eb1-1821-4559-82cb-6cde04b70be7" path="/var/lib/kubelet/pods/515f4eb1-1821-4559-82cb-6cde04b70be7/volumes"
Sep 07 17:13:51.595342 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:51.595271    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="653e4aeb-5d5b-4728-82a7-0faae05a50b8" path="/var/lib/kubelet/pods/653e4aeb-5d5b-4728-82a7-0faae05a50b8/volumes"
Sep 07 17:13:51.595594 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:13:51.595581    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbebceb2-18f8-4987-b23c-976f5f4ff58e" path="/var/lib/kubelet/pods/dbebceb2-18f8-4987-b23c-976f5f4ff58e/volumes"
Sep 07 17:14:04.143211 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:04.143169    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99-ql2j9"]
Sep 07 17:14:04.143622 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:04.143587    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="515f4eb1-1821-4559-82cb-6cde04b70be7" containerName="maas-api"
Sep 07 17:14:04.143622 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:04.143601    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="515f4eb1-1821-4559-82cb-6cde04b70be7" containerName="maas-api"
Sep 07 17:14:04.143622 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:04.143608    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d373bf5d-764c-40b0-9270-941359ec5883" containerName="payload-pre-processing"
Sep 07 17:14:04.143622 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:04.143614    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d373bf5d-764c-40b0-9270-941359ec5883" containerName="payload-pre-processing"
Sep 07 17:14:04.143622 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:04.143622    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbebceb2-18f8-4987-b23c-976f5f4ff58e" containerName="payload-processing"
Sep 07 17:14:04.143786 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:04.143628    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbebceb2-18f8-4987-b23c-976f5f4ff58e" containerName="payload-processing"
Sep 07 17:14:04.143786 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:04.143644    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a522831-e2f9-4823-83d8-f8bcb05118f9" containerName="payload-processing"
Sep 07 17:14:04.143786 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:04.143649    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a522831-e2f9-4823-83d8-f8bcb05118f9" containerName="payload-processing"
Sep 07 17:14:04.143786 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:04.143658    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="653e4aeb-5d5b-4728-82a7-0faae05a50b8" containerName="payload-pre-processing"
Sep 07 17:14:04.143786 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:04.143664    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="653e4aeb-5d5b-4728-82a7-0faae05a50b8" containerName="payload-pre-processing"
Sep 07 17:14:04.143786 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:04.143723    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a522831-e2f9-4823-83d8-f8bcb05118f9" containerName="payload-processing"
Sep 07 17:14:04.143786 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:04.143729    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbebceb2-18f8-4987-b23c-976f5f4ff58e" containerName="payload-processing"
Sep 07 17:14:04.143786 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:04.143737    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="515f4eb1-1821-4559-82cb-6cde04b70be7" containerName="maas-api"
Sep 07 17:14:04.143786 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:04.143742    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d373bf5d-764c-40b0-9270-941359ec5883" containerName="payload-pre-processing"
Sep 07 17:14:04.143786 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:04.143749    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="653e4aeb-5d5b-4728-82a7-0faae05a50b8" containerName="payload-pre-processing"
Sep 07 17:14:04.148253 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:04.148215    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99-ql2j9"
Sep 07 17:14:04.157101 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:04.157078    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-1795dd\""
Sep 07 17:14:04.157969 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:04.157948    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-1795dd-dockercfg-27746\""
Sep 07 17:14:04.171084 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:04.171057    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99-ql2j9"]
Sep 07 17:14:04.295372 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:04.295336    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2clq2\" (UniqueName: \"kubernetes.io/projected/9d50f6f9-57cf-4d71-92ee-b3baadb3b71f-kube-api-access-2clq2\") pod \"payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99-ql2j9\" (UID: \"9d50f6f9-57cf-4d71-92ee-b3baadb3b71f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99-ql2j9"
Sep 07 17:14:04.295540 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:04.295378    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d50f6f9-57cf-4d71-92ee-b3baadb3b71f-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99-ql2j9\" (UID: \"9d50f6f9-57cf-4d71-92ee-b3baadb3b71f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99-ql2j9"
Sep 07 17:14:04.396950 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:04.396865    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2clq2\" (UniqueName: \"kubernetes.io/projected/9d50f6f9-57cf-4d71-92ee-b3baadb3b71f-kube-api-access-2clq2\") pod \"payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99-ql2j9\" (UID: \"9d50f6f9-57cf-4d71-92ee-b3baadb3b71f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99-ql2j9"
Sep 07 17:14:04.396950 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:04.396917    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d50f6f9-57cf-4d71-92ee-b3baadb3b71f-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99-ql2j9\" (UID: \"9d50f6f9-57cf-4d71-92ee-b3baadb3b71f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99-ql2j9"
Sep 07 17:14:04.397655 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:04.397633    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d50f6f9-57cf-4d71-92ee-b3baadb3b71f-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99-ql2j9\" (UID: \"9d50f6f9-57cf-4d71-92ee-b3baadb3b71f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99-ql2j9"
Sep 07 17:14:04.406931 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:04.406900    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2clq2\" (UniqueName: \"kubernetes.io/projected/9d50f6f9-57cf-4d71-92ee-b3baadb3b71f-kube-api-access-2clq2\") pod \"payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99-ql2j9\" (UID: \"9d50f6f9-57cf-4d71-92ee-b3baadb3b71f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99-ql2j9"
Sep 07 17:14:04.458946 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:04.458914    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99-ql2j9"
Sep 07 17:14:04.737799 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:04.737759    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99-ql2j9"]
Sep 07 17:14:04.738591 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:14:04.738562    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d50f6f9_57cf_4d71_92ee_b3baadb3b71f.slice/crio-842a0bd94e69890f5100414e47d30c5624ee9bd717353fc119eeda24385fffc9 WatchSource:0}: Error finding container 842a0bd94e69890f5100414e47d30c5624ee9bd717353fc119eeda24385fffc9: Status 404 returned error can't find the container with id 842a0bd94e69890f5100414e47d30c5624ee9bd717353fc119eeda24385fffc9
Sep 07 17:14:05.039146 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:05.039059    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99-ql2j9" event={"ID":"9d50f6f9-57cf-4d71-92ee-b3baadb3b71f","Type":"ContainerStarted","Data":"662400abde04ffbf6cf5be97b27d45e9f7c85885676fc58874800a5d064a3f35"}
Sep 07 17:14:05.039146 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:05.039113    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99-ql2j9" event={"ID":"9d50f6f9-57cf-4d71-92ee-b3baadb3b71f","Type":"ContainerStarted","Data":"842a0bd94e69890f5100414e47d30c5624ee9bd717353fc119eeda24385fffc9"}
Sep 07 17:14:05.039385 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:05.039267    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99-ql2j9"
Sep 07 17:14:05.066459 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:05.066394    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99-ql2j9" podStartSLOduration=1.066372855 podStartE2EDuration="1.066372855s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:14:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:14:05.062591912 +0000 UTC m=+1062.094022705" watchObservedRunningTime="2026-09-07 17:14:05.066372855 +0000 UTC m=+1062.097803648"
Sep 07 17:14:16.046191 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:16.046118    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99-ql2j9"
Sep 07 17:14:16.056222 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:16.056193    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f799c427-5b6c5859d-6l7sm"]
Sep 07 17:14:16.059679 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:16.059664    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f799c427-5b6c5859d-6l7sm"
Sep 07 17:14:16.062507 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:16.062485    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-f799c427\""
Sep 07 17:14:16.062618 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:16.062560    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-f799c427-dockercfg-gfzjz\""
Sep 07 17:14:16.068738 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:16.068716    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f799c427-5b6c5859d-6l7sm"]
Sep 07 17:14:16.210658 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:16.210614    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6690d9b-2ef3-447f-8e92-6e2d1bb76c63-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f799c427-5b6c5859d-6l7sm\" (UID: \"a6690d9b-2ef3-447f-8e92-6e2d1bb76c63\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f799c427-5b6c5859d-6l7sm"
Sep 07 17:14:16.210803 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:16.210695    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fsjn\" (UniqueName: \"kubernetes.io/projected/a6690d9b-2ef3-447f-8e92-6e2d1bb76c63-kube-api-access-8fsjn\") pod \"payload-pre-processing-e2e-mt-f799c427-5b6c5859d-6l7sm\" (UID: \"a6690d9b-2ef3-447f-8e92-6e2d1bb76c63\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f799c427-5b6c5859d-6l7sm"
Sep 07 17:14:16.311962 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:16.311866    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fsjn\" (UniqueName: \"kubernetes.io/projected/a6690d9b-2ef3-447f-8e92-6e2d1bb76c63-kube-api-access-8fsjn\") pod \"payload-pre-processing-e2e-mt-f799c427-5b6c5859d-6l7sm\" (UID: \"a6690d9b-2ef3-447f-8e92-6e2d1bb76c63\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f799c427-5b6c5859d-6l7sm"
Sep 07 17:14:16.312140 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:16.311976    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6690d9b-2ef3-447f-8e92-6e2d1bb76c63-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f799c427-5b6c5859d-6l7sm\" (UID: \"a6690d9b-2ef3-447f-8e92-6e2d1bb76c63\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f799c427-5b6c5859d-6l7sm"
Sep 07 17:14:16.312739 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:16.312714    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6690d9b-2ef3-447f-8e92-6e2d1bb76c63-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f799c427-5b6c5859d-6l7sm\" (UID: \"a6690d9b-2ef3-447f-8e92-6e2d1bb76c63\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f799c427-5b6c5859d-6l7sm"
Sep 07 17:14:16.321878 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:16.321853    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fsjn\" (UniqueName: \"kubernetes.io/projected/a6690d9b-2ef3-447f-8e92-6e2d1bb76c63-kube-api-access-8fsjn\") pod \"payload-pre-processing-e2e-mt-f799c427-5b6c5859d-6l7sm\" (UID: \"a6690d9b-2ef3-447f-8e92-6e2d1bb76c63\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f799c427-5b6c5859d-6l7sm"
Sep 07 17:14:16.371686 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:16.371656    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f799c427-5b6c5859d-6l7sm"
Sep 07 17:14:16.645463 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:16.645431    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f799c427-5b6c5859d-6l7sm"]
Sep 07 17:14:16.647003 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:14:16.646974    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6690d9b_2ef3_447f_8e92_6e2d1bb76c63.slice/crio-7409fd9ee17bb7cfad39d4425a2fe8eebf687dce31fe33e9068d7d0637992a3b WatchSource:0}: Error finding container 7409fd9ee17bb7cfad39d4425a2fe8eebf687dce31fe33e9068d7d0637992a3b: Status 404 returned error can't find the container with id 7409fd9ee17bb7cfad39d4425a2fe8eebf687dce31fe33e9068d7d0637992a3b
Sep 07 17:14:17.103322 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:17.103285    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f799c427-5b6c5859d-6l7sm" event={"ID":"a6690d9b-2ef3-447f-8e92-6e2d1bb76c63","Type":"ContainerStarted","Data":"e607291de473b3447a28156c2647bb7e395261d774cf3c5fae5c4c5baf4cc5b3"}
Sep 07 17:14:17.103673 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:17.103349    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f799c427-5b6c5859d-6l7sm" event={"ID":"a6690d9b-2ef3-447f-8e92-6e2d1bb76c63","Type":"ContainerStarted","Data":"7409fd9ee17bb7cfad39d4425a2fe8eebf687dce31fe33e9068d7d0637992a3b"}
Sep 07 17:14:17.103673 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:17.103374    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-f799c427-5b6c5859d-6l7sm"
Sep 07 17:14:28.110622 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:28.110586    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-f799c427-5b6c5859d-6l7sm"
Sep 07 17:14:28.132624 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:28.132566    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-f799c427-5b6c5859d-6l7sm" podStartSLOduration=12.132546898 podStartE2EDuration="12.132546898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:14:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:14:17.125708887 +0000 UTC m=+1074.157139678" watchObservedRunningTime="2026-09-07 17:14:28.132546898 +0000 UTC m=+1085.163977690"
Sep 07 17:14:33.049030 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:33.048985    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-3973bf-85c5575f57-jzdm9"]
Sep 07 17:14:33.053774 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:33.053755    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3973bf-85c5575f57-jzdm9"
Sep 07 17:14:33.056993 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:33.056970    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-3973bf\""
Sep 07 17:14:33.074369 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:33.074338    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-3973bf-85c5575f57-jzdm9"]
Sep 07 17:14:33.159026 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:33.158993    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5dbd3dd-392b-4f05-b9fc-0658bb4a7911-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-3973bf-85c5575f57-jzdm9\" (UID: \"f5dbd3dd-392b-4f05-b9fc-0658bb4a7911\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3973bf-85c5575f57-jzdm9"
Sep 07 17:14:33.159193 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:33.159080    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f69v\" (UniqueName: \"kubernetes.io/projected/f5dbd3dd-392b-4f05-b9fc-0658bb4a7911-kube-api-access-6f69v\") pod \"payload-processing-e2e-shared-b-w3-3973bf-85c5575f57-jzdm9\" (UID: \"f5dbd3dd-392b-4f05-b9fc-0658bb4a7911\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3973bf-85c5575f57-jzdm9"
Sep 07 17:14:33.260010 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:33.259975    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f69v\" (UniqueName: \"kubernetes.io/projected/f5dbd3dd-392b-4f05-b9fc-0658bb4a7911-kube-api-access-6f69v\") pod \"payload-processing-e2e-shared-b-w3-3973bf-85c5575f57-jzdm9\" (UID: \"f5dbd3dd-392b-4f05-b9fc-0658bb4a7911\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3973bf-85c5575f57-jzdm9"
Sep 07 17:14:33.260186 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:33.260056    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5dbd3dd-392b-4f05-b9fc-0658bb4a7911-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-3973bf-85c5575f57-jzdm9\" (UID: \"f5dbd3dd-392b-4f05-b9fc-0658bb4a7911\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3973bf-85c5575f57-jzdm9"
Sep 07 17:14:33.260860 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:33.260837    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5dbd3dd-392b-4f05-b9fc-0658bb4a7911-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-3973bf-85c5575f57-jzdm9\" (UID: \"f5dbd3dd-392b-4f05-b9fc-0658bb4a7911\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3973bf-85c5575f57-jzdm9"
Sep 07 17:14:33.285879 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:33.285853    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f69v\" (UniqueName: \"kubernetes.io/projected/f5dbd3dd-392b-4f05-b9fc-0658bb4a7911-kube-api-access-6f69v\") pod \"payload-processing-e2e-shared-b-w3-3973bf-85c5575f57-jzdm9\" (UID: \"f5dbd3dd-392b-4f05-b9fc-0658bb4a7911\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3973bf-85c5575f57-jzdm9"
Sep 07 17:14:33.363883 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:33.363844    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3973bf-85c5575f57-jzdm9"
Sep 07 17:14:33.652453 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:33.652424    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-3973bf-85c5575f57-jzdm9"]
Sep 07 17:14:33.652853 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:14:33.652830    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5dbd3dd_392b_4f05_b9fc_0658bb4a7911.slice/crio-8d13459fae63c7bb77b688d4dd726dac20ee43ff9ef9d8421bbef5d53c21936a WatchSource:0}: Error finding container 8d13459fae63c7bb77b688d4dd726dac20ee43ff9ef9d8421bbef5d53c21936a: Status 404 returned error can't find the container with id 8d13459fae63c7bb77b688d4dd726dac20ee43ff9ef9d8421bbef5d53c21936a
Sep 07 17:14:34.196393 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:34.196353    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3973bf-85c5575f57-jzdm9" event={"ID":"f5dbd3dd-392b-4f05-b9fc-0658bb4a7911","Type":"ContainerStarted","Data":"3a6ebaab3c575e48b77fd2b6ab236f74979c65f2f2f280ecf9d14e7575ee5bf9"}
Sep 07 17:14:34.196809 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:34.196418    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3973bf-85c5575f57-jzdm9" event={"ID":"f5dbd3dd-392b-4f05-b9fc-0658bb4a7911","Type":"ContainerStarted","Data":"8d13459fae63c7bb77b688d4dd726dac20ee43ff9ef9d8421bbef5d53c21936a"}
Sep 07 17:14:34.196809 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:34.196586    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3973bf-85c5575f57-jzdm9"
Sep 07 17:14:34.216741 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:34.216695    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3973bf-85c5575f57-jzdm9" podStartSLOduration=1.216681776 podStartE2EDuration="1.216681776s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:14:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:14:34.212864166 +0000 UTC m=+1091.244294971" watchObservedRunningTime="2026-09-07 17:14:34.216681776 +0000 UTC m=+1091.248112567"
Sep 07 17:14:45.203941 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:45.203909    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3973bf-85c5575f57-jzdm9"
Sep 07 17:14:57.509349 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:57.509310    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f799c427-5b6c5859d-6l7sm"]
Sep 07 17:14:57.510199 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:57.509575    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-f799c427-5b6c5859d-6l7sm" podUID="a6690d9b-2ef3-447f-8e92-6e2d1bb76c63" containerName="payload-pre-processing" containerID="cri-o://e607291de473b3447a28156c2647bb7e395261d774cf3c5fae5c4c5baf4cc5b3" gracePeriod=30
Sep 07 17:14:57.762779 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:57.762716    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f799c427-5b6c5859d-6l7sm"
Sep 07 17:14:57.894099 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:57.894071    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6690d9b-2ef3-447f-8e92-6e2d1bb76c63-plugins-config-volume\") pod \"a6690d9b-2ef3-447f-8e92-6e2d1bb76c63\" (UID: \"a6690d9b-2ef3-447f-8e92-6e2d1bb76c63\") "
Sep 07 17:14:57.894309 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:57.894155    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8fsjn\" (UniqueName: \"kubernetes.io/projected/a6690d9b-2ef3-447f-8e92-6e2d1bb76c63-kube-api-access-8fsjn\") pod \"a6690d9b-2ef3-447f-8e92-6e2d1bb76c63\" (UID: \"a6690d9b-2ef3-447f-8e92-6e2d1bb76c63\") "
Sep 07 17:14:57.894505 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:57.894480    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6690d9b-2ef3-447f-8e92-6e2d1bb76c63-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a6690d9b-2ef3-447f-8e92-6e2d1bb76c63" (UID: "a6690d9b-2ef3-447f-8e92-6e2d1bb76c63"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:14:57.896173 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:57.896142    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6690d9b-2ef3-447f-8e92-6e2d1bb76c63-kube-api-access-8fsjn" (OuterVolumeSpecName: "kube-api-access-8fsjn") pod "a6690d9b-2ef3-447f-8e92-6e2d1bb76c63" (UID: "a6690d9b-2ef3-447f-8e92-6e2d1bb76c63"). InnerVolumeSpecName "kube-api-access-8fsjn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:14:57.995634 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:57.995603    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6690d9b-2ef3-447f-8e92-6e2d1bb76c63-plugins-config-volume\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:14:57.995634 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:57.995629    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8fsjn\" (UniqueName: \"kubernetes.io/projected/a6690d9b-2ef3-447f-8e92-6e2d1bb76c63-kube-api-access-8fsjn\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:14:58.322329 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:58.322293    2558 generic.go:356] "Generic (PLEG): container finished" podID="a6690d9b-2ef3-447f-8e92-6e2d1bb76c63" containerID="e607291de473b3447a28156c2647bb7e395261d774cf3c5fae5c4c5baf4cc5b3" exitCode=0
Sep 07 17:14:58.322495 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:58.322335    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f799c427-5b6c5859d-6l7sm"
Sep 07 17:14:58.322495 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:58.322375    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f799c427-5b6c5859d-6l7sm" event={"ID":"a6690d9b-2ef3-447f-8e92-6e2d1bb76c63","Type":"ContainerDied","Data":"e607291de473b3447a28156c2647bb7e395261d774cf3c5fae5c4c5baf4cc5b3"}
Sep 07 17:14:58.322495 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:58.322427    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f799c427-5b6c5859d-6l7sm" event={"ID":"a6690d9b-2ef3-447f-8e92-6e2d1bb76c63","Type":"ContainerDied","Data":"7409fd9ee17bb7cfad39d4425a2fe8eebf687dce31fe33e9068d7d0637992a3b"}
Sep 07 17:14:58.322495 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:58.322451    2558 scope.go:117] "RemoveContainer" containerID="e607291de473b3447a28156c2647bb7e395261d774cf3c5fae5c4c5baf4cc5b3"
Sep 07 17:14:58.333769 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:58.333745    2558 scope.go:117] "RemoveContainer" containerID="e607291de473b3447a28156c2647bb7e395261d774cf3c5fae5c4c5baf4cc5b3"
Sep 07 17:14:58.334050 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:14:58.334022    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e607291de473b3447a28156c2647bb7e395261d774cf3c5fae5c4c5baf4cc5b3\": container with ID starting with e607291de473b3447a28156c2647bb7e395261d774cf3c5fae5c4c5baf4cc5b3 not found: ID does not exist" containerID="e607291de473b3447a28156c2647bb7e395261d774cf3c5fae5c4c5baf4cc5b3"
Sep 07 17:14:58.334144 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:58.334053    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e607291de473b3447a28156c2647bb7e395261d774cf3c5fae5c4c5baf4cc5b3"} err="failed to get container status \"e607291de473b3447a28156c2647bb7e395261d774cf3c5fae5c4c5baf4cc5b3\": rpc error: code = NotFound desc = could not find container \"e607291de473b3447a28156c2647bb7e395261d774cf3c5fae5c4c5baf4cc5b3\": container with ID starting with e607291de473b3447a28156c2647bb7e395261d774cf3c5fae5c4c5baf4cc5b3 not found: ID does not exist"
Sep 07 17:14:58.350852 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:58.350820    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f799c427-5b6c5859d-6l7sm"]
Sep 07 17:14:58.354522 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:58.354496    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f799c427-5b6c5859d-6l7sm"]
Sep 07 17:14:59.594406 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:14:59.594376    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6690d9b-2ef3-447f-8e92-6e2d1bb76c63" path="/var/lib/kubelet/pods/a6690d9b-2ef3-447f-8e92-6e2d1bb76c63/volumes"
Sep 07 17:15:00.145818 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:00.145773    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1795dd-29813355-bggh2"]
Sep 07 17:15:00.146263 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:00.146229    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6690d9b-2ef3-447f-8e92-6e2d1bb76c63" containerName="payload-pre-processing"
Sep 07 17:15:00.146362 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:00.146266    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6690d9b-2ef3-447f-8e92-6e2d1bb76c63" containerName="payload-pre-processing"
Sep 07 17:15:00.146420 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:00.146402    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6690d9b-2ef3-447f-8e92-6e2d1bb76c63" containerName="payload-pre-processing"
Sep 07 17:15:00.149724 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:00.149702    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1795dd-29813355-bggh2"
Sep 07 17:15:00.153396 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:00.153041    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qphph\""
Sep 07 17:15:00.159478 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:00.159456    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1795dd-29813355-bggh2"]
Sep 07 17:15:00.161811 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:00.161794    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1795dd-29813355-bggh2"
Sep 07 17:15:00.457664 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:00.457637    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1795dd-29813355-bggh2"]
Sep 07 17:15:00.460131 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:15:00.460099    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9b5c53b_33bc_4bee_8202_c3954afcfc1a.slice/crio-fdb393846575ff7721f8fdb41edd01ae5969254142da2b2d4f2771a2b992c9e7 WatchSource:0}: Error finding container fdb393846575ff7721f8fdb41edd01ae5969254142da2b2d4f2771a2b992c9e7: Status 404 returned error can't find the container with id fdb393846575ff7721f8fdb41edd01ae5969254142da2b2d4f2771a2b992c9e7
Sep 07 17:15:00.462078 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:00.462060    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 17:15:01.340801 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:01.340761    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1795dd-29813355-bggh2" event={"ID":"c9b5c53b-33bc-4bee-8202-c3954afcfc1a","Type":"ContainerStarted","Data":"fdb393846575ff7721f8fdb41edd01ae5969254142da2b2d4f2771a2b992c9e7"}
Sep 07 17:15:03.354611 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:03.354575    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1795dd-29813355-bggh2" event={"ID":"c9b5c53b-33bc-4bee-8202-c3954afcfc1a","Type":"ContainerStarted","Data":"296bc402804f89fdd0a07a14080a7298ba3d628ef4248aa21491b98f7042792e"}
Sep 07 17:15:03.374062 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:03.374011    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1795dd-29813355-bggh2" podStartSLOduration=0.921269981 podStartE2EDuration="3.373992811s" totalImagesPullingTime="2.45272283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:15:03.372494923 +0000 UTC m=+1120.403925713" watchObservedRunningTime="2026-09-07 17:15:03.373992811 +0000 UTC m=+1120.405423603"
Sep 07 17:15:04.361765 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:04.361729    2558 generic.go:356] "Generic (PLEG): container finished" podID="c9b5c53b-33bc-4bee-8202-c3954afcfc1a" containerID="296bc402804f89fdd0a07a14080a7298ba3d628ef4248aa21491b98f7042792e" exitCode=0
Sep 07 17:15:04.362148 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:04.361769    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1795dd-29813355-bggh2" event={"ID":"c9b5c53b-33bc-4bee-8202-c3954afcfc1a","Type":"ContainerDied","Data":"296bc402804f89fdd0a07a14080a7298ba3d628ef4248aa21491b98f7042792e"}
Sep 07 17:15:05.511945 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:05.511917    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1795dd-29813355-bggh2"
Sep 07 17:15:06.373420 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:06.373384    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1795dd-29813355-bggh2" event={"ID":"c9b5c53b-33bc-4bee-8202-c3954afcfc1a","Type":"ContainerDied","Data":"fdb393846575ff7721f8fdb41edd01ae5969254142da2b2d4f2771a2b992c9e7"}
Sep 07 17:15:06.373420 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:06.373421    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1795dd-29813355-bggh2"
Sep 07 17:15:06.373633 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:06.373441    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fdb393846575ff7721f8fdb41edd01ae5969254142da2b2d4f2771a2b992c9e7"
Sep 07 17:15:24.381621 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:24.381590    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-202015-67cb789677-9xlqr"]
Sep 07 17:15:24.382024 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:24.382012    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9b5c53b-33bc-4bee-8202-c3954afcfc1a" containerName="cleanup"
Sep 07 17:15:24.382068 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:24.382025    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9b5c53b-33bc-4bee-8202-c3954afcfc1a" containerName="cleanup"
Sep 07 17:15:24.382104 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:24.382091    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9b5c53b-33bc-4bee-8202-c3954afcfc1a" containerName="cleanup"
Sep 07 17:15:24.385628 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:24.385611    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-202015-67cb789677-9xlqr"
Sep 07 17:15:24.388801 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:24.388776    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-202015-dockercfg-r9p9l\""
Sep 07 17:15:24.389154 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:24.389126    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-202015\""
Sep 07 17:15:24.399913 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:24.399890    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-202015-67cb789677-9xlqr"]
Sep 07 17:15:24.439265 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:24.439218    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01417128-befa-4fc5-bd12-e001f5cf4e65-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-202015-67cb789677-9xlqr\" (UID: \"01417128-befa-4fc5-bd12-e001f5cf4e65\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-202015-67cb789677-9xlqr"
Sep 07 17:15:24.439424 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:24.439323    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7sjz\" (UniqueName: \"kubernetes.io/projected/01417128-befa-4fc5-bd12-e001f5cf4e65-kube-api-access-h7sjz\") pod \"payload-processing-e2e-shared-a-w2-202015-67cb789677-9xlqr\" (UID: \"01417128-befa-4fc5-bd12-e001f5cf4e65\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-202015-67cb789677-9xlqr"
Sep 07 17:15:24.540325 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:24.540287    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7sjz\" (UniqueName: \"kubernetes.io/projected/01417128-befa-4fc5-bd12-e001f5cf4e65-kube-api-access-h7sjz\") pod \"payload-processing-e2e-shared-a-w2-202015-67cb789677-9xlqr\" (UID: \"01417128-befa-4fc5-bd12-e001f5cf4e65\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-202015-67cb789677-9xlqr"
Sep 07 17:15:24.540520 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:24.540404    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01417128-befa-4fc5-bd12-e001f5cf4e65-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-202015-67cb789677-9xlqr\" (UID: \"01417128-befa-4fc5-bd12-e001f5cf4e65\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-202015-67cb789677-9xlqr"
Sep 07 17:15:24.541064 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:24.541044    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01417128-befa-4fc5-bd12-e001f5cf4e65-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-202015-67cb789677-9xlqr\" (UID: \"01417128-befa-4fc5-bd12-e001f5cf4e65\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-202015-67cb789677-9xlqr"
Sep 07 17:15:24.548916 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:24.548890    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7sjz\" (UniqueName: \"kubernetes.io/projected/01417128-befa-4fc5-bd12-e001f5cf4e65-kube-api-access-h7sjz\") pod \"payload-processing-e2e-shared-a-w2-202015-67cb789677-9xlqr\" (UID: \"01417128-befa-4fc5-bd12-e001f5cf4e65\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-202015-67cb789677-9xlqr"
Sep 07 17:15:24.696436 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:24.696357    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-202015-67cb789677-9xlqr"
Sep 07 17:15:24.974466 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:24.974441    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-202015-67cb789677-9xlqr"]
Sep 07 17:15:24.976192 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:15:24.976152    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01417128_befa_4fc5_bd12_e001f5cf4e65.slice/crio-2ac95cdb93d0f1f5846b43d350c501b0a2b598eb62428ef79d9098e8912ae82d WatchSource:0}: Error finding container 2ac95cdb93d0f1f5846b43d350c501b0a2b598eb62428ef79d9098e8912ae82d: Status 404 returned error can't find the container with id 2ac95cdb93d0f1f5846b43d350c501b0a2b598eb62428ef79d9098e8912ae82d
Sep 07 17:15:25.483849 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:25.483808    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-202015-67cb789677-9xlqr" event={"ID":"01417128-befa-4fc5-bd12-e001f5cf4e65","Type":"ContainerStarted","Data":"6ee121220b812c3c93cdd217365982fc5b47afcb97ef525084069cb1924c039f"}
Sep 07 17:15:25.484341 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:25.483872    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-202015-67cb789677-9xlqr" event={"ID":"01417128-befa-4fc5-bd12-e001f5cf4e65","Type":"ContainerStarted","Data":"2ac95cdb93d0f1f5846b43d350c501b0a2b598eb62428ef79d9098e8912ae82d"}
Sep 07 17:15:25.484341 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:25.483979    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-202015-67cb789677-9xlqr"
Sep 07 17:15:25.504069 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:25.504022    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-202015-67cb789677-9xlqr" podStartSLOduration=1.504007348 podStartE2EDuration="1.504007348s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:15:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:15:25.501262888 +0000 UTC m=+1142.532693671" watchObservedRunningTime="2026-09-07 17:15:25.504007348 +0000 UTC m=+1142.535438139"
Sep 07 17:15:36.491351 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:36.491320    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-202015-67cb789677-9xlqr"
Sep 07 17:15:53.039403 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:53.039322    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m"]
Sep 07 17:15:53.043004 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:53.042987    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m"
Sep 07 17:15:53.046061 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:53.046037    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-43ab35-serving-cert\""
Sep 07 17:15:53.056045 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:53.056016    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m"]
Sep 07 17:15:53.225325 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:53.225282    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f9n7\" (UniqueName: \"kubernetes.io/projected/9a67fc9a-1fad-4457-9aed-2554eef865b6-kube-api-access-6f9n7\") pod \"maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m\" (UID: \"9a67fc9a-1fad-4457-9aed-2554eef865b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m"
Sep 07 17:15:53.225499 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:53.225356    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a67fc9a-1fad-4457-9aed-2554eef865b6-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m\" (UID: \"9a67fc9a-1fad-4457-9aed-2554eef865b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m"
Sep 07 17:15:53.225499 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:53.225399    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a67fc9a-1fad-4457-9aed-2554eef865b6-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m\" (UID: \"9a67fc9a-1fad-4457-9aed-2554eef865b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m"
Sep 07 17:15:53.225499 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:53.225436    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a67fc9a-1fad-4457-9aed-2554eef865b6-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m\" (UID: \"9a67fc9a-1fad-4457-9aed-2554eef865b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m"
Sep 07 17:15:53.326693 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:53.326598    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f9n7\" (UniqueName: \"kubernetes.io/projected/9a67fc9a-1fad-4457-9aed-2554eef865b6-kube-api-access-6f9n7\") pod \"maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m\" (UID: \"9a67fc9a-1fad-4457-9aed-2554eef865b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m"
Sep 07 17:15:53.326693 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:53.326674    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a67fc9a-1fad-4457-9aed-2554eef865b6-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m\" (UID: \"9a67fc9a-1fad-4457-9aed-2554eef865b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m"
Sep 07 17:15:53.326952 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:53.326714    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a67fc9a-1fad-4457-9aed-2554eef865b6-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m\" (UID: \"9a67fc9a-1fad-4457-9aed-2554eef865b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m"
Sep 07 17:15:53.326952 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:53.326773    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a67fc9a-1fad-4457-9aed-2554eef865b6-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m\" (UID: \"9a67fc9a-1fad-4457-9aed-2554eef865b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m"
Sep 07 17:15:53.327872 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:53.327846    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a67fc9a-1fad-4457-9aed-2554eef865b6-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m\" (UID: \"9a67fc9a-1fad-4457-9aed-2554eef865b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m"
Sep 07 17:15:53.329471 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:53.329449    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a67fc9a-1fad-4457-9aed-2554eef865b6-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m\" (UID: \"9a67fc9a-1fad-4457-9aed-2554eef865b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m"
Sep 07 17:15:53.329552 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:53.329531    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a67fc9a-1fad-4457-9aed-2554eef865b6-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m\" (UID: \"9a67fc9a-1fad-4457-9aed-2554eef865b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m"
Sep 07 17:15:53.339354 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:53.339331    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f9n7\" (UniqueName: \"kubernetes.io/projected/9a67fc9a-1fad-4457-9aed-2554eef865b6-kube-api-access-6f9n7\") pod \"maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m\" (UID: \"9a67fc9a-1fad-4457-9aed-2554eef865b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m"
Sep 07 17:15:53.356671 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:53.356652    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m"
Sep 07 17:15:53.637075 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:53.637051    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m"]
Sep 07 17:15:53.638222 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:15:53.638197    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a67fc9a_1fad_4457_9aed_2554eef865b6.slice/crio-7936836cd55c8b6c06e008f4f56b870836ee8aa7f0dc9d80ee2aefe37936987c WatchSource:0}: Error finding container 7936836cd55c8b6c06e008f4f56b870836ee8aa7f0dc9d80ee2aefe37936987c: Status 404 returned error can't find the container with id 7936836cd55c8b6c06e008f4f56b870836ee8aa7f0dc9d80ee2aefe37936987c
Sep 07 17:15:54.638859 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:54.638815    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m" event={"ID":"9a67fc9a-1fad-4457-9aed-2554eef865b6","Type":"ContainerStarted","Data":"6c58e8183a2c57a07165cf6d84da3ec5cf1a79e865539eb1dba1a2a9d1905852"}
Sep 07 17:15:54.639218 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:54.638883    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m"
Sep 07 17:15:54.639218 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:54.638904    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m" event={"ID":"9a67fc9a-1fad-4457-9aed-2554eef865b6","Type":"ContainerStarted","Data":"7936836cd55c8b6c06e008f4f56b870836ee8aa7f0dc9d80ee2aefe37936987c"}
Sep 07 17:15:54.662188 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:15:54.662140    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m" podStartSLOduration=1.341886704 podStartE2EDuration="1.662125865s" totalImagesPullingTime="320.239161ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:15:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:15:54.659601904 +0000 UTC m=+1171.691032695" watchObservedRunningTime="2026-09-07 17:15:54.662125865 +0000 UTC m=+1171.693556656"
Sep 07 17:16:00.649523 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:00.649488    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m"
Sep 07 17:16:20.225191 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:20.225153    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7724-140701956580528"]
Sep 07 17:16:20.229000 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:20.228980    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7724-140701956580528"
Sep 07 17:16:20.236092 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:20.236071    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-zsccf\""
Sep 07 17:16:20.240303 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:20.240277    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7724-140701956580528"]
Sep 07 17:16:20.381386 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:20.381345    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sgtp\" (UniqueName: \"kubernetes.io/projected/e62c3aee-7ab1-46d7-a8f4-d3ec9f2915a4-kube-api-access-7sgtp\") pod \"test-curl-7724-140701956580528\" (UID: \"e62c3aee-7ab1-46d7-a8f4-d3ec9f2915a4\") " pod="opendatahub/test-curl-7724-140701956580528"
Sep 07 17:16:20.482170 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:20.482073    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sgtp\" (UniqueName: \"kubernetes.io/projected/e62c3aee-7ab1-46d7-a8f4-d3ec9f2915a4-kube-api-access-7sgtp\") pod \"test-curl-7724-140701956580528\" (UID: \"e62c3aee-7ab1-46d7-a8f4-d3ec9f2915a4\") " pod="opendatahub/test-curl-7724-140701956580528"
Sep 07 17:16:20.490825 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:20.490796    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sgtp\" (UniqueName: \"kubernetes.io/projected/e62c3aee-7ab1-46d7-a8f4-d3ec9f2915a4-kube-api-access-7sgtp\") pod \"test-curl-7724-140701956580528\" (UID: \"e62c3aee-7ab1-46d7-a8f4-d3ec9f2915a4\") " pod="opendatahub/test-curl-7724-140701956580528"
Sep 07 17:16:20.540148 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:20.540121    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7724-140701956580528"
Sep 07 17:16:20.809088 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:20.809058    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7724-140701956580528"]
Sep 07 17:16:20.810542 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:16:20.810512    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode62c3aee_7ab1_46d7_a8f4_d3ec9f2915a4.slice/crio-dcfaa6ce4f435fd47394ed375ca0e537567246213a99d5fd5a0eb40931be4022 WatchSource:0}: Error finding container dcfaa6ce4f435fd47394ed375ca0e537567246213a99d5fd5a0eb40931be4022: Status 404 returned error can't find the container with id dcfaa6ce4f435fd47394ed375ca0e537567246213a99d5fd5a0eb40931be4022
Sep 07 17:16:21.783023 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:21.782919    2558 generic.go:356] "Generic (PLEG): container finished" podID="e62c3aee-7ab1-46d7-a8f4-d3ec9f2915a4" containerID="718060dd2dee6b4d3874a7832c325342f9df49f8217cd3a3f13e94189fb9d796" exitCode=0
Sep 07 17:16:21.783023 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:21.783008    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7724-140701956580528" event={"ID":"e62c3aee-7ab1-46d7-a8f4-d3ec9f2915a4","Type":"ContainerDied","Data":"718060dd2dee6b4d3874a7832c325342f9df49f8217cd3a3f13e94189fb9d796"}
Sep 07 17:16:21.783494 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:21.783043    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7724-140701956580528" event={"ID":"e62c3aee-7ab1-46d7-a8f4-d3ec9f2915a4","Type":"ContainerStarted","Data":"dcfaa6ce4f435fd47394ed375ca0e537567246213a99d5fd5a0eb40931be4022"}
Sep 07 17:16:22.922047 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:22.922022    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7724-140701956580528"
Sep 07 17:16:22.963421 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:22.963390    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7724-140701956580528_e62c3aee-7ab1-46d7-a8f4-d3ec9f2915a4/test-curl-7724-140701956580528/0.log"
Sep 07 17:16:22.989410 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:22.989377    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7724-140701956580528"]
Sep 07 17:16:22.995622 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:22.995597    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7724-140701956580528"]
Sep 07 17:16:23.007204 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:23.007171    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7sgtp\" (UniqueName: \"kubernetes.io/projected/e62c3aee-7ab1-46d7-a8f4-d3ec9f2915a4-kube-api-access-7sgtp\") pod \"e62c3aee-7ab1-46d7-a8f4-d3ec9f2915a4\" (UID: \"e62c3aee-7ab1-46d7-a8f4-d3ec9f2915a4\") "
Sep 07 17:16:23.009436 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:23.009408    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e62c3aee-7ab1-46d7-a8f4-d3ec9f2915a4-kube-api-access-7sgtp" (OuterVolumeSpecName: "kube-api-access-7sgtp") pod "e62c3aee-7ab1-46d7-a8f4-d3ec9f2915a4" (UID: "e62c3aee-7ab1-46d7-a8f4-d3ec9f2915a4"). InnerVolumeSpecName "kube-api-access-7sgtp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:16:23.108223 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:23.108183    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7sgtp\" (UniqueName: \"kubernetes.io/projected/e62c3aee-7ab1-46d7-a8f4-d3ec9f2915a4-kube-api-access-7sgtp\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:16:23.595017 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:23.594941    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e62c3aee-7ab1-46d7-a8f4-d3ec9f2915a4" path="/var/lib/kubelet/pods/e62c3aee-7ab1-46d7-a8f4-d3ec9f2915a4/volumes"
Sep 07 17:16:23.668551 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:23.668520    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-f6srd_24750b4e-c0bc-4c3c-a256-6ca251306d06/console-operator/1.log"
Sep 07 17:16:23.670418 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:23.670395    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-f6srd_24750b4e-c0bc-4c3c-a256-6ca251306d06/console-operator/1.log"
Sep 07 17:16:23.676954 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:23.676934    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwj7s_9b97dbca-7e8f-4e05-9cc4-8f42785f01e7/ovn-acl-logging/0.log"
Sep 07 17:16:23.678674 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:23.678654    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwj7s_9b97dbca-7e8f-4e05-9cc4-8f42785f01e7/ovn-acl-logging/0.log"
Sep 07 17:16:23.794682 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:23.794653    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7724-140701956580528"
Sep 07 17:16:23.794682 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:23.794643    2558 scope.go:117] "RemoveContainer" containerID="718060dd2dee6b4d3874a7832c325342f9df49f8217cd3a3f13e94189fb9d796"
Sep 07 17:16:26.271589 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:26.271550    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7724-140701949242656"]
Sep 07 17:16:26.271973 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:26.271954    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e62c3aee-7ab1-46d7-a8f4-d3ec9f2915a4" containerName="test-curl-7724-140701956580528"
Sep 07 17:16:26.271973 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:26.271966    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e62c3aee-7ab1-46d7-a8f4-d3ec9f2915a4" containerName="test-curl-7724-140701956580528"
Sep 07 17:16:26.272058 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:26.272047    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e62c3aee-7ab1-46d7-a8f4-d3ec9f2915a4" containerName="test-curl-7724-140701956580528"
Sep 07 17:16:26.276559 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:26.276540    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7724-140701949242656"
Sep 07 17:16:26.280176 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:26.280144    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-zsccf\""
Sep 07 17:16:26.282521 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:26.282494    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7724-140701949242656"]
Sep 07 17:16:26.438981 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:26.438938    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxml5\" (UniqueName: \"kubernetes.io/projected/c8dd78a3-2c43-4378-b223-108bb80f9291-kube-api-access-jxml5\") pod \"test-curl-7724-140701949242656\" (UID: \"c8dd78a3-2c43-4378-b223-108bb80f9291\") " pod="opendatahub/test-curl-7724-140701949242656"
Sep 07 17:16:26.540359 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:26.540263    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxml5\" (UniqueName: \"kubernetes.io/projected/c8dd78a3-2c43-4378-b223-108bb80f9291-kube-api-access-jxml5\") pod \"test-curl-7724-140701949242656\" (UID: \"c8dd78a3-2c43-4378-b223-108bb80f9291\") " pod="opendatahub/test-curl-7724-140701949242656"
Sep 07 17:16:26.549224 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:26.549196    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxml5\" (UniqueName: \"kubernetes.io/projected/c8dd78a3-2c43-4378-b223-108bb80f9291-kube-api-access-jxml5\") pod \"test-curl-7724-140701949242656\" (UID: \"c8dd78a3-2c43-4378-b223-108bb80f9291\") " pod="opendatahub/test-curl-7724-140701949242656"
Sep 07 17:16:26.586904 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:26.586879    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7724-140701949242656"
Sep 07 17:16:26.877658 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:16:26.877627    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc8dd78a3_2c43_4378_b223_108bb80f9291.slice/crio-d59f268cf555163c1004d0f57a04304ae1f579f99fbbfdcc49fc811e19787a7e WatchSource:0}: Error finding container d59f268cf555163c1004d0f57a04304ae1f579f99fbbfdcc49fc811e19787a7e: Status 404 returned error can't find the container with id d59f268cf555163c1004d0f57a04304ae1f579f99fbbfdcc49fc811e19787a7e
Sep 07 17:16:26.878484 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:26.878437    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7724-140701949242656"]
Sep 07 17:16:27.818516 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:27.818473    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7724-140701949242656" event={"ID":"c8dd78a3-2c43-4378-b223-108bb80f9291","Type":"ContainerStarted","Data":"d59f268cf555163c1004d0f57a04304ae1f579f99fbbfdcc49fc811e19787a7e"}
Sep 07 17:16:28.825671 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:28.825632    2558 generic.go:356] "Generic (PLEG): container finished" podID="c8dd78a3-2c43-4378-b223-108bb80f9291" containerID="c3e77539527a4f58e0e920adde57e79ed7c394461097384fff97120fdaa3f042" exitCode=0
Sep 07 17:16:28.826109 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:28.825724    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7724-140701949242656" event={"ID":"c8dd78a3-2c43-4378-b223-108bb80f9291","Type":"ContainerDied","Data":"c3e77539527a4f58e0e920adde57e79ed7c394461097384fff97120fdaa3f042"}
Sep 07 17:16:29.960725 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:29.960699    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7724-140701949242656"
Sep 07 17:16:29.982356 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:29.982326    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7724-140701949242656_c8dd78a3-2c43-4378-b223-108bb80f9291/test-curl-7724-140701949242656/0.log"
Sep 07 17:16:30.007321 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:30.007285    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7724-140701949242656"]
Sep 07 17:16:30.013573 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:30.013537    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7724-140701949242656"]
Sep 07 17:16:30.077535 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:30.077502    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxml5\" (UniqueName: \"kubernetes.io/projected/c8dd78a3-2c43-4378-b223-108bb80f9291-kube-api-access-jxml5\") pod \"c8dd78a3-2c43-4378-b223-108bb80f9291\" (UID: \"c8dd78a3-2c43-4378-b223-108bb80f9291\") "
Sep 07 17:16:30.079624 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:30.079600    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8dd78a3-2c43-4378-b223-108bb80f9291-kube-api-access-jxml5" (OuterVolumeSpecName: "kube-api-access-jxml5") pod "c8dd78a3-2c43-4378-b223-108bb80f9291" (UID: "c8dd78a3-2c43-4378-b223-108bb80f9291"). InnerVolumeSpecName "kube-api-access-jxml5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:16:30.178988 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:30.178955    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxml5\" (UniqueName: \"kubernetes.io/projected/c8dd78a3-2c43-4378-b223-108bb80f9291-kube-api-access-jxml5\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:16:30.840000 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:30.839972    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7724-140701949242656"
Sep 07 17:16:30.840000 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:30.839988    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d59f268cf555163c1004d0f57a04304ae1f579f99fbbfdcc49fc811e19787a7e"
Sep 07 17:16:30.852525 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:16:30.852498    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7724-140701949242656\" is forbidden: User \"system:node:ip-10-0-131-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-84.ec2.internal' and this object" podUID="c8dd78a3-2c43-4378-b223-108bb80f9291" pod="opendatahub/test-curl-7724-140701949242656"
Sep 07 17:16:31.595218 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:31.595185    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8dd78a3-2c43-4378-b223-108bb80f9291" path="/var/lib/kubelet/pods/c8dd78a3-2c43-4378-b223-108bb80f9291/volumes"
Sep 07 17:16:35.921599 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:35.921555    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647"]
Sep 07 17:16:35.922248 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:35.922212    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8dd78a3-2c43-4378-b223-108bb80f9291" containerName="test-curl-7724-140701949242656"
Sep 07 17:16:35.922292 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:35.922256    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8dd78a3-2c43-4378-b223-108bb80f9291" containerName="test-curl-7724-140701949242656"
Sep 07 17:16:35.922401 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:35.922388    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8dd78a3-2c43-4378-b223-108bb80f9291" containerName="test-curl-7724-140701949242656"
Sep 07 17:16:35.926061 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:35.926042    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647"
Sep 07 17:16:35.929204 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:35.929184    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-4170e7d8-serving-cert\""
Sep 07 17:16:35.937977 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:35.937948    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647"]
Sep 07 17:16:36.028751 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:36.028714    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s46s5\" (UniqueName: \"kubernetes.io/projected/f6a65165-b5b9-469a-9699-2c3c360ddc5f-kube-api-access-s46s5\") pod \"maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647\" (UID: \"f6a65165-b5b9-469a-9699-2c3c360ddc5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647"
Sep 07 17:16:36.028925 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:36.028755    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6a65165-b5b9-469a-9699-2c3c360ddc5f-metrics-certs\") pod \"maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647\" (UID: \"f6a65165-b5b9-469a-9699-2c3c360ddc5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647"
Sep 07 17:16:36.028925 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:36.028833    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6a65165-b5b9-469a-9699-2c3c360ddc5f-maas-api-tls\") pod \"maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647\" (UID: \"f6a65165-b5b9-469a-9699-2c3c360ddc5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647"
Sep 07 17:16:36.028925 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:36.028880    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6a65165-b5b9-469a-9699-2c3c360ddc5f-openshift-service-ca\") pod \"maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647\" (UID: \"f6a65165-b5b9-469a-9699-2c3c360ddc5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647"
Sep 07 17:16:36.129682 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:36.129647    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6a65165-b5b9-469a-9699-2c3c360ddc5f-maas-api-tls\") pod \"maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647\" (UID: \"f6a65165-b5b9-469a-9699-2c3c360ddc5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647"
Sep 07 17:16:36.129909 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:36.129700    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6a65165-b5b9-469a-9699-2c3c360ddc5f-openshift-service-ca\") pod \"maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647\" (UID: \"f6a65165-b5b9-469a-9699-2c3c360ddc5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647"
Sep 07 17:16:36.129909 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:36.129745    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s46s5\" (UniqueName: \"kubernetes.io/projected/f6a65165-b5b9-469a-9699-2c3c360ddc5f-kube-api-access-s46s5\") pod \"maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647\" (UID: \"f6a65165-b5b9-469a-9699-2c3c360ddc5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647"
Sep 07 17:16:36.129909 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:36.129766    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6a65165-b5b9-469a-9699-2c3c360ddc5f-metrics-certs\") pod \"maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647\" (UID: \"f6a65165-b5b9-469a-9699-2c3c360ddc5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647"
Sep 07 17:16:36.129909 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:16:36.129793    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-4170e7d8-serving-cert: secret "maas-api-e2e-mt-4170e7d8-serving-cert" not found
Sep 07 17:16:36.129909 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:16:36.129875    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6a65165-b5b9-469a-9699-2c3c360ddc5f-maas-api-tls podName:f6a65165-b5b9-469a-9699-2c3c360ddc5f nodeName:}" failed. No retries permitted until 2026-09-07 17:16:36.629852238 +0000 UTC m=+1213.661283010 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f6a65165-b5b9-469a-9699-2c3c360ddc5f-maas-api-tls") pod "maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647" (UID: "f6a65165-b5b9-469a-9699-2c3c360ddc5f") : secret "maas-api-e2e-mt-4170e7d8-serving-cert" not found
Sep 07 17:16:36.130423 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:36.130399    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6a65165-b5b9-469a-9699-2c3c360ddc5f-openshift-service-ca\") pod \"maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647\" (UID: \"f6a65165-b5b9-469a-9699-2c3c360ddc5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647"
Sep 07 17:16:36.132142 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:36.132119    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6a65165-b5b9-469a-9699-2c3c360ddc5f-metrics-certs\") pod \"maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647\" (UID: \"f6a65165-b5b9-469a-9699-2c3c360ddc5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647"
Sep 07 17:16:36.146766 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:36.146737    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s46s5\" (UniqueName: \"kubernetes.io/projected/f6a65165-b5b9-469a-9699-2c3c360ddc5f-kube-api-access-s46s5\") pod \"maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647\" (UID: \"f6a65165-b5b9-469a-9699-2c3c360ddc5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647"
Sep 07 17:16:36.633620 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:36.633575    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6a65165-b5b9-469a-9699-2c3c360ddc5f-maas-api-tls\") pod \"maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647\" (UID: \"f6a65165-b5b9-469a-9699-2c3c360ddc5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647"
Sep 07 17:16:36.635958 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:36.635931    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6a65165-b5b9-469a-9699-2c3c360ddc5f-maas-api-tls\") pod \"maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647\" (UID: \"f6a65165-b5b9-469a-9699-2c3c360ddc5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647"
Sep 07 17:16:36.784508 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:36.784467    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b-qd4j2"]
Sep 07 17:16:36.788153 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:36.788136    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b-qd4j2"
Sep 07 17:16:36.791005 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:36.790983    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-4170e7d8\""
Sep 07 17:16:36.791210 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:36.791190    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-4170e7d8-dockercfg-wz7q2\""
Sep 07 17:16:36.802387 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:36.802355    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b-qd4j2"]
Sep 07 17:16:36.835071 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:36.835036    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91b89da5-2f5f-470a-8df5-ce583f3564a2-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b-qd4j2\" (UID: \"91b89da5-2f5f-470a-8df5-ce583f3564a2\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b-qd4j2"
Sep 07 17:16:36.835255 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:36.835090    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8cmv\" (UniqueName: \"kubernetes.io/projected/91b89da5-2f5f-470a-8df5-ce583f3564a2-kube-api-access-r8cmv\") pod \"payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b-qd4j2\" (UID: \"91b89da5-2f5f-470a-8df5-ce583f3564a2\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b-qd4j2"
Sep 07 17:16:36.838428 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:36.838399    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647"
Sep 07 17:16:36.935905 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:36.935868    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8cmv\" (UniqueName: \"kubernetes.io/projected/91b89da5-2f5f-470a-8df5-ce583f3564a2-kube-api-access-r8cmv\") pod \"payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b-qd4j2\" (UID: \"91b89da5-2f5f-470a-8df5-ce583f3564a2\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b-qd4j2"
Sep 07 17:16:36.936373 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:36.936036    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91b89da5-2f5f-470a-8df5-ce583f3564a2-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b-qd4j2\" (UID: \"91b89da5-2f5f-470a-8df5-ce583f3564a2\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b-qd4j2"
Sep 07 17:16:36.936933 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:36.936907    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91b89da5-2f5f-470a-8df5-ce583f3564a2-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b-qd4j2\" (UID: \"91b89da5-2f5f-470a-8df5-ce583f3564a2\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b-qd4j2"
Sep 07 17:16:36.945225 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:36.945203    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8cmv\" (UniqueName: \"kubernetes.io/projected/91b89da5-2f5f-470a-8df5-ce583f3564a2-kube-api-access-r8cmv\") pod \"payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b-qd4j2\" (UID: \"91b89da5-2f5f-470a-8df5-ce583f3564a2\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b-qd4j2"
Sep 07 17:16:37.099941 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:37.099906    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b-qd4j2"
Sep 07 17:16:37.125914 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:37.125879    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647"]
Sep 07 17:16:37.126552 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:16:37.126529    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6a65165_b5b9_469a_9699_2c3c360ddc5f.slice/crio-254cf04188c60d9407d53c23a347b1a1f61dbece6698070077ed925228004ef9 WatchSource:0}: Error finding container 254cf04188c60d9407d53c23a347b1a1f61dbece6698070077ed925228004ef9: Status 404 returned error can't find the container with id 254cf04188c60d9407d53c23a347b1a1f61dbece6698070077ed925228004ef9
Sep 07 17:16:37.378667 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:37.378636    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b-qd4j2"]
Sep 07 17:16:37.379945 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:16:37.379922    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91b89da5_2f5f_470a_8df5_ce583f3564a2.slice/crio-f21e0a1c9689235e7d49f03870b1b4d2e2335ead9c8b7659ccf8c624382d2ac8 WatchSource:0}: Error finding container f21e0a1c9689235e7d49f03870b1b4d2e2335ead9c8b7659ccf8c624382d2ac8: Status 404 returned error can't find the container with id f21e0a1c9689235e7d49f03870b1b4d2e2335ead9c8b7659ccf8c624382d2ac8
Sep 07 17:16:37.883673 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:37.883638    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647" event={"ID":"f6a65165-b5b9-469a-9699-2c3c360ddc5f","Type":"ContainerStarted","Data":"3c8601dfa5fc919561cc1db5f95891a924cac31364e01a52f6a9b7c275ae4b3b"}
Sep 07 17:16:37.883869 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:37.883699    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647" event={"ID":"f6a65165-b5b9-469a-9699-2c3c360ddc5f","Type":"ContainerStarted","Data":"254cf04188c60d9407d53c23a347b1a1f61dbece6698070077ed925228004ef9"}
Sep 07 17:16:37.883869 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:37.883847    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647"
Sep 07 17:16:37.885690 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:37.885646    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b-qd4j2" event={"ID":"91b89da5-2f5f-470a-8df5-ce583f3564a2","Type":"ContainerStarted","Data":"0cacad0f5eb9f870acebf657e50aa93053ff4b2a9fb8d5b451bdbb481bbd50e0"}
Sep 07 17:16:37.885840 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:37.885698    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b-qd4j2" event={"ID":"91b89da5-2f5f-470a-8df5-ce583f3564a2","Type":"ContainerStarted","Data":"f21e0a1c9689235e7d49f03870b1b4d2e2335ead9c8b7659ccf8c624382d2ac8"}
Sep 07 17:16:37.885840 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:37.885772    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b-qd4j2"
Sep 07 17:16:37.906844 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:37.906793    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647" podStartSLOduration=2.375881257 podStartE2EDuration="2.906778859s" totalImagesPullingTime="530.897602ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:16:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:16:37.903221972 +0000 UTC m=+1214.934652763" watchObservedRunningTime="2026-09-07 17:16:37.906778859 +0000 UTC m=+1214.938209650"
Sep 07 17:16:37.927977 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:37.927886    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b-qd4j2" podStartSLOduration=1.927871465 podStartE2EDuration="1.927871465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:16:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:16:37.926202924 +0000 UTC m=+1214.957633716" watchObservedRunningTime="2026-09-07 17:16:37.927871465 +0000 UTC m=+1214.959302255"
Sep 07 17:16:43.901369 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:43.901338    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647"
Sep 07 17:16:48.892912 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:16:48.892880    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b-qd4j2"
Sep 07 17:17:05.607640 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:05.607600    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-4170e7d8/e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9"]
Sep 07 17:17:05.611487 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:05.611464    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4170e7d8/e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9"
Sep 07 17:17:05.615778 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:05.615749    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-4170e7d8\"/\"openshift-service-ca.crt\""
Sep 07 17:17:05.615933 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:05.615809    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-4170e7d8\"/\"kube-root-ca.crt\""
Sep 07 17:17:05.615933 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:05.615887    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-4170e7d8\"/\"default-dockercfg-ln5hc\""
Sep 07 17:17:05.616064 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:05.616041    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-4170e7d8\"/\"e2e-lifecycle-model-4170e7d8-kserve-self-signed-certs\""
Sep 07 17:17:05.623211 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:05.623189    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-4170e7d8/e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9"]
Sep 07 17:17:05.716468 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:05.716434    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d4d9600-8277-4474-b37b-55ced717ea94-home\") pod \"e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9\" (UID: \"9d4d9600-8277-4474-b37b-55ced717ea94\") " pod="ai-tenant-e2e-mt-4170e7d8/e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9"
Sep 07 17:17:05.716659 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:05.716633    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d4d9600-8277-4474-b37b-55ced717ea94-dshm\") pod \"e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9\" (UID: \"9d4d9600-8277-4474-b37b-55ced717ea94\") " pod="ai-tenant-e2e-mt-4170e7d8/e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9"
Sep 07 17:17:05.716779 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:05.716759    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5v92\" (UniqueName: \"kubernetes.io/projected/9d4d9600-8277-4474-b37b-55ced717ea94-kube-api-access-j5v92\") pod \"e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9\" (UID: \"9d4d9600-8277-4474-b37b-55ced717ea94\") " pod="ai-tenant-e2e-mt-4170e7d8/e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9"
Sep 07 17:17:05.716850 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:05.716796    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d4d9600-8277-4474-b37b-55ced717ea94-tmp-dir\") pod \"e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9\" (UID: \"9d4d9600-8277-4474-b37b-55ced717ea94\") " pod="ai-tenant-e2e-mt-4170e7d8/e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9"
Sep 07 17:17:05.716903 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:05.716886    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d4d9600-8277-4474-b37b-55ced717ea94-tls-certs\") pod \"e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9\" (UID: \"9d4d9600-8277-4474-b37b-55ced717ea94\") " pod="ai-tenant-e2e-mt-4170e7d8/e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9"
Sep 07 17:17:05.716950 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:05.716914    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d4d9600-8277-4474-b37b-55ced717ea94-model-cache\") pod \"e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9\" (UID: \"9d4d9600-8277-4474-b37b-55ced717ea94\") " pod="ai-tenant-e2e-mt-4170e7d8/e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9"
Sep 07 17:17:05.818082 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:05.818048    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d4d9600-8277-4474-b37b-55ced717ea94-home\") pod \"e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9\" (UID: \"9d4d9600-8277-4474-b37b-55ced717ea94\") " pod="ai-tenant-e2e-mt-4170e7d8/e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9"
Sep 07 17:17:05.818297 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:05.818115    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d4d9600-8277-4474-b37b-55ced717ea94-dshm\") pod \"e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9\" (UID: \"9d4d9600-8277-4474-b37b-55ced717ea94\") " pod="ai-tenant-e2e-mt-4170e7d8/e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9"
Sep 07 17:17:05.818297 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:05.818151    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5v92\" (UniqueName: \"kubernetes.io/projected/9d4d9600-8277-4474-b37b-55ced717ea94-kube-api-access-j5v92\") pod \"e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9\" (UID: \"9d4d9600-8277-4474-b37b-55ced717ea94\") " pod="ai-tenant-e2e-mt-4170e7d8/e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9"
Sep 07 17:17:05.818297 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:05.818177    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d4d9600-8277-4474-b37b-55ced717ea94-tmp-dir\") pod \"e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9\" (UID: \"9d4d9600-8277-4474-b37b-55ced717ea94\") " pod="ai-tenant-e2e-mt-4170e7d8/e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9"
Sep 07 17:17:05.818487 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:05.818305    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d4d9600-8277-4474-b37b-55ced717ea94-tls-certs\") pod \"e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9\" (UID: \"9d4d9600-8277-4474-b37b-55ced717ea94\") " pod="ai-tenant-e2e-mt-4170e7d8/e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9"
Sep 07 17:17:05.818487 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:05.818363    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d4d9600-8277-4474-b37b-55ced717ea94-model-cache\") pod \"e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9\" (UID: \"9d4d9600-8277-4474-b37b-55ced717ea94\") " pod="ai-tenant-e2e-mt-4170e7d8/e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9"
Sep 07 17:17:05.818593 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:05.818512    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d4d9600-8277-4474-b37b-55ced717ea94-home\") pod \"e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9\" (UID: \"9d4d9600-8277-4474-b37b-55ced717ea94\") " pod="ai-tenant-e2e-mt-4170e7d8/e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9"
Sep 07 17:17:05.818640 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:05.818618    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d4d9600-8277-4474-b37b-55ced717ea94-tmp-dir\") pod \"e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9\" (UID: \"9d4d9600-8277-4474-b37b-55ced717ea94\") " pod="ai-tenant-e2e-mt-4170e7d8/e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9"
Sep 07 17:17:05.818754 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:05.818734    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d4d9600-8277-4474-b37b-55ced717ea94-model-cache\") pod \"e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9\" (UID: \"9d4d9600-8277-4474-b37b-55ced717ea94\") " pod="ai-tenant-e2e-mt-4170e7d8/e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9"
Sep 07 17:17:05.820424 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:05.820391    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d4d9600-8277-4474-b37b-55ced717ea94-dshm\") pod \"e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9\" (UID: \"9d4d9600-8277-4474-b37b-55ced717ea94\") " pod="ai-tenant-e2e-mt-4170e7d8/e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9"
Sep 07 17:17:05.820714 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:05.820697    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d4d9600-8277-4474-b37b-55ced717ea94-tls-certs\") pod \"e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9\" (UID: \"9d4d9600-8277-4474-b37b-55ced717ea94\") " pod="ai-tenant-e2e-mt-4170e7d8/e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9"
Sep 07 17:17:05.827733 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:05.827708    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5v92\" (UniqueName: \"kubernetes.io/projected/9d4d9600-8277-4474-b37b-55ced717ea94-kube-api-access-j5v92\") pod \"e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9\" (UID: \"9d4d9600-8277-4474-b37b-55ced717ea94\") " pod="ai-tenant-e2e-mt-4170e7d8/e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9"
Sep 07 17:17:05.922726 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:05.922640    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4170e7d8/e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9"
Sep 07 17:17:06.197719 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:06.197689    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-4170e7d8/e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9"]
Sep 07 17:17:06.198596 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:17:06.198571    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9d4d9600_8277_4474_b37b_55ced717ea94.slice/crio-ea52a3f662dac8999db128f8714f5e4e728913f736ae906b2efd8fadda0d38b1 WatchSource:0}: Error finding container ea52a3f662dac8999db128f8714f5e4e728913f736ae906b2efd8fadda0d38b1: Status 404 returned error can't find the container with id ea52a3f662dac8999db128f8714f5e4e728913f736ae906b2efd8fadda0d38b1
Sep 07 17:17:07.043048 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:07.043001    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4170e7d8/e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9" event={"ID":"9d4d9600-8277-4474-b37b-55ced717ea94","Type":"ContainerStarted","Data":"aba4828fa25ab7534119e77bf99d50888f4219b5f4424203c5be976f03a89c82"}
Sep 07 17:17:07.043048 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:07.043055    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4170e7d8/e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9" event={"ID":"9d4d9600-8277-4474-b37b-55ced717ea94","Type":"ContainerStarted","Data":"ea52a3f662dac8999db128f8714f5e4e728913f736ae906b2efd8fadda0d38b1"}
Sep 07 17:17:07.068136 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:07.068081    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-4170e7d8/e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9" podStartSLOduration=2.06806529 podStartE2EDuration="2.06806529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:17:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:17:07.066179303 +0000 UTC m=+1244.097610095" watchObservedRunningTime="2026-09-07 17:17:07.06806529 +0000 UTC m=+1244.099496089"
Sep 07 17:17:15.923386 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:15.923299    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-4170e7d8/e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9"
Sep 07 17:17:15.923768 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:15.923636    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-4170e7d8/e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9"
Sep 07 17:17:15.936255 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:15.936213    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-4170e7d8/e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9"
Sep 07 17:17:16.103943 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:16.103914    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-4170e7d8/e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9"
Sep 07 17:17:53.852866 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:53.852826    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647"]
Sep 07 17:17:53.853400 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:53.853107    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647" podUID="f6a65165-b5b9-469a-9699-2c3c360ddc5f" containerName="maas-api" containerID="cri-o://3c8601dfa5fc919561cc1db5f95891a924cac31364e01a52f6a9b7c275ae4b3b" gracePeriod=30
Sep 07 17:17:53.891504 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:53.891464    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647" podUID="f6a65165-b5b9-469a-9699-2c3c360ddc5f" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.65:8443/health\": dial tcp 10.132.0.65:8443: connect: connection refused"
Sep 07 17:17:53.937102 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:53.937065    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b-qd4j2"]
Sep 07 17:17:53.938457 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:53.938221    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b-qd4j2" podUID="91b89da5-2f5f-470a-8df5-ce583f3564a2" containerName="payload-pre-processing" containerID="cri-o://0cacad0f5eb9f870acebf657e50aa93053ff4b2a9fb8d5b451bdbb481bbd50e0" gracePeriod=30
Sep 07 17:17:54.201092 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:54.201063    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647"
Sep 07 17:17:54.236113 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:54.236087    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b-qd4j2"
Sep 07 17:17:54.295278 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:54.295216    2558 generic.go:356] "Generic (PLEG): container finished" podID="f6a65165-b5b9-469a-9699-2c3c360ddc5f" containerID="3c8601dfa5fc919561cc1db5f95891a924cac31364e01a52f6a9b7c275ae4b3b" exitCode=0
Sep 07 17:17:54.295278 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:54.295271    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647" event={"ID":"f6a65165-b5b9-469a-9699-2c3c360ddc5f","Type":"ContainerDied","Data":"3c8601dfa5fc919561cc1db5f95891a924cac31364e01a52f6a9b7c275ae4b3b"}
Sep 07 17:17:54.295514 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:54.295327    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647" event={"ID":"f6a65165-b5b9-469a-9699-2c3c360ddc5f","Type":"ContainerDied","Data":"254cf04188c60d9407d53c23a347b1a1f61dbece6698070077ed925228004ef9"}
Sep 07 17:17:54.295514 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:54.295350    2558 scope.go:117] "RemoveContainer" containerID="3c8601dfa5fc919561cc1db5f95891a924cac31364e01a52f6a9b7c275ae4b3b"
Sep 07 17:17:54.295514 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:54.295284    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647"
Sep 07 17:17:54.296660 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:54.296642    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s46s5\" (UniqueName: \"kubernetes.io/projected/f6a65165-b5b9-469a-9699-2c3c360ddc5f-kube-api-access-s46s5\") pod \"f6a65165-b5b9-469a-9699-2c3c360ddc5f\" (UID: \"f6a65165-b5b9-469a-9699-2c3c360ddc5f\") "
Sep 07 17:17:54.296761 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:54.296684    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6a65165-b5b9-469a-9699-2c3c360ddc5f-openshift-service-ca\") pod \"f6a65165-b5b9-469a-9699-2c3c360ddc5f\" (UID: \"f6a65165-b5b9-469a-9699-2c3c360ddc5f\") "
Sep 07 17:17:54.296847 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:54.296783    2558 generic.go:356] "Generic (PLEG): container finished" podID="91b89da5-2f5f-470a-8df5-ce583f3564a2" containerID="0cacad0f5eb9f870acebf657e50aa93053ff4b2a9fb8d5b451bdbb481bbd50e0" exitCode=0
Sep 07 17:17:54.296847 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:54.296808    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8cmv\" (UniqueName: \"kubernetes.io/projected/91b89da5-2f5f-470a-8df5-ce583f3564a2-kube-api-access-r8cmv\") pod \"91b89da5-2f5f-470a-8df5-ce583f3564a2\" (UID: \"91b89da5-2f5f-470a-8df5-ce583f3564a2\") "
Sep 07 17:17:54.296847 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:54.296834    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b-qd4j2" event={"ID":"91b89da5-2f5f-470a-8df5-ce583f3564a2","Type":"ContainerDied","Data":"0cacad0f5eb9f870acebf657e50aa93053ff4b2a9fb8d5b451bdbb481bbd50e0"}
Sep 07 17:17:54.297014 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:54.296878    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91b89da5-2f5f-470a-8df5-ce583f3564a2-plugins-config-volume\") pod \"91b89da5-2f5f-470a-8df5-ce583f3564a2\" (UID: \"91b89da5-2f5f-470a-8df5-ce583f3564a2\") "
Sep 07 17:17:54.297014 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:54.296838    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b-qd4j2"
Sep 07 17:17:54.297014 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:54.296935    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6a65165-b5b9-469a-9699-2c3c360ddc5f-metrics-certs\") pod \"f6a65165-b5b9-469a-9699-2c3c360ddc5f\" (UID: \"f6a65165-b5b9-469a-9699-2c3c360ddc5f\") "
Sep 07 17:17:54.297014 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:54.296948    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b-qd4j2" event={"ID":"91b89da5-2f5f-470a-8df5-ce583f3564a2","Type":"ContainerDied","Data":"f21e0a1c9689235e7d49f03870b1b4d2e2335ead9c8b7659ccf8c624382d2ac8"}
Sep 07 17:17:54.297224 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:54.297021    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6a65165-b5b9-469a-9699-2c3c360ddc5f-maas-api-tls\") pod \"f6a65165-b5b9-469a-9699-2c3c360ddc5f\" (UID: \"f6a65165-b5b9-469a-9699-2c3c360ddc5f\") "
Sep 07 17:17:54.297224 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:54.297032    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6a65165-b5b9-469a-9699-2c3c360ddc5f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f6a65165-b5b9-469a-9699-2c3c360ddc5f" (UID: "f6a65165-b5b9-469a-9699-2c3c360ddc5f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:17:54.297388 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:54.297306    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91b89da5-2f5f-470a-8df5-ce583f3564a2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "91b89da5-2f5f-470a-8df5-ce583f3564a2" (UID: "91b89da5-2f5f-470a-8df5-ce583f3564a2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:17:54.297456 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:54.297411    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91b89da5-2f5f-470a-8df5-ce583f3564a2-plugins-config-volume\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:17:54.297456 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:54.297436    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6a65165-b5b9-469a-9699-2c3c360ddc5f-openshift-service-ca\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:17:54.299057 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:54.298980    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6a65165-b5b9-469a-9699-2c3c360ddc5f-kube-api-access-s46s5" (OuterVolumeSpecName: "kube-api-access-s46s5") pod "f6a65165-b5b9-469a-9699-2c3c360ddc5f" (UID: "f6a65165-b5b9-469a-9699-2c3c360ddc5f"). InnerVolumeSpecName "kube-api-access-s46s5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:17:54.299193 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:54.299173    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6a65165-b5b9-469a-9699-2c3c360ddc5f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f6a65165-b5b9-469a-9699-2c3c360ddc5f" (UID: "f6a65165-b5b9-469a-9699-2c3c360ddc5f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:17:54.299456 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:54.299436    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6a65165-b5b9-469a-9699-2c3c360ddc5f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f6a65165-b5b9-469a-9699-2c3c360ddc5f" (UID: "f6a65165-b5b9-469a-9699-2c3c360ddc5f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:17:54.299546 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:54.299453    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91b89da5-2f5f-470a-8df5-ce583f3564a2-kube-api-access-r8cmv" (OuterVolumeSpecName: "kube-api-access-r8cmv") pod "91b89da5-2f5f-470a-8df5-ce583f3564a2" (UID: "91b89da5-2f5f-470a-8df5-ce583f3564a2"). InnerVolumeSpecName "kube-api-access-r8cmv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:17:54.305097 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:54.305080    2558 scope.go:117] "RemoveContainer" containerID="3c8601dfa5fc919561cc1db5f95891a924cac31364e01a52f6a9b7c275ae4b3b"
Sep 07 17:17:54.305379 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:17:54.305362    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c8601dfa5fc919561cc1db5f95891a924cac31364e01a52f6a9b7c275ae4b3b\": container with ID starting with 3c8601dfa5fc919561cc1db5f95891a924cac31364e01a52f6a9b7c275ae4b3b not found: ID does not exist" containerID="3c8601dfa5fc919561cc1db5f95891a924cac31364e01a52f6a9b7c275ae4b3b"
Sep 07 17:17:54.305436 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:54.305388    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c8601dfa5fc919561cc1db5f95891a924cac31364e01a52f6a9b7c275ae4b3b"} err="failed to get container status \"3c8601dfa5fc919561cc1db5f95891a924cac31364e01a52f6a9b7c275ae4b3b\": rpc error: code = NotFound desc = could not find container \"3c8601dfa5fc919561cc1db5f95891a924cac31364e01a52f6a9b7c275ae4b3b\": container with ID starting with 3c8601dfa5fc919561cc1db5f95891a924cac31364e01a52f6a9b7c275ae4b3b not found: ID does not exist"
Sep 07 17:17:54.305436 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:54.305405    2558 scope.go:117] "RemoveContainer" containerID="0cacad0f5eb9f870acebf657e50aa93053ff4b2a9fb8d5b451bdbb481bbd50e0"
Sep 07 17:17:54.313266 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:54.313223    2558 scope.go:117] "RemoveContainer" containerID="0cacad0f5eb9f870acebf657e50aa93053ff4b2a9fb8d5b451bdbb481bbd50e0"
Sep 07 17:17:54.313522 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:17:54.313502    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cacad0f5eb9f870acebf657e50aa93053ff4b2a9fb8d5b451bdbb481bbd50e0\": container with ID starting with 0cacad0f5eb9f870acebf657e50aa93053ff4b2a9fb8d5b451bdbb481bbd50e0 not found: ID does not exist" containerID="0cacad0f5eb9f870acebf657e50aa93053ff4b2a9fb8d5b451bdbb481bbd50e0"
Sep 07 17:17:54.313572 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:54.313529    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cacad0f5eb9f870acebf657e50aa93053ff4b2a9fb8d5b451bdbb481bbd50e0"} err="failed to get container status \"0cacad0f5eb9f870acebf657e50aa93053ff4b2a9fb8d5b451bdbb481bbd50e0\": rpc error: code = NotFound desc = could not find container \"0cacad0f5eb9f870acebf657e50aa93053ff4b2a9fb8d5b451bdbb481bbd50e0\": container with ID starting with 0cacad0f5eb9f870acebf657e50aa93053ff4b2a9fb8d5b451bdbb481bbd50e0 not found: ID does not exist"
Sep 07 17:17:54.398726 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:54.398631    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6a65165-b5b9-469a-9699-2c3c360ddc5f-maas-api-tls\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:17:54.398726 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:54.398664    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s46s5\" (UniqueName: \"kubernetes.io/projected/f6a65165-b5b9-469a-9699-2c3c360ddc5f-kube-api-access-s46s5\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:17:54.398726 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:54.398676    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8cmv\" (UniqueName: \"kubernetes.io/projected/91b89da5-2f5f-470a-8df5-ce583f3564a2-kube-api-access-r8cmv\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:17:54.398726 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:54.398685    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6a65165-b5b9-469a-9699-2c3c360ddc5f-metrics-certs\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:17:54.633875 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:54.633844    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647"]
Sep 07 17:17:54.640603 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:54.640578    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4170e7d8-7f4f549dd7-5c647"]
Sep 07 17:17:54.651711 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:54.651648    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b-qd4j2"]
Sep 07 17:17:54.658875 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:54.658854    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b-qd4j2"]
Sep 07 17:17:55.595177 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:55.595133    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91b89da5-2f5f-470a-8df5-ce583f3564a2" path="/var/lib/kubelet/pods/91b89da5-2f5f-470a-8df5-ce583f3564a2/volumes"
Sep 07 17:17:55.595779 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:17:55.595756    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6a65165-b5b9-469a-9699-2c3c360ddc5f" path="/var/lib/kubelet/pods/f6a65165-b5b9-469a-9699-2c3c360ddc5f/volumes"
Sep 07 17:18:02.109412 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:18:02.109373    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-4170e7d8/e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9"]
Sep 07 17:18:17.129927 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:18:17.129865    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-4170e7d8/e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9" podUID="9d4d9600-8277-4474-b37b-55ced717ea94" containerName="main" containerID="cri-o://aba4828fa25ab7534119e77bf99d50888f4219b5f4424203c5be976f03a89c82" gracePeriod=45
Sep 07 17:18:17.388385 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:18:17.388324    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4170e7d8/e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9"
Sep 07 17:18:17.423041 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:18:17.423002    2558 generic.go:356] "Generic (PLEG): container finished" podID="9d4d9600-8277-4474-b37b-55ced717ea94" containerID="aba4828fa25ab7534119e77bf99d50888f4219b5f4424203c5be976f03a89c82" exitCode=0
Sep 07 17:18:17.423207 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:18:17.423041    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4170e7d8/e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9"
Sep 07 17:18:17.423207 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:18:17.423049    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4170e7d8/e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9" event={"ID":"9d4d9600-8277-4474-b37b-55ced717ea94","Type":"ContainerDied","Data":"aba4828fa25ab7534119e77bf99d50888f4219b5f4424203c5be976f03a89c82"}
Sep 07 17:18:17.423207 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:18:17.423099    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4170e7d8/e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9" event={"ID":"9d4d9600-8277-4474-b37b-55ced717ea94","Type":"ContainerDied","Data":"ea52a3f662dac8999db128f8714f5e4e728913f736ae906b2efd8fadda0d38b1"}
Sep 07 17:18:17.423207 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:18:17.423123    2558 scope.go:117] "RemoveContainer" containerID="aba4828fa25ab7534119e77bf99d50888f4219b5f4424203c5be976f03a89c82"
Sep 07 17:18:17.437117 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:18:17.437095    2558 scope.go:117] "RemoveContainer" containerID="aba4828fa25ab7534119e77bf99d50888f4219b5f4424203c5be976f03a89c82"
Sep 07 17:18:17.437488 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:18:17.437459    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aba4828fa25ab7534119e77bf99d50888f4219b5f4424203c5be976f03a89c82\": container with ID starting with aba4828fa25ab7534119e77bf99d50888f4219b5f4424203c5be976f03a89c82 not found: ID does not exist" containerID="aba4828fa25ab7534119e77bf99d50888f4219b5f4424203c5be976f03a89c82"
Sep 07 17:18:17.437601 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:18:17.437496    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aba4828fa25ab7534119e77bf99d50888f4219b5f4424203c5be976f03a89c82"} err="failed to get container status \"aba4828fa25ab7534119e77bf99d50888f4219b5f4424203c5be976f03a89c82\": rpc error: code = NotFound desc = could not find container \"aba4828fa25ab7534119e77bf99d50888f4219b5f4424203c5be976f03a89c82\": container with ID starting with aba4828fa25ab7534119e77bf99d50888f4219b5f4424203c5be976f03a89c82 not found: ID does not exist"
Sep 07 17:18:17.523022 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:18:17.522987    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d4d9600-8277-4474-b37b-55ced717ea94-home\") pod \"9d4d9600-8277-4474-b37b-55ced717ea94\" (UID: \"9d4d9600-8277-4474-b37b-55ced717ea94\") "
Sep 07 17:18:17.523219 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:18:17.523052    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d4d9600-8277-4474-b37b-55ced717ea94-tls-certs\") pod \"9d4d9600-8277-4474-b37b-55ced717ea94\" (UID: \"9d4d9600-8277-4474-b37b-55ced717ea94\") "
Sep 07 17:18:17.523219 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:18:17.523073    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5v92\" (UniqueName: \"kubernetes.io/projected/9d4d9600-8277-4474-b37b-55ced717ea94-kube-api-access-j5v92\") pod \"9d4d9600-8277-4474-b37b-55ced717ea94\" (UID: \"9d4d9600-8277-4474-b37b-55ced717ea94\") "
Sep 07 17:18:17.523219 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:18:17.523112    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d4d9600-8277-4474-b37b-55ced717ea94-tmp-dir\") pod \"9d4d9600-8277-4474-b37b-55ced717ea94\" (UID: \"9d4d9600-8277-4474-b37b-55ced717ea94\") "
Sep 07 17:18:17.523219 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:18:17.523184    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d4d9600-8277-4474-b37b-55ced717ea94-dshm\") pod \"9d4d9600-8277-4474-b37b-55ced717ea94\" (UID: \"9d4d9600-8277-4474-b37b-55ced717ea94\") "
Sep 07 17:18:17.523487 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:18:17.523226    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d4d9600-8277-4474-b37b-55ced717ea94-model-cache\") pod \"9d4d9600-8277-4474-b37b-55ced717ea94\" (UID: \"9d4d9600-8277-4474-b37b-55ced717ea94\") "
Sep 07 17:18:17.523487 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:18:17.523328    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d4d9600-8277-4474-b37b-55ced717ea94-home" (OuterVolumeSpecName: "home") pod "9d4d9600-8277-4474-b37b-55ced717ea94" (UID: "9d4d9600-8277-4474-b37b-55ced717ea94"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:18:17.523487 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:18:17.523425    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d4d9600-8277-4474-b37b-55ced717ea94-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9d4d9600-8277-4474-b37b-55ced717ea94" (UID: "9d4d9600-8277-4474-b37b-55ced717ea94"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:18:17.523609 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:18:17.523545    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d4d9600-8277-4474-b37b-55ced717ea94-model-cache" (OuterVolumeSpecName: "model-cache") pod "9d4d9600-8277-4474-b37b-55ced717ea94" (UID: "9d4d9600-8277-4474-b37b-55ced717ea94"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:18:17.523673 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:18:17.523654    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d4d9600-8277-4474-b37b-55ced717ea94-model-cache\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:18:17.523673 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:18:17.523667    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d4d9600-8277-4474-b37b-55ced717ea94-home\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:18:17.523755 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:18:17.523676    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d4d9600-8277-4474-b37b-55ced717ea94-tmp-dir\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:18:17.525403 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:18:17.525376    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d4d9600-8277-4474-b37b-55ced717ea94-kube-api-access-j5v92" (OuterVolumeSpecName: "kube-api-access-j5v92") pod "9d4d9600-8277-4474-b37b-55ced717ea94" (UID: "9d4d9600-8277-4474-b37b-55ced717ea94"). InnerVolumeSpecName "kube-api-access-j5v92". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:18:17.525403 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:18:17.525389    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d4d9600-8277-4474-b37b-55ced717ea94-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9d4d9600-8277-4474-b37b-55ced717ea94" (UID: "9d4d9600-8277-4474-b37b-55ced717ea94"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:18:17.525571 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:18:17.525402    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d4d9600-8277-4474-b37b-55ced717ea94-dshm" (OuterVolumeSpecName: "dshm") pod "9d4d9600-8277-4474-b37b-55ced717ea94" (UID: "9d4d9600-8277-4474-b37b-55ced717ea94"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:18:17.624858 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:18:17.624828    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d4d9600-8277-4474-b37b-55ced717ea94-dshm\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:18:17.624858 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:18:17.624855    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d4d9600-8277-4474-b37b-55ced717ea94-tls-certs\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:18:17.625040 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:18:17.624865    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5v92\" (UniqueName: \"kubernetes.io/projected/9d4d9600-8277-4474-b37b-55ced717ea94-kube-api-access-j5v92\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:18:17.743045 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:18:17.742957    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-4170e7d8/e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9"]
Sep 07 17:18:17.748246 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:18:17.748205    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-4170e7d8/e2e-lifecycle-model-4170e7d8-kserve-55c6667bcf-h4ln9"]
Sep 07 17:18:19.594885 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:18:19.594849    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d4d9600-8277-4474-b37b-55ced717ea94" path="/var/lib/kubelet/pods/9d4d9600-8277-4474-b37b-55ced717ea94/volumes"
Sep 07 17:19:57.096919 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:57.096878    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-1795dd/rate-test-model-1795dd-kserve-7bdb74587f-t7xw9"]
Sep 07 17:19:57.097562 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:57.097540    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6a65165-b5b9-469a-9699-2c3c360ddc5f" containerName="maas-api"
Sep 07 17:19:57.097647 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:57.097567    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6a65165-b5b9-469a-9699-2c3c360ddc5f" containerName="maas-api"
Sep 07 17:19:57.097647 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:57.097588    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91b89da5-2f5f-470a-8df5-ce583f3564a2" containerName="payload-pre-processing"
Sep 07 17:19:57.097647 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:57.097598    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="91b89da5-2f5f-470a-8df5-ce583f3564a2" containerName="payload-pre-processing"
Sep 07 17:19:57.097647 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:57.097612    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d4d9600-8277-4474-b37b-55ced717ea94" containerName="main"
Sep 07 17:19:57.097647 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:57.097621    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d4d9600-8277-4474-b37b-55ced717ea94" containerName="main"
Sep 07 17:19:57.097894 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:57.097742    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6a65165-b5b9-469a-9699-2c3c360ddc5f" containerName="maas-api"
Sep 07 17:19:57.097894 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:57.097756    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d4d9600-8277-4474-b37b-55ced717ea94" containerName="main"
Sep 07 17:19:57.097894 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:57.097771    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="91b89da5-2f5f-470a-8df5-ce583f3564a2" containerName="payload-pre-processing"
Sep 07 17:19:57.100907 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:57.100885    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-1795dd/rate-test-model-1795dd-kserve-7bdb74587f-t7xw9"
Sep 07 17:19:57.104899 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:57.104697    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-1795dd\"/\"kube-root-ca.crt\""
Sep 07 17:19:57.104899 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:57.104708    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-1795dd\"/\"rate-test-model-1795dd-kserve-self-signed-certs\""
Sep 07 17:19:57.105082 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:57.104962    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-1795dd\"/\"default-dockercfg-9jlnk\""
Sep 07 17:19:57.105082 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:57.104995    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-1795dd\"/\"openshift-service-ca.crt\""
Sep 07 17:19:57.108330 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:57.108198    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1795dd/rate-test-model-1795dd-kserve-7bdb74587f-t7xw9"]
Sep 07 17:19:57.175852 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:57.175762    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76sln\" (UniqueName: \"kubernetes.io/projected/f4030afc-9ad4-47dd-b06d-f5abcc50ff06-kube-api-access-76sln\") pod \"rate-test-model-1795dd-kserve-7bdb74587f-t7xw9\" (UID: \"f4030afc-9ad4-47dd-b06d-f5abcc50ff06\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/rate-test-model-1795dd-kserve-7bdb74587f-t7xw9"
Sep 07 17:19:57.175852 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:57.175811    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4030afc-9ad4-47dd-b06d-f5abcc50ff06-tmp-dir\") pod \"rate-test-model-1795dd-kserve-7bdb74587f-t7xw9\" (UID: \"f4030afc-9ad4-47dd-b06d-f5abcc50ff06\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/rate-test-model-1795dd-kserve-7bdb74587f-t7xw9"
Sep 07 17:19:57.176119 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:57.175952    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4030afc-9ad4-47dd-b06d-f5abcc50ff06-dshm\") pod \"rate-test-model-1795dd-kserve-7bdb74587f-t7xw9\" (UID: \"f4030afc-9ad4-47dd-b06d-f5abcc50ff06\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/rate-test-model-1795dd-kserve-7bdb74587f-t7xw9"
Sep 07 17:19:57.176119 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:57.176005    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4030afc-9ad4-47dd-b06d-f5abcc50ff06-tls-certs\") pod \"rate-test-model-1795dd-kserve-7bdb74587f-t7xw9\" (UID: \"f4030afc-9ad4-47dd-b06d-f5abcc50ff06\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/rate-test-model-1795dd-kserve-7bdb74587f-t7xw9"
Sep 07 17:19:57.176119 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:57.176036    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4030afc-9ad4-47dd-b06d-f5abcc50ff06-home\") pod \"rate-test-model-1795dd-kserve-7bdb74587f-t7xw9\" (UID: \"f4030afc-9ad4-47dd-b06d-f5abcc50ff06\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/rate-test-model-1795dd-kserve-7bdb74587f-t7xw9"
Sep 07 17:19:57.176119 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:57.176058    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4030afc-9ad4-47dd-b06d-f5abcc50ff06-model-cache\") pod \"rate-test-model-1795dd-kserve-7bdb74587f-t7xw9\" (UID: \"f4030afc-9ad4-47dd-b06d-f5abcc50ff06\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/rate-test-model-1795dd-kserve-7bdb74587f-t7xw9"
Sep 07 17:19:57.277084 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:57.277050    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4030afc-9ad4-47dd-b06d-f5abcc50ff06-dshm\") pod \"rate-test-model-1795dd-kserve-7bdb74587f-t7xw9\" (UID: \"f4030afc-9ad4-47dd-b06d-f5abcc50ff06\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/rate-test-model-1795dd-kserve-7bdb74587f-t7xw9"
Sep 07 17:19:57.277285 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:57.277094    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4030afc-9ad4-47dd-b06d-f5abcc50ff06-tls-certs\") pod \"rate-test-model-1795dd-kserve-7bdb74587f-t7xw9\" (UID: \"f4030afc-9ad4-47dd-b06d-f5abcc50ff06\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/rate-test-model-1795dd-kserve-7bdb74587f-t7xw9"
Sep 07 17:19:57.277285 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:57.277111    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4030afc-9ad4-47dd-b06d-f5abcc50ff06-home\") pod \"rate-test-model-1795dd-kserve-7bdb74587f-t7xw9\" (UID: \"f4030afc-9ad4-47dd-b06d-f5abcc50ff06\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/rate-test-model-1795dd-kserve-7bdb74587f-t7xw9"
Sep 07 17:19:57.277285 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:57.277126    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4030afc-9ad4-47dd-b06d-f5abcc50ff06-model-cache\") pod \"rate-test-model-1795dd-kserve-7bdb74587f-t7xw9\" (UID: \"f4030afc-9ad4-47dd-b06d-f5abcc50ff06\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/rate-test-model-1795dd-kserve-7bdb74587f-t7xw9"
Sep 07 17:19:57.277285 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:57.277186    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76sln\" (UniqueName: \"kubernetes.io/projected/f4030afc-9ad4-47dd-b06d-f5abcc50ff06-kube-api-access-76sln\") pod \"rate-test-model-1795dd-kserve-7bdb74587f-t7xw9\" (UID: \"f4030afc-9ad4-47dd-b06d-f5abcc50ff06\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/rate-test-model-1795dd-kserve-7bdb74587f-t7xw9"
Sep 07 17:19:57.277285 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:57.277205    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4030afc-9ad4-47dd-b06d-f5abcc50ff06-tmp-dir\") pod \"rate-test-model-1795dd-kserve-7bdb74587f-t7xw9\" (UID: \"f4030afc-9ad4-47dd-b06d-f5abcc50ff06\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/rate-test-model-1795dd-kserve-7bdb74587f-t7xw9"
Sep 07 17:19:57.277677 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:57.277630    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4030afc-9ad4-47dd-b06d-f5abcc50ff06-home\") pod \"rate-test-model-1795dd-kserve-7bdb74587f-t7xw9\" (UID: \"f4030afc-9ad4-47dd-b06d-f5abcc50ff06\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/rate-test-model-1795dd-kserve-7bdb74587f-t7xw9"
Sep 07 17:19:57.277739 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:57.277678    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4030afc-9ad4-47dd-b06d-f5abcc50ff06-model-cache\") pod \"rate-test-model-1795dd-kserve-7bdb74587f-t7xw9\" (UID: \"f4030afc-9ad4-47dd-b06d-f5abcc50ff06\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/rate-test-model-1795dd-kserve-7bdb74587f-t7xw9"
Sep 07 17:19:57.277986 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:57.277964    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4030afc-9ad4-47dd-b06d-f5abcc50ff06-tmp-dir\") pod \"rate-test-model-1795dd-kserve-7bdb74587f-t7xw9\" (UID: \"f4030afc-9ad4-47dd-b06d-f5abcc50ff06\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/rate-test-model-1795dd-kserve-7bdb74587f-t7xw9"
Sep 07 17:19:57.279723 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:57.279701    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4030afc-9ad4-47dd-b06d-f5abcc50ff06-dshm\") pod \"rate-test-model-1795dd-kserve-7bdb74587f-t7xw9\" (UID: \"f4030afc-9ad4-47dd-b06d-f5abcc50ff06\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/rate-test-model-1795dd-kserve-7bdb74587f-t7xw9"
Sep 07 17:19:57.279995 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:57.279972    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4030afc-9ad4-47dd-b06d-f5abcc50ff06-tls-certs\") pod \"rate-test-model-1795dd-kserve-7bdb74587f-t7xw9\" (UID: \"f4030afc-9ad4-47dd-b06d-f5abcc50ff06\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/rate-test-model-1795dd-kserve-7bdb74587f-t7xw9"
Sep 07 17:19:57.285182 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:57.285162    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76sln\" (UniqueName: \"kubernetes.io/projected/f4030afc-9ad4-47dd-b06d-f5abcc50ff06-kube-api-access-76sln\") pod \"rate-test-model-1795dd-kserve-7bdb74587f-t7xw9\" (UID: \"f4030afc-9ad4-47dd-b06d-f5abcc50ff06\") " pod="ai-tenant-e2e-shared-a-w3-1795dd/rate-test-model-1795dd-kserve-7bdb74587f-t7xw9"
Sep 07 17:19:57.411416 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:57.411388    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-1795dd/rate-test-model-1795dd-kserve-7bdb74587f-t7xw9"
Sep 07 17:19:57.687543 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:57.687514    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1795dd/rate-test-model-1795dd-kserve-7bdb74587f-t7xw9"]
Sep 07 17:19:57.688792 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:19:57.688763    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf4030afc_9ad4_47dd_b06d_f5abcc50ff06.slice/crio-ce45ae42a2f0b4f627800d86f584b1ce9a2ada56e9082a3057171f11c3184db5 WatchSource:0}: Error finding container ce45ae42a2f0b4f627800d86f584b1ce9a2ada56e9082a3057171f11c3184db5: Status 404 returned error can't find the container with id ce45ae42a2f0b4f627800d86f584b1ce9a2ada56e9082a3057171f11c3184db5
Sep 07 17:19:57.949290 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:57.949207    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-1795dd/rate-test-model-1795dd-kserve-7bdb74587f-t7xw9" event={"ID":"f4030afc-9ad4-47dd-b06d-f5abcc50ff06","Type":"ContainerStarted","Data":"3ebb784a50301654171e6a9c516b28418d0106c985739f79137669df622f6970"}
Sep 07 17:19:57.949446 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:57.949290    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-1795dd/rate-test-model-1795dd-kserve-7bdb74587f-t7xw9" event={"ID":"f4030afc-9ad4-47dd-b06d-f5abcc50ff06","Type":"ContainerStarted","Data":"ce45ae42a2f0b4f627800d86f584b1ce9a2ada56e9082a3057171f11c3184db5"}
Sep 07 17:19:57.965733 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:57.965681    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-1795dd/rate-test-model-1795dd-kserve-7bdb74587f-t7xw9" podStartSLOduration=0.965665897 podStartE2EDuration="965.665897ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:19:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:19:57.96509378 +0000 UTC m=+1414.996524571" watchObservedRunningTime="2026-09-07 17:19:57.965665897 +0000 UTC m=+1414.997096688"
Sep 07 17:19:59.836647 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:59.836612    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-b36e3a-5fdf7d9759-58866"]
Sep 07 17:19:59.840395 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:59.840375    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-b36e3a-5fdf7d9759-58866"
Sep 07 17:19:59.843177 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:59.843154    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-b36e3a\""
Sep 07 17:19:59.843299 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:59.843230    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-b36e3a-dockercfg-rjl92\""
Sep 07 17:19:59.849700 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:59.849537    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-b36e3a-5fdf7d9759-58866"]
Sep 07 17:19:59.901327 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:59.901288    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g62lz\" (UniqueName: \"kubernetes.io/projected/e1015260-f20e-4d9e-91fd-59f7aef1d9d0-kube-api-access-g62lz\") pod \"payload-processing-e2e-api-a-b36e3a-5fdf7d9759-58866\" (UID: \"e1015260-f20e-4d9e-91fd-59f7aef1d9d0\") " pod="openshift-ingress/payload-processing-e2e-api-a-b36e3a-5fdf7d9759-58866"
Sep 07 17:19:59.901489 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:19:59.901365    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1015260-f20e-4d9e-91fd-59f7aef1d9d0-plugins-config-volume\") pod \"payload-processing-e2e-api-a-b36e3a-5fdf7d9759-58866\" (UID: \"e1015260-f20e-4d9e-91fd-59f7aef1d9d0\") " pod="openshift-ingress/payload-processing-e2e-api-a-b36e3a-5fdf7d9759-58866"
Sep 07 17:20:00.002885 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:00.002844    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1015260-f20e-4d9e-91fd-59f7aef1d9d0-plugins-config-volume\") pod \"payload-processing-e2e-api-a-b36e3a-5fdf7d9759-58866\" (UID: \"e1015260-f20e-4d9e-91fd-59f7aef1d9d0\") " pod="openshift-ingress/payload-processing-e2e-api-a-b36e3a-5fdf7d9759-58866"
Sep 07 17:20:00.003067 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:00.002938    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g62lz\" (UniqueName: \"kubernetes.io/projected/e1015260-f20e-4d9e-91fd-59f7aef1d9d0-kube-api-access-g62lz\") pod \"payload-processing-e2e-api-a-b36e3a-5fdf7d9759-58866\" (UID: \"e1015260-f20e-4d9e-91fd-59f7aef1d9d0\") " pod="openshift-ingress/payload-processing-e2e-api-a-b36e3a-5fdf7d9759-58866"
Sep 07 17:20:00.003671 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:00.003649    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1015260-f20e-4d9e-91fd-59f7aef1d9d0-plugins-config-volume\") pod \"payload-processing-e2e-api-a-b36e3a-5fdf7d9759-58866\" (UID: \"e1015260-f20e-4d9e-91fd-59f7aef1d9d0\") " pod="openshift-ingress/payload-processing-e2e-api-a-b36e3a-5fdf7d9759-58866"
Sep 07 17:20:00.010892 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:00.010873    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g62lz\" (UniqueName: \"kubernetes.io/projected/e1015260-f20e-4d9e-91fd-59f7aef1d9d0-kube-api-access-g62lz\") pod \"payload-processing-e2e-api-a-b36e3a-5fdf7d9759-58866\" (UID: \"e1015260-f20e-4d9e-91fd-59f7aef1d9d0\") " pod="openshift-ingress/payload-processing-e2e-api-a-b36e3a-5fdf7d9759-58866"
Sep 07 17:20:00.155751 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:00.155719    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-b36e3a-5fdf7d9759-58866"
Sep 07 17:20:00.433405 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:00.433376    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-b36e3a-5fdf7d9759-58866"]
Sep 07 17:20:00.435653 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:20:00.435621    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1015260_f20e_4d9e_91fd_59f7aef1d9d0.slice/crio-2a84447c50b53f7d76bdfb4fdd56ee035236f65fa054de5d46e61813576e0925 WatchSource:0}: Error finding container 2a84447c50b53f7d76bdfb4fdd56ee035236f65fa054de5d46e61813576e0925: Status 404 returned error can't find the container with id 2a84447c50b53f7d76bdfb4fdd56ee035236f65fa054de5d46e61813576e0925
Sep 07 17:20:00.969986 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:00.969947    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-b36e3a-5fdf7d9759-58866" event={"ID":"e1015260-f20e-4d9e-91fd-59f7aef1d9d0","Type":"ContainerStarted","Data":"635de04db836fe0ebb0471a4b90b7e9bc00ab3dfcb672e447bb468537e9bcb73"}
Sep 07 17:20:00.970407 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:00.970009    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-b36e3a-5fdf7d9759-58866" event={"ID":"e1015260-f20e-4d9e-91fd-59f7aef1d9d0","Type":"ContainerStarted","Data":"2a84447c50b53f7d76bdfb4fdd56ee035236f65fa054de5d46e61813576e0925"}
Sep 07 17:20:00.970407 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:00.970094    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-b36e3a-5fdf7d9759-58866"
Sep 07 17:20:00.989472 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:00.989414    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-b36e3a-5fdf7d9759-58866" podStartSLOduration=1.989393701 podStartE2EDuration="1.989393701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:19:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:20:00.987757211 +0000 UTC m=+1418.019188005" watchObservedRunningTime="2026-09-07 17:20:00.989393701 +0000 UTC m=+1418.020824496"
Sep 07 17:20:07.411848 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:07.411808    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-1795dd/rate-test-model-1795dd-kserve-7bdb74587f-t7xw9"
Sep 07 17:20:07.412383 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:07.411880    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-1795dd/rate-test-model-1795dd-kserve-7bdb74587f-t7xw9"
Sep 07 17:20:07.424733 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:07.424707    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-1795dd/rate-test-model-1795dd-kserve-7bdb74587f-t7xw9"
Sep 07 17:20:08.022967 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:08.022941    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-1795dd/rate-test-model-1795dd-kserve-7bdb74587f-t7xw9"
Sep 07 17:20:11.984150 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:11.984120    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-b36e3a-5fdf7d9759-58866"
Sep 07 17:20:23.858679 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:23.858648    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"]
Sep 07 17:20:23.862048 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:23.862032    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"
Sep 07 17:20:23.888312 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:23.888280    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-611042-openshift-default-dockercfg-5n56t\""
Sep 07 17:20:23.906128 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:23.906096    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"]
Sep 07 17:20:24.037430 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:24.037394    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe5f1643-2aee-4734-a7ea-67b21bea90c5-workload-socket\") pod \"e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9\" (UID: \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\") " pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"
Sep 07 17:20:24.037600 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:24.037436    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe5f1643-2aee-4734-a7ea-67b21bea90c5-istio-data\") pod \"e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9\" (UID: \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\") " pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"
Sep 07 17:20:24.037600 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:24.037467    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe5f1643-2aee-4734-a7ea-67b21bea90c5-istio-token\") pod \"e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9\" (UID: \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\") " pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"
Sep 07 17:20:24.037600 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:24.037533    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe5f1643-2aee-4734-a7ea-67b21bea90c5-istio-envoy\") pod \"e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9\" (UID: \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\") " pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"
Sep 07 17:20:24.037600 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:24.037592    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe5f1643-2aee-4734-a7ea-67b21bea90c5-istiod-ca-cert\") pod \"e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9\" (UID: \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\") " pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"
Sep 07 17:20:24.037748 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:24.037619    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe5f1643-2aee-4734-a7ea-67b21bea90c5-credential-socket\") pod \"e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9\" (UID: \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\") " pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"
Sep 07 17:20:24.037748 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:24.037665    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe5f1643-2aee-4734-a7ea-67b21bea90c5-istio-podinfo\") pod \"e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9\" (UID: \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\") " pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"
Sep 07 17:20:24.037748 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:24.037701    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe5f1643-2aee-4734-a7ea-67b21bea90c5-workload-certs\") pod \"e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9\" (UID: \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\") " pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"
Sep 07 17:20:24.037748 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:24.037715    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knbhz\" (UniqueName: \"kubernetes.io/projected/fe5f1643-2aee-4734-a7ea-67b21bea90c5-kube-api-access-knbhz\") pod \"e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9\" (UID: \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\") " pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"
Sep 07 17:20:24.138472 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:24.138378    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe5f1643-2aee-4734-a7ea-67b21bea90c5-workload-socket\") pod \"e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9\" (UID: \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\") " pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"
Sep 07 17:20:24.138472 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:24.138419    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe5f1643-2aee-4734-a7ea-67b21bea90c5-istio-data\") pod \"e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9\" (UID: \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\") " pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"
Sep 07 17:20:24.138472 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:24.138441    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe5f1643-2aee-4734-a7ea-67b21bea90c5-istio-token\") pod \"e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9\" (UID: \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\") " pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"
Sep 07 17:20:24.138787 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:24.138559    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe5f1643-2aee-4734-a7ea-67b21bea90c5-istio-envoy\") pod \"e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9\" (UID: \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\") " pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"
Sep 07 17:20:24.138787 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:24.138616    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe5f1643-2aee-4734-a7ea-67b21bea90c5-istiod-ca-cert\") pod \"e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9\" (UID: \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\") " pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"
Sep 07 17:20:24.138787 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:24.138653    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe5f1643-2aee-4734-a7ea-67b21bea90c5-credential-socket\") pod \"e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9\" (UID: \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\") " pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"
Sep 07 17:20:24.138787 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:24.138711    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe5f1643-2aee-4734-a7ea-67b21bea90c5-istio-podinfo\") pod \"e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9\" (UID: \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\") " pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"
Sep 07 17:20:24.138787 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:24.138765    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe5f1643-2aee-4734-a7ea-67b21bea90c5-workload-certs\") pod \"e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9\" (UID: \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\") " pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"
Sep 07 17:20:24.138787 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:24.138787    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knbhz\" (UniqueName: \"kubernetes.io/projected/fe5f1643-2aee-4734-a7ea-67b21bea90c5-kube-api-access-knbhz\") pod \"e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9\" (UID: \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\") " pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"
Sep 07 17:20:24.139150 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:24.138827    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe5f1643-2aee-4734-a7ea-67b21bea90c5-istio-data\") pod \"e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9\" (UID: \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\") " pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"
Sep 07 17:20:24.139150 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:24.139000    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe5f1643-2aee-4734-a7ea-67b21bea90c5-credential-socket\") pod \"e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9\" (UID: \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\") " pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"
Sep 07 17:20:24.139150 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:24.139079    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe5f1643-2aee-4734-a7ea-67b21bea90c5-workload-certs\") pod \"e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9\" (UID: \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\") " pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"
Sep 07 17:20:24.139344 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:24.139182    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe5f1643-2aee-4734-a7ea-67b21bea90c5-workload-socket\") pod \"e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9\" (UID: \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\") " pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"
Sep 07 17:20:24.139441 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:24.139420    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe5f1643-2aee-4734-a7ea-67b21bea90c5-istiod-ca-cert\") pod \"e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9\" (UID: \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\") " pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"
Sep 07 17:20:24.140829 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:24.140803    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe5f1643-2aee-4734-a7ea-67b21bea90c5-istio-envoy\") pod \"e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9\" (UID: \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\") " pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"
Sep 07 17:20:24.141341 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:24.141325    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe5f1643-2aee-4734-a7ea-67b21bea90c5-istio-podinfo\") pod \"e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9\" (UID: \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\") " pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"
Sep 07 17:20:24.147966 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:24.147934    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe5f1643-2aee-4734-a7ea-67b21bea90c5-istio-token\") pod \"e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9\" (UID: \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\") " pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"
Sep 07 17:20:24.148069 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:24.148032    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knbhz\" (UniqueName: \"kubernetes.io/projected/fe5f1643-2aee-4734-a7ea-67b21bea90c5-kube-api-access-knbhz\") pod \"e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9\" (UID: \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\") " pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"
Sep 07 17:20:24.172822 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:24.172749    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"
Sep 07 17:20:24.455609 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:24.455579    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"]
Sep 07 17:20:24.457452 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:20:24.457428    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe5f1643_2aee_4734_a7ea_67b21bea90c5.slice/crio-d6611d0f136354381025e97c0e00f3bc3115b51eb01298071674a475e097f7ac WatchSource:0}: Error finding container d6611d0f136354381025e97c0e00f3bc3115b51eb01298071674a475e097f7ac: Status 404 returned error can't find the container with id d6611d0f136354381025e97c0e00f3bc3115b51eb01298071674a475e097f7ac
Sep 07 17:20:24.460382 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:24.460343    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:20:24.460473 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:24.460444    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:20:24.460516 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:24.460483    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:20:25.108408 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:25.108355    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9" event={"ID":"fe5f1643-2aee-4734-a7ea-67b21bea90c5","Type":"ContainerStarted","Data":"6d4590a33325446c409ba55813922a946d856f3e0936dac0f7732ca5872cfa4c"}
Sep 07 17:20:25.108888 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:25.108482    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9" event={"ID":"fe5f1643-2aee-4734-a7ea-67b21bea90c5","Type":"ContainerStarted","Data":"d6611d0f136354381025e97c0e00f3bc3115b51eb01298071674a475e097f7ac"}
Sep 07 17:20:25.135627 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:25.135569    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9" podStartSLOduration=2.135554065 podStartE2EDuration="2.135554065s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:20:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:20:25.131814576 +0000 UTC m=+1442.163245373" watchObservedRunningTime="2026-09-07 17:20:25.135554065 +0000 UTC m=+1442.166984855"
Sep 07 17:20:25.173122 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:25.173091    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"
Sep 07 17:20:25.178395 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:25.178369    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"
Sep 07 17:20:26.114454 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:26.114420    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"
Sep 07 17:20:26.115568 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:26.115544    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"
Sep 07 17:20:48.235426 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:48.235392    2558 generic.go:356] "Generic (PLEG): container finished" podID="fe5f1643-2aee-4734-a7ea-67b21bea90c5" containerID="6d4590a33325446c409ba55813922a946d856f3e0936dac0f7732ca5872cfa4c" exitCode=0
Sep 07 17:20:48.235843 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:48.235465    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9" event={"ID":"fe5f1643-2aee-4734-a7ea-67b21bea90c5","Type":"ContainerDied","Data":"6d4590a33325446c409ba55813922a946d856f3e0936dac0f7732ca5872cfa4c"}
Sep 07 17:20:48.235913 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:48.235899    2558 scope.go:117] "RemoveContainer" containerID="6d4590a33325446c409ba55813922a946d856f3e0936dac0f7732ca5872cfa4c"
Sep 07 17:20:48.237084 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:48.237055    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:20:48.237195 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:48.237141    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:20:48.237195 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:48.237189    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:20:49.242895 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:49.242862    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9" event={"ID":"fe5f1643-2aee-4734-a7ea-67b21bea90c5","Type":"ContainerStarted","Data":"800e2970724db73fb3579eb624f458c3c61c8362f03c6f20c18b118db3bf5093"}
Sep 07 17:20:50.172973 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:50.172928    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"
Sep 07 17:20:50.173190 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:50.173149    2558 patch_prober.go:28] interesting pod/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Sep 07 17:20:50.173295 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:50.173202    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9" podUID="fe5f1643-2aee-4734-a7ea-67b21bea90c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Sep 07 17:20:51.173735 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:51.173697    2558 patch_prober.go:28] interesting pod/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Sep 07 17:20:51.174125 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:51.173751    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9" podUID="fe5f1643-2aee-4734-a7ea-67b21bea90c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Sep 07 17:20:52.174264 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:52.173613    2558 patch_prober.go:28] interesting pod/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Sep 07 17:20:52.174264 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:52.173676    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9" podUID="fe5f1643-2aee-4734-a7ea-67b21bea90c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Sep 07 17:20:53.173463 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:53.173418    2558 patch_prober.go:28] interesting pod/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Sep 07 17:20:53.173674 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:53.173490    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9" podUID="fe5f1643-2aee-4734-a7ea-67b21bea90c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Sep 07 17:20:54.173733 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:54.173684    2558 patch_prober.go:28] interesting pod/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Sep 07 17:20:54.174142 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:54.173761    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9" podUID="fe5f1643-2aee-4734-a7ea-67b21bea90c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Sep 07 17:20:55.177589 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:55.177559    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"
Sep 07 17:20:55.177974 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:55.177816    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"
Sep 07 17:20:55.178630 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:20:55.178611    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"
Sep 07 17:21:10.575201 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:10.575163    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-b36e3a-5fdf7d9759-58866"]
Sep 07 17:21:10.575692 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:10.575433    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-b36e3a-5fdf7d9759-58866" podUID="e1015260-f20e-4d9e-91fd-59f7aef1d9d0" containerName="payload-processing" containerID="cri-o://635de04db836fe0ebb0471a4b90b7e9bc00ab3dfcb672e447bb468537e9bcb73" gracePeriod=30
Sep 07 17:21:10.856822 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:10.856793    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-b36e3a-5fdf7d9759-58866"
Sep 07 17:21:10.888768 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:10.888737    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g62lz\" (UniqueName: \"kubernetes.io/projected/e1015260-f20e-4d9e-91fd-59f7aef1d9d0-kube-api-access-g62lz\") pod \"e1015260-f20e-4d9e-91fd-59f7aef1d9d0\" (UID: \"e1015260-f20e-4d9e-91fd-59f7aef1d9d0\") "
Sep 07 17:21:10.888933 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:10.888843    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1015260-f20e-4d9e-91fd-59f7aef1d9d0-plugins-config-volume\") pod \"e1015260-f20e-4d9e-91fd-59f7aef1d9d0\" (UID: \"e1015260-f20e-4d9e-91fd-59f7aef1d9d0\") "
Sep 07 17:21:10.889224 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:10.889199    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1015260-f20e-4d9e-91fd-59f7aef1d9d0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e1015260-f20e-4d9e-91fd-59f7aef1d9d0" (UID: "e1015260-f20e-4d9e-91fd-59f7aef1d9d0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:21:10.890828 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:10.890801    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1015260-f20e-4d9e-91fd-59f7aef1d9d0-kube-api-access-g62lz" (OuterVolumeSpecName: "kube-api-access-g62lz") pod "e1015260-f20e-4d9e-91fd-59f7aef1d9d0" (UID: "e1015260-f20e-4d9e-91fd-59f7aef1d9d0"). InnerVolumeSpecName "kube-api-access-g62lz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:21:10.990037 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:10.990004    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1015260-f20e-4d9e-91fd-59f7aef1d9d0-plugins-config-volume\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:21:10.990037 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:10.990033    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g62lz\" (UniqueName: \"kubernetes.io/projected/e1015260-f20e-4d9e-91fd-59f7aef1d9d0-kube-api-access-g62lz\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:21:11.373075 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:11.373039    2558 generic.go:356] "Generic (PLEG): container finished" podID="e1015260-f20e-4d9e-91fd-59f7aef1d9d0" containerID="635de04db836fe0ebb0471a4b90b7e9bc00ab3dfcb672e447bb468537e9bcb73" exitCode=0
Sep 07 17:21:11.373302 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:11.373087    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-b36e3a-5fdf7d9759-58866"
Sep 07 17:21:11.373302 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:11.373130    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-b36e3a-5fdf7d9759-58866" event={"ID":"e1015260-f20e-4d9e-91fd-59f7aef1d9d0","Type":"ContainerDied","Data":"635de04db836fe0ebb0471a4b90b7e9bc00ab3dfcb672e447bb468537e9bcb73"}
Sep 07 17:21:11.373302 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:11.373184    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-b36e3a-5fdf7d9759-58866" event={"ID":"e1015260-f20e-4d9e-91fd-59f7aef1d9d0","Type":"ContainerDied","Data":"2a84447c50b53f7d76bdfb4fdd56ee035236f65fa054de5d46e61813576e0925"}
Sep 07 17:21:11.373302 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:11.373207    2558 scope.go:117] "RemoveContainer" containerID="635de04db836fe0ebb0471a4b90b7e9bc00ab3dfcb672e447bb468537e9bcb73"
Sep 07 17:21:11.382223 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:11.382205    2558 scope.go:117] "RemoveContainer" containerID="635de04db836fe0ebb0471a4b90b7e9bc00ab3dfcb672e447bb468537e9bcb73"
Sep 07 17:21:11.382518 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:21:11.382494    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"635de04db836fe0ebb0471a4b90b7e9bc00ab3dfcb672e447bb468537e9bcb73\": container with ID starting with 635de04db836fe0ebb0471a4b90b7e9bc00ab3dfcb672e447bb468537e9bcb73 not found: ID does not exist" containerID="635de04db836fe0ebb0471a4b90b7e9bc00ab3dfcb672e447bb468537e9bcb73"
Sep 07 17:21:11.382583 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:11.382528    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"635de04db836fe0ebb0471a4b90b7e9bc00ab3dfcb672e447bb468537e9bcb73"} err="failed to get container status \"635de04db836fe0ebb0471a4b90b7e9bc00ab3dfcb672e447bb468537e9bcb73\": rpc error: code = NotFound desc = could not find container \"635de04db836fe0ebb0471a4b90b7e9bc00ab3dfcb672e447bb468537e9bcb73\": container with ID starting with 635de04db836fe0ebb0471a4b90b7e9bc00ab3dfcb672e447bb468537e9bcb73 not found: ID does not exist"
Sep 07 17:21:11.405431 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:11.405410    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-b36e3a-5fdf7d9759-58866"]
Sep 07 17:21:11.409814 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:11.409795    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-b36e3a-5fdf7d9759-58866"]
Sep 07 17:21:11.601888 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:11.601852    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1015260-f20e-4d9e-91fd-59f7aef1d9d0" path="/var/lib/kubelet/pods/e1015260-f20e-4d9e-91fd-59f7aef1d9d0/volumes"
Sep 07 17:21:23.702454 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:23.702423    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-f6srd_24750b4e-c0bc-4c3c-a256-6ca251306d06/console-operator/1.log"
Sep 07 17:21:23.707263 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:23.707217    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-f6srd_24750b4e-c0bc-4c3c-a256-6ca251306d06/console-operator/1.log"
Sep 07 17:21:23.717942 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:23.717921    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwj7s_9b97dbca-7e8f-4e05-9cc4-8f42785f01e7/ovn-acl-logging/0.log"
Sep 07 17:21:23.722873 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:23.722855    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwj7s_9b97dbca-7e8f-4e05-9cc4-8f42785f01e7/ovn-acl-logging/0.log"
Sep 07 17:21:41.300567 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:41.300531    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"]
Sep 07 17:21:41.300995 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:41.300791    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9" podUID="fe5f1643-2aee-4734-a7ea-67b21bea90c5" containerName="istio-proxy" containerID="cri-o://800e2970724db73fb3579eb624f458c3c61c8362f03c6f20c18b118db3bf5093" gracePeriod=30
Sep 07 17:21:46.560202 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:46.560172    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"
Sep 07 17:21:46.578371 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:46.578306    2558 generic.go:356] "Generic (PLEG): container finished" podID="fe5f1643-2aee-4734-a7ea-67b21bea90c5" containerID="800e2970724db73fb3579eb624f458c3c61c8362f03c6f20c18b118db3bf5093" exitCode=0
Sep 07 17:21:46.578371 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:46.578354    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"
Sep 07 17:21:46.578560 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:46.578393    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9" event={"ID":"fe5f1643-2aee-4734-a7ea-67b21bea90c5","Type":"ContainerDied","Data":"800e2970724db73fb3579eb624f458c3c61c8362f03c6f20c18b118db3bf5093"}
Sep 07 17:21:46.578560 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:46.578460    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9" event={"ID":"fe5f1643-2aee-4734-a7ea-67b21bea90c5","Type":"ContainerDied","Data":"d6611d0f136354381025e97c0e00f3bc3115b51eb01298071674a475e097f7ac"}
Sep 07 17:21:46.578560 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:46.578489    2558 scope.go:117] "RemoveContainer" containerID="800e2970724db73fb3579eb624f458c3c61c8362f03c6f20c18b118db3bf5093"
Sep 07 17:21:46.589513 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:46.589491    2558 scope.go:117] "RemoveContainer" containerID="6d4590a33325446c409ba55813922a946d856f3e0936dac0f7732ca5872cfa4c"
Sep 07 17:21:46.598348 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:46.598327    2558 scope.go:117] "RemoveContainer" containerID="800e2970724db73fb3579eb624f458c3c61c8362f03c6f20c18b118db3bf5093"
Sep 07 17:21:46.598626 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:21:46.598608    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"800e2970724db73fb3579eb624f458c3c61c8362f03c6f20c18b118db3bf5093\": container with ID starting with 800e2970724db73fb3579eb624f458c3c61c8362f03c6f20c18b118db3bf5093 not found: ID does not exist" containerID="800e2970724db73fb3579eb624f458c3c61c8362f03c6f20c18b118db3bf5093"
Sep 07 17:21:46.598706 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:46.598634    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"800e2970724db73fb3579eb624f458c3c61c8362f03c6f20c18b118db3bf5093"} err="failed to get container status \"800e2970724db73fb3579eb624f458c3c61c8362f03c6f20c18b118db3bf5093\": rpc error: code = NotFound desc = could not find container \"800e2970724db73fb3579eb624f458c3c61c8362f03c6f20c18b118db3bf5093\": container with ID starting with 800e2970724db73fb3579eb624f458c3c61c8362f03c6f20c18b118db3bf5093 not found: ID does not exist"
Sep 07 17:21:46.598706 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:46.598650    2558 scope.go:117] "RemoveContainer" containerID="6d4590a33325446c409ba55813922a946d856f3e0936dac0f7732ca5872cfa4c"
Sep 07 17:21:46.598932 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:21:46.598916    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d4590a33325446c409ba55813922a946d856f3e0936dac0f7732ca5872cfa4c\": container with ID starting with 6d4590a33325446c409ba55813922a946d856f3e0936dac0f7732ca5872cfa4c not found: ID does not exist" containerID="6d4590a33325446c409ba55813922a946d856f3e0936dac0f7732ca5872cfa4c"
Sep 07 17:21:46.598986 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:46.598936    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d4590a33325446c409ba55813922a946d856f3e0936dac0f7732ca5872cfa4c"} err="failed to get container status \"6d4590a33325446c409ba55813922a946d856f3e0936dac0f7732ca5872cfa4c\": rpc error: code = NotFound desc = could not find container \"6d4590a33325446c409ba55813922a946d856f3e0936dac0f7732ca5872cfa4c\": container with ID starting with 6d4590a33325446c409ba55813922a946d856f3e0936dac0f7732ca5872cfa4c not found: ID does not exist"
Sep 07 17:21:46.641866 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:46.641841    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knbhz\" (UniqueName: \"kubernetes.io/projected/fe5f1643-2aee-4734-a7ea-67b21bea90c5-kube-api-access-knbhz\") pod \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\" (UID: \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\") "
Sep 07 17:21:46.642031 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:46.641873    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe5f1643-2aee-4734-a7ea-67b21bea90c5-istio-token\") pod \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\" (UID: \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\") "
Sep 07 17:21:46.642031 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:46.641893    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe5f1643-2aee-4734-a7ea-67b21bea90c5-istiod-ca-cert\") pod \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\" (UID: \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\") "
Sep 07 17:21:46.642031 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:46.641935    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe5f1643-2aee-4734-a7ea-67b21bea90c5-istio-envoy\") pod \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\" (UID: \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\") "
Sep 07 17:21:46.642200 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:46.642055    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe5f1643-2aee-4734-a7ea-67b21bea90c5-credential-socket\") pod \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\" (UID: \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\") "
Sep 07 17:21:46.642200 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:46.642139    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe5f1643-2aee-4734-a7ea-67b21bea90c5-workload-certs\") pod \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\" (UID: \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\") "
Sep 07 17:21:46.642351 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:46.642216    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe5f1643-2aee-4734-a7ea-67b21bea90c5-workload-socket\") pod \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\" (UID: \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\") "
Sep 07 17:21:46.642351 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:46.642297    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe5f1643-2aee-4734-a7ea-67b21bea90c5-istio-podinfo\") pod \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\" (UID: \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\") "
Sep 07 17:21:46.642459 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:46.642327    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe5f1643-2aee-4734-a7ea-67b21bea90c5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fe5f1643-2aee-4734-a7ea-67b21bea90c5" (UID: "fe5f1643-2aee-4734-a7ea-67b21bea90c5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:21:46.642459 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:46.642341    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe5f1643-2aee-4734-a7ea-67b21bea90c5-istio-data\") pod \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\" (UID: \"fe5f1643-2aee-4734-a7ea-67b21bea90c5\") "
Sep 07 17:21:46.642459 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:46.642417    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe5f1643-2aee-4734-a7ea-67b21bea90c5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fe5f1643-2aee-4734-a7ea-67b21bea90c5" (UID: "fe5f1643-2aee-4734-a7ea-67b21bea90c5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:21:46.642459 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:46.642449    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe5f1643-2aee-4734-a7ea-67b21bea90c5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fe5f1643-2aee-4734-a7ea-67b21bea90c5" (UID: "fe5f1643-2aee-4734-a7ea-67b21bea90c5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:21:46.642676 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:46.642455    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe5f1643-2aee-4734-a7ea-67b21bea90c5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fe5f1643-2aee-4734-a7ea-67b21bea90c5" (UID: "fe5f1643-2aee-4734-a7ea-67b21bea90c5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:21:46.642676 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:46.642547    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe5f1643-2aee-4734-a7ea-67b21bea90c5-istio-data" (OuterVolumeSpecName: "istio-data") pod "fe5f1643-2aee-4734-a7ea-67b21bea90c5" (UID: "fe5f1643-2aee-4734-a7ea-67b21bea90c5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:21:46.642792 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:46.642729    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe5f1643-2aee-4734-a7ea-67b21bea90c5-workload-certs\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:21:46.642792 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:46.642746    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe5f1643-2aee-4734-a7ea-67b21bea90c5-workload-socket\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:21:46.642792 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:46.642759    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe5f1643-2aee-4734-a7ea-67b21bea90c5-istio-data\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:21:46.642792 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:46.642772    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe5f1643-2aee-4734-a7ea-67b21bea90c5-istiod-ca-cert\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:21:46.642792 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:46.642784    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe5f1643-2aee-4734-a7ea-67b21bea90c5-credential-socket\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:21:46.644209 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:46.644175    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe5f1643-2aee-4734-a7ea-67b21bea90c5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fe5f1643-2aee-4734-a7ea-67b21bea90c5" (UID: "fe5f1643-2aee-4734-a7ea-67b21bea90c5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:21:46.644347 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:46.644226    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe5f1643-2aee-4734-a7ea-67b21bea90c5-kube-api-access-knbhz" (OuterVolumeSpecName: "kube-api-access-knbhz") pod "fe5f1643-2aee-4734-a7ea-67b21bea90c5" (UID: "fe5f1643-2aee-4734-a7ea-67b21bea90c5"). InnerVolumeSpecName "kube-api-access-knbhz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:21:46.644347 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:46.644327    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fe5f1643-2aee-4734-a7ea-67b21bea90c5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fe5f1643-2aee-4734-a7ea-67b21bea90c5" (UID: "fe5f1643-2aee-4734-a7ea-67b21bea90c5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 17:21:46.644426 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:46.644383    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe5f1643-2aee-4734-a7ea-67b21bea90c5-istio-token" (OuterVolumeSpecName: "istio-token") pod "fe5f1643-2aee-4734-a7ea-67b21bea90c5" (UID: "fe5f1643-2aee-4734-a7ea-67b21bea90c5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:21:46.743576 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:46.743540    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe5f1643-2aee-4734-a7ea-67b21bea90c5-istio-podinfo\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:21:46.743576 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:46.743570    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knbhz\" (UniqueName: \"kubernetes.io/projected/fe5f1643-2aee-4734-a7ea-67b21bea90c5-kube-api-access-knbhz\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:21:46.743576 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:46.743578    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe5f1643-2aee-4734-a7ea-67b21bea90c5-istio-token\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:21:46.743576 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:46.743587    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe5f1643-2aee-4734-a7ea-67b21bea90c5-istio-envoy\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:21:46.902279 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:46.902249    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"]
Sep 07 17:21:46.906362 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:46.906335    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9"]
Sep 07 17:21:47.594196 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:47.594157    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe5f1643-2aee-4734-a7ea-67b21bea90c5" path="/var/lib/kubelet/pods/fe5f1643-2aee-4734-a7ea-67b21bea90c5/volumes"
Sep 07 17:21:52.331873 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:52.331840    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-202015-67cb789677-9xlqr"]
Sep 07 17:21:52.332360 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:52.332077    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-202015-67cb789677-9xlqr" podUID="01417128-befa-4fc5-bd12-e001f5cf4e65" containerName="payload-processing" containerID="cri-o://6ee121220b812c3c93cdd217365982fc5b47afcb97ef525084069cb1924c039f" gracePeriod=30
Sep 07 17:21:52.597162 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:52.597099    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-202015-67cb789677-9xlqr"
Sep 07 17:21:52.612376 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:52.612346    2558 generic.go:356] "Generic (PLEG): container finished" podID="01417128-befa-4fc5-bd12-e001f5cf4e65" containerID="6ee121220b812c3c93cdd217365982fc5b47afcb97ef525084069cb1924c039f" exitCode=0
Sep 07 17:21:52.612546 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:52.612390    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-202015-67cb789677-9xlqr"
Sep 07 17:21:52.612546 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:52.612422    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-202015-67cb789677-9xlqr" event={"ID":"01417128-befa-4fc5-bd12-e001f5cf4e65","Type":"ContainerDied","Data":"6ee121220b812c3c93cdd217365982fc5b47afcb97ef525084069cb1924c039f"}
Sep 07 17:21:52.612546 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:52.612475    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-202015-67cb789677-9xlqr" event={"ID":"01417128-befa-4fc5-bd12-e001f5cf4e65","Type":"ContainerDied","Data":"2ac95cdb93d0f1f5846b43d350c501b0a2b598eb62428ef79d9098e8912ae82d"}
Sep 07 17:21:52.612546 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:52.612498    2558 scope.go:117] "RemoveContainer" containerID="6ee121220b812c3c93cdd217365982fc5b47afcb97ef525084069cb1924c039f"
Sep 07 17:21:52.623844 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:52.623816    2558 scope.go:117] "RemoveContainer" containerID="6ee121220b812c3c93cdd217365982fc5b47afcb97ef525084069cb1924c039f"
Sep 07 17:21:52.624228 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:21:52.624203    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ee121220b812c3c93cdd217365982fc5b47afcb97ef525084069cb1924c039f\": container with ID starting with 6ee121220b812c3c93cdd217365982fc5b47afcb97ef525084069cb1924c039f not found: ID does not exist" containerID="6ee121220b812c3c93cdd217365982fc5b47afcb97ef525084069cb1924c039f"
Sep 07 17:21:52.624342 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:52.624256    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ee121220b812c3c93cdd217365982fc5b47afcb97ef525084069cb1924c039f"} err="failed to get container status \"6ee121220b812c3c93cdd217365982fc5b47afcb97ef525084069cb1924c039f\": rpc error: code = NotFound desc = could not find container \"6ee121220b812c3c93cdd217365982fc5b47afcb97ef525084069cb1924c039f\": container with ID starting with 6ee121220b812c3c93cdd217365982fc5b47afcb97ef525084069cb1924c039f not found: ID does not exist"
Sep 07 17:21:52.698893 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:52.698858    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01417128-befa-4fc5-bd12-e001f5cf4e65-plugins-config-volume\") pod \"01417128-befa-4fc5-bd12-e001f5cf4e65\" (UID: \"01417128-befa-4fc5-bd12-e001f5cf4e65\") "
Sep 07 17:21:52.699062 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:52.698907    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7sjz\" (UniqueName: \"kubernetes.io/projected/01417128-befa-4fc5-bd12-e001f5cf4e65-kube-api-access-h7sjz\") pod \"01417128-befa-4fc5-bd12-e001f5cf4e65\" (UID: \"01417128-befa-4fc5-bd12-e001f5cf4e65\") "
Sep 07 17:21:52.699296 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:52.699232    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01417128-befa-4fc5-bd12-e001f5cf4e65-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "01417128-befa-4fc5-bd12-e001f5cf4e65" (UID: "01417128-befa-4fc5-bd12-e001f5cf4e65"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:21:52.699618 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:52.699595    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01417128-befa-4fc5-bd12-e001f5cf4e65-plugins-config-volume\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:21:52.701182 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:52.701158    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01417128-befa-4fc5-bd12-e001f5cf4e65-kube-api-access-h7sjz" (OuterVolumeSpecName: "kube-api-access-h7sjz") pod "01417128-befa-4fc5-bd12-e001f5cf4e65" (UID: "01417128-befa-4fc5-bd12-e001f5cf4e65"). InnerVolumeSpecName "kube-api-access-h7sjz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:21:52.801056 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:52.801026    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7sjz\" (UniqueName: \"kubernetes.io/projected/01417128-befa-4fc5-bd12-e001f5cf4e65-kube-api-access-h7sjz\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:21:52.942387 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:52.942355    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-202015-67cb789677-9xlqr"]
Sep 07 17:21:52.945015 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:52.944991    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-202015-67cb789677-9xlqr"]
Sep 07 17:21:53.595082 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:53.595051    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01417128-befa-4fc5-bd12-e001f5cf4e65" path="/var/lib/kubelet/pods/01417128-befa-4fc5-bd12-e001f5cf4e65/volumes"
Sep 07 17:21:54.092873 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:54.092839    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1795dd/rate-test-model-1795dd-kserve-7bdb74587f-t7xw9"]
Sep 07 17:21:55.877073 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:55.877030    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"]
Sep 07 17:21:55.877683 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:55.877661    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe5f1643-2aee-4734-a7ea-67b21bea90c5" containerName="istio-proxy"
Sep 07 17:21:55.877729 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:55.877687    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe5f1643-2aee-4734-a7ea-67b21bea90c5" containerName="istio-proxy"
Sep 07 17:21:55.877729 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:55.877710    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01417128-befa-4fc5-bd12-e001f5cf4e65" containerName="payload-processing"
Sep 07 17:21:55.877729 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:55.877719    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="01417128-befa-4fc5-bd12-e001f5cf4e65" containerName="payload-processing"
Sep 07 17:21:55.877827 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:55.877756    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1015260-f20e-4d9e-91fd-59f7aef1d9d0" containerName="payload-processing"
Sep 07 17:21:55.877827 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:55.877766    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1015260-f20e-4d9e-91fd-59f7aef1d9d0" containerName="payload-processing"
Sep 07 17:21:55.877892 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:55.877865    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1015260-f20e-4d9e-91fd-59f7aef1d9d0" containerName="payload-processing"
Sep 07 17:21:55.877892 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:55.877880    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe5f1643-2aee-4734-a7ea-67b21bea90c5" containerName="istio-proxy"
Sep 07 17:21:55.877892 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:55.877888    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe5f1643-2aee-4734-a7ea-67b21bea90c5" containerName="istio-proxy"
Sep 07 17:21:55.877988 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:55.877901    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="01417128-befa-4fc5-bd12-e001f5cf4e65" containerName="payload-processing"
Sep 07 17:21:55.880949 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:55.880927    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"
Sep 07 17:21:55.884225 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:55.884203    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-9765ce-openshift-default-dockercfg-ppxcz\""
Sep 07 17:21:55.894012 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:55.893992    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"]
Sep 07 17:21:55.928381 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:55.928350    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54b1189b-78d7-4489-9f73-76f495ac36a7-istio-envoy\") pod \"e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4\" (UID: \"54b1189b-78d7-4489-9f73-76f495ac36a7\") " pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"
Sep 07 17:21:55.928530 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:55.928389    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54b1189b-78d7-4489-9f73-76f495ac36a7-istiod-ca-cert\") pod \"e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4\" (UID: \"54b1189b-78d7-4489-9f73-76f495ac36a7\") " pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"
Sep 07 17:21:55.928530 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:55.928421    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54b1189b-78d7-4489-9f73-76f495ac36a7-istio-podinfo\") pod \"e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4\" (UID: \"54b1189b-78d7-4489-9f73-76f495ac36a7\") " pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"
Sep 07 17:21:55.928530 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:55.928468    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54b1189b-78d7-4489-9f73-76f495ac36a7-credential-socket\") pod \"e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4\" (UID: \"54b1189b-78d7-4489-9f73-76f495ac36a7\") " pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"
Sep 07 17:21:55.928530 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:55.928496    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54b1189b-78d7-4489-9f73-76f495ac36a7-workload-certs\") pod \"e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4\" (UID: \"54b1189b-78d7-4489-9f73-76f495ac36a7\") " pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"
Sep 07 17:21:55.928672 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:55.928574    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54b1189b-78d7-4489-9f73-76f495ac36a7-workload-socket\") pod \"e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4\" (UID: \"54b1189b-78d7-4489-9f73-76f495ac36a7\") " pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"
Sep 07 17:21:55.928672 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:55.928603    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54b1189b-78d7-4489-9f73-76f495ac36a7-istio-token\") pod \"e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4\" (UID: \"54b1189b-78d7-4489-9f73-76f495ac36a7\") " pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"
Sep 07 17:21:55.928672 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:55.928620    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9q5mh\" (UniqueName: \"kubernetes.io/projected/54b1189b-78d7-4489-9f73-76f495ac36a7-kube-api-access-9q5mh\") pod \"e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4\" (UID: \"54b1189b-78d7-4489-9f73-76f495ac36a7\") " pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"
Sep 07 17:21:55.928766 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:55.928691    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54b1189b-78d7-4489-9f73-76f495ac36a7-istio-data\") pod \"e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4\" (UID: \"54b1189b-78d7-4489-9f73-76f495ac36a7\") " pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"
Sep 07 17:21:56.029386 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:56.029346    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54b1189b-78d7-4489-9f73-76f495ac36a7-istio-data\") pod \"e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4\" (UID: \"54b1189b-78d7-4489-9f73-76f495ac36a7\") " pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"
Sep 07 17:21:56.029591 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:56.029411    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54b1189b-78d7-4489-9f73-76f495ac36a7-istio-envoy\") pod \"e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4\" (UID: \"54b1189b-78d7-4489-9f73-76f495ac36a7\") " pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"
Sep 07 17:21:56.029591 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:56.029452    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54b1189b-78d7-4489-9f73-76f495ac36a7-istiod-ca-cert\") pod \"e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4\" (UID: \"54b1189b-78d7-4489-9f73-76f495ac36a7\") " pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"
Sep 07 17:21:56.029591 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:56.029489    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54b1189b-78d7-4489-9f73-76f495ac36a7-istio-podinfo\") pod \"e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4\" (UID: \"54b1189b-78d7-4489-9f73-76f495ac36a7\") " pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"
Sep 07 17:21:56.029591 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:56.029526    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54b1189b-78d7-4489-9f73-76f495ac36a7-credential-socket\") pod \"e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4\" (UID: \"54b1189b-78d7-4489-9f73-76f495ac36a7\") " pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"
Sep 07 17:21:56.029591 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:56.029559    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54b1189b-78d7-4489-9f73-76f495ac36a7-workload-certs\") pod \"e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4\" (UID: \"54b1189b-78d7-4489-9f73-76f495ac36a7\") " pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"
Sep 07 17:21:56.029861 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:56.029614    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54b1189b-78d7-4489-9f73-76f495ac36a7-workload-socket\") pod \"e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4\" (UID: \"54b1189b-78d7-4489-9f73-76f495ac36a7\") " pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"
Sep 07 17:21:56.029861 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:56.029640    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54b1189b-78d7-4489-9f73-76f495ac36a7-istio-token\") pod \"e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4\" (UID: \"54b1189b-78d7-4489-9f73-76f495ac36a7\") " pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"
Sep 07 17:21:56.029861 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:56.029665    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9q5mh\" (UniqueName: \"kubernetes.io/projected/54b1189b-78d7-4489-9f73-76f495ac36a7-kube-api-access-9q5mh\") pod \"e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4\" (UID: \"54b1189b-78d7-4489-9f73-76f495ac36a7\") " pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"
Sep 07 17:21:56.029861 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:56.029811    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54b1189b-78d7-4489-9f73-76f495ac36a7-istio-data\") pod \"e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4\" (UID: \"54b1189b-78d7-4489-9f73-76f495ac36a7\") " pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"
Sep 07 17:21:56.030056 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:56.029920    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54b1189b-78d7-4489-9f73-76f495ac36a7-credential-socket\") pod \"e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4\" (UID: \"54b1189b-78d7-4489-9f73-76f495ac36a7\") " pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"
Sep 07 17:21:56.030056 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:56.029960    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54b1189b-78d7-4489-9f73-76f495ac36a7-workload-socket\") pod \"e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4\" (UID: \"54b1189b-78d7-4489-9f73-76f495ac36a7\") " pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"
Sep 07 17:21:56.030152 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:56.030127    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54b1189b-78d7-4489-9f73-76f495ac36a7-workload-certs\") pod \"e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4\" (UID: \"54b1189b-78d7-4489-9f73-76f495ac36a7\") " pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"
Sep 07 17:21:56.030202 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:56.030172    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54b1189b-78d7-4489-9f73-76f495ac36a7-istiod-ca-cert\") pod \"e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4\" (UID: \"54b1189b-78d7-4489-9f73-76f495ac36a7\") " pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"
Sep 07 17:21:56.031807 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:56.031788    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54b1189b-78d7-4489-9f73-76f495ac36a7-istio-envoy\") pod \"e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4\" (UID: \"54b1189b-78d7-4489-9f73-76f495ac36a7\") " pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"
Sep 07 17:21:56.031934 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:56.031918    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54b1189b-78d7-4489-9f73-76f495ac36a7-istio-podinfo\") pod \"e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4\" (UID: \"54b1189b-78d7-4489-9f73-76f495ac36a7\") " pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"
Sep 07 17:21:56.038024 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:56.037997    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54b1189b-78d7-4489-9f73-76f495ac36a7-istio-token\") pod \"e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4\" (UID: \"54b1189b-78d7-4489-9f73-76f495ac36a7\") " pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"
Sep 07 17:21:56.038155 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:56.038135    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q5mh\" (UniqueName: \"kubernetes.io/projected/54b1189b-78d7-4489-9f73-76f495ac36a7-kube-api-access-9q5mh\") pod \"e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4\" (UID: \"54b1189b-78d7-4489-9f73-76f495ac36a7\") " pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"
Sep 07 17:21:56.191395 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:56.191306    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"
Sep 07 17:21:56.472808 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:21:56.472771    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54b1189b_78d7_4489_9f73_76f495ac36a7.slice/crio-139becdf428387302c238f778eb9cdaee9cef25fe4eb73167394aff8f54644f4 WatchSource:0}: Error finding container 139becdf428387302c238f778eb9cdaee9cef25fe4eb73167394aff8f54644f4: Status 404 returned error can't find the container with id 139becdf428387302c238f778eb9cdaee9cef25fe4eb73167394aff8f54644f4
Sep 07 17:21:56.473077 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:56.473053    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"]
Sep 07 17:21:56.475060 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:56.475013    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:21:56.475162 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:56.475101    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:21:56.475162 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:56.475140    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:21:56.635624 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:56.635585    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4" event={"ID":"54b1189b-78d7-4489-9f73-76f495ac36a7","Type":"ContainerStarted","Data":"2cb822447e5764d815acea3cafc8ef56b98655fb7c2a50b5c7260b5ba537b0e2"}
Sep 07 17:21:56.635822 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:56.635655    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4" event={"ID":"54b1189b-78d7-4489-9f73-76f495ac36a7","Type":"ContainerStarted","Data":"139becdf428387302c238f778eb9cdaee9cef25fe4eb73167394aff8f54644f4"}
Sep 07 17:21:56.662908 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:56.662843    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4" podStartSLOduration=1.662822184 podStartE2EDuration="1.662822184s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:21:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:21:56.659964804 +0000 UTC m=+1533.691395597" watchObservedRunningTime="2026-09-07 17:21:56.662822184 +0000 UTC m=+1533.694252975"
Sep 07 17:21:57.192293 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:57.192258    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"
Sep 07 17:21:57.197612 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:57.197592    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"
Sep 07 17:21:57.641475 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:57.641433    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"
Sep 07 17:21:57.642631 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:21:57.642603    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"
Sep 07 17:22:09.112881 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:09.112833    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-1795dd/rate-test-model-1795dd-kserve-7bdb74587f-t7xw9" podUID="f4030afc-9ad4-47dd-b06d-f5abcc50ff06" containerName="main" containerID="cri-o://3ebb784a50301654171e6a9c516b28418d0106c985739f79137669df622f6970" gracePeriod=45
Sep 07 17:22:09.398941 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:09.398916    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-1795dd/rate-test-model-1795dd-kserve-7bdb74587f-t7xw9"
Sep 07 17:22:09.479772 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:09.479734    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76sln\" (UniqueName: \"kubernetes.io/projected/f4030afc-9ad4-47dd-b06d-f5abcc50ff06-kube-api-access-76sln\") pod \"f4030afc-9ad4-47dd-b06d-f5abcc50ff06\" (UID: \"f4030afc-9ad4-47dd-b06d-f5abcc50ff06\") "
Sep 07 17:22:09.479959 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:09.479829    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4030afc-9ad4-47dd-b06d-f5abcc50ff06-tls-certs\") pod \"f4030afc-9ad4-47dd-b06d-f5abcc50ff06\" (UID: \"f4030afc-9ad4-47dd-b06d-f5abcc50ff06\") "
Sep 07 17:22:09.479959 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:09.479869    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4030afc-9ad4-47dd-b06d-f5abcc50ff06-home\") pod \"f4030afc-9ad4-47dd-b06d-f5abcc50ff06\" (UID: \"f4030afc-9ad4-47dd-b06d-f5abcc50ff06\") "
Sep 07 17:22:09.480079 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:09.479960    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4030afc-9ad4-47dd-b06d-f5abcc50ff06-tmp-dir\") pod \"f4030afc-9ad4-47dd-b06d-f5abcc50ff06\" (UID: \"f4030afc-9ad4-47dd-b06d-f5abcc50ff06\") "
Sep 07 17:22:09.480079 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:09.480061    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4030afc-9ad4-47dd-b06d-f5abcc50ff06-model-cache\") pod \"f4030afc-9ad4-47dd-b06d-f5abcc50ff06\" (UID: \"f4030afc-9ad4-47dd-b06d-f5abcc50ff06\") "
Sep 07 17:22:09.480207 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:09.480102    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4030afc-9ad4-47dd-b06d-f5abcc50ff06-dshm\") pod \"f4030afc-9ad4-47dd-b06d-f5abcc50ff06\" (UID: \"f4030afc-9ad4-47dd-b06d-f5abcc50ff06\") "
Sep 07 17:22:09.480207 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:09.480106    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4030afc-9ad4-47dd-b06d-f5abcc50ff06-home" (OuterVolumeSpecName: "home") pod "f4030afc-9ad4-47dd-b06d-f5abcc50ff06" (UID: "f4030afc-9ad4-47dd-b06d-f5abcc50ff06"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:22:09.480318 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:09.480207    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4030afc-9ad4-47dd-b06d-f5abcc50ff06-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f4030afc-9ad4-47dd-b06d-f5abcc50ff06" (UID: "f4030afc-9ad4-47dd-b06d-f5abcc50ff06"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:22:09.480359 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:09.480310    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4030afc-9ad4-47dd-b06d-f5abcc50ff06-model-cache" (OuterVolumeSpecName: "model-cache") pod "f4030afc-9ad4-47dd-b06d-f5abcc50ff06" (UID: "f4030afc-9ad4-47dd-b06d-f5abcc50ff06"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:22:09.480515 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:09.480493    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4030afc-9ad4-47dd-b06d-f5abcc50ff06-model-cache\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:22:09.480611 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:09.480517    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4030afc-9ad4-47dd-b06d-f5abcc50ff06-home\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:22:09.480611 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:09.480531    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4030afc-9ad4-47dd-b06d-f5abcc50ff06-tmp-dir\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:22:09.482114 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:09.482083    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4030afc-9ad4-47dd-b06d-f5abcc50ff06-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f4030afc-9ad4-47dd-b06d-f5abcc50ff06" (UID: "f4030afc-9ad4-47dd-b06d-f5abcc50ff06"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:22:09.482114 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:09.482087    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4030afc-9ad4-47dd-b06d-f5abcc50ff06-kube-api-access-76sln" (OuterVolumeSpecName: "kube-api-access-76sln") pod "f4030afc-9ad4-47dd-b06d-f5abcc50ff06" (UID: "f4030afc-9ad4-47dd-b06d-f5abcc50ff06"). InnerVolumeSpecName "kube-api-access-76sln". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:22:09.482289 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:09.482141    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4030afc-9ad4-47dd-b06d-f5abcc50ff06-dshm" (OuterVolumeSpecName: "dshm") pod "f4030afc-9ad4-47dd-b06d-f5abcc50ff06" (UID: "f4030afc-9ad4-47dd-b06d-f5abcc50ff06"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:22:09.581710 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:09.581677    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4030afc-9ad4-47dd-b06d-f5abcc50ff06-dshm\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:22:09.581710 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:09.581709    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76sln\" (UniqueName: \"kubernetes.io/projected/f4030afc-9ad4-47dd-b06d-f5abcc50ff06-kube-api-access-76sln\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:22:09.581979 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:09.581723    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4030afc-9ad4-47dd-b06d-f5abcc50ff06-tls-certs\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:22:09.708377 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:09.708271    2558 generic.go:356] "Generic (PLEG): container finished" podID="f4030afc-9ad4-47dd-b06d-f5abcc50ff06" containerID="3ebb784a50301654171e6a9c516b28418d0106c985739f79137669df622f6970" exitCode=0
Sep 07 17:22:09.708377 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:09.708345    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-1795dd/rate-test-model-1795dd-kserve-7bdb74587f-t7xw9"
Sep 07 17:22:09.708377 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:09.708357    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-1795dd/rate-test-model-1795dd-kserve-7bdb74587f-t7xw9" event={"ID":"f4030afc-9ad4-47dd-b06d-f5abcc50ff06","Type":"ContainerDied","Data":"3ebb784a50301654171e6a9c516b28418d0106c985739f79137669df622f6970"}
Sep 07 17:22:09.708661 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:09.708400    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-1795dd/rate-test-model-1795dd-kserve-7bdb74587f-t7xw9" event={"ID":"f4030afc-9ad4-47dd-b06d-f5abcc50ff06","Type":"ContainerDied","Data":"ce45ae42a2f0b4f627800d86f584b1ce9a2ada56e9082a3057171f11c3184db5"}
Sep 07 17:22:09.708661 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:09.708418    2558 scope.go:117] "RemoveContainer" containerID="3ebb784a50301654171e6a9c516b28418d0106c985739f79137669df622f6970"
Sep 07 17:22:09.717062 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:09.717044    2558 scope.go:117] "RemoveContainer" containerID="3ebb784a50301654171e6a9c516b28418d0106c985739f79137669df622f6970"
Sep 07 17:22:09.717365 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:22:09.717343    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ebb784a50301654171e6a9c516b28418d0106c985739f79137669df622f6970\": container with ID starting with 3ebb784a50301654171e6a9c516b28418d0106c985739f79137669df622f6970 not found: ID does not exist" containerID="3ebb784a50301654171e6a9c516b28418d0106c985739f79137669df622f6970"
Sep 07 17:22:09.717425 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:09.717373    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ebb784a50301654171e6a9c516b28418d0106c985739f79137669df622f6970"} err="failed to get container status \"3ebb784a50301654171e6a9c516b28418d0106c985739f79137669df622f6970\": rpc error: code = NotFound desc = could not find container \"3ebb784a50301654171e6a9c516b28418d0106c985739f79137669df622f6970\": container with ID starting with 3ebb784a50301654171e6a9c516b28418d0106c985739f79137669df622f6970 not found: ID does not exist"
Sep 07 17:22:09.727346 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:09.727311    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1795dd/rate-test-model-1795dd-kserve-7bdb74587f-t7xw9"]
Sep 07 17:22:09.732118 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:09.732095    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1795dd/rate-test-model-1795dd-kserve-7bdb74587f-t7xw9"]
Sep 07 17:22:10.927302 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:10.927270    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m"]
Sep 07 17:22:10.927705 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:10.927508    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m" podUID="9a67fc9a-1fad-4457-9aed-2554eef865b6" containerName="maas-api" containerID="cri-o://6c58e8183a2c57a07165cf6d84da3ec5cf1a79e865539eb1dba1a2a9d1905852" gracePeriod=30
Sep 07 17:22:11.243807 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:11.243782    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m"
Sep 07 17:22:11.399287 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:11.399217    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a67fc9a-1fad-4457-9aed-2554eef865b6-maas-api-tls\") pod \"9a67fc9a-1fad-4457-9aed-2554eef865b6\" (UID: \"9a67fc9a-1fad-4457-9aed-2554eef865b6\") "
Sep 07 17:22:11.399464 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:11.399363    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a67fc9a-1fad-4457-9aed-2554eef865b6-metrics-certs\") pod \"9a67fc9a-1fad-4457-9aed-2554eef865b6\" (UID: \"9a67fc9a-1fad-4457-9aed-2554eef865b6\") "
Sep 07 17:22:11.399464 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:11.399395    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6f9n7\" (UniqueName: \"kubernetes.io/projected/9a67fc9a-1fad-4457-9aed-2554eef865b6-kube-api-access-6f9n7\") pod \"9a67fc9a-1fad-4457-9aed-2554eef865b6\" (UID: \"9a67fc9a-1fad-4457-9aed-2554eef865b6\") "
Sep 07 17:22:11.399464 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:11.399418    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a67fc9a-1fad-4457-9aed-2554eef865b6-openshift-service-ca\") pod \"9a67fc9a-1fad-4457-9aed-2554eef865b6\" (UID: \"9a67fc9a-1fad-4457-9aed-2554eef865b6\") "
Sep 07 17:22:11.399856 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:11.399820    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a67fc9a-1fad-4457-9aed-2554eef865b6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9a67fc9a-1fad-4457-9aed-2554eef865b6" (UID: "9a67fc9a-1fad-4457-9aed-2554eef865b6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:22:11.401605 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:11.401580    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a67fc9a-1fad-4457-9aed-2554eef865b6-kube-api-access-6f9n7" (OuterVolumeSpecName: "kube-api-access-6f9n7") pod "9a67fc9a-1fad-4457-9aed-2554eef865b6" (UID: "9a67fc9a-1fad-4457-9aed-2554eef865b6"). InnerVolumeSpecName "kube-api-access-6f9n7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:22:11.401872 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:11.401845    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a67fc9a-1fad-4457-9aed-2554eef865b6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9a67fc9a-1fad-4457-9aed-2554eef865b6" (UID: "9a67fc9a-1fad-4457-9aed-2554eef865b6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:22:11.401965 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:11.401875    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a67fc9a-1fad-4457-9aed-2554eef865b6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9a67fc9a-1fad-4457-9aed-2554eef865b6" (UID: "9a67fc9a-1fad-4457-9aed-2554eef865b6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:22:11.501061 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:11.500977    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a67fc9a-1fad-4457-9aed-2554eef865b6-maas-api-tls\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:22:11.501061 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:11.501005    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a67fc9a-1fad-4457-9aed-2554eef865b6-metrics-certs\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:22:11.501061 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:11.501016    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6f9n7\" (UniqueName: \"kubernetes.io/projected/9a67fc9a-1fad-4457-9aed-2554eef865b6-kube-api-access-6f9n7\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:22:11.501061 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:11.501026    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a67fc9a-1fad-4457-9aed-2554eef865b6-openshift-service-ca\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:22:11.595402 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:11.595368    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4030afc-9ad4-47dd-b06d-f5abcc50ff06" path="/var/lib/kubelet/pods/f4030afc-9ad4-47dd-b06d-f5abcc50ff06/volumes"
Sep 07 17:22:11.721868 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:11.721826    2558 generic.go:356] "Generic (PLEG): container finished" podID="9a67fc9a-1fad-4457-9aed-2554eef865b6" containerID="6c58e8183a2c57a07165cf6d84da3ec5cf1a79e865539eb1dba1a2a9d1905852" exitCode=0
Sep 07 17:22:11.721868 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:11.721864    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m"
Sep 07 17:22:11.722111 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:11.721864    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m" event={"ID":"9a67fc9a-1fad-4457-9aed-2554eef865b6","Type":"ContainerDied","Data":"6c58e8183a2c57a07165cf6d84da3ec5cf1a79e865539eb1dba1a2a9d1905852"}
Sep 07 17:22:11.722111 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:11.721980    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m" event={"ID":"9a67fc9a-1fad-4457-9aed-2554eef865b6","Type":"ContainerDied","Data":"7936836cd55c8b6c06e008f4f56b870836ee8aa7f0dc9d80ee2aefe37936987c"}
Sep 07 17:22:11.722111 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:11.722004    2558 scope.go:117] "RemoveContainer" containerID="6c58e8183a2c57a07165cf6d84da3ec5cf1a79e865539eb1dba1a2a9d1905852"
Sep 07 17:22:11.730933 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:11.730912    2558 scope.go:117] "RemoveContainer" containerID="6c58e8183a2c57a07165cf6d84da3ec5cf1a79e865539eb1dba1a2a9d1905852"
Sep 07 17:22:11.731223 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:22:11.731205    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c58e8183a2c57a07165cf6d84da3ec5cf1a79e865539eb1dba1a2a9d1905852\": container with ID starting with 6c58e8183a2c57a07165cf6d84da3ec5cf1a79e865539eb1dba1a2a9d1905852 not found: ID does not exist" containerID="6c58e8183a2c57a07165cf6d84da3ec5cf1a79e865539eb1dba1a2a9d1905852"
Sep 07 17:22:11.731345 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:11.731231    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c58e8183a2c57a07165cf6d84da3ec5cf1a79e865539eb1dba1a2a9d1905852"} err="failed to get container status \"6c58e8183a2c57a07165cf6d84da3ec5cf1a79e865539eb1dba1a2a9d1905852\": rpc error: code = NotFound desc = could not find container \"6c58e8183a2c57a07165cf6d84da3ec5cf1a79e865539eb1dba1a2a9d1905852\": container with ID starting with 6c58e8183a2c57a07165cf6d84da3ec5cf1a79e865539eb1dba1a2a9d1905852 not found: ID does not exist"
Sep 07 17:22:11.820565 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:11.820468    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m"]
Sep 07 17:22:11.840139 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:11.840096    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-43ab35-cf9bcfdc4-m2j6m"]
Sep 07 17:22:13.595174 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:13.595133    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a67fc9a-1fad-4457-9aed-2554eef865b6" path="/var/lib/kubelet/pods/9a67fc9a-1fad-4457-9aed-2554eef865b6/volumes"
Sep 07 17:22:13.683401 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:13.683364    2558 patch_prober.go:28] interesting pod/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 07 17:22:13.683569 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:13.683421    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4" podUID="54b1189b-78d7-4489-9f73-76f495ac36a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 07 17:22:14.743165 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:14.743089    2558 generic.go:356] "Generic (PLEG): container finished" podID="54b1189b-78d7-4489-9f73-76f495ac36a7" containerID="2cb822447e5764d815acea3cafc8ef56b98655fb7c2a50b5c7260b5ba537b0e2" exitCode=0
Sep 07 17:22:14.743165 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:14.743122    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4" event={"ID":"54b1189b-78d7-4489-9f73-76f495ac36a7","Type":"ContainerDied","Data":"2cb822447e5764d815acea3cafc8ef56b98655fb7c2a50b5c7260b5ba537b0e2"}
Sep 07 17:22:14.743595 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:14.743490    2558 scope.go:117] "RemoveContainer" containerID="2cb822447e5764d815acea3cafc8ef56b98655fb7c2a50b5c7260b5ba537b0e2"
Sep 07 17:22:14.744578 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:14.744554    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:22:14.744642 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:14.744623    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:22:14.744677 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:14.744651    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 17:22:15.753826 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:15.753777    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4" event={"ID":"54b1189b-78d7-4489-9f73-76f495ac36a7","Type":"ContainerStarted","Data":"f39104cf09996d961720bcd04c8b90c3c6230b19fe62580a85dd5c5567614d12"}
Sep 07 17:22:16.192137 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:16.192087    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"
Sep 07 17:22:16.192408 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:16.192385    2558 patch_prober.go:28] interesting pod/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 07 17:22:16.192464 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:16.192438    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4" podUID="54b1189b-78d7-4489-9f73-76f495ac36a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 07 17:22:17.192206 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:17.192168    2558 patch_prober.go:28] interesting pod/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 07 17:22:17.192661 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:17.192230    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4" podUID="54b1189b-78d7-4489-9f73-76f495ac36a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 07 17:22:18.192231 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:18.192182    2558 patch_prober.go:28] interesting pod/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 07 17:22:18.192632 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:18.192275    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4" podUID="54b1189b-78d7-4489-9f73-76f495ac36a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 07 17:22:19.192760 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:19.192721    2558 patch_prober.go:28] interesting pod/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 07 17:22:19.193160 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:19.192781    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4" podUID="54b1189b-78d7-4489-9f73-76f495ac36a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 07 17:22:20.192054 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:20.192018    2558 patch_prober.go:28] interesting pod/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 07 17:22:20.192284 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:20.192073    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4" podUID="54b1189b-78d7-4489-9f73-76f495ac36a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 07 17:22:21.195502 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:21.195470    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"
Sep 07 17:22:21.195897 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:21.195839    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"
Sep 07 17:22:21.196450 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:21.196429    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"
Sep 07 17:22:29.821097 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:29.821061    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58-wgmpx"]
Sep 07 17:22:29.821754 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:29.821733    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a67fc9a-1fad-4457-9aed-2554eef865b6" containerName="maas-api"
Sep 07 17:22:29.821846 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:29.821756    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a67fc9a-1fad-4457-9aed-2554eef865b6" containerName="maas-api"
Sep 07 17:22:29.821846 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:29.821785    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4030afc-9ad4-47dd-b06d-f5abcc50ff06" containerName="main"
Sep 07 17:22:29.821846 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:29.821796    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4030afc-9ad4-47dd-b06d-f5abcc50ff06" containerName="main"
Sep 07 17:22:29.821846 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:29.821810    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe5f1643-2aee-4734-a7ea-67b21bea90c5" containerName="istio-proxy"
Sep 07 17:22:29.821846 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:29.821819    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe5f1643-2aee-4734-a7ea-67b21bea90c5" containerName="istio-proxy"
Sep 07 17:22:29.822090 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:29.821951    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4030afc-9ad4-47dd-b06d-f5abcc50ff06" containerName="main"
Sep 07 17:22:29.822090 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:29.821974    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a67fc9a-1fad-4457-9aed-2554eef865b6" containerName="maas-api"
Sep 07 17:22:29.825290 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:29.825270    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58-wgmpx"
Sep 07 17:22:29.828817 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:29.828795    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-fac82d-dockercfg-74wlt\""
Sep 07 17:22:29.829251 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:29.829220    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-fac82d\""
Sep 07 17:22:29.847551 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:29.847510    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58-wgmpx"]
Sep 07 17:22:29.883805 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:29.883767    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5fa2fd07-5570-4413-bb16-73966b7bc227-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58-wgmpx\" (UID: \"5fa2fd07-5570-4413-bb16-73966b7bc227\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58-wgmpx"
Sep 07 17:22:29.884089 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:29.884041    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7t2q\" (UniqueName: \"kubernetes.io/projected/5fa2fd07-5570-4413-bb16-73966b7bc227-kube-api-access-c7t2q\") pod \"payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58-wgmpx\" (UID: \"5fa2fd07-5570-4413-bb16-73966b7bc227\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58-wgmpx"
Sep 07 17:22:29.985549 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:29.985510    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5fa2fd07-5570-4413-bb16-73966b7bc227-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58-wgmpx\" (UID: \"5fa2fd07-5570-4413-bb16-73966b7bc227\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58-wgmpx"
Sep 07 17:22:29.985549 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:29.985552    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7t2q\" (UniqueName: \"kubernetes.io/projected/5fa2fd07-5570-4413-bb16-73966b7bc227-kube-api-access-c7t2q\") pod \"payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58-wgmpx\" (UID: \"5fa2fd07-5570-4413-bb16-73966b7bc227\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58-wgmpx"
Sep 07 17:22:29.986306 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:29.986281    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5fa2fd07-5570-4413-bb16-73966b7bc227-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58-wgmpx\" (UID: \"5fa2fd07-5570-4413-bb16-73966b7bc227\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58-wgmpx"
Sep 07 17:22:29.994952 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:29.994924    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7t2q\" (UniqueName: \"kubernetes.io/projected/5fa2fd07-5570-4413-bb16-73966b7bc227-kube-api-access-c7t2q\") pod \"payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58-wgmpx\" (UID: \"5fa2fd07-5570-4413-bb16-73966b7bc227\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58-wgmpx"
Sep 07 17:22:30.148414 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:30.148380    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58-wgmpx"
Sep 07 17:22:30.423905 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:30.423874    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58-wgmpx"]
Sep 07 17:22:30.425002 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:22:30.424973    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fa2fd07_5570_4413_bb16_73966b7bc227.slice/crio-3c7c4b0ce30459d08010551ed74e44a90602c9b0e90f9024c66c226358f52348 WatchSource:0}: Error finding container 3c7c4b0ce30459d08010551ed74e44a90602c9b0e90f9024c66c226358f52348: Status 404 returned error can't find the container with id 3c7c4b0ce30459d08010551ed74e44a90602c9b0e90f9024c66c226358f52348
Sep 07 17:22:30.849709 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:30.849616    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58-wgmpx" event={"ID":"5fa2fd07-5570-4413-bb16-73966b7bc227","Type":"ContainerStarted","Data":"1a4917481fd25b9c4ca0f7980d497360550b6fe51ee77dc9dee0fcf43d5de068"}
Sep 07 17:22:30.849709 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:30.849684    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58-wgmpx" event={"ID":"5fa2fd07-5570-4413-bb16-73966b7bc227","Type":"ContainerStarted","Data":"3c7c4b0ce30459d08010551ed74e44a90602c9b0e90f9024c66c226358f52348"}
Sep 07 17:22:30.850212 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:30.849756    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58-wgmpx"
Sep 07 17:22:41.856854 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:41.856822    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58-wgmpx"
Sep 07 17:22:41.881526 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:41.881477    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58-wgmpx" podStartSLOduration=12.881462547 podStartE2EDuration="12.881462547s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:22:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:22:30.869347427 +0000 UTC m=+1567.900778223" watchObservedRunningTime="2026-09-07 17:22:41.881462547 +0000 UTC m=+1578.912893337"
Sep 07 17:22:58.009830 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:22:58.009799    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-d4wsh_ecfe0367-8dc5-4314-9eb3-cb9d1b7e7087/payload-processing/0.log"
Sep 07 17:23:10.609274 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:10.609220    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-9765ce/ipp-route-9765ce-kserve-fb5499f75-rh9fb"]
Sep 07 17:23:10.613340 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:10.613308    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-9765ce/ipp-route-9765ce-kserve-fb5499f75-rh9fb"
Sep 07 17:23:10.617809 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:10.617761    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-9765ce\"/\"kube-root-ca.crt\""
Sep 07 17:23:10.617809 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:10.617776    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-9765ce\"/\"ipp-route-9765ce-kserve-self-signed-certs\""
Sep 07 17:23:10.618047 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:10.617784    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-9765ce\"/\"default-dockercfg-64tvk\""
Sep 07 17:23:10.618047 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:10.617784    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-9765ce\"/\"openshift-service-ca.crt\""
Sep 07 17:23:10.627387 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:10.627361    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-9765ce/ipp-route-9765ce-kserve-fb5499f75-rh9fb"]
Sep 07 17:23:10.681198 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:10.681168    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94485bce-0547-473b-ade8-5b20a05bce2b-tls-certs\") pod \"ipp-route-9765ce-kserve-fb5499f75-rh9fb\" (UID: \"94485bce-0547-473b-ade8-5b20a05bce2b\") " pod="ai-tenant-e2e-ipp-a-9765ce/ipp-route-9765ce-kserve-fb5499f75-rh9fb"
Sep 07 17:23:10.681388 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:10.681217    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94485bce-0547-473b-ade8-5b20a05bce2b-dshm\") pod \"ipp-route-9765ce-kserve-fb5499f75-rh9fb\" (UID: \"94485bce-0547-473b-ade8-5b20a05bce2b\") " pod="ai-tenant-e2e-ipp-a-9765ce/ipp-route-9765ce-kserve-fb5499f75-rh9fb"
Sep 07 17:23:10.681388 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:10.681302    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk7ws\" (UniqueName: \"kubernetes.io/projected/94485bce-0547-473b-ade8-5b20a05bce2b-kube-api-access-wk7ws\") pod \"ipp-route-9765ce-kserve-fb5499f75-rh9fb\" (UID: \"94485bce-0547-473b-ade8-5b20a05bce2b\") " pod="ai-tenant-e2e-ipp-a-9765ce/ipp-route-9765ce-kserve-fb5499f75-rh9fb"
Sep 07 17:23:10.681464 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:10.681410    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94485bce-0547-473b-ade8-5b20a05bce2b-tmp-dir\") pod \"ipp-route-9765ce-kserve-fb5499f75-rh9fb\" (UID: \"94485bce-0547-473b-ade8-5b20a05bce2b\") " pod="ai-tenant-e2e-ipp-a-9765ce/ipp-route-9765ce-kserve-fb5499f75-rh9fb"
Sep 07 17:23:10.681464 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:10.681434    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94485bce-0547-473b-ade8-5b20a05bce2b-home\") pod \"ipp-route-9765ce-kserve-fb5499f75-rh9fb\" (UID: \"94485bce-0547-473b-ade8-5b20a05bce2b\") " pod="ai-tenant-e2e-ipp-a-9765ce/ipp-route-9765ce-kserve-fb5499f75-rh9fb"
Sep 07 17:23:10.681464 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:10.681454    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94485bce-0547-473b-ade8-5b20a05bce2b-model-cache\") pod \"ipp-route-9765ce-kserve-fb5499f75-rh9fb\" (UID: \"94485bce-0547-473b-ade8-5b20a05bce2b\") " pod="ai-tenant-e2e-ipp-a-9765ce/ipp-route-9765ce-kserve-fb5499f75-rh9fb"
Sep 07 17:23:10.782496 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:10.782449    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94485bce-0547-473b-ade8-5b20a05bce2b-dshm\") pod \"ipp-route-9765ce-kserve-fb5499f75-rh9fb\" (UID: \"94485bce-0547-473b-ade8-5b20a05bce2b\") " pod="ai-tenant-e2e-ipp-a-9765ce/ipp-route-9765ce-kserve-fb5499f75-rh9fb"
Sep 07 17:23:10.782683 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:10.782519    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk7ws\" (UniqueName: \"kubernetes.io/projected/94485bce-0547-473b-ade8-5b20a05bce2b-kube-api-access-wk7ws\") pod \"ipp-route-9765ce-kserve-fb5499f75-rh9fb\" (UID: \"94485bce-0547-473b-ade8-5b20a05bce2b\") " pod="ai-tenant-e2e-ipp-a-9765ce/ipp-route-9765ce-kserve-fb5499f75-rh9fb"
Sep 07 17:23:10.782683 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:10.782577    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94485bce-0547-473b-ade8-5b20a05bce2b-tmp-dir\") pod \"ipp-route-9765ce-kserve-fb5499f75-rh9fb\" (UID: \"94485bce-0547-473b-ade8-5b20a05bce2b\") " pod="ai-tenant-e2e-ipp-a-9765ce/ipp-route-9765ce-kserve-fb5499f75-rh9fb"
Sep 07 17:23:10.782683 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:10.782594    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94485bce-0547-473b-ade8-5b20a05bce2b-home\") pod \"ipp-route-9765ce-kserve-fb5499f75-rh9fb\" (UID: \"94485bce-0547-473b-ade8-5b20a05bce2b\") " pod="ai-tenant-e2e-ipp-a-9765ce/ipp-route-9765ce-kserve-fb5499f75-rh9fb"
Sep 07 17:23:10.782683 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:10.782616    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94485bce-0547-473b-ade8-5b20a05bce2b-model-cache\") pod \"ipp-route-9765ce-kserve-fb5499f75-rh9fb\" (UID: \"94485bce-0547-473b-ade8-5b20a05bce2b\") " pod="ai-tenant-e2e-ipp-a-9765ce/ipp-route-9765ce-kserve-fb5499f75-rh9fb"
Sep 07 17:23:10.782683 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:10.782650    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94485bce-0547-473b-ade8-5b20a05bce2b-tls-certs\") pod \"ipp-route-9765ce-kserve-fb5499f75-rh9fb\" (UID: \"94485bce-0547-473b-ade8-5b20a05bce2b\") " pod="ai-tenant-e2e-ipp-a-9765ce/ipp-route-9765ce-kserve-fb5499f75-rh9fb"
Sep 07 17:23:10.783011 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:10.782980    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94485bce-0547-473b-ade8-5b20a05bce2b-tmp-dir\") pod \"ipp-route-9765ce-kserve-fb5499f75-rh9fb\" (UID: \"94485bce-0547-473b-ade8-5b20a05bce2b\") " pod="ai-tenant-e2e-ipp-a-9765ce/ipp-route-9765ce-kserve-fb5499f75-rh9fb"
Sep 07 17:23:10.783011 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:10.782997    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94485bce-0547-473b-ade8-5b20a05bce2b-home\") pod \"ipp-route-9765ce-kserve-fb5499f75-rh9fb\" (UID: \"94485bce-0547-473b-ade8-5b20a05bce2b\") " pod="ai-tenant-e2e-ipp-a-9765ce/ipp-route-9765ce-kserve-fb5499f75-rh9fb"
Sep 07 17:23:10.783173 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:10.783048    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94485bce-0547-473b-ade8-5b20a05bce2b-model-cache\") pod \"ipp-route-9765ce-kserve-fb5499f75-rh9fb\" (UID: \"94485bce-0547-473b-ade8-5b20a05bce2b\") " pod="ai-tenant-e2e-ipp-a-9765ce/ipp-route-9765ce-kserve-fb5499f75-rh9fb"
Sep 07 17:23:10.784814 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:10.784784    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94485bce-0547-473b-ade8-5b20a05bce2b-dshm\") pod \"ipp-route-9765ce-kserve-fb5499f75-rh9fb\" (UID: \"94485bce-0547-473b-ade8-5b20a05bce2b\") " pod="ai-tenant-e2e-ipp-a-9765ce/ipp-route-9765ce-kserve-fb5499f75-rh9fb"
Sep 07 17:23:10.785049 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:10.785033    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94485bce-0547-473b-ade8-5b20a05bce2b-tls-certs\") pod \"ipp-route-9765ce-kserve-fb5499f75-rh9fb\" (UID: \"94485bce-0547-473b-ade8-5b20a05bce2b\") " pod="ai-tenant-e2e-ipp-a-9765ce/ipp-route-9765ce-kserve-fb5499f75-rh9fb"
Sep 07 17:23:10.790873 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:10.790853    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk7ws\" (UniqueName: \"kubernetes.io/projected/94485bce-0547-473b-ade8-5b20a05bce2b-kube-api-access-wk7ws\") pod \"ipp-route-9765ce-kserve-fb5499f75-rh9fb\" (UID: \"94485bce-0547-473b-ade8-5b20a05bce2b\") " pod="ai-tenant-e2e-ipp-a-9765ce/ipp-route-9765ce-kserve-fb5499f75-rh9fb"
Sep 07 17:23:10.924502 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:10.924406    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-9765ce/ipp-route-9765ce-kserve-fb5499f75-rh9fb"
Sep 07 17:23:11.199803 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:11.199775    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-9765ce/ipp-route-9765ce-kserve-fb5499f75-rh9fb"]
Sep 07 17:23:11.200955 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:23:11.200930    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94485bce_0547_473b_ade8_5b20a05bce2b.slice/crio-b3869d76c3141a0d102d4d64a36fb835edf945a2fb0294b0732a204f3b44f405 WatchSource:0}: Error finding container b3869d76c3141a0d102d4d64a36fb835edf945a2fb0294b0732a204f3b44f405: Status 404 returned error can't find the container with id b3869d76c3141a0d102d4d64a36fb835edf945a2fb0294b0732a204f3b44f405
Sep 07 17:23:12.072845 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:12.072814    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-9765ce/ipp-route-9765ce-kserve-fb5499f75-rh9fb" event={"ID":"94485bce-0547-473b-ade8-5b20a05bce2b","Type":"ContainerStarted","Data":"e597d8a406c5757168eca9b5d2b088a6d0b7be2bf50819bf64cc0723ea7eb6d3"}
Sep 07 17:23:12.073223 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:12.072856    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-9765ce/ipp-route-9765ce-kserve-fb5499f75-rh9fb" event={"ID":"94485bce-0547-473b-ade8-5b20a05bce2b","Type":"ContainerStarted","Data":"b3869d76c3141a0d102d4d64a36fb835edf945a2fb0294b0732a204f3b44f405"}
Sep 07 17:23:12.093144 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:12.093086    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-9765ce/ipp-route-9765ce-kserve-fb5499f75-rh9fb" podStartSLOduration=2.093070747 podStartE2EDuration="2.093070747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:23:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:23:12.090485922 +0000 UTC m=+1609.121916715" watchObservedRunningTime="2026-09-07 17:23:12.093070747 +0000 UTC m=+1609.124501538"
Sep 07 17:23:20.925542 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:20.925451    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-9765ce/ipp-route-9765ce-kserve-fb5499f75-rh9fb"
Sep 07 17:23:20.925542 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:20.925508    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-9765ce/ipp-route-9765ce-kserve-fb5499f75-rh9fb"
Sep 07 17:23:20.937994 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:20.937971    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-9765ce/ipp-route-9765ce-kserve-fb5499f75-rh9fb"
Sep 07 17:23:21.142623 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:21.142590    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-9765ce/ipp-route-9765ce-kserve-fb5499f75-rh9fb"
Sep 07 17:23:23.833493 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:23.833462    2558 scope.go:117] "RemoveContainer" containerID="c3e77539527a4f58e0e920adde57e79ed7c394461097384fff97120fdaa3f042"
Sep 07 17:23:39.022482 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:39.022449    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-d4wsh_ecfe0367-8dc5-4314-9eb3-cb9d1b7e7087/payload-processing/0.log"
Sep 07 17:23:44.453017 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:44.452977    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db-xkqxn"]
Sep 07 17:23:44.457078 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:44.457056    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db-xkqxn"
Sep 07 17:23:44.459692 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:44.459660    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-dad805\""
Sep 07 17:23:44.476708 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:44.476675    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db-xkqxn"]
Sep 07 17:23:44.493705 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:44.493663    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blc8l\" (UniqueName: \"kubernetes.io/projected/15d559af-9b6d-48b9-92e7-dcbcb70e5f1e-kube-api-access-blc8l\") pod \"payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db-xkqxn\" (UID: \"15d559af-9b6d-48b9-92e7-dcbcb70e5f1e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db-xkqxn"
Sep 07 17:23:44.493874 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:44.493791    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15d559af-9b6d-48b9-92e7-dcbcb70e5f1e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db-xkqxn\" (UID: \"15d559af-9b6d-48b9-92e7-dcbcb70e5f1e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db-xkqxn"
Sep 07 17:23:44.594816 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:44.594762    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blc8l\" (UniqueName: \"kubernetes.io/projected/15d559af-9b6d-48b9-92e7-dcbcb70e5f1e-kube-api-access-blc8l\") pod \"payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db-xkqxn\" (UID: \"15d559af-9b6d-48b9-92e7-dcbcb70e5f1e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db-xkqxn"
Sep 07 17:23:44.595007 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:44.594910    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15d559af-9b6d-48b9-92e7-dcbcb70e5f1e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db-xkqxn\" (UID: \"15d559af-9b6d-48b9-92e7-dcbcb70e5f1e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db-xkqxn"
Sep 07 17:23:44.595807 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:44.595781    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15d559af-9b6d-48b9-92e7-dcbcb70e5f1e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db-xkqxn\" (UID: \"15d559af-9b6d-48b9-92e7-dcbcb70e5f1e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db-xkqxn"
Sep 07 17:23:44.606460 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:44.606429    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blc8l\" (UniqueName: \"kubernetes.io/projected/15d559af-9b6d-48b9-92e7-dcbcb70e5f1e-kube-api-access-blc8l\") pod \"payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db-xkqxn\" (UID: \"15d559af-9b6d-48b9-92e7-dcbcb70e5f1e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db-xkqxn"
Sep 07 17:23:44.767289 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:44.767178    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db-xkqxn"
Sep 07 17:23:45.046149 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:45.046116    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db-xkqxn"]
Sep 07 17:23:45.046705 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:23:45.046675    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15d559af_9b6d_48b9_92e7_dcbcb70e5f1e.slice/crio-3fe181a28e8886bc1ede5d23a644c11b2a81c92d4bb7a1bd59bffa4f83969172 WatchSource:0}: Error finding container 3fe181a28e8886bc1ede5d23a644c11b2a81c92d4bb7a1bd59bffa4f83969172: Status 404 returned error can't find the container with id 3fe181a28e8886bc1ede5d23a644c11b2a81c92d4bb7a1bd59bffa4f83969172
Sep 07 17:23:45.268820 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:45.268784    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db-xkqxn" event={"ID":"15d559af-9b6d-48b9-92e7-dcbcb70e5f1e","Type":"ContainerStarted","Data":"20186a75529a37642c54db2ed1e6eba6795ac5fa2fdeee1d0166ee7d9fe12fab"}
Sep 07 17:23:45.268997 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:45.268840    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db-xkqxn" event={"ID":"15d559af-9b6d-48b9-92e7-dcbcb70e5f1e","Type":"ContainerStarted","Data":"3fe181a28e8886bc1ede5d23a644c11b2a81c92d4bb7a1bd59bffa4f83969172"}
Sep 07 17:23:45.268997 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:45.268961    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db-xkqxn"
Sep 07 17:23:45.293821 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:45.293725    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db-xkqxn" podStartSLOduration=1.293708945 podStartE2EDuration="1.293708945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:23:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:23:45.292051905 +0000 UTC m=+1642.323482696" watchObservedRunningTime="2026-09-07 17:23:45.293708945 +0000 UTC m=+1642.325139782"
Sep 07 17:23:56.276860 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:23:56.276826    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db-xkqxn"
Sep 07 17:24:08.159206 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:08.159163    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-dad805-bvpdh"]
Sep 07 17:24:08.163469 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:08.163451    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-dad805-bvpdh"
Sep 07 17:24:08.166793 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:08.166764    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qphph\""
Sep 07 17:24:08.170146 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:08.170109    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-dad805-bvpdh"]
Sep 07 17:24:08.322405 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:08.322370    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c018d974-7700-42c6-95c0-becbd86a0a3d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-dad805-bvpdh\" (UID: \"c018d974-7700-42c6-95c0-becbd86a0a3d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-dad805-bvpdh"
Sep 07 17:24:08.423684 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:08.423595    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c018d974-7700-42c6-95c0-becbd86a0a3d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-dad805-bvpdh\" (UID: \"c018d974-7700-42c6-95c0-becbd86a0a3d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-dad805-bvpdh"
Sep 07 17:24:08.424294 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:08.424267    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c018d974-7700-42c6-95c0-becbd86a0a3d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-dad805-bvpdh\" (UID: \"c018d974-7700-42c6-95c0-becbd86a0a3d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-dad805-bvpdh"
Sep 07 17:24:08.476671 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:08.476644    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-dad805-bvpdh"
Sep 07 17:24:08.753762 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:08.753734    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-dad805-bvpdh"]
Sep 07 17:24:08.755586 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:24:08.755558    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc018d974_7700_42c6_95c0_becbd86a0a3d.slice/crio-d5236efab847f6e054cdb544cd2c4b00a6a96886cae28025ecd70cf006eaa324 WatchSource:0}: Error finding container d5236efab847f6e054cdb544cd2c4b00a6a96886cae28025ecd70cf006eaa324: Status 404 returned error can't find the container with id d5236efab847f6e054cdb544cd2c4b00a6a96886cae28025ecd70cf006eaa324
Sep 07 17:24:09.399620 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:09.399585    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-dad805-bvpdh" event={"ID":"c018d974-7700-42c6-95c0-becbd86a0a3d","Type":"ContainerStarted","Data":"430cd255ae95cd19dba5480b92770fd1cb95020cea103024456b2d70d4f8eb5e"}
Sep 07 17:24:09.399991 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:09.399669    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-dad805-bvpdh" event={"ID":"c018d974-7700-42c6-95c0-becbd86a0a3d","Type":"ContainerStarted","Data":"d5236efab847f6e054cdb544cd2c4b00a6a96886cae28025ecd70cf006eaa324"}
Sep 07 17:24:09.418277 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:09.418215    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-dad805-bvpdh" podStartSLOduration=1.4181995029999999 podStartE2EDuration="1.418199503s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:24:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:24:09.41637181 +0000 UTC m=+1666.447802602" watchObservedRunningTime="2026-09-07 17:24:09.418199503 +0000 UTC m=+1666.449630335"
Sep 07 17:24:10.407153 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:10.407116    2558 generic.go:356] "Generic (PLEG): container finished" podID="c018d974-7700-42c6-95c0-becbd86a0a3d" containerID="430cd255ae95cd19dba5480b92770fd1cb95020cea103024456b2d70d4f8eb5e" exitCode=0
Sep 07 17:24:10.407550 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:10.407198    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-dad805-bvpdh" event={"ID":"c018d974-7700-42c6-95c0-becbd86a0a3d","Type":"ContainerDied","Data":"430cd255ae95cd19dba5480b92770fd1cb95020cea103024456b2d70d4f8eb5e"}
Sep 07 17:24:11.552422 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:11.552398    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-dad805-bvpdh"
Sep 07 17:24:11.660429 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:11.660398    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c018d974-7700-42c6-95c0-becbd86a0a3d-maas-api-service-ca\") pod \"c018d974-7700-42c6-95c0-becbd86a0a3d\" (UID: \"c018d974-7700-42c6-95c0-becbd86a0a3d\") "
Sep 07 17:24:11.660750 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:11.660725    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c018d974-7700-42c6-95c0-becbd86a0a3d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c018d974-7700-42c6-95c0-becbd86a0a3d" (UID: "c018d974-7700-42c6-95c0-becbd86a0a3d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:24:11.761753 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:11.761672    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c018d974-7700-42c6-95c0-becbd86a0a3d-maas-api-service-ca\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:24:12.419806 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:12.419777    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-dad805-bvpdh" event={"ID":"c018d974-7700-42c6-95c0-becbd86a0a3d","Type":"ContainerDied","Data":"d5236efab847f6e054cdb544cd2c4b00a6a96886cae28025ecd70cf006eaa324"}
Sep 07 17:24:12.419979 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:12.419815    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-dad805-bvpdh"
Sep 07 17:24:12.419979 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:12.419823    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d5236efab847f6e054cdb544cd2c4b00a6a96886cae28025ecd70cf006eaa324"
Sep 07 17:24:14.256783 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:14.256750    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db-xkqxn"]
Sep 07 17:24:14.257141 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:14.257028    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db-xkqxn" podUID="15d559af-9b6d-48b9-92e7-dcbcb70e5f1e" containerName="payload-pre-processing" containerID="cri-o://20186a75529a37642c54db2ed1e6eba6795ac5fa2fdeee1d0166ee7d9fe12fab" gracePeriod=30
Sep 07 17:24:14.436119 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:14.436085    2558 generic.go:356] "Generic (PLEG): container finished" podID="15d559af-9b6d-48b9-92e7-dcbcb70e5f1e" containerID="20186a75529a37642c54db2ed1e6eba6795ac5fa2fdeee1d0166ee7d9fe12fab" exitCode=0
Sep 07 17:24:14.436279 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:14.436151    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db-xkqxn" event={"ID":"15d559af-9b6d-48b9-92e7-dcbcb70e5f1e","Type":"ContainerDied","Data":"20186a75529a37642c54db2ed1e6eba6795ac5fa2fdeee1d0166ee7d9fe12fab"}
Sep 07 17:24:14.446385 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:14.446359    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-dad805-bvpdh"]
Sep 07 17:24:14.456462 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:14.456429    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-dad805-bvpdh"]
Sep 07 17:24:14.519147 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:14.519082    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db-xkqxn"
Sep 07 17:24:14.690474 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:14.690438    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15d559af-9b6d-48b9-92e7-dcbcb70e5f1e-plugins-config-volume\") pod \"15d559af-9b6d-48b9-92e7-dcbcb70e5f1e\" (UID: \"15d559af-9b6d-48b9-92e7-dcbcb70e5f1e\") "
Sep 07 17:24:14.690650 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:14.690574    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-blc8l\" (UniqueName: \"kubernetes.io/projected/15d559af-9b6d-48b9-92e7-dcbcb70e5f1e-kube-api-access-blc8l\") pod \"15d559af-9b6d-48b9-92e7-dcbcb70e5f1e\" (UID: \"15d559af-9b6d-48b9-92e7-dcbcb70e5f1e\") "
Sep 07 17:24:14.690880 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:14.690845    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15d559af-9b6d-48b9-92e7-dcbcb70e5f1e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "15d559af-9b6d-48b9-92e7-dcbcb70e5f1e" (UID: "15d559af-9b6d-48b9-92e7-dcbcb70e5f1e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:24:14.692708 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:14.692686    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15d559af-9b6d-48b9-92e7-dcbcb70e5f1e-kube-api-access-blc8l" (OuterVolumeSpecName: "kube-api-access-blc8l") pod "15d559af-9b6d-48b9-92e7-dcbcb70e5f1e" (UID: "15d559af-9b6d-48b9-92e7-dcbcb70e5f1e"). InnerVolumeSpecName "kube-api-access-blc8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:24:14.792281 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:14.792161    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15d559af-9b6d-48b9-92e7-dcbcb70e5f1e-plugins-config-volume\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:24:14.792281 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:14.792204    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-blc8l\" (UniqueName: \"kubernetes.io/projected/15d559af-9b6d-48b9-92e7-dcbcb70e5f1e-kube-api-access-blc8l\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:24:15.442472 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:15.442442    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db-xkqxn"
Sep 07 17:24:15.442472 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:15.442451    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db-xkqxn" event={"ID":"15d559af-9b6d-48b9-92e7-dcbcb70e5f1e","Type":"ContainerDied","Data":"3fe181a28e8886bc1ede5d23a644c11b2a81c92d4bb7a1bd59bffa4f83969172"}
Sep 07 17:24:15.443079 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:15.442517    2558 scope.go:117] "RemoveContainer" containerID="20186a75529a37642c54db2ed1e6eba6795ac5fa2fdeee1d0166ee7d9fe12fab"
Sep 07 17:24:15.467722 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:15.467695    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db-xkqxn"]
Sep 07 17:24:15.472945 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:15.472914    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db-xkqxn"]
Sep 07 17:24:15.594780 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:15.594746    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15d559af-9b6d-48b9-92e7-dcbcb70e5f1e" path="/var/lib/kubelet/pods/15d559af-9b6d-48b9-92e7-dcbcb70e5f1e/volumes"
Sep 07 17:24:15.595108 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:15.595095    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c018d974-7700-42c6-95c0-becbd86a0a3d" path="/var/lib/kubelet/pods/c018d974-7700-42c6-95c0-becbd86a0a3d/volumes"
Sep 07 17:24:25.073522 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:25.073486    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9765ce-fbkfg"]
Sep 07 17:24:25.073959 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:25.073945    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15d559af-9b6d-48b9-92e7-dcbcb70e5f1e" containerName="payload-pre-processing"
Sep 07 17:24:25.074013 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:25.073960    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="15d559af-9b6d-48b9-92e7-dcbcb70e5f1e" containerName="payload-pre-processing"
Sep 07 17:24:25.074013 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:25.073977    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c018d974-7700-42c6-95c0-becbd86a0a3d" containerName="revoke-keys"
Sep 07 17:24:25.074013 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:25.073983    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c018d974-7700-42c6-95c0-becbd86a0a3d" containerName="revoke-keys"
Sep 07 17:24:25.074119 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:25.074053    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c018d974-7700-42c6-95c0-becbd86a0a3d" containerName="revoke-keys"
Sep 07 17:24:25.074119 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:25.074063    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="15d559af-9b6d-48b9-92e7-dcbcb70e5f1e" containerName="payload-pre-processing"
Sep 07 17:24:25.078683 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:25.078665    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9765ce-fbkfg"
Sep 07 17:24:25.082707 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:25.082640    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qphph\""
Sep 07 17:24:25.087413 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:25.086974    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9765ce-fbkfg"]
Sep 07 17:24:25.087413 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:25.087050    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f96f790f-44cb-4ad3-9245-1525f7cc5721-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-9765ce-fbkfg\" (UID: \"f96f790f-44cb-4ad3-9245-1525f7cc5721\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9765ce-fbkfg"
Sep 07 17:24:25.188198 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:25.188156    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f96f790f-44cb-4ad3-9245-1525f7cc5721-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-9765ce-fbkfg\" (UID: \"f96f790f-44cb-4ad3-9245-1525f7cc5721\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9765ce-fbkfg"
Sep 07 17:24:25.188834 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:25.188804    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f96f790f-44cb-4ad3-9245-1525f7cc5721-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-9765ce-fbkfg\" (UID: \"f96f790f-44cb-4ad3-9245-1525f7cc5721\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9765ce-fbkfg"
Sep 07 17:24:25.392483 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:25.392446    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9765ce-fbkfg"
Sep 07 17:24:25.667728 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:25.667698    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9765ce-fbkfg"]
Sep 07 17:24:25.668882 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:24:25.668851    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf96f790f_44cb_4ad3_9245_1525f7cc5721.slice/crio-b35422cae07fbc985ae5dedc9b7053b7f6d56698971c84e1ecb7e1d45905fd73 WatchSource:0}: Error finding container b35422cae07fbc985ae5dedc9b7053b7f6d56698971c84e1ecb7e1d45905fd73: Status 404 returned error can't find the container with id b35422cae07fbc985ae5dedc9b7053b7f6d56698971c84e1ecb7e1d45905fd73
Sep 07 17:24:26.504592 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:26.504559    2558 generic.go:356] "Generic (PLEG): container finished" podID="f96f790f-44cb-4ad3-9245-1525f7cc5721" containerID="47cb36193e040aa383683180d246932362a8437f5d6ac551240605d7e657fe39" exitCode=0
Sep 07 17:24:26.504976 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:26.504601    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9765ce-fbkfg" event={"ID":"f96f790f-44cb-4ad3-9245-1525f7cc5721","Type":"ContainerDied","Data":"47cb36193e040aa383683180d246932362a8437f5d6ac551240605d7e657fe39"}
Sep 07 17:24:26.504976 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:26.504642    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9765ce-fbkfg" event={"ID":"f96f790f-44cb-4ad3-9245-1525f7cc5721","Type":"ContainerStarted","Data":"b35422cae07fbc985ae5dedc9b7053b7f6d56698971c84e1ecb7e1d45905fd73"}
Sep 07 17:24:27.662486 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:27.662457    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9765ce-fbkfg"
Sep 07 17:24:27.713979 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:27.713890    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f96f790f-44cb-4ad3-9245-1525f7cc5721-maas-api-service-ca\") pod \"f96f790f-44cb-4ad3-9245-1525f7cc5721\" (UID: \"f96f790f-44cb-4ad3-9245-1525f7cc5721\") "
Sep 07 17:24:27.714233 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:27.714206    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f96f790f-44cb-4ad3-9245-1525f7cc5721-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f96f790f-44cb-4ad3-9245-1525f7cc5721" (UID: "f96f790f-44cb-4ad3-9245-1525f7cc5721"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:24:27.815420 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:27.815326    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f96f790f-44cb-4ad3-9245-1525f7cc5721-maas-api-service-ca\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:24:28.516993 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:28.516963    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9765ce-fbkfg"
Sep 07 17:24:28.517177 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:28.517017    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9765ce-fbkfg" event={"ID":"f96f790f-44cb-4ad3-9245-1525f7cc5721","Type":"ContainerDied","Data":"b35422cae07fbc985ae5dedc9b7053b7f6d56698971c84e1ecb7e1d45905fd73"}
Sep 07 17:24:28.517177 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:28.517062    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b35422cae07fbc985ae5dedc9b7053b7f6d56698971c84e1ecb7e1d45905fd73"
Sep 07 17:24:40.902453 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:40.902413    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9765ce-fbkfg"]
Sep 07 17:24:40.905059 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:40.905035    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9765ce-fbkfg"]
Sep 07 17:24:41.594204 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:41.594164    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f96f790f-44cb-4ad3-9245-1525f7cc5721" path="/var/lib/kubelet/pods/f96f790f-44cb-4ad3-9245-1525f7cc5721/volumes"
Sep 07 17:24:46.254272 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:24:46.254164    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-9765ce/ipp-route-9765ce-kserve-fb5499f75-rh9fb"]
Sep 07 17:25:01.274417 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:01.274373    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-9765ce/ipp-route-9765ce-kserve-fb5499f75-rh9fb" podUID="94485bce-0547-473b-ade8-5b20a05bce2b" containerName="main" containerID="cri-o://e597d8a406c5757168eca9b5d2b088a6d0b7be2bf50819bf64cc0723ea7eb6d3" gracePeriod=45
Sep 07 17:25:01.538370 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:01.538309    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-9765ce/ipp-route-9765ce-kserve-fb5499f75-rh9fb"
Sep 07 17:25:01.543362 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:01.543341    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94485bce-0547-473b-ade8-5b20a05bce2b-home\") pod \"94485bce-0547-473b-ade8-5b20a05bce2b\" (UID: \"94485bce-0547-473b-ade8-5b20a05bce2b\") "
Sep 07 17:25:01.543488 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:01.543410    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94485bce-0547-473b-ade8-5b20a05bce2b-tls-certs\") pod \"94485bce-0547-473b-ade8-5b20a05bce2b\" (UID: \"94485bce-0547-473b-ade8-5b20a05bce2b\") "
Sep 07 17:25:01.543488 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:01.543444    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94485bce-0547-473b-ade8-5b20a05bce2b-tmp-dir\") pod \"94485bce-0547-473b-ade8-5b20a05bce2b\" (UID: \"94485bce-0547-473b-ade8-5b20a05bce2b\") "
Sep 07 17:25:01.543488 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:01.543461    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94485bce-0547-473b-ade8-5b20a05bce2b-model-cache\") pod \"94485bce-0547-473b-ade8-5b20a05bce2b\" (UID: \"94485bce-0547-473b-ade8-5b20a05bce2b\") "
Sep 07 17:25:01.543644 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:01.543496    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wk7ws\" (UniqueName: \"kubernetes.io/projected/94485bce-0547-473b-ade8-5b20a05bce2b-kube-api-access-wk7ws\") pod \"94485bce-0547-473b-ade8-5b20a05bce2b\" (UID: \"94485bce-0547-473b-ade8-5b20a05bce2b\") "
Sep 07 17:25:01.543644 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:01.543526    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94485bce-0547-473b-ade8-5b20a05bce2b-dshm\") pod \"94485bce-0547-473b-ade8-5b20a05bce2b\" (UID: \"94485bce-0547-473b-ade8-5b20a05bce2b\") "
Sep 07 17:25:01.543753 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:01.543649    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94485bce-0547-473b-ade8-5b20a05bce2b-home" (OuterVolumeSpecName: "home") pod "94485bce-0547-473b-ade8-5b20a05bce2b" (UID: "94485bce-0547-473b-ade8-5b20a05bce2b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:25:01.543753 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:01.543703    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94485bce-0547-473b-ade8-5b20a05bce2b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "94485bce-0547-473b-ade8-5b20a05bce2b" (UID: "94485bce-0547-473b-ade8-5b20a05bce2b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:25:01.543753 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:01.543715    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94485bce-0547-473b-ade8-5b20a05bce2b-model-cache" (OuterVolumeSpecName: "model-cache") pod "94485bce-0547-473b-ade8-5b20a05bce2b" (UID: "94485bce-0547-473b-ade8-5b20a05bce2b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:25:01.543919 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:01.543858    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94485bce-0547-473b-ade8-5b20a05bce2b-home\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:25:01.543919 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:01.543870    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94485bce-0547-473b-ade8-5b20a05bce2b-tmp-dir\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:25:01.543919 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:01.543879    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94485bce-0547-473b-ade8-5b20a05bce2b-model-cache\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:25:01.545822 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:01.545800    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94485bce-0547-473b-ade8-5b20a05bce2b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "94485bce-0547-473b-ade8-5b20a05bce2b" (UID: "94485bce-0547-473b-ade8-5b20a05bce2b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:25:01.545948 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:01.545797    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94485bce-0547-473b-ade8-5b20a05bce2b-dshm" (OuterVolumeSpecName: "dshm") pod "94485bce-0547-473b-ade8-5b20a05bce2b" (UID: "94485bce-0547-473b-ade8-5b20a05bce2b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:25:01.545948 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:01.545848    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94485bce-0547-473b-ade8-5b20a05bce2b-kube-api-access-wk7ws" (OuterVolumeSpecName: "kube-api-access-wk7ws") pod "94485bce-0547-473b-ade8-5b20a05bce2b" (UID: "94485bce-0547-473b-ade8-5b20a05bce2b"). InnerVolumeSpecName "kube-api-access-wk7ws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:25:01.645068 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:01.645031    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94485bce-0547-473b-ade8-5b20a05bce2b-tls-certs\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:25:01.645068 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:01.645062    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wk7ws\" (UniqueName: \"kubernetes.io/projected/94485bce-0547-473b-ade8-5b20a05bce2b-kube-api-access-wk7ws\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:25:01.645068 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:01.645072    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94485bce-0547-473b-ade8-5b20a05bce2b-dshm\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:25:01.690949 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:01.690915    2558 generic.go:356] "Generic (PLEG): container finished" podID="94485bce-0547-473b-ade8-5b20a05bce2b" containerID="e597d8a406c5757168eca9b5d2b088a6d0b7be2bf50819bf64cc0723ea7eb6d3" exitCode=0
Sep 07 17:25:01.691149 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:01.690978    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-9765ce/ipp-route-9765ce-kserve-fb5499f75-rh9fb"
Sep 07 17:25:01.691149 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:01.691002    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-9765ce/ipp-route-9765ce-kserve-fb5499f75-rh9fb" event={"ID":"94485bce-0547-473b-ade8-5b20a05bce2b","Type":"ContainerDied","Data":"e597d8a406c5757168eca9b5d2b088a6d0b7be2bf50819bf64cc0723ea7eb6d3"}
Sep 07 17:25:01.691149 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:01.691055    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-9765ce/ipp-route-9765ce-kserve-fb5499f75-rh9fb" event={"ID":"94485bce-0547-473b-ade8-5b20a05bce2b","Type":"ContainerDied","Data":"b3869d76c3141a0d102d4d64a36fb835edf945a2fb0294b0732a204f3b44f405"}
Sep 07 17:25:01.691149 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:01.691079    2558 scope.go:117] "RemoveContainer" containerID="e597d8a406c5757168eca9b5d2b088a6d0b7be2bf50819bf64cc0723ea7eb6d3"
Sep 07 17:25:01.700485 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:01.700466    2558 scope.go:117] "RemoveContainer" containerID="e597d8a406c5757168eca9b5d2b088a6d0b7be2bf50819bf64cc0723ea7eb6d3"
Sep 07 17:25:01.700760 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:25:01.700740    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e597d8a406c5757168eca9b5d2b088a6d0b7be2bf50819bf64cc0723ea7eb6d3\": container with ID starting with e597d8a406c5757168eca9b5d2b088a6d0b7be2bf50819bf64cc0723ea7eb6d3 not found: ID does not exist" containerID="e597d8a406c5757168eca9b5d2b088a6d0b7be2bf50819bf64cc0723ea7eb6d3"
Sep 07 17:25:01.700824 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:01.700768    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e597d8a406c5757168eca9b5d2b088a6d0b7be2bf50819bf64cc0723ea7eb6d3"} err="failed to get container status \"e597d8a406c5757168eca9b5d2b088a6d0b7be2bf50819bf64cc0723ea7eb6d3\": rpc error: code = NotFound desc = could not find container \"e597d8a406c5757168eca9b5d2b088a6d0b7be2bf50819bf64cc0723ea7eb6d3\": container with ID starting with e597d8a406c5757168eca9b5d2b088a6d0b7be2bf50819bf64cc0723ea7eb6d3 not found: ID does not exist"
Sep 07 17:25:01.709661 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:01.709639    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-9765ce/ipp-route-9765ce-kserve-fb5499f75-rh9fb"]
Sep 07 17:25:01.713063 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:01.713045    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-9765ce/ipp-route-9765ce-kserve-fb5499f75-rh9fb"]
Sep 07 17:25:03.595091 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:03.595056    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94485bce-0547-473b-ade8-5b20a05bce2b" path="/var/lib/kubelet/pods/94485bce-0547-473b-ade8-5b20a05bce2b/volumes"
Sep 07 17:25:29.692999 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:29.692965    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"]
Sep 07 17:25:29.693429 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:29.693174    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4" podUID="54b1189b-78d7-4489-9f73-76f495ac36a7" containerName="istio-proxy" containerID="cri-o://f39104cf09996d961720bcd04c8b90c3c6230b19fe62580a85dd5c5567614d12" gracePeriod=30
Sep 07 17:25:34.865436 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:34.865403    2558 generic.go:356] "Generic (PLEG): container finished" podID="54b1189b-78d7-4489-9f73-76f495ac36a7" containerID="f39104cf09996d961720bcd04c8b90c3c6230b19fe62580a85dd5c5567614d12" exitCode=0
Sep 07 17:25:34.865817 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:34.865477    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4" event={"ID":"54b1189b-78d7-4489-9f73-76f495ac36a7","Type":"ContainerDied","Data":"f39104cf09996d961720bcd04c8b90c3c6230b19fe62580a85dd5c5567614d12"}
Sep 07 17:25:34.865817 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:34.865557    2558 scope.go:117] "RemoveContainer" containerID="2cb822447e5764d815acea3cafc8ef56b98655fb7c2a50b5c7260b5ba537b0e2"
Sep 07 17:25:34.946270 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:34.946230    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"
Sep 07 17:25:35.063136 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:35.063045    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54b1189b-78d7-4489-9f73-76f495ac36a7-workload-certs\") pod \"54b1189b-78d7-4489-9f73-76f495ac36a7\" (UID: \"54b1189b-78d7-4489-9f73-76f495ac36a7\") "
Sep 07 17:25:35.063136 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:35.063110    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54b1189b-78d7-4489-9f73-76f495ac36a7-istio-podinfo\") pod \"54b1189b-78d7-4489-9f73-76f495ac36a7\" (UID: \"54b1189b-78d7-4489-9f73-76f495ac36a7\") "
Sep 07 17:25:35.063393 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:35.063138    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54b1189b-78d7-4489-9f73-76f495ac36a7-istio-envoy\") pod \"54b1189b-78d7-4489-9f73-76f495ac36a7\" (UID: \"54b1189b-78d7-4489-9f73-76f495ac36a7\") "
Sep 07 17:25:35.063393 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:35.063182    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54b1189b-78d7-4489-9f73-76f495ac36a7-credential-socket\") pod \"54b1189b-78d7-4489-9f73-76f495ac36a7\" (UID: \"54b1189b-78d7-4489-9f73-76f495ac36a7\") "
Sep 07 17:25:35.063393 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:35.063210    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54b1189b-78d7-4489-9f73-76f495ac36a7-workload-socket\") pod \"54b1189b-78d7-4489-9f73-76f495ac36a7\" (UID: \"54b1189b-78d7-4489-9f73-76f495ac36a7\") "
Sep 07 17:25:35.063393 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:35.063257    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54b1189b-78d7-4489-9f73-76f495ac36a7-istiod-ca-cert\") pod \"54b1189b-78d7-4489-9f73-76f495ac36a7\" (UID: \"54b1189b-78d7-4489-9f73-76f495ac36a7\") "
Sep 07 17:25:35.063393 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:35.063286    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54b1189b-78d7-4489-9f73-76f495ac36a7-istio-data\") pod \"54b1189b-78d7-4489-9f73-76f495ac36a7\" (UID: \"54b1189b-78d7-4489-9f73-76f495ac36a7\") "
Sep 07 17:25:35.063393 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:35.063355    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54b1189b-78d7-4489-9f73-76f495ac36a7-istio-token\") pod \"54b1189b-78d7-4489-9f73-76f495ac36a7\" (UID: \"54b1189b-78d7-4489-9f73-76f495ac36a7\") "
Sep 07 17:25:35.063393 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:35.063394    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9q5mh\" (UniqueName: \"kubernetes.io/projected/54b1189b-78d7-4489-9f73-76f495ac36a7-kube-api-access-9q5mh\") pod \"54b1189b-78d7-4489-9f73-76f495ac36a7\" (UID: \"54b1189b-78d7-4489-9f73-76f495ac36a7\") "
Sep 07 17:25:35.063738 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:35.063395    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54b1189b-78d7-4489-9f73-76f495ac36a7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "54b1189b-78d7-4489-9f73-76f495ac36a7" (UID: "54b1189b-78d7-4489-9f73-76f495ac36a7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:25:35.063738 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:35.063510    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54b1189b-78d7-4489-9f73-76f495ac36a7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "54b1189b-78d7-4489-9f73-76f495ac36a7" (UID: "54b1189b-78d7-4489-9f73-76f495ac36a7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:25:35.063738 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:35.063549    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54b1189b-78d7-4489-9f73-76f495ac36a7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "54b1189b-78d7-4489-9f73-76f495ac36a7" (UID: "54b1189b-78d7-4489-9f73-76f495ac36a7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:25:35.063738 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:35.063617    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54b1189b-78d7-4489-9f73-76f495ac36a7-istio-data" (OuterVolumeSpecName: "istio-data") pod "54b1189b-78d7-4489-9f73-76f495ac36a7" (UID: "54b1189b-78d7-4489-9f73-76f495ac36a7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:25:35.063738 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:35.063703    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54b1189b-78d7-4489-9f73-76f495ac36a7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "54b1189b-78d7-4489-9f73-76f495ac36a7" (UID: "54b1189b-78d7-4489-9f73-76f495ac36a7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:25:35.063993 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:35.063798    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54b1189b-78d7-4489-9f73-76f495ac36a7-workload-certs\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:25:35.063993 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:35.063816    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54b1189b-78d7-4489-9f73-76f495ac36a7-credential-socket\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:25:35.063993 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:35.063830    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54b1189b-78d7-4489-9f73-76f495ac36a7-workload-socket\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:25:35.063993 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:35.063840    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54b1189b-78d7-4489-9f73-76f495ac36a7-istiod-ca-cert\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:25:35.063993 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:35.063848    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54b1189b-78d7-4489-9f73-76f495ac36a7-istio-data\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:25:35.065518 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:35.065489    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54b1189b-78d7-4489-9f73-76f495ac36a7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "54b1189b-78d7-4489-9f73-76f495ac36a7" (UID: "54b1189b-78d7-4489-9f73-76f495ac36a7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:25:35.065636 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:35.065536    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/54b1189b-78d7-4489-9f73-76f495ac36a7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "54b1189b-78d7-4489-9f73-76f495ac36a7" (UID: "54b1189b-78d7-4489-9f73-76f495ac36a7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 17:25:35.065636 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:35.065575    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54b1189b-78d7-4489-9f73-76f495ac36a7-kube-api-access-9q5mh" (OuterVolumeSpecName: "kube-api-access-9q5mh") pod "54b1189b-78d7-4489-9f73-76f495ac36a7" (UID: "54b1189b-78d7-4489-9f73-76f495ac36a7"). InnerVolumeSpecName "kube-api-access-9q5mh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:25:35.065636 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:35.065590    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54b1189b-78d7-4489-9f73-76f495ac36a7-istio-token" (OuterVolumeSpecName: "istio-token") pod "54b1189b-78d7-4489-9f73-76f495ac36a7" (UID: "54b1189b-78d7-4489-9f73-76f495ac36a7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:25:35.165072 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:35.165039    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54b1189b-78d7-4489-9f73-76f495ac36a7-istio-podinfo\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:25:35.165072 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:35.165068    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54b1189b-78d7-4489-9f73-76f495ac36a7-istio-envoy\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:25:35.165072 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:35.165075    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54b1189b-78d7-4489-9f73-76f495ac36a7-istio-token\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:25:35.165311 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:35.165084    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9q5mh\" (UniqueName: \"kubernetes.io/projected/54b1189b-78d7-4489-9f73-76f495ac36a7-kube-api-access-9q5mh\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:25:35.872010 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:35.871936    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"
Sep 07 17:25:35.872415 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:35.871938    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4" event={"ID":"54b1189b-78d7-4489-9f73-76f495ac36a7","Type":"ContainerDied","Data":"139becdf428387302c238f778eb9cdaee9cef25fe4eb73167394aff8f54644f4"}
Sep 07 17:25:35.872415 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:35.872061    2558 scope.go:117] "RemoveContainer" containerID="f39104cf09996d961720bcd04c8b90c3c6230b19fe62580a85dd5c5567614d12"
Sep 07 17:25:35.891783 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:35.891758    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"]
Sep 07 17:25:35.898661 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:35.898640    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4"]
Sep 07 17:25:37.594830 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:37.594797    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54b1189b-78d7-4489-9f73-76f495ac36a7" path="/var/lib/kubelet/pods/54b1189b-78d7-4489-9f73-76f495ac36a7/volumes"
Sep 07 17:25:40.802980 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:40.802947    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58-wgmpx"]
Sep 07 17:25:40.803449 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:40.803168    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58-wgmpx" podUID="5fa2fd07-5570-4413-bb16-73966b7bc227" containerName="payload-pre-processing" containerID="cri-o://1a4917481fd25b9c4ca0f7980d497360550b6fe51ee77dc9dee0fcf43d5de068" gracePeriod=30
Sep 07 17:25:41.057763 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:41.057704    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58-wgmpx"
Sep 07 17:25:41.220113 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:41.220069    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7t2q\" (UniqueName: \"kubernetes.io/projected/5fa2fd07-5570-4413-bb16-73966b7bc227-kube-api-access-c7t2q\") pod \"5fa2fd07-5570-4413-bb16-73966b7bc227\" (UID: \"5fa2fd07-5570-4413-bb16-73966b7bc227\") "
Sep 07 17:25:41.220307 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:41.220213    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5fa2fd07-5570-4413-bb16-73966b7bc227-plugins-config-volume\") pod \"5fa2fd07-5570-4413-bb16-73966b7bc227\" (UID: \"5fa2fd07-5570-4413-bb16-73966b7bc227\") "
Sep 07 17:25:41.220635 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:41.220604    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fa2fd07-5570-4413-bb16-73966b7bc227-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5fa2fd07-5570-4413-bb16-73966b7bc227" (UID: "5fa2fd07-5570-4413-bb16-73966b7bc227"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:25:41.222494 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:41.222462    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fa2fd07-5570-4413-bb16-73966b7bc227-kube-api-access-c7t2q" (OuterVolumeSpecName: "kube-api-access-c7t2q") pod "5fa2fd07-5570-4413-bb16-73966b7bc227" (UID: "5fa2fd07-5570-4413-bb16-73966b7bc227"). InnerVolumeSpecName "kube-api-access-c7t2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:25:41.321271 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:41.321155    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5fa2fd07-5570-4413-bb16-73966b7bc227-plugins-config-volume\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:25:41.321271 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:41.321188    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7t2q\" (UniqueName: \"kubernetes.io/projected/5fa2fd07-5570-4413-bb16-73966b7bc227-kube-api-access-c7t2q\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:25:41.906387 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:41.906350    2558 generic.go:356] "Generic (PLEG): container finished" podID="5fa2fd07-5570-4413-bb16-73966b7bc227" containerID="1a4917481fd25b9c4ca0f7980d497360550b6fe51ee77dc9dee0fcf43d5de068" exitCode=0
Sep 07 17:25:41.906829 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:41.906427    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58-wgmpx"
Sep 07 17:25:41.906829 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:41.906436    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58-wgmpx" event={"ID":"5fa2fd07-5570-4413-bb16-73966b7bc227","Type":"ContainerDied","Data":"1a4917481fd25b9c4ca0f7980d497360550b6fe51ee77dc9dee0fcf43d5de068"}
Sep 07 17:25:41.906829 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:41.906504    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58-wgmpx" event={"ID":"5fa2fd07-5570-4413-bb16-73966b7bc227","Type":"ContainerDied","Data":"3c7c4b0ce30459d08010551ed74e44a90602c9b0e90f9024c66c226358f52348"}
Sep 07 17:25:41.906829 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:41.906528    2558 scope.go:117] "RemoveContainer" containerID="1a4917481fd25b9c4ca0f7980d497360550b6fe51ee77dc9dee0fcf43d5de068"
Sep 07 17:25:41.915405 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:41.915387    2558 scope.go:117] "RemoveContainer" containerID="1a4917481fd25b9c4ca0f7980d497360550b6fe51ee77dc9dee0fcf43d5de068"
Sep 07 17:25:41.915702 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:25:41.915682    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a4917481fd25b9c4ca0f7980d497360550b6fe51ee77dc9dee0fcf43d5de068\": container with ID starting with 1a4917481fd25b9c4ca0f7980d497360550b6fe51ee77dc9dee0fcf43d5de068 not found: ID does not exist" containerID="1a4917481fd25b9c4ca0f7980d497360550b6fe51ee77dc9dee0fcf43d5de068"
Sep 07 17:25:41.915749 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:41.915710    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a4917481fd25b9c4ca0f7980d497360550b6fe51ee77dc9dee0fcf43d5de068"} err="failed to get container status \"1a4917481fd25b9c4ca0f7980d497360550b6fe51ee77dc9dee0fcf43d5de068\": rpc error: code = NotFound desc = could not find container \"1a4917481fd25b9c4ca0f7980d497360550b6fe51ee77dc9dee0fcf43d5de068\": container with ID starting with 1a4917481fd25b9c4ca0f7980d497360550b6fe51ee77dc9dee0fcf43d5de068 not found: ID does not exist"
Sep 07 17:25:41.925473 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:41.925446    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58-wgmpx"]
Sep 07 17:25:41.931712 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:41.931690    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58-wgmpx"]
Sep 07 17:25:43.594060 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:43.594028    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fa2fd07-5570-4413-bb16-73966b7bc227" path="/var/lib/kubelet/pods/5fa2fd07-5570-4413-bb16-73966b7bc227/volumes"
Sep 07 17:25:58.707454 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:58.707419    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1795dd-29813355-bggh2"]
Sep 07 17:25:58.709976 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:58.709949    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1795dd-29813355-bggh2"]
Sep 07 17:25:58.736609 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:58.736583    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99-ql2j9"]
Sep 07 17:25:58.736805 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:58.736771    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99-ql2j9" podUID="9d50f6f9-57cf-4d71-92ee-b3baadb3b71f" containerName="payload-processing" containerID="cri-o://662400abde04ffbf6cf5be97b27d45e9f7c85885676fc58874800a5d064a3f35" gracePeriod=30
Sep 07 17:25:59.000017 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:58.999955    2558 generic.go:356] "Generic (PLEG): container finished" podID="9d50f6f9-57cf-4d71-92ee-b3baadb3b71f" containerID="662400abde04ffbf6cf5be97b27d45e9f7c85885676fc58874800a5d064a3f35" exitCode=0
Sep 07 17:25:59.000192 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:59.000044    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99-ql2j9" event={"ID":"9d50f6f9-57cf-4d71-92ee-b3baadb3b71f","Type":"ContainerDied","Data":"662400abde04ffbf6cf5be97b27d45e9f7c85885676fc58874800a5d064a3f35"}
Sep 07 17:25:59.000192 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:59.000133    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99-ql2j9" event={"ID":"9d50f6f9-57cf-4d71-92ee-b3baadb3b71f","Type":"ContainerDied","Data":"842a0bd94e69890f5100414e47d30c5624ee9bd717353fc119eeda24385fffc9"}
Sep 07 17:25:59.000192 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:59.000159    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="842a0bd94e69890f5100414e47d30c5624ee9bd717353fc119eeda24385fffc9"
Sep 07 17:25:59.002650 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:59.002624    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99-ql2j9"
Sep 07 17:25:59.090127 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:59.090089    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2clq2\" (UniqueName: \"kubernetes.io/projected/9d50f6f9-57cf-4d71-92ee-b3baadb3b71f-kube-api-access-2clq2\") pod \"9d50f6f9-57cf-4d71-92ee-b3baadb3b71f\" (UID: \"9d50f6f9-57cf-4d71-92ee-b3baadb3b71f\") "
Sep 07 17:25:59.090301 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:59.090164    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d50f6f9-57cf-4d71-92ee-b3baadb3b71f-plugins-config-volume\") pod \"9d50f6f9-57cf-4d71-92ee-b3baadb3b71f\" (UID: \"9d50f6f9-57cf-4d71-92ee-b3baadb3b71f\") "
Sep 07 17:25:59.090600 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:59.090574    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d50f6f9-57cf-4d71-92ee-b3baadb3b71f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9d50f6f9-57cf-4d71-92ee-b3baadb3b71f" (UID: "9d50f6f9-57cf-4d71-92ee-b3baadb3b71f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:25:59.092283 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:59.092259    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d50f6f9-57cf-4d71-92ee-b3baadb3b71f-kube-api-access-2clq2" (OuterVolumeSpecName: "kube-api-access-2clq2") pod "9d50f6f9-57cf-4d71-92ee-b3baadb3b71f" (UID: "9d50f6f9-57cf-4d71-92ee-b3baadb3b71f"). InnerVolumeSpecName "kube-api-access-2clq2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:25:59.190848 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:59.190808    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d50f6f9-57cf-4d71-92ee-b3baadb3b71f-plugins-config-volume\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:25:59.190848 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:59.190842    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2clq2\" (UniqueName: \"kubernetes.io/projected/9d50f6f9-57cf-4d71-92ee-b3baadb3b71f-kube-api-access-2clq2\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:25:59.594682 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:25:59.594647    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9b5c53b-33bc-4bee-8202-c3954afcfc1a" path="/var/lib/kubelet/pods/c9b5c53b-33bc-4bee-8202-c3954afcfc1a/volumes"
Sep 07 17:26:00.005396 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:00.005365    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99-ql2j9"
Sep 07 17:26:00.023907 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:00.023869    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99-ql2j9"]
Sep 07 17:26:00.027699 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:00.027671    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99-ql2j9"]
Sep 07 17:26:01.594774 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:01.594727    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d50f6f9-57cf-4d71-92ee-b3baadb3b71f" path="/var/lib/kubelet/pods/9d50f6f9-57cf-4d71-92ee-b3baadb3b71f/volumes"
Sep 07 17:26:16.998829 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:16.998747    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-3973bf-85c5575f57-jzdm9"]
Sep 07 17:26:16.999392 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:16.999017    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3973bf-85c5575f57-jzdm9" podUID="f5dbd3dd-392b-4f05-b9fc-0658bb4a7911" containerName="payload-processing" containerID="cri-o://3a6ebaab3c575e48b77fd2b6ab236f74979c65f2f2f280ecf9d14e7575ee5bf9" gracePeriod=30
Sep 07 17:26:17.256287 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:17.256206    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3973bf-85c5575f57-jzdm9"
Sep 07 17:26:17.351655 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:17.351625    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5dbd3dd-392b-4f05-b9fc-0658bb4a7911-plugins-config-volume\") pod \"f5dbd3dd-392b-4f05-b9fc-0658bb4a7911\" (UID: \"f5dbd3dd-392b-4f05-b9fc-0658bb4a7911\") "
Sep 07 17:26:17.351655 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:17.351659    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6f69v\" (UniqueName: \"kubernetes.io/projected/f5dbd3dd-392b-4f05-b9fc-0658bb4a7911-kube-api-access-6f69v\") pod \"f5dbd3dd-392b-4f05-b9fc-0658bb4a7911\" (UID: \"f5dbd3dd-392b-4f05-b9fc-0658bb4a7911\") "
Sep 07 17:26:17.351986 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:17.351960    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5dbd3dd-392b-4f05-b9fc-0658bb4a7911-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f5dbd3dd-392b-4f05-b9fc-0658bb4a7911" (UID: "f5dbd3dd-392b-4f05-b9fc-0658bb4a7911"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:26:17.353768 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:17.353742    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5dbd3dd-392b-4f05-b9fc-0658bb4a7911-kube-api-access-6f69v" (OuterVolumeSpecName: "kube-api-access-6f69v") pod "f5dbd3dd-392b-4f05-b9fc-0658bb4a7911" (UID: "f5dbd3dd-392b-4f05-b9fc-0658bb4a7911"). InnerVolumeSpecName "kube-api-access-6f69v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:26:17.452561 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:17.452530    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5dbd3dd-392b-4f05-b9fc-0658bb4a7911-plugins-config-volume\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:26:17.452561 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:17.452556    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6f69v\" (UniqueName: \"kubernetes.io/projected/f5dbd3dd-392b-4f05-b9fc-0658bb4a7911-kube-api-access-6f69v\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:26:18.100374 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:18.100340    2558 generic.go:356] "Generic (PLEG): container finished" podID="f5dbd3dd-392b-4f05-b9fc-0658bb4a7911" containerID="3a6ebaab3c575e48b77fd2b6ab236f74979c65f2f2f280ecf9d14e7575ee5bf9" exitCode=0
Sep 07 17:26:18.100760 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:18.100383    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3973bf-85c5575f57-jzdm9"
Sep 07 17:26:18.100760 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:18.100421    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3973bf-85c5575f57-jzdm9" event={"ID":"f5dbd3dd-392b-4f05-b9fc-0658bb4a7911","Type":"ContainerDied","Data":"3a6ebaab3c575e48b77fd2b6ab236f74979c65f2f2f280ecf9d14e7575ee5bf9"}
Sep 07 17:26:18.100760 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:18.100471    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3973bf-85c5575f57-jzdm9" event={"ID":"f5dbd3dd-392b-4f05-b9fc-0658bb4a7911","Type":"ContainerDied","Data":"8d13459fae63c7bb77b688d4dd726dac20ee43ff9ef9d8421bbef5d53c21936a"}
Sep 07 17:26:18.100760 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:18.100491    2558 scope.go:117] "RemoveContainer" containerID="3a6ebaab3c575e48b77fd2b6ab236f74979c65f2f2f280ecf9d14e7575ee5bf9"
Sep 07 17:26:18.109368 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:18.109351    2558 scope.go:117] "RemoveContainer" containerID="3a6ebaab3c575e48b77fd2b6ab236f74979c65f2f2f280ecf9d14e7575ee5bf9"
Sep 07 17:26:18.109655 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:26:18.109631    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a6ebaab3c575e48b77fd2b6ab236f74979c65f2f2f280ecf9d14e7575ee5bf9\": container with ID starting with 3a6ebaab3c575e48b77fd2b6ab236f74979c65f2f2f280ecf9d14e7575ee5bf9 not found: ID does not exist" containerID="3a6ebaab3c575e48b77fd2b6ab236f74979c65f2f2f280ecf9d14e7575ee5bf9"
Sep 07 17:26:18.109742 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:18.109661    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a6ebaab3c575e48b77fd2b6ab236f74979c65f2f2f280ecf9d14e7575ee5bf9"} err="failed to get container status \"3a6ebaab3c575e48b77fd2b6ab236f74979c65f2f2f280ecf9d14e7575ee5bf9\": rpc error: code = NotFound desc = could not find container \"3a6ebaab3c575e48b77fd2b6ab236f74979c65f2f2f280ecf9d14e7575ee5bf9\": container with ID starting with 3a6ebaab3c575e48b77fd2b6ab236f74979c65f2f2f280ecf9d14e7575ee5bf9 not found: ID does not exist"
Sep 07 17:26:18.120642 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:18.120620    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-3973bf-85c5575f57-jzdm9"]
Sep 07 17:26:18.125754 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:18.125734    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-3973bf-85c5575f57-jzdm9"]
Sep 07 17:26:19.600636 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:19.600596    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5dbd3dd-392b-4f05-b9fc-0658bb4a7911" path="/var/lib/kubelet/pods/f5dbd3dd-392b-4f05-b9fc-0658bb4a7911/volumes"
Sep 07 17:26:23.742623 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:23.742597    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-f6srd_24750b4e-c0bc-4c3c-a256-6ca251306d06/console-operator/1.log"
Sep 07 17:26:23.748767 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:23.748745    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-f6srd_24750b4e-c0bc-4c3c-a256-6ca251306d06/console-operator/1.log"
Sep 07 17:26:23.750386 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:23.750366    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwj7s_9b97dbca-7e8f-4e05-9cc4-8f42785f01e7/ovn-acl-logging/0.log"
Sep 07 17:26:23.762517 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:23.762494    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwj7s_9b97dbca-7e8f-4e05-9cc4-8f42785f01e7/ovn-acl-logging/0.log"
Sep 07 17:26:23.879414 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:23.879383    2558 scope.go:117] "RemoveContainer" containerID="662400abde04ffbf6cf5be97b27d45e9f7c85885676fc58874800a5d064a3f35"
Sep 07 17:26:23.888434 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:23.888414    2558 scope.go:117] "RemoveContainer" containerID="296bc402804f89fdd0a07a14080a7298ba3d628ef4248aa21491b98f7042792e"
Sep 07 17:26:26.610994 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:26.610961    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7fbf888cb7-zc6tl"]
Sep 07 17:26:26.611388 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:26.611163    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7fbf888cb7-zc6tl" podUID="bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670" containerName="manager" containerID="cri-o://18865e3f79a434f4ea186f495619585cc640ab90b1fb83d941cb37fe3ff10eca" gracePeriod=30
Sep 07 17:26:26.853987 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:26.853963    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fbf888cb7-zc6tl"
Sep 07 17:26:26.948741 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:26.948649    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670-webhook-cert\") pod \"bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670\" (UID: \"bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670\") "
Sep 07 17:26:26.948741 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:26.948697    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670-metrics-certs\") pod \"bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670\" (UID: \"bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670\") "
Sep 07 17:26:26.948968 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:26.948812    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8g2k\" (UniqueName: \"kubernetes.io/projected/bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670-kube-api-access-v8g2k\") pod \"bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670\" (UID: \"bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670\") "
Sep 07 17:26:26.950695 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:26.950669    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670" (UID: "bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:26:26.950823 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:26.950802    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670" (UID: "bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:26:26.950870 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:26.950815    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670-kube-api-access-v8g2k" (OuterVolumeSpecName: "kube-api-access-v8g2k") pod "bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670" (UID: "bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670"). InnerVolumeSpecName "kube-api-access-v8g2k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:26:27.050200 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:27.050163    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8g2k\" (UniqueName: \"kubernetes.io/projected/bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670-kube-api-access-v8g2k\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:26:27.050200 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:27.050196    2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670-webhook-cert\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:26:27.050200 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:27.050206    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670-metrics-certs\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:26:27.150019 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:27.149974    2558 generic.go:356] "Generic (PLEG): container finished" podID="bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670" containerID="18865e3f79a434f4ea186f495619585cc640ab90b1fb83d941cb37fe3ff10eca" exitCode=0
Sep 07 17:26:27.150164 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:27.150023    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fbf888cb7-zc6tl"
Sep 07 17:26:27.150164 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:27.150031    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fbf888cb7-zc6tl" event={"ID":"bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670","Type":"ContainerDied","Data":"18865e3f79a434f4ea186f495619585cc640ab90b1fb83d941cb37fe3ff10eca"}
Sep 07 17:26:27.150164 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:27.150079    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fbf888cb7-zc6tl" event={"ID":"bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670","Type":"ContainerDied","Data":"c3f365422dd0c1b97a723f0383c7b8a8b7e8776d960aea4da55c20da4c65750d"}
Sep 07 17:26:27.150164 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:27.150104    2558 scope.go:117] "RemoveContainer" containerID="18865e3f79a434f4ea186f495619585cc640ab90b1fb83d941cb37fe3ff10eca"
Sep 07 17:26:27.159933 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:27.159913    2558 scope.go:117] "RemoveContainer" containerID="18865e3f79a434f4ea186f495619585cc640ab90b1fb83d941cb37fe3ff10eca"
Sep 07 17:26:27.160209 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:26:27.160191    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18865e3f79a434f4ea186f495619585cc640ab90b1fb83d941cb37fe3ff10eca\": container with ID starting with 18865e3f79a434f4ea186f495619585cc640ab90b1fb83d941cb37fe3ff10eca not found: ID does not exist" containerID="18865e3f79a434f4ea186f495619585cc640ab90b1fb83d941cb37fe3ff10eca"
Sep 07 17:26:27.160316 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:27.160217    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18865e3f79a434f4ea186f495619585cc640ab90b1fb83d941cb37fe3ff10eca"} err="failed to get container status \"18865e3f79a434f4ea186f495619585cc640ab90b1fb83d941cb37fe3ff10eca\": rpc error: code = NotFound desc = could not find container \"18865e3f79a434f4ea186f495619585cc640ab90b1fb83d941cb37fe3ff10eca\": container with ID starting with 18865e3f79a434f4ea186f495619585cc640ab90b1fb83d941cb37fe3ff10eca not found: ID does not exist"
Sep 07 17:26:27.175703 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:27.175681    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7fbf888cb7-zc6tl"]
Sep 07 17:26:27.178145 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:27.178124    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7fbf888cb7-zc6tl"]
Sep 07 17:26:27.594452 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:26:27.594419    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670" path="/var/lib/kubelet/pods/bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670/volumes"
Sep 07 17:27:28.003325 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:28.003292    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7fbf888cb7-b8flv"]
Sep 07 17:27:28.003740 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:28.003676    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d50f6f9-57cf-4d71-92ee-b3baadb3b71f" containerName="payload-processing"
Sep 07 17:27:28.003740 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:28.003686    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d50f6f9-57cf-4d71-92ee-b3baadb3b71f" containerName="payload-processing"
Sep 07 17:27:28.003740 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:28.003702    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fa2fd07-5570-4413-bb16-73966b7bc227" containerName="payload-pre-processing"
Sep 07 17:27:28.003740 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:28.003708    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fa2fd07-5570-4413-bb16-73966b7bc227" containerName="payload-pre-processing"
Sep 07 17:27:28.003740 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:28.003722    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f96f790f-44cb-4ad3-9245-1525f7cc5721" containerName="revoke-keys"
Sep 07 17:27:28.003740 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:28.003729    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f96f790f-44cb-4ad3-9245-1525f7cc5721" containerName="revoke-keys"
Sep 07 17:27:28.003740 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:28.003739    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54b1189b-78d7-4489-9f73-76f495ac36a7" containerName="istio-proxy"
Sep 07 17:27:28.003740 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:28.003745    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="54b1189b-78d7-4489-9f73-76f495ac36a7" containerName="istio-proxy"
Sep 07 17:27:28.003995 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:28.003752    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5dbd3dd-392b-4f05-b9fc-0658bb4a7911" containerName="payload-processing"
Sep 07 17:27:28.003995 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:28.003757    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5dbd3dd-392b-4f05-b9fc-0658bb4a7911" containerName="payload-processing"
Sep 07 17:27:28.003995 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:28.003765    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670" containerName="manager"
Sep 07 17:27:28.003995 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:28.003770    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670" containerName="manager"
Sep 07 17:27:28.003995 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:28.003777    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94485bce-0547-473b-ade8-5b20a05bce2b" containerName="main"
Sep 07 17:27:28.003995 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:28.003782    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="94485bce-0547-473b-ade8-5b20a05bce2b" containerName="main"
Sep 07 17:27:28.003995 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:28.003835    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfdf8166-06b2-4bf9-a54f-bc1b9c0bb670" containerName="manager"
Sep 07 17:27:28.003995 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:28.003843    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="94485bce-0547-473b-ade8-5b20a05bce2b" containerName="main"
Sep 07 17:27:28.003995 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:28.003849    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5dbd3dd-392b-4f05-b9fc-0658bb4a7911" containerName="payload-processing"
Sep 07 17:27:28.003995 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:28.003855    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d50f6f9-57cf-4d71-92ee-b3baadb3b71f" containerName="payload-processing"
Sep 07 17:27:28.003995 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:28.003861    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fa2fd07-5570-4413-bb16-73966b7bc227" containerName="payload-pre-processing"
Sep 07 17:27:28.003995 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:28.003866    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="54b1189b-78d7-4489-9f73-76f495ac36a7" containerName="istio-proxy"
Sep 07 17:27:28.003995 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:28.003871    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="54b1189b-78d7-4489-9f73-76f495ac36a7" containerName="istio-proxy"
Sep 07 17:27:28.003995 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:28.003878    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f96f790f-44cb-4ad3-9245-1525f7cc5721" containerName="revoke-keys"
Sep 07 17:27:28.006906 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:28.006891    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fbf888cb7-b8flv"
Sep 07 17:27:28.010829 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:28.010804    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 07 17:27:28.011008 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:28.010990    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 07 17:27:28.012499 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:28.012481    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 07 17:27:28.012616 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:28.012503    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8bspl\""
Sep 07 17:27:28.019606 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:28.019583    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7fbf888cb7-b8flv"]
Sep 07 17:27:28.102555 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:28.102518    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh5wl\" (UniqueName: \"kubernetes.io/projected/c881d646-3676-4e81-bc1d-f3f099d46402-kube-api-access-gh5wl\") pod \"maas-controller-7fbf888cb7-b8flv\" (UID: \"c881d646-3676-4e81-bc1d-f3f099d46402\") " pod="opendatahub/maas-controller-7fbf888cb7-b8flv"
Sep 07 17:27:28.102717 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:28.102558    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c881d646-3676-4e81-bc1d-f3f099d46402-webhook-cert\") pod \"maas-controller-7fbf888cb7-b8flv\" (UID: \"c881d646-3676-4e81-bc1d-f3f099d46402\") " pod="opendatahub/maas-controller-7fbf888cb7-b8flv"
Sep 07 17:27:28.102717 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:28.102582    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c881d646-3676-4e81-bc1d-f3f099d46402-metrics-certs\") pod \"maas-controller-7fbf888cb7-b8flv\" (UID: \"c881d646-3676-4e81-bc1d-f3f099d46402\") " pod="opendatahub/maas-controller-7fbf888cb7-b8flv"
Sep 07 17:27:28.203292 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:28.203257    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh5wl\" (UniqueName: \"kubernetes.io/projected/c881d646-3676-4e81-bc1d-f3f099d46402-kube-api-access-gh5wl\") pod \"maas-controller-7fbf888cb7-b8flv\" (UID: \"c881d646-3676-4e81-bc1d-f3f099d46402\") " pod="opendatahub/maas-controller-7fbf888cb7-b8flv"
Sep 07 17:27:28.203543 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:28.203397    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c881d646-3676-4e81-bc1d-f3f099d46402-webhook-cert\") pod \"maas-controller-7fbf888cb7-b8flv\" (UID: \"c881d646-3676-4e81-bc1d-f3f099d46402\") " pod="opendatahub/maas-controller-7fbf888cb7-b8flv"
Sep 07 17:27:28.203543 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:28.203434    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c881d646-3676-4e81-bc1d-f3f099d46402-metrics-certs\") pod \"maas-controller-7fbf888cb7-b8flv\" (UID: \"c881d646-3676-4e81-bc1d-f3f099d46402\") " pod="opendatahub/maas-controller-7fbf888cb7-b8flv"
Sep 07 17:27:28.205909 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:28.205881    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c881d646-3676-4e81-bc1d-f3f099d46402-metrics-certs\") pod \"maas-controller-7fbf888cb7-b8flv\" (UID: \"c881d646-3676-4e81-bc1d-f3f099d46402\") " pod="opendatahub/maas-controller-7fbf888cb7-b8flv"
Sep 07 17:27:28.206020 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:28.205934    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c881d646-3676-4e81-bc1d-f3f099d46402-webhook-cert\") pod \"maas-controller-7fbf888cb7-b8flv\" (UID: \"c881d646-3676-4e81-bc1d-f3f099d46402\") " pod="opendatahub/maas-controller-7fbf888cb7-b8flv"
Sep 07 17:27:28.212931 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:28.212908    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh5wl\" (UniqueName: \"kubernetes.io/projected/c881d646-3676-4e81-bc1d-f3f099d46402-kube-api-access-gh5wl\") pod \"maas-controller-7fbf888cb7-b8flv\" (UID: \"c881d646-3676-4e81-bc1d-f3f099d46402\") " pod="opendatahub/maas-controller-7fbf888cb7-b8flv"
Sep 07 17:27:28.318032 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:28.317955    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fbf888cb7-b8flv"
Sep 07 17:27:28.597641 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:28.597611    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7fbf888cb7-b8flv"]
Sep 07 17:27:28.598691 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:27:28.598670    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc881d646_3676_4e81_bc1d_f3f099d46402.slice/crio-ae294599394c50c84135f6bb11329b4259eb780ae96b7af0059955d2b99e18c7 WatchSource:0}: Error finding container ae294599394c50c84135f6bb11329b4259eb780ae96b7af0059955d2b99e18c7: Status 404 returned error can't find the container with id ae294599394c50c84135f6bb11329b4259eb780ae96b7af0059955d2b99e18c7
Sep 07 17:27:28.600037 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:28.600019    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 17:27:29.479067 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:29.479026    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fbf888cb7-b8flv" event={"ID":"c881d646-3676-4e81-bc1d-f3f099d46402","Type":"ContainerStarted","Data":"3a8913798b764e14cf50971ed3a9e61e31bd52083c84a903c2d3509c4f3b0d0c"}
Sep 07 17:27:29.479488 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:29.479081    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fbf888cb7-b8flv" event={"ID":"c881d646-3676-4e81-bc1d-f3f099d46402","Type":"ContainerStarted","Data":"ae294599394c50c84135f6bb11329b4259eb780ae96b7af0059955d2b99e18c7"}
Sep 07 17:27:29.479488 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:29.479110    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7fbf888cb7-b8flv"
Sep 07 17:27:29.497740 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:29.497685    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7fbf888cb7-b8flv" podStartSLOduration=2.080164165 podStartE2EDuration="2.497670941s" totalImagesPullingTime="417.506776ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:27:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:27:29.497134051 +0000 UTC m=+1866.528564843" watchObservedRunningTime="2026-09-07 17:27:29.497670941 +0000 UTC m=+1866.529101781"
Sep 07 17:27:40.486493 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:40.486463    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7fbf888cb7-b8flv"
Sep 07 17:27:49.820796 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:49.820712    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7fbf888cb7-b8flv"]
Sep 07 17:27:49.821216 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:49.820902    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7fbf888cb7-b8flv" podUID="c881d646-3676-4e81-bc1d-f3f099d46402" containerName="manager" containerID="cri-o://3a8913798b764e14cf50971ed3a9e61e31bd52083c84a903c2d3509c4f3b0d0c" gracePeriod=30
Sep 07 17:27:50.075047 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:50.074987    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fbf888cb7-b8flv"
Sep 07 17:27:50.209322 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:50.209288    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c881d646-3676-4e81-bc1d-f3f099d46402-webhook-cert\") pod \"c881d646-3676-4e81-bc1d-f3f099d46402\" (UID: \"c881d646-3676-4e81-bc1d-f3f099d46402\") "
Sep 07 17:27:50.209484 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:50.209356    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c881d646-3676-4e81-bc1d-f3f099d46402-metrics-certs\") pod \"c881d646-3676-4e81-bc1d-f3f099d46402\" (UID: \"c881d646-3676-4e81-bc1d-f3f099d46402\") "
Sep 07 17:27:50.209484 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:50.209463    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gh5wl\" (UniqueName: \"kubernetes.io/projected/c881d646-3676-4e81-bc1d-f3f099d46402-kube-api-access-gh5wl\") pod \"c881d646-3676-4e81-bc1d-f3f099d46402\" (UID: \"c881d646-3676-4e81-bc1d-f3f099d46402\") "
Sep 07 17:27:50.211416 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:50.211387    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c881d646-3676-4e81-bc1d-f3f099d46402-kube-api-access-gh5wl" (OuterVolumeSpecName: "kube-api-access-gh5wl") pod "c881d646-3676-4e81-bc1d-f3f099d46402" (UID: "c881d646-3676-4e81-bc1d-f3f099d46402"). InnerVolumeSpecName "kube-api-access-gh5wl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:27:50.211543 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:50.211456    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c881d646-3676-4e81-bc1d-f3f099d46402-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c881d646-3676-4e81-bc1d-f3f099d46402" (UID: "c881d646-3676-4e81-bc1d-f3f099d46402"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:27:50.211543 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:50.211483    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c881d646-3676-4e81-bc1d-f3f099d46402-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c881d646-3676-4e81-bc1d-f3f099d46402" (UID: "c881d646-3676-4e81-bc1d-f3f099d46402"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:27:50.311055 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:50.311022    2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c881d646-3676-4e81-bc1d-f3f099d46402-webhook-cert\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:27:50.311055 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:50.311049    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c881d646-3676-4e81-bc1d-f3f099d46402-metrics-certs\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:27:50.311055 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:50.311060    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gh5wl\" (UniqueName: \"kubernetes.io/projected/c881d646-3676-4e81-bc1d-f3f099d46402-kube-api-access-gh5wl\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:27:50.589909 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:50.589861    2558 generic.go:356] "Generic (PLEG): container finished" podID="c881d646-3676-4e81-bc1d-f3f099d46402" containerID="3a8913798b764e14cf50971ed3a9e61e31bd52083c84a903c2d3509c4f3b0d0c" exitCode=0
Sep 07 17:27:50.589909 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:50.589909    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fbf888cb7-b8flv"
Sep 07 17:27:50.590126 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:50.589947    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fbf888cb7-b8flv" event={"ID":"c881d646-3676-4e81-bc1d-f3f099d46402","Type":"ContainerDied","Data":"3a8913798b764e14cf50971ed3a9e61e31bd52083c84a903c2d3509c4f3b0d0c"}
Sep 07 17:27:50.590126 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:50.590001    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fbf888cb7-b8flv" event={"ID":"c881d646-3676-4e81-bc1d-f3f099d46402","Type":"ContainerDied","Data":"ae294599394c50c84135f6bb11329b4259eb780ae96b7af0059955d2b99e18c7"}
Sep 07 17:27:50.590126 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:50.590029    2558 scope.go:117] "RemoveContainer" containerID="3a8913798b764e14cf50971ed3a9e61e31bd52083c84a903c2d3509c4f3b0d0c"
Sep 07 17:27:50.599417 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:50.599378    2558 scope.go:117] "RemoveContainer" containerID="3a8913798b764e14cf50971ed3a9e61e31bd52083c84a903c2d3509c4f3b0d0c"
Sep 07 17:27:50.599659 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:27:50.599640    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a8913798b764e14cf50971ed3a9e61e31bd52083c84a903c2d3509c4f3b0d0c\": container with ID starting with 3a8913798b764e14cf50971ed3a9e61e31bd52083c84a903c2d3509c4f3b0d0c not found: ID does not exist" containerID="3a8913798b764e14cf50971ed3a9e61e31bd52083c84a903c2d3509c4f3b0d0c"
Sep 07 17:27:50.599721 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:50.599670    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a8913798b764e14cf50971ed3a9e61e31bd52083c84a903c2d3509c4f3b0d0c"} err="failed to get container status \"3a8913798b764e14cf50971ed3a9e61e31bd52083c84a903c2d3509c4f3b0d0c\": rpc error: code = NotFound desc = could not find container \"3a8913798b764e14cf50971ed3a9e61e31bd52083c84a903c2d3509c4f3b0d0c\": container with ID starting with 3a8913798b764e14cf50971ed3a9e61e31bd52083c84a903c2d3509c4f3b0d0c not found: ID does not exist"
Sep 07 17:27:50.613375 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:50.613351    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7fbf888cb7-b8flv"]
Sep 07 17:27:50.619501 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:50.619480    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7fbf888cb7-b8flv"]
Sep 07 17:27:51.381440 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:51.381407    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7fbf888cb7-9mv8f"]
Sep 07 17:27:51.381866 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:51.381813    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54b1189b-78d7-4489-9f73-76f495ac36a7" containerName="istio-proxy"
Sep 07 17:27:51.381866 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:51.381824    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="54b1189b-78d7-4489-9f73-76f495ac36a7" containerName="istio-proxy"
Sep 07 17:27:51.381866 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:51.381833    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c881d646-3676-4e81-bc1d-f3f099d46402" containerName="manager"
Sep 07 17:27:51.381866 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:51.381838    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c881d646-3676-4e81-bc1d-f3f099d46402" containerName="manager"
Sep 07 17:27:51.382092 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:51.381905    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c881d646-3676-4e81-bc1d-f3f099d46402" containerName="manager"
Sep 07 17:27:51.386063 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:51.386044    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fbf888cb7-9mv8f"
Sep 07 17:27:51.392692 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:51.392665    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 07 17:27:51.392839 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:51.392671    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 07 17:27:51.392839 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:51.392673    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 07 17:27:51.392839 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:51.392798    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8bspl\""
Sep 07 17:27:51.398923 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:51.398899    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7fbf888cb7-9mv8f"]
Sep 07 17:27:51.519402 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:51.519365    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60fe1f2b-0ed7-4ff9-8200-4a52652f5811-metrics-certs\") pod \"maas-controller-7fbf888cb7-9mv8f\" (UID: \"60fe1f2b-0ed7-4ff9-8200-4a52652f5811\") " pod="opendatahub/maas-controller-7fbf888cb7-9mv8f"
Sep 07 17:27:51.519606 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:51.519480    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/60fe1f2b-0ed7-4ff9-8200-4a52652f5811-webhook-cert\") pod \"maas-controller-7fbf888cb7-9mv8f\" (UID: \"60fe1f2b-0ed7-4ff9-8200-4a52652f5811\") " pod="opendatahub/maas-controller-7fbf888cb7-9mv8f"
Sep 07 17:27:51.519606 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:51.519524    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl4wz\" (UniqueName: \"kubernetes.io/projected/60fe1f2b-0ed7-4ff9-8200-4a52652f5811-kube-api-access-rl4wz\") pod \"maas-controller-7fbf888cb7-9mv8f\" (UID: \"60fe1f2b-0ed7-4ff9-8200-4a52652f5811\") " pod="opendatahub/maas-controller-7fbf888cb7-9mv8f"
Sep 07 17:27:51.594181 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:51.594149    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c881d646-3676-4e81-bc1d-f3f099d46402" path="/var/lib/kubelet/pods/c881d646-3676-4e81-bc1d-f3f099d46402/volumes"
Sep 07 17:27:51.620332 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:51.620306    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/60fe1f2b-0ed7-4ff9-8200-4a52652f5811-webhook-cert\") pod \"maas-controller-7fbf888cb7-9mv8f\" (UID: \"60fe1f2b-0ed7-4ff9-8200-4a52652f5811\") " pod="opendatahub/maas-controller-7fbf888cb7-9mv8f"
Sep 07 17:27:51.620476 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:51.620351    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl4wz\" (UniqueName: \"kubernetes.io/projected/60fe1f2b-0ed7-4ff9-8200-4a52652f5811-kube-api-access-rl4wz\") pod \"maas-controller-7fbf888cb7-9mv8f\" (UID: \"60fe1f2b-0ed7-4ff9-8200-4a52652f5811\") " pod="opendatahub/maas-controller-7fbf888cb7-9mv8f"
Sep 07 17:27:51.620476 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:51.620378    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60fe1f2b-0ed7-4ff9-8200-4a52652f5811-metrics-certs\") pod \"maas-controller-7fbf888cb7-9mv8f\" (UID: \"60fe1f2b-0ed7-4ff9-8200-4a52652f5811\") " pod="opendatahub/maas-controller-7fbf888cb7-9mv8f"
Sep 07 17:27:51.622763 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:51.622732    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60fe1f2b-0ed7-4ff9-8200-4a52652f5811-metrics-certs\") pod \"maas-controller-7fbf888cb7-9mv8f\" (UID: \"60fe1f2b-0ed7-4ff9-8200-4a52652f5811\") " pod="opendatahub/maas-controller-7fbf888cb7-9mv8f"
Sep 07 17:27:51.622879 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:51.622767    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/60fe1f2b-0ed7-4ff9-8200-4a52652f5811-webhook-cert\") pod \"maas-controller-7fbf888cb7-9mv8f\" (UID: \"60fe1f2b-0ed7-4ff9-8200-4a52652f5811\") " pod="opendatahub/maas-controller-7fbf888cb7-9mv8f"
Sep 07 17:27:51.631657 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:51.631601    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl4wz\" (UniqueName: \"kubernetes.io/projected/60fe1f2b-0ed7-4ff9-8200-4a52652f5811-kube-api-access-rl4wz\") pod \"maas-controller-7fbf888cb7-9mv8f\" (UID: \"60fe1f2b-0ed7-4ff9-8200-4a52652f5811\") " pod="opendatahub/maas-controller-7fbf888cb7-9mv8f"
Sep 07 17:27:51.697157 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:51.697131    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fbf888cb7-9mv8f"
Sep 07 17:27:51.977794 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:51.977768    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7fbf888cb7-9mv8f"]
Sep 07 17:27:51.978582 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:27:51.978561    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60fe1f2b_0ed7_4ff9_8200_4a52652f5811.slice/crio-72f26371c366c7c7cdb4b29827f4dcb550b180e2104d4b74430af5455ac05230 WatchSource:0}: Error finding container 72f26371c366c7c7cdb4b29827f4dcb550b180e2104d4b74430af5455ac05230: Status 404 returned error can't find the container with id 72f26371c366c7c7cdb4b29827f4dcb550b180e2104d4b74430af5455ac05230
Sep 07 17:27:52.602919 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:52.602873    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fbf888cb7-9mv8f" event={"ID":"60fe1f2b-0ed7-4ff9-8200-4a52652f5811","Type":"ContainerStarted","Data":"70dd6ccae00f0094cd29648dcf80034656c2f551380a25eef78023f4b62c477f"}
Sep 07 17:27:52.603446 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:52.602940    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fbf888cb7-9mv8f" event={"ID":"60fe1f2b-0ed7-4ff9-8200-4a52652f5811","Type":"ContainerStarted","Data":"72f26371c366c7c7cdb4b29827f4dcb550b180e2104d4b74430af5455ac05230"}
Sep 07 17:27:52.603446 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:52.602972    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7fbf888cb7-9mv8f"
Sep 07 17:27:52.628734 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:27:52.628623    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7fbf888cb7-9mv8f" podStartSLOduration=1.248965817 podStartE2EDuration="1.628601376s" totalImagesPullingTime="379.635559ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:27:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:27:52.624593097 +0000 UTC m=+1889.656023924" watchObservedRunningTime="2026-09-07 17:27:52.628601376 +0000 UTC m=+1889.660032168"
Sep 07 17:28:03.609097 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:28:03.609070    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7fbf888cb7-9mv8f"
Sep 07 17:30:23.951890 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:30:23.951856    2558 scope.go:117] "RemoveContainer" containerID="430cd255ae95cd19dba5480b92770fd1cb95020cea103024456b2d70d4f8eb5e"
Sep 07 17:31:23.773197 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:31:23.773168    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-f6srd_24750b4e-c0bc-4c3c-a256-6ca251306d06/console-operator/1.log"
Sep 07 17:31:23.781077 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:31:23.781054    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwj7s_9b97dbca-7e8f-4e05-9cc4-8f42785f01e7/ovn-acl-logging/0.log"
Sep 07 17:31:23.787370 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:31:23.787349    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-f6srd_24750b4e-c0bc-4c3c-a256-6ca251306d06/console-operator/1.log"
Sep 07 17:31:23.794648 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:31:23.794629    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwj7s_9b97dbca-7e8f-4e05-9cc4-8f42785f01e7/ovn-acl-logging/0.log"
Sep 07 17:31:23.970851 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:31:23.970822    2558 scope.go:117] "RemoveContainer" containerID="47cb36193e040aa383683180d246932362a8437f5d6ac551240605d7e657fe39"
Sep 07 17:32:32.220209 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:32.220173    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-65dbf959f5-df2h6"]
Sep 07 17:32:32.222475 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:32.220423    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-65dbf959f5-df2h6" podUID="2b771af0-80e0-463b-b45d-2c46461ed747" containerName="maas-api" containerID="cri-o://9de8902e05fccb6e606a681c6bda13f9636344b7304f091fafc648b6476e064a" gracePeriod=30
Sep 07 17:32:33.473414 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:33.473390    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-65dbf959f5-df2h6"
Sep 07 17:32:33.511956 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:33.511919    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b771af0-80e0-463b-b45d-2c46461ed747-maas-api-tls\") pod \"2b771af0-80e0-463b-b45d-2c46461ed747\" (UID: \"2b771af0-80e0-463b-b45d-2c46461ed747\") "
Sep 07 17:32:33.512134 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:33.512019    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b771af0-80e0-463b-b45d-2c46461ed747-openshift-service-ca\") pod \"2b771af0-80e0-463b-b45d-2c46461ed747\" (UID: \"2b771af0-80e0-463b-b45d-2c46461ed747\") "
Sep 07 17:32:33.512134 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:33.512054    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2ns8\" (UniqueName: \"kubernetes.io/projected/2b771af0-80e0-463b-b45d-2c46461ed747-kube-api-access-j2ns8\") pod \"2b771af0-80e0-463b-b45d-2c46461ed747\" (UID: \"2b771af0-80e0-463b-b45d-2c46461ed747\") "
Sep 07 17:32:33.512134 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:33.512119    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b771af0-80e0-463b-b45d-2c46461ed747-metrics-certs\") pod \"2b771af0-80e0-463b-b45d-2c46461ed747\" (UID: \"2b771af0-80e0-463b-b45d-2c46461ed747\") "
Sep 07 17:32:33.512443 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:33.512417    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b771af0-80e0-463b-b45d-2c46461ed747-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2b771af0-80e0-463b-b45d-2c46461ed747" (UID: "2b771af0-80e0-463b-b45d-2c46461ed747"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:32:33.514399 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:33.514371    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b771af0-80e0-463b-b45d-2c46461ed747-kube-api-access-j2ns8" (OuterVolumeSpecName: "kube-api-access-j2ns8") pod "2b771af0-80e0-463b-b45d-2c46461ed747" (UID: "2b771af0-80e0-463b-b45d-2c46461ed747"). InnerVolumeSpecName "kube-api-access-j2ns8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:32:33.514685 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:33.514659    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b771af0-80e0-463b-b45d-2c46461ed747-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2b771af0-80e0-463b-b45d-2c46461ed747" (UID: "2b771af0-80e0-463b-b45d-2c46461ed747"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:32:33.514685 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:33.514680    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b771af0-80e0-463b-b45d-2c46461ed747-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2b771af0-80e0-463b-b45d-2c46461ed747" (UID: "2b771af0-80e0-463b-b45d-2c46461ed747"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:32:33.613308 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:33.613275    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b771af0-80e0-463b-b45d-2c46461ed747-openshift-service-ca\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:32:33.613308 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:33.613302    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2ns8\" (UniqueName: \"kubernetes.io/projected/2b771af0-80e0-463b-b45d-2c46461ed747-kube-api-access-j2ns8\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:32:33.613308 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:33.613311    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b771af0-80e0-463b-b45d-2c46461ed747-metrics-certs\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:32:33.613513 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:33.613319    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b771af0-80e0-463b-b45d-2c46461ed747-maas-api-tls\") on node \"ip-10-0-131-84.ec2.internal\" DevicePath \"\""
Sep 07 17:32:34.046977 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:34.046940    2558 generic.go:356] "Generic (PLEG): container finished" podID="2b771af0-80e0-463b-b45d-2c46461ed747" containerID="9de8902e05fccb6e606a681c6bda13f9636344b7304f091fafc648b6476e064a" exitCode=0
Sep 07 17:32:34.047178 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:34.046999    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-65dbf959f5-df2h6"
Sep 07 17:32:34.047178 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:34.047029    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-65dbf959f5-df2h6" event={"ID":"2b771af0-80e0-463b-b45d-2c46461ed747","Type":"ContainerDied","Data":"9de8902e05fccb6e606a681c6bda13f9636344b7304f091fafc648b6476e064a"}
Sep 07 17:32:34.047178 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:34.047076    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-65dbf959f5-df2h6" event={"ID":"2b771af0-80e0-463b-b45d-2c46461ed747","Type":"ContainerDied","Data":"27e2f5e82396fa3cd49d468b9c47aa58739202967471ae1c544b622d4558fd5a"}
Sep 07 17:32:34.047178 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:34.047098    2558 scope.go:117] "RemoveContainer" containerID="9de8902e05fccb6e606a681c6bda13f9636344b7304f091fafc648b6476e064a"
Sep 07 17:32:34.056067 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:34.056042    2558 scope.go:117] "RemoveContainer" containerID="9de8902e05fccb6e606a681c6bda13f9636344b7304f091fafc648b6476e064a"
Sep 07 17:32:34.056352 ip-10-0-131-84 kubenswrapper[2558]: E0907 17:32:34.056331    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9de8902e05fccb6e606a681c6bda13f9636344b7304f091fafc648b6476e064a\": container with ID starting with 9de8902e05fccb6e606a681c6bda13f9636344b7304f091fafc648b6476e064a not found: ID does not exist" containerID="9de8902e05fccb6e606a681c6bda13f9636344b7304f091fafc648b6476e064a"
Sep 07 17:32:34.056414 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:34.056360    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9de8902e05fccb6e606a681c6bda13f9636344b7304f091fafc648b6476e064a"} err="failed to get container status \"9de8902e05fccb6e606a681c6bda13f9636344b7304f091fafc648b6476e064a\": rpc error: code = NotFound desc = could not find container \"9de8902e05fccb6e606a681c6bda13f9636344b7304f091fafc648b6476e064a\": container with ID starting with 9de8902e05fccb6e606a681c6bda13f9636344b7304f091fafc648b6476e064a not found: ID does not exist"
Sep 07 17:32:34.066672 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:34.066647    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-65dbf959f5-df2h6"]
Sep 07 17:32:34.071628 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:34.071607    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-65dbf959f5-df2h6"]
Sep 07 17:32:35.599576 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:35.599540    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b771af0-80e0-463b-b45d-2c46461ed747" path="/var/lib/kubelet/pods/2b771af0-80e0-463b-b45d-2c46461ed747/volumes"
Sep 07 17:32:36.445479 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:36.445433    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-65dbf959f5-df2h6" podUID="2b771af0-80e0-463b-b45d-2c46461ed747" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.40:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Sep 07 17:32:48.832614 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:48.832582    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5d495b56f5-fr6hb_455bd64c-3cf6-4ec7-a5ed-3f63af916bdb/authorino/0.log"
Sep 07 17:32:54.030595 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:54.030563    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-9b5nj_3dabb2db-254b-47a8-9aa3-42860d1a91cd/manager/1.log"
Sep 07 17:32:54.149504 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:54.149461    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-l667g_6dc35201-0282-4160-8c00-99a7ce9e5101/manager/0.log"
Sep 07 17:32:54.268537 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:54.268509    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7fbf888cb7-9mv8f_60fe1f2b-0ed7-4ff9-8200-4a52652f5811/manager/0.log"
Sep 07 17:32:54.515797 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:54.515766    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-fpl6h_953d4e8b-0139-44b7-947e-9a06fc7af205/manager/0.log"
Sep 07 17:32:54.742172 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:54.742141    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f6f7795c7-ddqvr_93400a1d-edf8-4e7b-8dd6-e7947111f6ce/copy-manifests/0.log"
Sep 07 17:32:54.754539 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:54.754509    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f6f7795c7-ddqvr_93400a1d-edf8-4e7b-8dd6-e7947111f6ce/manager/0.log"
Sep 07 17:32:55.645029 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:55.644995    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-xx86k_bcd96fa7-a697-4903-ba6a-92181c1bcc5b/postgres/0.log"
Sep 07 17:32:56.412066 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:56.412032    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5d495b56f5-fr6hb_455bd64c-3cf6-4ec7-a5ed-3f63af916bdb/authorino/0.log"
Sep 07 17:32:56.524930 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:56.524892    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-qg2z4_28d1d893-cb6b-4a8c-a40b-fd36d2b8d2e2/manager/0.log"
Sep 07 17:32:56.636755 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:56.636722    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-5hpfd_37a62ba3-3ee0-420b-a540-32f60d43b3d8/manager/0.log"
Sep 07 17:32:56.739305 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:56.739191    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-8dt2n_35f46763-9a47-4394-9453-12577eb35b3f/kuadrant-console-plugin/0.log"
Sep 07 17:32:57.091366 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:57.091286    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-fl9sb_e005c58a-0024-4ff3-ab1b-d0e6543a9885/manager/0.log"
Sep 07 17:32:57.437502 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:57.437475    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g_79fd7621-ac15-4c0f-b9ac-15667195a26e/istio-proxy/0.log"
Sep 07 17:32:57.768136 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:57.768046    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b977b55fb-l74k5_db528ab7-14df-446e-b347-33cd95589e50/kube-auth-proxy/0.log"
Sep 07 17:32:57.890111 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:57.890068    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wk6hz_9c7d1bab-dd03-424b-a348-0576b99f691f/istio-proxy/1.log"
Sep 07 17:32:58.117704 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:58.117672    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-d4wsh_ecfe0367-8dc5-4314-9eb3-cb9d1b7e7087/payload-processing/0.log"
Sep 07 17:32:58.233162 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:58.233116    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-868d865496-l5lhw_fcf33d4f-f41e-4380-be30-ba07d4b8dd16/router/0.log"
Sep 07 17:32:58.567302 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:58.567214    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-57dgm_6d3d56d7-2474-4966-beed-e822dd423344/main/0.log"
Sep 07 17:32:58.680152 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:58.680115    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-th5zw_e3274daa-bb37-482c-8c33-46d1ac6b38f6/main/0.log"
Sep 07 17:32:59.130717 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:32:59.130684    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-sfq5z_0fefec1a-0e03-4a0c-963a-91ef300f74cb/main/0.log"
Sep 07 17:33:04.549229 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:04.549191    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-brnxc/must-gather-mv6q6"]
Sep 07 17:33:04.549765 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:04.549596    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b771af0-80e0-463b-b45d-2c46461ed747" containerName="maas-api"
Sep 07 17:33:04.549765 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:04.549607    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b771af0-80e0-463b-b45d-2c46461ed747" containerName="maas-api"
Sep 07 17:33:04.549765 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:04.549671    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b771af0-80e0-463b-b45d-2c46461ed747" containerName="maas-api"
Sep 07 17:33:04.552735 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:04.552718    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-brnxc/must-gather-mv6q6"
Sep 07 17:33:04.556537 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:04.556515    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-brnxc\"/\"kube-root-ca.crt\""
Sep 07 17:33:04.556677 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:04.556650    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-brnxc\"/\"openshift-service-ca.crt\""
Sep 07 17:33:04.575350 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:04.575324    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-brnxc/must-gather-mv6q6"]
Sep 07 17:33:04.690899 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:04.690868    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/05f7e9d2-c830-4bfb-a0f3-a7a665fd1dc9-must-gather-output\") pod \"must-gather-mv6q6\" (UID: \"05f7e9d2-c830-4bfb-a0f3-a7a665fd1dc9\") " pod="openshift-must-gather-brnxc/must-gather-mv6q6"
Sep 07 17:33:04.691075 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:04.690926    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swnq4\" (UniqueName: \"kubernetes.io/projected/05f7e9d2-c830-4bfb-a0f3-a7a665fd1dc9-kube-api-access-swnq4\") pod \"must-gather-mv6q6\" (UID: \"05f7e9d2-c830-4bfb-a0f3-a7a665fd1dc9\") " pod="openshift-must-gather-brnxc/must-gather-mv6q6"
Sep 07 17:33:04.792182 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:04.792147    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/05f7e9d2-c830-4bfb-a0f3-a7a665fd1dc9-must-gather-output\") pod \"must-gather-mv6q6\" (UID: \"05f7e9d2-c830-4bfb-a0f3-a7a665fd1dc9\") " pod="openshift-must-gather-brnxc/must-gather-mv6q6"
Sep 07 17:33:04.792378 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:04.792207    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swnq4\" (UniqueName: \"kubernetes.io/projected/05f7e9d2-c830-4bfb-a0f3-a7a665fd1dc9-kube-api-access-swnq4\") pod \"must-gather-mv6q6\" (UID: \"05f7e9d2-c830-4bfb-a0f3-a7a665fd1dc9\") " pod="openshift-must-gather-brnxc/must-gather-mv6q6"
Sep 07 17:33:04.792581 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:04.792557    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/05f7e9d2-c830-4bfb-a0f3-a7a665fd1dc9-must-gather-output\") pod \"must-gather-mv6q6\" (UID: \"05f7e9d2-c830-4bfb-a0f3-a7a665fd1dc9\") " pod="openshift-must-gather-brnxc/must-gather-mv6q6"
Sep 07 17:33:04.810118 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:04.810050    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swnq4\" (UniqueName: \"kubernetes.io/projected/05f7e9d2-c830-4bfb-a0f3-a7a665fd1dc9-kube-api-access-swnq4\") pod \"must-gather-mv6q6\" (UID: \"05f7e9d2-c830-4bfb-a0f3-a7a665fd1dc9\") " pod="openshift-must-gather-brnxc/must-gather-mv6q6"
Sep 07 17:33:04.861634 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:04.861604    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-brnxc/must-gather-mv6q6"
Sep 07 17:33:05.138281 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:05.138256    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-brnxc/must-gather-mv6q6"]
Sep 07 17:33:05.140896 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:33:05.140866    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod05f7e9d2_c830_4bfb_a0f3_a7a665fd1dc9.slice/crio-311f7cc974e4747844fdbdcb2617d0f914cead165020183a766b0ba353b53af5 WatchSource:0}: Error finding container 311f7cc974e4747844fdbdcb2617d0f914cead165020183a766b0ba353b53af5: Status 404 returned error can't find the container with id 311f7cc974e4747844fdbdcb2617d0f914cead165020183a766b0ba353b53af5
Sep 07 17:33:05.143103 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:05.143085    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 17:33:05.208855 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:05.208824    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-brnxc/must-gather-mv6q6" event={"ID":"05f7e9d2-c830-4bfb-a0f3-a7a665fd1dc9","Type":"ContainerStarted","Data":"311f7cc974e4747844fdbdcb2617d0f914cead165020183a766b0ba353b53af5"}
Sep 07 17:33:06.216915 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:06.216878    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-brnxc/must-gather-mv6q6" event={"ID":"05f7e9d2-c830-4bfb-a0f3-a7a665fd1dc9","Type":"ContainerStarted","Data":"b067c5e228197571137e34fd957cb80a99df874660d5a40e3c066c0cba05994b"}
Sep 07 17:33:07.227210 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:07.227156    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-brnxc/must-gather-mv6q6" event={"ID":"05f7e9d2-c830-4bfb-a0f3-a7a665fd1dc9","Type":"ContainerStarted","Data":"38f42444d13d3bb67460735e5bcbda660dc2c0d02bc2e404cd7599b707a66da7"}
Sep 07 17:33:07.248718 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:07.248659    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-brnxc/must-gather-mv6q6" podStartSLOduration=2.352394014 podStartE2EDuration="3.248642648s" totalImagesPullingTime="896.248634ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:33:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:33:07.247771861 +0000 UTC m=+2204.279202654" watchObservedRunningTime="2026-09-07 17:33:07.248642648 +0000 UTC m=+2204.280073439"
Sep 07 17:33:07.893874 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:07.893837    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tfbtz_3475a555-fcbb-4145-bf0a-91a8d6b0099b/global-pull-secret-syncer/0.log"
Sep 07 17:33:08.033689 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:08.033657    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-r4pfn_05b23baa-883b-420a-afc8-ed4f9dd1a534/konnectivity-agent/0.log"
Sep 07 17:33:08.090932 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:08.090891    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-84.ec2.internal_2bcf0fe9132996095ce4831570ed6ab9/haproxy/0.log"
Sep 07 17:33:13.137257 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:13.133833    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5d495b56f5-fr6hb_455bd64c-3cf6-4ec7-a5ed-3f63af916bdb/authorino/0.log"
Sep 07 17:33:13.170279 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:13.170247    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-qg2z4_28d1d893-cb6b-4a8c-a40b-fd36d2b8d2e2/manager/0.log"
Sep 07 17:33:13.217662 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:13.217618    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-5hpfd_37a62ba3-3ee0-420b-a540-32f60d43b3d8/manager/0.log"
Sep 07 17:33:13.252633 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:13.252591    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-8dt2n_35f46763-9a47-4394-9453-12577eb35b3f/kuadrant-console-plugin/0.log"
Sep 07 17:33:13.408595 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:13.408487    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-fl9sb_e005c58a-0024-4ff3-ab1b-d0e6543a9885/manager/0.log"
Sep 07 17:33:15.019521 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:15.019483    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-bc6d9_96e71053-7215-446f-b880-5c7236d5ab72/cluster-monitoring-operator/0.log"
Sep 07 17:33:15.469327 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:15.469297    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kw2pf_eeade69a-8b74-4e5d-b851-9f36d7af50f5/node-exporter/0.log"
Sep 07 17:33:15.503428 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:15.503365    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kw2pf_eeade69a-8b74-4e5d-b851-9f36d7af50f5/kube-rbac-proxy/0.log"
Sep 07 17:33:15.539925 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:15.539900    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kw2pf_eeade69a-8b74-4e5d-b851-9f36d7af50f5/init-textfile/0.log"
Sep 07 17:33:17.284987 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:17.284949    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-brnxc/perf-node-gather-daemonset-4f8sw"]
Sep 07 17:33:17.290117 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:17.290085    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-4f8sw"
Sep 07 17:33:17.293965 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:17.293942    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-brnxc\"/\"default-dockercfg-6bd8x\""
Sep 07 17:33:17.306713 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:17.306681    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-brnxc/perf-node-gather-daemonset-4f8sw"]
Sep 07 17:33:17.332533 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:17.332498    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dd7079e4-6f0e-4299-ad39-c268c5aeb3f2-proc\") pod \"perf-node-gather-daemonset-4f8sw\" (UID: \"dd7079e4-6f0e-4299-ad39-c268c5aeb3f2\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-4f8sw"
Sep 07 17:33:17.332718 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:17.332552    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd7079e4-6f0e-4299-ad39-c268c5aeb3f2-sys\") pod \"perf-node-gather-daemonset-4f8sw\" (UID: \"dd7079e4-6f0e-4299-ad39-c268c5aeb3f2\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-4f8sw"
Sep 07 17:33:17.332718 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:17.332579    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dd7079e4-6f0e-4299-ad39-c268c5aeb3f2-podres\") pod \"perf-node-gather-daemonset-4f8sw\" (UID: \"dd7079e4-6f0e-4299-ad39-c268c5aeb3f2\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-4f8sw"
Sep 07 17:33:17.332718 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:17.332647    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd7079e4-6f0e-4299-ad39-c268c5aeb3f2-lib-modules\") pod \"perf-node-gather-daemonset-4f8sw\" (UID: \"dd7079e4-6f0e-4299-ad39-c268c5aeb3f2\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-4f8sw"
Sep 07 17:33:17.332718 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:17.332679    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24wjr\" (UniqueName: \"kubernetes.io/projected/dd7079e4-6f0e-4299-ad39-c268c5aeb3f2-kube-api-access-24wjr\") pod \"perf-node-gather-daemonset-4f8sw\" (UID: \"dd7079e4-6f0e-4299-ad39-c268c5aeb3f2\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-4f8sw"
Sep 07 17:33:17.433481 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:17.433441    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dd7079e4-6f0e-4299-ad39-c268c5aeb3f2-proc\") pod \"perf-node-gather-daemonset-4f8sw\" (UID: \"dd7079e4-6f0e-4299-ad39-c268c5aeb3f2\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-4f8sw"
Sep 07 17:33:17.433481 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:17.433486    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd7079e4-6f0e-4299-ad39-c268c5aeb3f2-sys\") pod \"perf-node-gather-daemonset-4f8sw\" (UID: \"dd7079e4-6f0e-4299-ad39-c268c5aeb3f2\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-4f8sw"
Sep 07 17:33:17.433727 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:17.433508    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dd7079e4-6f0e-4299-ad39-c268c5aeb3f2-podres\") pod \"perf-node-gather-daemonset-4f8sw\" (UID: \"dd7079e4-6f0e-4299-ad39-c268c5aeb3f2\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-4f8sw"
Sep 07 17:33:17.433727 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:17.433549    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd7079e4-6f0e-4299-ad39-c268c5aeb3f2-lib-modules\") pod \"perf-node-gather-daemonset-4f8sw\" (UID: \"dd7079e4-6f0e-4299-ad39-c268c5aeb3f2\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-4f8sw"
Sep 07 17:33:17.433727 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:17.433573    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24wjr\" (UniqueName: \"kubernetes.io/projected/dd7079e4-6f0e-4299-ad39-c268c5aeb3f2-kube-api-access-24wjr\") pod \"perf-node-gather-daemonset-4f8sw\" (UID: \"dd7079e4-6f0e-4299-ad39-c268c5aeb3f2\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-4f8sw"
Sep 07 17:33:17.433727 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:17.433592    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dd7079e4-6f0e-4299-ad39-c268c5aeb3f2-proc\") pod \"perf-node-gather-daemonset-4f8sw\" (UID: \"dd7079e4-6f0e-4299-ad39-c268c5aeb3f2\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-4f8sw"
Sep 07 17:33:17.433727 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:17.433591    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd7079e4-6f0e-4299-ad39-c268c5aeb3f2-sys\") pod \"perf-node-gather-daemonset-4f8sw\" (UID: \"dd7079e4-6f0e-4299-ad39-c268c5aeb3f2\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-4f8sw"
Sep 07 17:33:17.433727 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:17.433691    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd7079e4-6f0e-4299-ad39-c268c5aeb3f2-lib-modules\") pod \"perf-node-gather-daemonset-4f8sw\" (UID: \"dd7079e4-6f0e-4299-ad39-c268c5aeb3f2\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-4f8sw"
Sep 07 17:33:17.433727 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:17.433698    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dd7079e4-6f0e-4299-ad39-c268c5aeb3f2-podres\") pod \"perf-node-gather-daemonset-4f8sw\" (UID: \"dd7079e4-6f0e-4299-ad39-c268c5aeb3f2\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-4f8sw"
Sep 07 17:33:17.443530 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:17.443500    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24wjr\" (UniqueName: \"kubernetes.io/projected/dd7079e4-6f0e-4299-ad39-c268c5aeb3f2-kube-api-access-24wjr\") pod \"perf-node-gather-daemonset-4f8sw\" (UID: \"dd7079e4-6f0e-4299-ad39-c268c5aeb3f2\") " pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-4f8sw"
Sep 07 17:33:17.607961 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:17.607934    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-4f8sw"
Sep 07 17:33:17.908057 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:17.908022    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-brnxc/perf-node-gather-daemonset-4f8sw"]
Sep 07 17:33:17.912336 ip-10-0-131-84 kubenswrapper[2558]: W0907 17:33:17.911532    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddd7079e4_6f0e_4299_ad39_c268c5aeb3f2.slice/crio-fbea85f01830e0cd93dfb08eb059b52693b62c303f52426de4d603e5aba536e2 WatchSource:0}: Error finding container fbea85f01830e0cd93dfb08eb059b52693b62c303f52426de4d603e5aba536e2: Status 404 returned error can't find the container with id fbea85f01830e0cd93dfb08eb059b52693b62c303f52426de4d603e5aba536e2
Sep 07 17:33:18.039915 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:18.039884    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-f6srd_24750b4e-c0bc-4c3c-a256-6ca251306d06/console-operator/1.log"
Sep 07 17:33:18.046468 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:18.046438    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-f6srd_24750b4e-c0bc-4c3c-a256-6ca251306d06/console-operator/2.log"
Sep 07 17:33:18.328468 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:18.328372    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-4f8sw" event={"ID":"dd7079e4-6f0e-4299-ad39-c268c5aeb3f2","Type":"ContainerStarted","Data":"c10e45a7ce0a9483eedc679915fc71757f33f11ece09c3d2d846603b9eb83cc8"}
Sep 07 17:33:18.328926 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:18.328487    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-4f8sw" event={"ID":"dd7079e4-6f0e-4299-ad39-c268c5aeb3f2","Type":"ContainerStarted","Data":"fbea85f01830e0cd93dfb08eb059b52693b62c303f52426de4d603e5aba536e2"}
Sep 07 17:33:18.354017 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:18.353951    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-4f8sw" podStartSLOduration=1.353929469 podStartE2EDuration="1.353929469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 17:33:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:33:18.350401778 +0000 UTC m=+2215.381832574" watchObservedRunningTime="2026-09-07 17:33:18.353929469 +0000 UTC m=+2215.385360261"
Sep 07 17:33:19.332271 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:19.332221    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-cmlx2_f23afbe6-ab97-47a4-ac01-f2fd36cc0e6b/volume-data-source-validator/0.log"
Sep 07 17:33:19.334842 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:19.334814    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-4f8sw"
Sep 07 17:33:20.390897 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:20.390859    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-26spm_5ce4365f-988f-4113-bee7-d55fd58dbff3/dns/0.log"
Sep 07 17:33:20.413848 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:20.413820    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-26spm_5ce4365f-988f-4113-bee7-d55fd58dbff3/kube-rbac-proxy/0.log"
Sep 07 17:33:20.596656 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:20.596624    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hj7sr_4fd644cb-0777-45a8-94a9-129dd37858f1/dns-node-resolver/0.log"
Sep 07 17:33:21.219366 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:21.219341    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vnzgb_a477d932-fad5-4317-bfd7-2c5f56eb234f/node-ca/0.log"
Sep 07 17:33:22.213727 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:22.213699    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g_79fd7621-ac15-4c0f-b9ac-15667195a26e/istio-proxy/0.log"
Sep 07 17:33:22.552578 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:22.552509    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b977b55fb-l74k5_db528ab7-14df-446e-b347-33cd95589e50/kube-auth-proxy/0.log"
Sep 07 17:33:22.585980 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:22.585948    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wk6hz_9c7d1bab-dd03-424b-a348-0576b99f691f/istio-proxy/0.log"
Sep 07 17:33:22.597520 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:22.597494    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wk6hz_9c7d1bab-dd03-424b-a348-0576b99f691f/istio-proxy/1.log"
Sep 07 17:33:22.670788 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:22.670760    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-d4wsh_ecfe0367-8dc5-4314-9eb3-cb9d1b7e7087/payload-processing/0.log"
Sep 07 17:33:22.697534 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:22.697492    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-868d865496-l5lhw_fcf33d4f-f41e-4380-be30-ba07d4b8dd16/router/0.log"
Sep 07 17:33:23.584378 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:23.584348    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cbxtz_379961e8-79b6-4026-9fdd-1f914d83870d/serve-healthcheck-canary/0.log"
Sep 07 17:33:24.146055 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:24.146019    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-fkmqj_3dc65911-abc9-4e9c-95ee-3f766159f1c3/insights-operator/0.log"
Sep 07 17:33:24.146810 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:24.146788    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-fkmqj_3dc65911-abc9-4e9c-95ee-3f766159f1c3/insights-operator/1.log"
Sep 07 17:33:24.169567 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:24.169537    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nh4xg_483bf37d-ca55-477b-a045-5d411f45a9b3/kube-rbac-proxy/0.log"
Sep 07 17:33:24.191761 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:24.191733    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nh4xg_483bf37d-ca55-477b-a045-5d411f45a9b3/exporter/0.log"
Sep 07 17:33:24.216141 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:24.216107    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nh4xg_483bf37d-ca55-477b-a045-5d411f45a9b3/extractor/0.log"
Sep 07 17:33:25.356825 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:25.356788    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-brnxc/perf-node-gather-daemonset-4f8sw"
Sep 07 17:33:26.618040 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:26.617977    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-9b5nj_3dabb2db-254b-47a8-9aa3-42860d1a91cd/manager/0.log"
Sep 07 17:33:26.619187 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:26.619165    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-9b5nj_3dabb2db-254b-47a8-9aa3-42860d1a91cd/manager/1.log"
Sep 07 17:33:26.853779 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:26.853746    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-l667g_6dc35201-0282-4160-8c00-99a7ce9e5101/manager/0.log"
Sep 07 17:33:26.918195 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:26.918113    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7fbf888cb7-9mv8f_60fe1f2b-0ed7-4ff9-8200-4a52652f5811/manager/0.log"
Sep 07 17:33:27.046978 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:27.046944    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-fpl6h_953d4e8b-0139-44b7-947e-9a06fc7af205/manager/0.log"
Sep 07 17:33:27.196591 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:27.196508    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f6f7795c7-ddqvr_93400a1d-edf8-4e7b-8dd6-e7947111f6ce/manager/0.log"
Sep 07 17:33:27.216371 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:27.216343    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f6f7795c7-ddqvr_93400a1d-edf8-4e7b-8dd6-e7947111f6ce/copy-manifests/0.log"
Sep 07 17:33:28.117900 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:28.117861    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g_79fd7621-ac15-4c0f-b9ac-15667195a26e/istio-proxy/0.log"
Sep 07 17:33:28.420906 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:28.420872    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b977b55fb-l74k5_db528ab7-14df-446e-b347-33cd95589e50/kube-auth-proxy/0.log"
Sep 07 17:33:28.441692 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:28.441661    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wk6hz_9c7d1bab-dd03-424b-a348-0576b99f691f/istio-proxy/0.log"
Sep 07 17:33:28.454953 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:28.454876    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wk6hz_9c7d1bab-dd03-424b-a348-0576b99f691f/istio-proxy/1.log"
Sep 07 17:33:28.509692 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:28.509656    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-d4wsh_ecfe0367-8dc5-4314-9eb3-cb9d1b7e7087/payload-processing/0.log"
Sep 07 17:33:28.526020 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:28.525975    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-868d865496-l5lhw_fcf33d4f-f41e-4380-be30-ba07d4b8dd16/router/0.log"
Sep 07 17:33:30.033128 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:30.033075    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g_79fd7621-ac15-4c0f-b9ac-15667195a26e/istio-proxy/0.log"
Sep 07 17:33:30.340420 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:30.340344    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b977b55fb-l74k5_db528ab7-14df-446e-b347-33cd95589e50/kube-auth-proxy/0.log"
Sep 07 17:33:30.384793 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:30.384760    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wk6hz_9c7d1bab-dd03-424b-a348-0576b99f691f/istio-proxy/0.log"
Sep 07 17:33:30.394071 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:30.394046    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wk6hz_9c7d1bab-dd03-424b-a348-0576b99f691f/istio-proxy/1.log"
Sep 07 17:33:30.483152 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:30.483118    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-d4wsh_ecfe0367-8dc5-4314-9eb3-cb9d1b7e7087/payload-processing/0.log"
Sep 07 17:33:30.501338 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:30.501270    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-868d865496-l5lhw_fcf33d4f-f41e-4380-be30-ba07d4b8dd16/router/0.log"
Sep 07 17:33:34.526078 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:34.526047    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-r987z_231f4bfa-55eb-4533-a0b0-f6d845f5fe0f/kube-storage-version-migrator-operator/1.log"
Sep 07 17:33:34.526797 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:34.526777    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-r987z_231f4bfa-55eb-4533-a0b0-f6d845f5fe0f/kube-storage-version-migrator-operator/0.log"
Sep 07 17:33:35.687791 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:35.687710    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9xhzz_e526a4b1-0e57-478e-ad59-7f160bbdbcc1/kube-multus-additional-cni-plugins/0.log"
Sep 07 17:33:35.712280 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:35.712228    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9xhzz_e526a4b1-0e57-478e-ad59-7f160bbdbcc1/egress-router-binary-copy/0.log"
Sep 07 17:33:35.737021 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:35.736995    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9xhzz_e526a4b1-0e57-478e-ad59-7f160bbdbcc1/cni-plugins/0.log"
Sep 07 17:33:35.758838 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:35.758811    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9xhzz_e526a4b1-0e57-478e-ad59-7f160bbdbcc1/bond-cni-plugin/0.log"
Sep 07 17:33:35.783914 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:35.783868    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9xhzz_e526a4b1-0e57-478e-ad59-7f160bbdbcc1/routeoverride-cni/0.log"
Sep 07 17:33:35.810749 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:35.810716    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9xhzz_e526a4b1-0e57-478e-ad59-7f160bbdbcc1/whereabouts-cni-bincopy/0.log"
Sep 07 17:33:35.834007 ip-10-0-131-84 kubenswrapper[2558]: I0907 17:33:35.833970    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9xhzz_e526a4b1-0e57-478e-ad59-7f160bbdbcc1/whereabouts-cni/0.log"