Sep 08 11:28:24.307319 ip-10-0-136-127 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 08 11:28:24.307447 ip-10-0-136-127 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 08 11:28:24.307536 ip-10-0-136-127 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 08 11:28:24.308044 ip-10-0-136-127 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 08 11:28:34.309553 ip-10-0-136-127 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 08 11:28:34.309576 ip-10-0-136-127 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot e9a97e0ad18d4ccb91e3dfff16eb3cd0 --
Sep 08 11:30:23.800929 ip-10-0-136-127 systemd[1]: Starting Kubernetes Kubelet...
Sep 08 11:30:24.207137 ip-10-0-136-127 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 11:30:24.207137 ip-10-0-136-127 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 08 11:30:24.207137 ip-10-0-136-127 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 11:30:24.207137 ip-10-0-136-127 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 08 11:30:24.207754 ip-10-0-136-127 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 11:30:24.207754 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.207206    2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 08 11:30:24.212100 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212079    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 11:30:24.212100 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212098    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 11:30:24.212100 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212102    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 11:30:24.212191 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212105    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 11:30:24.212191 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212108    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 11:30:24.212191 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212111    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 11:30:24.212191 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212113    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 11:30:24.212191 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212116    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 11:30:24.212191 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212118    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 11:30:24.212191 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212121    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 11:30:24.212191 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212124    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 11:30:24.212191 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212127    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 11:30:24.212191 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212130    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 11:30:24.212191 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212132    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 11:30:24.212191 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212140    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 11:30:24.212191 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212142    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 11:30:24.212191 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212145    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 11:30:24.212191 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212147    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 11:30:24.212191 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212150    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 11:30:24.212191 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212152    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 11:30:24.212191 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212155    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 11:30:24.212191 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212158    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 11:30:24.212191 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212160    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 11:30:24.212670 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212162    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 11:30:24.212670 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212165    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 11:30:24.212670 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212168    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 11:30:24.212670 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212170    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 11:30:24.212670 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212172    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 11:30:24.212670 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212175    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 11:30:24.212670 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212177    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 11:30:24.212670 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212180    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 11:30:24.212670 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212183    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 11:30:24.212670 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212185    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 11:30:24.212670 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212187    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 11:30:24.212670 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212190    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 11:30:24.212670 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212193    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 11:30:24.212670 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212196    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 11:30:24.212670 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212199    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 11:30:24.212670 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212201    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 11:30:24.212670 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212204    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 11:30:24.212670 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212207    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 11:30:24.212670 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212209    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 11:30:24.213119 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212211    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 11:30:24.213119 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212215    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 11:30:24.213119 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212219    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 11:30:24.213119 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212222    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 11:30:24.213119 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212225    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 11:30:24.213119 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212227    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 11:30:24.213119 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212230    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 11:30:24.213119 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212232    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 11:30:24.213119 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212235    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 11:30:24.213119 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212237    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 11:30:24.213119 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212239    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 11:30:24.213119 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212241    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 11:30:24.213119 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212244    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 11:30:24.213119 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212246    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 11:30:24.213119 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212249    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 11:30:24.213119 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212252    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 11:30:24.213119 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212254    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 11:30:24.213119 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212256    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 11:30:24.213119 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212259    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 11:30:24.213119 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212261    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 11:30:24.213592 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212263    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 11:30:24.213592 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212266    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 11:30:24.213592 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212268    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 11:30:24.213592 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212270    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 11:30:24.213592 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212273    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 11:30:24.213592 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212275    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 11:30:24.213592 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212277    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 11:30:24.213592 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212280    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 11:30:24.213592 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212282    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 11:30:24.213592 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212285    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 11:30:24.213592 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212288    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 11:30:24.213592 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212292    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 11:30:24.213592 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212295    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 11:30:24.213592 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212299    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 11:30:24.213592 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212302    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 11:30:24.213592 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212305    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 11:30:24.213592 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212307    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 11:30:24.213592 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212310    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 11:30:24.213592 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212312    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 11:30:24.214080 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212316    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 11:30:24.214080 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212319    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 11:30:24.214080 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212322    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 11:30:24.214080 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212325    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 11:30:24.214080 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212327    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 11:30:24.214080 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212330    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 11:30:24.214080 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212332    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 11:30:24.214080 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212336    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 11:30:24.214080 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212339    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 11:30:24.214080 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212341    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 11:30:24.214080 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212344    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 11:30:24.214080 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212346    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 11:30:24.214080 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212348    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 11:30:24.214080 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212351    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 11:30:24.214080 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212354    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 11:30:24.214080 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212356    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 11:30:24.214080 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212359    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 11:30:24.214080 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.212361    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 11:30:24.214534 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214521    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 11:30:24.214560 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214535    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 11:30:24.214560 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214539    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 11:30:24.214560 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214542    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 11:30:24.214560 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214545    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 11:30:24.214560 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214548    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 11:30:24.214560 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214550    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 11:30:24.214560 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214553    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 11:30:24.214560 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214556    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 11:30:24.214560 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214558    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 11:30:24.214560 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214561    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 11:30:24.214807 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214570    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 11:30:24.214807 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214574    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 11:30:24.214807 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214577    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 11:30:24.214807 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214579    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 11:30:24.214807 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214582    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 11:30:24.214807 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214584    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 11:30:24.214807 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214587    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 11:30:24.214807 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214589    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 11:30:24.214807 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214592    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 11:30:24.214807 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214594    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 11:30:24.214807 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214611    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 11:30:24.214807 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214614    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 11:30:24.214807 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214616    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 11:30:24.214807 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214619    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 11:30:24.214807 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214621    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 11:30:24.214807 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214624    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 11:30:24.214807 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214626    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 11:30:24.214807 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214628    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 11:30:24.214807 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214631    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 11:30:24.215273 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214633    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 11:30:24.215273 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214636    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 11:30:24.215273 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214638    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 11:30:24.215273 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214641    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 11:30:24.215273 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214643    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 11:30:24.215273 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214645    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 11:30:24.215273 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214648    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 11:30:24.215273 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214650    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 11:30:24.215273 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214653    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 11:30:24.215273 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214655    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 11:30:24.215273 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214658    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 11:30:24.215273 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214660    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 11:30:24.215273 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214662    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 11:30:24.215273 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214665    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 11:30:24.215273 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214669    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 11:30:24.215273 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214674    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 11:30:24.215273 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214678    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 11:30:24.215273 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214681    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 11:30:24.215273 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214684    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 11:30:24.215744 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214687    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 11:30:24.215744 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214689    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 11:30:24.215744 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214692    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 11:30:24.215744 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214695    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 11:30:24.215744 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214697    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 11:30:24.215744 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214699    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 11:30:24.215744 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214702    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 11:30:24.215744 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214704    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 11:30:24.215744 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214707    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 11:30:24.215744 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214709    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 11:30:24.215744 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214712    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 11:30:24.215744 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214714    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 11:30:24.215744 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214716    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 11:30:24.215744 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214719    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 11:30:24.215744 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214722    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 11:30:24.215744 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214724    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 11:30:24.215744 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214727    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 11:30:24.215744 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214729    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 11:30:24.215744 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214732    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 11:30:24.215744 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214735    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 11:30:24.216242 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214737    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 11:30:24.216242 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214740    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 11:30:24.216242 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214743    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 11:30:24.216242 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214746    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 11:30:24.216242 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214748    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 11:30:24.216242 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214751    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 11:30:24.216242 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214755    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 11:30:24.216242 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214759    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 11:30:24.216242 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214762    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 11:30:24.216242 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214764    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 11:30:24.216242 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214767    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 11:30:24.216242 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214770    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 11:30:24.216242 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214772    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 11:30:24.216242 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214775    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 11:30:24.216242 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214778    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 11:30:24.216242 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214780    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 11:30:24.216242 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214783    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 11:30:24.216242 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214785    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 11:30:24.216242 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214788    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 11:30:24.216242 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214790    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 11:30:24.216728 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214792    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 11:30:24.216728 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214795    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 11:30:24.216728 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214797    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 11:30:24.216728 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214800    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 11:30:24.216728 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214802    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 11:30:24.216728 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214805    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 11:30:24.216728 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214807    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 11:30:24.216728 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214810    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 11:30:24.216728 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214813    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 11:30:24.216728 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.214815    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 11:30:24.216728 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215214    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 11:30:24.216728 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215219    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 11:30:24.216728 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215222    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 11:30:24.216728 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215225    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 11:30:24.216728 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215228    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 11:30:24.216728 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215232    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 11:30:24.216728 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215235    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 11:30:24.216728 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215238    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 11:30:24.216728 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215240    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 11:30:24.216728 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215243    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 11:30:24.217202 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215246    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 11:30:24.217202 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215248    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 11:30:24.217202 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215251    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 11:30:24.217202 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215254    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 11:30:24.217202 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215256    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 11:30:24.217202 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215259    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 11:30:24.217202 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215261    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 11:30:24.217202 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215264    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 11:30:24.217202 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215266    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 11:30:24.217202 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215269    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 11:30:24.217202 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215272    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 11:30:24.217202 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215274    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 11:30:24.217202 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215277    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 11:30:24.217202 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215279    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 11:30:24.217202 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215282    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 11:30:24.217202 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215285    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 11:30:24.217202 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215287    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 11:30:24.217202 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215290    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 11:30:24.217202 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215292    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 11:30:24.217202 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215295    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 11:30:24.217748 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215297    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 11:30:24.217748 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215299    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 11:30:24.217748 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215302    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 11:30:24.217748 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215304    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 11:30:24.217748 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215307    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 11:30:24.217748 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215309    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 11:30:24.217748 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215311    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 11:30:24.217748 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215314    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 11:30:24.217748 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215317    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 11:30:24.217748 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215319    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 11:30:24.217748 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215321    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 11:30:24.217748 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215324    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 11:30:24.217748 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215326    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 11:30:24.217748 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215330    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 11:30:24.217748 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215332    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 11:30:24.217748 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215335    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 11:30:24.217748 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215337    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 11:30:24.217748 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215340    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 11:30:24.217748 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215342    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 11:30:24.217748 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215344    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 11:30:24.218239 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215347    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 11:30:24.218239 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215349    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 11:30:24.218239 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215351    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 11:30:24.218239 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215354    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 11:30:24.218239 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215356    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 11:30:24.218239 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215359    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 11:30:24.218239 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215362    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 11:30:24.218239 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215364    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 11:30:24.218239 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215366    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 11:30:24.218239 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215369    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 11:30:24.218239 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215371    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 11:30:24.218239 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215373    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 11:30:24.218239 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215376    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 11:30:24.218239 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215378    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 11:30:24.218239 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215381    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 11:30:24.218239 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215383    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 11:30:24.218239 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215385    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 11:30:24.218239 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215388    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 11:30:24.218239 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215390    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 11:30:24.218239 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215393    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 11:30:24.218739 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215397    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 11:30:24.218739 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215401    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 11:30:24.218739 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215405    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 11:30:24.218739 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215409    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 11:30:24.218739 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215411    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 11:30:24.218739 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215414    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 11:30:24.218739 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215417    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 11:30:24.218739 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215420    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 11:30:24.218739 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215422    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 11:30:24.218739 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215425    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 11:30:24.218739 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215427    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 11:30:24.218739 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215429    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 11:30:24.218739 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215433    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 11:30:24.218739 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215437    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 11:30:24.218739 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215439    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 11:30:24.218739 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215442    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 11:30:24.218739 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215444    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 11:30:24.218739 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215446    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 11:30:24.218739 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215449    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 11:30:24.219221 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215451    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 11:30:24.219221 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215453    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 11:30:24.219221 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215456    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 11:30:24.219221 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215458    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 11:30:24.219221 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215461    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 11:30:24.219221 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215463    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 11:30:24.219221 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215465    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 11:30:24.219221 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215468    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 11:30:24.219221 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215470    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 11:30:24.219221 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.215472    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 11:30:24.219221 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215554    2575 flags.go:64] FLAG: --address="0.0.0.0"
Sep 08 11:30:24.219221 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215613    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 08 11:30:24.219221 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215621    2575 flags.go:64] FLAG: --anonymous-auth="true"
Sep 08 11:30:24.219221 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215626    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 08 11:30:24.219221 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215630    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 08 11:30:24.219221 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215633    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 08 11:30:24.219221 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215637    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 08 11:30:24.219221 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215641    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 08 11:30:24.219221 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215644    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 08 11:30:24.219221 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215647    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 08 11:30:24.219221 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215652    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 08 11:30:24.219739 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215656    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 08 11:30:24.219739 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215659    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 08 11:30:24.219739 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215662    2575 flags.go:64] FLAG: --cgroup-root=""
Sep 08 11:30:24.219739 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215664    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 08 11:30:24.219739 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215667    2575 flags.go:64] FLAG: --client-ca-file=""
Sep 08 11:30:24.219739 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215670    2575 flags.go:64] FLAG: --cloud-provider="external"
Sep 08 11:30:24.219739 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215673    2575 flags.go:64] FLAG: --cluster-dns="[]"
Sep 08 11:30:24.219739 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215678    2575 flags.go:64] FLAG: --cluster-domain=""
Sep 08 11:30:24.219739 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215681    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 08 11:30:24.219739 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215684    2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 08 11:30:24.219739 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215686    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 08 11:30:24.219739 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215690    2575 flags.go:64] FLAG: --container-log-max-files="5"
Sep 08 11:30:24.219739 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215693    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 08 11:30:24.219739 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215696    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 08 11:30:24.219739 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215699    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 08 11:30:24.219739 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215703    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 08 11:30:24.219739 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215705    2575 flags.go:64] FLAG: --contention-profiling="false"
Sep 08 11:30:24.219739 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215708    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 08 11:30:24.219739 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215711    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 08 11:30:24.219739 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215714    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 08 11:30:24.219739 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215717    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 08 11:30:24.219739 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215720    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 08 11:30:24.219739 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215723    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 08 11:30:24.219739 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215726    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 08 11:30:24.219739 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215729    2575 flags.go:64] FLAG: --enable-load-reader="false"
Sep 08 11:30:24.220311 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215732    2575 flags.go:64] FLAG: --enable-server="true"
Sep 08 11:30:24.220311 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215734    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 08 11:30:24.220311 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215739    2575 flags.go:64] FLAG: --event-burst="100"
Sep 08 11:30:24.220311 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215741    2575 flags.go:64] FLAG: --event-qps="50"
Sep 08 11:30:24.220311 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215744    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 08 11:30:24.220311 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215747    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 08 11:30:24.220311 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215750    2575 flags.go:64] FLAG: --eviction-hard=""
Sep 08 11:30:24.220311 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215755    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 08 11:30:24.220311 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215757    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 08 11:30:24.220311 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215761    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 08 11:30:24.220311 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215764    2575 flags.go:64] FLAG: --eviction-soft=""
Sep 08 11:30:24.220311 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215767    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 08 11:30:24.220311 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215769    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 08 11:30:24.220311 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215772    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 08 11:30:24.220311 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215775    2575 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 08 11:30:24.220311 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215778    2575 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 08 11:30:24.220311 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215780    2575 flags.go:64] FLAG: --fail-swap-on="true"
Sep 08 11:30:24.220311 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215783    2575 flags.go:64] FLAG: --feature-gates=""
Sep 08 11:30:24.220311 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215787    2575 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 08 11:30:24.220311 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215790    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 08 11:30:24.220311 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215793    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 08 11:30:24.220311 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215795    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 08 11:30:24.220311 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215798    2575 flags.go:64] FLAG: --healthz-port="10248"
Sep 08 11:30:24.220311 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215801    2575 flags.go:64] FLAG: --help="false"
Sep 08 11:30:24.220311 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215804    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-136-127.ec2.internal"
Sep 08 11:30:24.221012 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215806    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 08 11:30:24.221012 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215810    2575 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 08 11:30:24.221012 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215812    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 08 11:30:24.221012 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215815    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 08 11:30:24.221012 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215818    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 08 11:30:24.221012 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215823    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 08 11:30:24.221012 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215826    2575 flags.go:64] FLAG: --image-service-endpoint=""
Sep 08 11:30:24.221012 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215829    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 08 11:30:24.221012 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215832    2575 flags.go:64] FLAG: --kube-api-burst="100"
Sep 08 11:30:24.221012 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215834    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 08 11:30:24.221012 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215837    2575 flags.go:64] FLAG: --kube-api-qps="50"
Sep 08 11:30:24.221012 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215840    2575 flags.go:64] FLAG: --kube-reserved=""
Sep 08 11:30:24.221012 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215843    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 08 11:30:24.221012 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215846    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 08 11:30:24.221012 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215849    2575 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 08 11:30:24.221012 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215852    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 08 11:30:24.221012 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215855    2575 flags.go:64] FLAG: --lock-file=""
Sep 08 11:30:24.221012 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215858    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 08 11:30:24.221012 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215861    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 08 11:30:24.221012 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215863    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 08 11:30:24.221012 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215869    2575 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 08 11:30:24.221012 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215872    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 08 11:30:24.221012 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215874    2575 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 08 11:30:24.221012 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215877    2575 flags.go:64] FLAG: --logging-format="text"
Sep 08 11:30:24.221621 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215880    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 08 11:30:24.221621 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215883    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 08 11:30:24.221621 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215885    2575 flags.go:64] FLAG: --manifest-url=""
Sep 08 11:30:24.221621 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215888    2575 flags.go:64] FLAG: --manifest-url-header=""
Sep 08 11:30:24.221621 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215893    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 08 11:30:24.221621 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215896    2575 flags.go:64] FLAG: --max-open-files="1000000"
Sep 08 11:30:24.221621 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215900    2575 flags.go:64] FLAG: --max-pods="110"
Sep 08 11:30:24.221621 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215903    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 08 11:30:24.221621 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215906    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 08 11:30:24.221621 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215909    2575 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 08 11:30:24.221621 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215912    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 08 11:30:24.221621 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215914    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 08 11:30:24.221621 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215917    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 08 11:30:24.221621 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215921    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 08 11:30:24.221621 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215929    2575 flags.go:64] FLAG: --node-status-max-images="50"
Sep 08 11:30:24.221621 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215932    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 08 11:30:24.221621 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215936    2575 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 08 11:30:24.221621 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215939    2575 flags.go:64] FLAG: --pod-cidr=""
Sep 08 11:30:24.221621 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215942    2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 08 11:30:24.221621 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215947    2575 flags.go:64] FLAG: --pod-manifest-path=""
Sep 08 11:30:24.221621 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215950    2575 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 08 11:30:24.221621 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215953    2575 flags.go:64] FLAG: --pods-per-core="0"
Sep 08 11:30:24.221621 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215956    2575 flags.go:64] FLAG: --port="10250"
Sep 08 11:30:24.221621 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215959    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 08 11:30:24.222197 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215962    2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-018f29bdebdb3abe0"
Sep 08 11:30:24.222197 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215966    2575 flags.go:64] FLAG: --qos-reserved=""
Sep 08 11:30:24.222197 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215969    2575 flags.go:64] FLAG: --read-only-port="10255"
Sep 08 11:30:24.222197 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215971    2575 flags.go:64] FLAG: --register-node="true"
Sep 08 11:30:24.222197 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215974    2575 flags.go:64] FLAG: --register-with-taints=""
Sep 08 11:30:24.222197 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215978    2575 flags.go:64] FLAG: --registry-burst="10"
Sep 08 11:30:24.222197 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215980    2575 flags.go:64] FLAG: --registry-qps="5"
Sep 08 11:30:24.222197 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215983    2575 flags.go:64] FLAG: --reserved-cpus=""
Sep 08 11:30:24.222197 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215986    2575 flags.go:64] FLAG: --reserved-memory=""
Sep 08 11:30:24.222197 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215989    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 08 11:30:24.222197 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215992    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 08 11:30:24.222197 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215995    2575 flags.go:64] FLAG: --rotate-certificates="false"
Sep 08 11:30:24.222197 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.215998    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 08 11:30:24.222197 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.216001    2575 flags.go:64] FLAG: --runonce="false"
Sep 08 11:30:24.222197 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.216004    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 08 11:30:24.222197 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.216006    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 08 11:30:24.222197 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.216009    2575 flags.go:64] FLAG: --seccomp-default="false"
Sep 08 11:30:24.222197 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.216012    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 08 11:30:24.222197 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.216015    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 08 11:30:24.222197 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.216018    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 08 11:30:24.222197 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.216021    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 08 11:30:24.222197 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.216024    2575 flags.go:64] FLAG: --storage-driver-password="root"
Sep 08 11:30:24.222197 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.216028    2575 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 08 11:30:24.222197 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.216031    2575 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 08 11:30:24.222197 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.216034    2575 flags.go:64] FLAG: --storage-driver-user="root"
Sep 08 11:30:24.222836 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.216037    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 08 11:30:24.222836 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.216040    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 08 11:30:24.222836 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.216043    2575 flags.go:64] FLAG: --system-cgroups=""
Sep 08 11:30:24.222836 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.216046    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 08 11:30:24.222836 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.216051    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 08 11:30:24.222836 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.216054    2575 flags.go:64] FLAG: --tls-cert-file=""
Sep 08 11:30:24.222836 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.216057    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 08 11:30:24.222836 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.216061    2575 flags.go:64] FLAG: --tls-min-version=""
Sep 08 11:30:24.222836 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.216065    2575 flags.go:64] FLAG: --tls-private-key-file=""
Sep 08 11:30:24.222836 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.216068    2575 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 08 11:30:24.222836 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.216071    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 08 11:30:24.222836 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.216074    2575 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 08 11:30:24.222836 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.216077    2575 flags.go:64] FLAG: --v="2"
Sep 08 11:30:24.222836 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.216080    2575 flags.go:64] FLAG: --version="false"
Sep 08 11:30:24.222836 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.216085    2575 flags.go:64] FLAG: --vmodule=""
Sep 08 11:30:24.222836 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.216088    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 08 11:30:24.222836 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.216092    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 08 11:30:24.222836 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216209    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 11:30:24.222836 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216212    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 11:30:24.222836 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216215    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 11:30:24.222836 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216218    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 11:30:24.222836 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216221    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 11:30:24.222836 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216223    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 11:30:24.222836 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216226    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 11:30:24.223391 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216228    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 11:30:24.223391 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216231    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 11:30:24.223391 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216234    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 11:30:24.223391 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216236    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 11:30:24.223391 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216239    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 11:30:24.223391 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216243    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 11:30:24.223391 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216245    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 11:30:24.223391 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216250    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 11:30:24.223391 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216252    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 11:30:24.223391 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216255    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 11:30:24.223391 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216257    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 11:30:24.223391 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216260    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 11:30:24.223391 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216262    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 11:30:24.223391 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216265    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 11:30:24.223391 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216267    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 11:30:24.223391 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216270    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 11:30:24.223391 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216272    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 11:30:24.223391 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216275    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 11:30:24.223391 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216278    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 11:30:24.223391 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216281    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 11:30:24.223892 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216283    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 11:30:24.223892 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216285    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 11:30:24.223892 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216288    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 11:30:24.223892 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216290    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 11:30:24.223892 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216293    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 11:30:24.223892 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216295    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 11:30:24.223892 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216298    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 11:30:24.223892 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216300    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 11:30:24.223892 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216302    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 11:30:24.223892 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216305    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 11:30:24.223892 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216307    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 11:30:24.223892 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216310    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 11:30:24.223892 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216317    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 11:30:24.223892 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216320    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 11:30:24.223892 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216322    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 11:30:24.223892 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216326    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 11:30:24.223892 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216330    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 11:30:24.223892 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216334    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 11:30:24.223892 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216336    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 11:30:24.223892 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216340    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 11:30:24.224360 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216343    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 11:30:24.224360 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216345    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 11:30:24.224360 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216348    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 11:30:24.224360 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216350    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 11:30:24.224360 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216353    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 11:30:24.224360 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216355    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 11:30:24.224360 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216358    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 11:30:24.224360 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216361    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 11:30:24.224360 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216367    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 11:30:24.224360 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216372    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 11:30:24.224360 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216376    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 11:30:24.224360 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216379    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 11:30:24.224360 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216382    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 11:30:24.224360 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216385    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 11:30:24.224360 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216387    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 11:30:24.224360 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216390    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 11:30:24.224360 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216392    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 11:30:24.224360 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216394    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 11:30:24.224360 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216397    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 11:30:24.224360 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216399    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 11:30:24.224857 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216402    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 11:30:24.224857 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216404    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 11:30:24.224857 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216406    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 11:30:24.224857 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216409    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 11:30:24.224857 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216412    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 11:30:24.224857 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216414    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 11:30:24.224857 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216416    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 11:30:24.224857 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216419    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 11:30:24.224857 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216421    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 11:30:24.224857 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216426    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 11:30:24.224857 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216428    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 11:30:24.224857 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216432    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 11:30:24.224857 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216434    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 11:30:24.224857 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216437    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 11:30:24.224857 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216439    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 11:30:24.224857 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216442    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 11:30:24.224857 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216445    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 11:30:24.224857 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216447    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 11:30:24.224857 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216450    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 11:30:24.225309 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216453    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 11:30:24.225309 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216455    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 11:30:24.225309 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216458    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 11:30:24.225309 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216460    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 11:30:24.225309 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216464    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 11:30:24.225309 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216466    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 11:30:24.225309 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216469    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 11:30:24.225309 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216471    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 11:30:24.225309 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216473    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 11:30:24.225309 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216476    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 11:30:24.225309 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216478    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 11:30:24.225309 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216480    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 11:30:24.225309 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.216484    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 11:30:24.225309 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.217086    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 11:30:24.225683 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.224537    2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 08 11:30:24.225683 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.224552    2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 08 11:30:24.225683 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.224569    2575 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 08 11:30:24.225683 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.224579    2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 08 11:30:24.225683 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224665    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 11:30:24.225683 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224671    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 11:30:24.225683 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224675    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 11:30:24.225683 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224678    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 11:30:24.225683 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224681    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 11:30:24.225683 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224684    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 11:30:24.225683 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224686    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 11:30:24.225683 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224689    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 11:30:24.225683 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224692    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 11:30:24.225683 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224694    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 11:30:24.225683 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224697    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 11:30:24.225683 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224699    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 11:30:24.225683 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224702    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 11:30:24.225683 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224705    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 11:30:24.225683 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224707    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 11:30:24.226156 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224710    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 11:30:24.226156 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224712    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 11:30:24.226156 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224715    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 11:30:24.226156 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224717    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 11:30:24.226156 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224720    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 11:30:24.226156 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224722    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 11:30:24.226156 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224725    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 11:30:24.226156 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224727    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 11:30:24.226156 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224729    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 11:30:24.226156 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224732    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 11:30:24.226156 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224736    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 11:30:24.226156 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224739    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 11:30:24.226156 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224742    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 11:30:24.226156 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224745    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 11:30:24.226156 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224749    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 11:30:24.226156 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224753    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 11:30:24.226156 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224756    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 11:30:24.226156 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224759    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 11:30:24.226156 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224762    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 11:30:24.226609 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224764    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 11:30:24.226609 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224767    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 11:30:24.226609 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224770    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 11:30:24.226609 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224772    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 11:30:24.226609 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224774    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 11:30:24.226609 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224777    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 11:30:24.226609 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224779    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 11:30:24.226609 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224782    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 11:30:24.226609 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224785    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 11:30:24.226609 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224789    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 11:30:24.226609 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224792    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 11:30:24.226609 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224794    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 11:30:24.226609 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224797    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 11:30:24.226609 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224799    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 11:30:24.226609 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224801    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 11:30:24.226609 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224804    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 11:30:24.226609 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224806    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 11:30:24.226609 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224809    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 11:30:24.226609 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224812    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 11:30:24.226609 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224814    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 11:30:24.227083 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224816    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 11:30:24.227083 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224819    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 11:30:24.227083 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224821    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 11:30:24.227083 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224824    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 11:30:24.227083 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224826    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 11:30:24.227083 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224829    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 11:30:24.227083 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224832    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 11:30:24.227083 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224835    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 11:30:24.227083 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224838    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 11:30:24.227083 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224840    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 11:30:24.227083 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224843    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 11:30:24.227083 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224845    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 11:30:24.227083 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224847    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 11:30:24.227083 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224849    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 11:30:24.227083 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224852    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 11:30:24.227083 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224854    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 11:30:24.227083 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224856    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 11:30:24.227083 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224859    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 11:30:24.227083 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224861    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 11:30:24.227083 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224864    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 11:30:24.227083 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224867    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 11:30:24.227568 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224870    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 11:30:24.227568 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224872    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 11:30:24.227568 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224874    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 11:30:24.227568 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224877    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 11:30:24.227568 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224880    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 11:30:24.227568 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224882    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 11:30:24.227568 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224885    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 11:30:24.227568 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224887    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 11:30:24.227568 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224889    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 11:30:24.227568 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224892    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 11:30:24.227568 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224894    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 11:30:24.227568 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224896    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 11:30:24.227568 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224899    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 11:30:24.227568 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224902    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 11:30:24.227568 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224904    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 11:30:24.227568 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224906    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 11:30:24.227568 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224909    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 11:30:24.227568 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224911    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 11:30:24.227568 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224914    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 11:30:24.228033 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224916    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 11:30:24.228033 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224920    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 11:30:24.228033 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224922    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 11:30:24.228033 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224925    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 11:30:24.228033 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.224927    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 11:30:24.228033 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.224932    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 11:30:24.228033 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225045    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 11:30:24.228033 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225051    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 11:30:24.228033 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225054    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 11:30:24.228033 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225057    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 11:30:24.228033 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225060    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 11:30:24.228033 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225062    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 11:30:24.228033 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225065    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 11:30:24.228033 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225068    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 11:30:24.228361 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225071    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 11:30:24.228361 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225075    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 11:30:24.228361 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225078    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 11:30:24.228361 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225081    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 11:30:24.228361 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225084    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 11:30:24.228361 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225086    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 11:30:24.228361 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225089    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 11:30:24.228361 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225092    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 11:30:24.228361 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225095    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 11:30:24.228361 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225097    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 11:30:24.228361 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225100    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 11:30:24.228361 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225102    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 11:30:24.228361 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225105    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 11:30:24.228361 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225107    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 11:30:24.228361 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225109    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 11:30:24.228361 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225112    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 11:30:24.228361 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225114    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 11:30:24.228361 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225116    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 11:30:24.228361 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225119    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 11:30:24.228821 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225121    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 11:30:24.228821 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225125    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 11:30:24.228821 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225127    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 11:30:24.228821 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225129    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 11:30:24.228821 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225132    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 11:30:24.228821 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225134    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 11:30:24.228821 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225137    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 11:30:24.228821 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225139    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 11:30:24.228821 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225141    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 11:30:24.228821 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225144    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 11:30:24.228821 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225146    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 11:30:24.228821 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225148    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 11:30:24.228821 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225151    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 11:30:24.228821 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225153    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 11:30:24.228821 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225155    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 11:30:24.228821 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225158    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 11:30:24.228821 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225160    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 11:30:24.228821 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225163    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 11:30:24.228821 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225165    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 11:30:24.228821 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225168    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 11:30:24.229303 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225170    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 11:30:24.229303 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225173    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 11:30:24.229303 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225175    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 11:30:24.229303 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225177    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 11:30:24.229303 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225180    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 11:30:24.229303 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225182    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 11:30:24.229303 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225184    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 11:30:24.229303 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225187    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 11:30:24.229303 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225189    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 11:30:24.229303 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225191    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 11:30:24.229303 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225194    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 11:30:24.229303 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225196    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 11:30:24.229303 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225198    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 11:30:24.229303 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225200    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 11:30:24.229303 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225203    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 11:30:24.229303 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225206    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 11:30:24.229303 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225208    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 11:30:24.229303 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225210    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 11:30:24.229303 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225213    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 11:30:24.229303 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225215    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 11:30:24.229787 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225217    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 11:30:24.229787 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225220    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 11:30:24.229787 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225222    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 11:30:24.229787 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225224    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 11:30:24.229787 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225227    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 11:30:24.229787 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225229    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 11:30:24.229787 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225232    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 11:30:24.229787 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225234    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 11:30:24.229787 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225237    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 11:30:24.229787 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225239    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 11:30:24.229787 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225241    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 11:30:24.229787 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225244    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 11:30:24.229787 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225246    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 11:30:24.229787 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225248    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 11:30:24.229787 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225251    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 11:30:24.229787 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225253    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 11:30:24.229787 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225256    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 11:30:24.229787 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225259    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 11:30:24.229787 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225271    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 11:30:24.229787 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225275    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 11:30:24.230248 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225277    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 11:30:24.230248 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225280    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 11:30:24.230248 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225283    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 11:30:24.230248 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225286    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 11:30:24.230248 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225288    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 11:30:24.230248 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225290    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 11:30:24.230248 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225292    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 11:30:24.230248 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225296    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 11:30:24.230248 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225298    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 11:30:24.230248 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225300    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 11:30:24.230248 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225303    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 11:30:24.230248 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:24.225305    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 11:30:24.230248 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.225310    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 11:30:24.230248 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.225423    2575 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 08 11:30:24.230589 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.227376    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 08 11:30:24.230589 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.228221    2575 server.go:1019] "Starting client certificate rotation"
Sep 08 11:30:24.230589 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.228318    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 11:30:24.230589 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.228364    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 11:30:24.230589 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.230529    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 11:30:24.231632 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.231616    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 11:30:24.246586 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.246565    2575 log.go:25] "Validated CRI v1 runtime API"
Sep 08 11:30:24.249257 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.249242    2575 log.go:25] "Validated CRI v1 image API"
Sep 08 11:30:24.250090 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.250072    2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 08 11:30:24.253477 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.253445    2575 fs.go:135] Filesystem UUIDs: map[5e136053-3af1-460a-8001-bd0fb89ac2ed:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ae7017ec-55b5-41d2-bb18-5dab91d6b59f:/dev/nvme0n1p3]
Sep 08 11:30:24.253564 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.253476    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 08 11:30:24.258378 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.258361    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 11:30:24.258683 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.258556    2575 manager.go:216] Machine: {Timestamp:2026-09-08 11:30:24.257277817 +0000 UTC m=+0.337722277 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3188316 MemoryCapacity:32812150784 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2625a531d00f97e0e1a60804ac89c0 SystemUUID:ec2625a5-31d0-0f97-e0e1-a60804ac89c0 BootID:e9a97e0a-d18d-4ccb-91e3-dfff16eb3cd0 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406073344 Type:vfs Inodes:4005389 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2e:a2:cd:38:c1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2e:a2:cd:38:c1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:7b:90:0e:2a:80 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812150784 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 08 11:30:24.258683 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.258680    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 08 11:30:24.258830 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.258786    2575 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 08 11:30:24.262114 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.262092    2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 08 11:30:24.262280 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.262116    2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-127.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 08 11:30:24.262965 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.262954    2575 topology_manager.go:138] "Creating topology manager with none policy"
Sep 08 11:30:24.263023 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.262970    2575 container_manager_linux.go:309] "Creating device plugin manager"
Sep 08 11:30:24.263023 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.262980    2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 11:30:24.264488 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.264475    2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 11:30:24.265654 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.265643    2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 08 11:30:24.270068 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.270055    2575 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 11:30:24.270198 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.270187    2575 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 08 11:30:24.270251 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.270224    2575 kubelet.go:486] "Attempting to sync node with API server"
Sep 08 11:30:24.270251 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.270243    2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 08 11:30:24.270340 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.270262    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 08 11:30:24.270340 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.270277    2575 kubelet.go:398] "Adding apiserver pod source"
Sep 08 11:30:24.270340 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.270288    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 08 11:30:24.270658 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.270645    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 11:30:24.270768 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.270668    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 11:30:24.273022 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.273007    2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 08 11:30:24.275749 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.275735    2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 08 11:30:24.275808 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.275773    2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 08 11:30:24.275943 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.275932    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 08 11:30:24.275987 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.275947    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 08 11:30:24.275987 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.275953    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 08 11:30:24.275987 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.275959    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 08 11:30:24.275987 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.275966    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 08 11:30:24.275987 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.275972    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 08 11:30:24.277401 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.277392    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 08 11:30:24.277443 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.277403    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 08 11:30:24.277443 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.277410    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 08 11:30:24.277443 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.277416    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 08 11:30:24.277443 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.277431    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 08 11:30:24.277443 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.277439    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 08 11:30:24.278220 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.278204    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 08 11:30:24.278276 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.278223    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 08 11:30:24.280108 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:24.280087    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 08 11:30:24.280182 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:24.280112    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-127.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 08 11:30:24.282418 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.282403    2575 server.go:1268] "Started kubelet"
Sep 08 11:30:24.282494 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.282473    2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 08 11:30:24.282540 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.282477    2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 08 11:30:24.282582 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.282539    2575 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 08 11:30:24.283217 ip-10-0-136-127 systemd[1]: Started Kubernetes Kubelet.
Sep 08 11:30:24.285439 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.285355    2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 08 11:30:24.286847 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.286830    2575 server.go:310] "Adding debug handlers to kubelet server"
Sep 08 11:30:24.288171 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:24.288146    2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 08 11:30:24.290545 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.290531    2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 08 11:30:24.290634 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.290577    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 08 11:30:24.291031 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:24.291003    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-127.ec2.internal\" not found"
Sep 08 11:30:24.291135 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.291124    2575 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 08 11:30:24.291190 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.291139    2575 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 08 11:30:24.291241 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.291188    2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 08 11:30:24.291241 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.291205    2575 reconstruct.go:97] "Volume reconstruction finished"
Sep 08 11:30:24.291241 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.291216    2575 reconciler.go:29] "Reconciler: start to sync state"
Sep 08 11:30:24.291998 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.291804    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 08 11:30:24.291998 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.291820    2575 factory.go:55] Registering systemd factory
Sep 08 11:30:24.291998 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.291828    2575 factory.go:223] Registration of the systemd container factory successfully
Sep 08 11:30:24.292263 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.292175    2575 factory.go:153] Registering CRI-O factory
Sep 08 11:30:24.292263 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.292190    2575 factory.go:223] Registration of the crio container factory successfully
Sep 08 11:30:24.292263 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.292226    2575 factory.go:103] Registering Raw factory
Sep 08 11:30:24.292263 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.292241    2575 manager.go:1196] Started watching for new ooms in manager
Sep 08 11:30:24.292685 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.292671    2575 manager.go:349] Starting recovery of all containers
Sep 08 11:30:24.294324 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:24.293325    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-127.ec2.internal.18d35514acbfecd5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-127.ec2.internal,UID:ip-10-0-136-127.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-127.ec2.internal,},FirstTimestamp:2026-09-08 11:30:24.282184917 +0000 UTC m=+0.362629366,LastTimestamp:2026-09-08 11:30:24.282184917 +0000 UTC m=+0.362629366,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-127.ec2.internal,}"
Sep 08 11:30:24.294427 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.294413    2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-127.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 08 11:30:24.294498 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:24.294459    2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-127.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 08 11:30:24.294581 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:24.294560    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 08 11:30:24.303298 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.303284    2575 manager.go:354] Recovery completed
Sep 08 11:30:24.307263 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.307250    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 11:30:24.308848 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.308831    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-127.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 11:30:24.308923 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.308862    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-127.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 11:30:24.308923 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.308872    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-127.ec2.internal" event="NodeHasSufficientPID"
Sep 08 11:30:24.309346 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.309333    2575 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 08 11:30:24.309403 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.309346    2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 08 11:30:24.309403 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.309391    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 11:30:24.309910 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.309898    2575 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 11:30:24.310176 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.310159    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-127.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 11:30:24.310241 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.310196    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-127.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 11:30:24.310241 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.310212    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-127.ec2.internal" event="NodeHasSufficientPID"
Sep 08 11:30:24.311005 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:24.310926    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-127.ec2.internal.18d35514ae56ca4f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-127.ec2.internal,UID:ip-10-0-136-127.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-127.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-127.ec2.internal,},FirstTimestamp:2026-09-08 11:30:24.308849231 +0000 UTC m=+0.389293679,LastTimestamp:2026-09-08 11:30:24.308849231 +0000 UTC m=+0.389293679,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-127.ec2.internal,}"
Sep 08 11:30:24.311896 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.311881    2575 policy_none.go:49] "None policy: Start"
Sep 08 11:30:24.311896 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.311898    2575 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 08 11:30:24.311983 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.311908    2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 08 11:30:24.313794 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.313781    2575 policy_none.go:47] "Start"
Sep 08 11:30:24.320655 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:24.320534    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-127.ec2.internal.18d35514ae570edd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-127.ec2.internal,UID:ip-10-0-136-127.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-127.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-127.ec2.internal,},FirstTimestamp:2026-09-08 11:30:24.308866781 +0000 UTC m=+0.389311230,LastTimestamp:2026-09-08 11:30:24.308866781 +0000 UTC m=+0.389311230,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-127.ec2.internal,}"
Sep 08 11:30:24.330376 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:24.330320    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-127.ec2.internal.18d35514ae573239  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-127.ec2.internal,UID:ip-10-0-136-127.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-127.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-127.ec2.internal,},FirstTimestamp:2026-09-08 11:30:24.308875833 +0000 UTC m=+0.389320282,LastTimestamp:2026-09-08 11:30:24.308875833 +0000 UTC m=+0.389320282,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-127.ec2.internal,}"
Sep 08 11:30:24.343139 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:24.343079    2575 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-127.ec2.internal.18d35514ae56ca4f\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-127.ec2.internal.18d35514ae56ca4f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-127.ec2.internal,UID:ip-10-0-136-127.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-127.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-127.ec2.internal,},FirstTimestamp:2026-09-08 11:30:24.308849231 +0000 UTC m=+0.389293679,LastTimestamp:2026-09-08 11:30:24.310175744 +0000 UTC m=+0.390620194,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-127.ec2.internal,}"
Sep 08 11:30:24.351064 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.350932    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pt86z"
Sep 08 11:30:24.352430 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:24.352373    2575 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-127.ec2.internal.18d35514ae570edd\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-127.ec2.internal.18d35514ae570edd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-127.ec2.internal,UID:ip-10-0-136-127.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-127.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-127.ec2.internal,},FirstTimestamp:2026-09-08 11:30:24.308866781 +0000 UTC m=+0.389311230,LastTimestamp:2026-09-08 11:30:24.310204159 +0000 UTC m=+0.390648610,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-127.ec2.internal,}"
Sep 08 11:30:24.359543 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.359531    2575 manager.go:337] "Starting Device Plugin manager"
Sep 08 11:30:24.384636 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:24.359565    2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 08 11:30:24.384636 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.359575    2575 server.go:87] "Starting device plugin registration server"
Sep 08 11:30:24.384636 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.359848    2575 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 08 11:30:24.384636 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.359861    2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 08 11:30:24.384636 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.359967    2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 08 11:30:24.384636 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.360047    2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 08 11:30:24.384636 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.360077    2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 08 11:30:24.384636 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:24.360880    2575 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-127.ec2.internal.18d35514ae573239\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-127.ec2.internal.18d35514ae573239  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-127.ec2.internal,UID:ip-10-0-136-127.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-127.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-127.ec2.internal,},FirstTimestamp:2026-09-08 11:30:24.308875833 +0000 UTC m=+0.389320282,LastTimestamp:2026-09-08 11:30:24.310218348 +0000 UTC m=+0.390662799,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-127.ec2.internal,}"
Sep 08 11:30:24.384636 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:24.360985    2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 08 11:30:24.384636 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:24.361037    2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-127.ec2.internal\" not found"
Sep 08 11:30:24.384636 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.361913    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pt86z"
Sep 08 11:30:24.404564 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.404530    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 08 11:30:24.405806 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.405789    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 08 11:30:24.405858 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.405842    2575 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 08 11:30:24.405901 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.405867    2575 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 08 11:30:24.405945 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:24.405911    2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 08 11:30:24.408148 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.408129    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 11:30:24.460010 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.459955    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 11:30:24.460810 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.460796    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-127.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 11:30:24.460882 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.460823    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-127.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 11:30:24.460882 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.460834    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-127.ec2.internal" event="NodeHasSufficientPID"
Sep 08 11:30:24.460882 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.460856    2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-127.ec2.internal"
Sep 08 11:30:24.469010 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.468995    2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-127.ec2.internal"
Sep 08 11:30:24.469051 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:24.469017    2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-127.ec2.internal\": node \"ip-10-0-136-127.ec2.internal\" not found"
Sep 08 11:30:24.495387 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:24.495366    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-127.ec2.internal\" not found"
Sep 08 11:30:24.506677 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.506658    2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-127.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-127.ec2.internal"]
Sep 08 11:30:24.506727 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.506715    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 11:30:24.507463 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.507449    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-127.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 11:30:24.507526 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.507477    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-127.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 11:30:24.507526 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.507488    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-127.ec2.internal" event="NodeHasSufficientPID"
Sep 08 11:30:24.509393 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.509382    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 11:30:24.509508 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.509495    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-127.ec2.internal"
Sep 08 11:30:24.509550 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.509522    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 11:30:24.510082 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.510070    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-127.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 11:30:24.510161 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.510080    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-127.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 11:30:24.510161 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.510092    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-127.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 11:30:24.510161 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.510101    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-127.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 11:30:24.510161 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.510112    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-127.ec2.internal" event="NodeHasSufficientPID"
Sep 08 11:30:24.510161 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.510102    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-127.ec2.internal" event="NodeHasSufficientPID"
Sep 08 11:30:24.512009 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.511994    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-127.ec2.internal"
Sep 08 11:30:24.512077 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.512023    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 11:30:24.512720 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.512700    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-127.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 11:30:24.512806 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.512727    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-127.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 11:30:24.512806 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.512739    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-127.ec2.internal" event="NodeHasSufficientPID"
Sep 08 11:30:24.536086 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:24.536069    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-127.ec2.internal\" not found" node="ip-10-0-136-127.ec2.internal"
Sep 08 11:30:24.540173 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:24.540160    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-127.ec2.internal\" not found" node="ip-10-0-136-127.ec2.internal"
Sep 08 11:30:24.592426 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.592402    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb9ace496af7ba31c85ad967df3bc565-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-127.ec2.internal\" (UID: \"eb9ace496af7ba31c85ad967df3bc565\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-127.ec2.internal"
Sep 08 11:30:24.592426 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.592427    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/50ad488f94e6200f7b23fbffec7fd91a-config\") pod \"kube-apiserver-proxy-ip-10-0-136-127.ec2.internal\" (UID: \"50ad488f94e6200f7b23fbffec7fd91a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-127.ec2.internal"
Sep 08 11:30:24.592573 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.592445    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/eb9ace496af7ba31c85ad967df3bc565-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-127.ec2.internal\" (UID: \"eb9ace496af7ba31c85ad967df3bc565\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-127.ec2.internal"
Sep 08 11:30:24.595455 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:24.595438    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-127.ec2.internal\" not found"
Sep 08 11:30:24.692715 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.692686    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/eb9ace496af7ba31c85ad967df3bc565-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-127.ec2.internal\" (UID: \"eb9ace496af7ba31c85ad967df3bc565\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-127.ec2.internal"
Sep 08 11:30:24.692808 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.692719    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb9ace496af7ba31c85ad967df3bc565-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-127.ec2.internal\" (UID: \"eb9ace496af7ba31c85ad967df3bc565\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-127.ec2.internal"
Sep 08 11:30:24.692808 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.692734    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/50ad488f94e6200f7b23fbffec7fd91a-config\") pod \"kube-apiserver-proxy-ip-10-0-136-127.ec2.internal\" (UID: \"50ad488f94e6200f7b23fbffec7fd91a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-127.ec2.internal"
Sep 08 11:30:24.692808 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.692775    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/50ad488f94e6200f7b23fbffec7fd91a-config\") pod \"kube-apiserver-proxy-ip-10-0-136-127.ec2.internal\" (UID: \"50ad488f94e6200f7b23fbffec7fd91a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-127.ec2.internal"
Sep 08 11:30:24.692897 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.692801    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb9ace496af7ba31c85ad967df3bc565-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-127.ec2.internal\" (UID: \"eb9ace496af7ba31c85ad967df3bc565\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-127.ec2.internal"
Sep 08 11:30:24.692897 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.692801    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/eb9ace496af7ba31c85ad967df3bc565-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-127.ec2.internal\" (UID: \"eb9ace496af7ba31c85ad967df3bc565\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-127.ec2.internal"
Sep 08 11:30:24.695752 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:24.695737    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-127.ec2.internal\" not found"
Sep 08 11:30:24.796492 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:24.796443    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-127.ec2.internal\" not found"
Sep 08 11:30:24.838635 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.838590    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-127.ec2.internal"
Sep 08 11:30:24.843144 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:24.843125    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-127.ec2.internal"
Sep 08 11:30:24.896794 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:24.896768    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-127.ec2.internal\" not found"
Sep 08 11:30:24.997325 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:24.997301    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-127.ec2.internal\" not found"
Sep 08 11:30:25.097810 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:25.097778    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-127.ec2.internal\" not found"
Sep 08 11:30:25.148187 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.148162    2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 11:30:25.149451 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.149434    2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 11:30:25.198522 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:25.198500    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-127.ec2.internal\" not found"
Sep 08 11:30:25.215200 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.215183    2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 11:30:25.228016 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.228000    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 08 11:30:25.228110 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.228091    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 11:30:25.228166 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.228120    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 11:30:25.228166 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.228142    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 11:30:25.228166 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.228146    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 11:30:25.271330 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.271302    2575 apiserver.go:52] "Watching apiserver"
Sep 08 11:30:25.290709 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.290685    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 08 11:30:25.290825 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.290686    2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 08 11:30:25.291026 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.291010    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-127.ec2.internal"
Sep 08 11:30:25.291386 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.291368    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-2tmp9","kube-system/konnectivity-agent-62v7t","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krfgv","openshift-multus/multus-additional-cni-plugins-r9ksl","openshift-network-operator/iptables-alerter-hvr4n","openshift-ovn-kubernetes/ovnkube-node-m57jb","openshift-cluster-node-tuning-operator/tuned-2b9cw","openshift-dns/node-resolver-cf287","openshift-image-registry/node-ca-bhshk","openshift-multus/multus-54b8t","openshift-multus/network-metrics-daemon-nb8wz","openshift-network-diagnostics/network-check-target-m5x5z"]
Sep 08 11:30:25.293637 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.293622    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r9ksl"
Sep 08 11:30:25.295382 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.295368    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hvr4n"
Sep 08 11:30:25.295809 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.295794    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 08 11:30:25.296121 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.296105    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 08 11:30:25.296268 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.296257    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 08 11:30:25.296310 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.296289    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 08 11:30:25.296383 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.296371    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qkrr8\""
Sep 08 11:30:25.296426 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.296376    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 08 11:30:25.297229 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.297216    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.297581 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.297565    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 08 11:30:25.297831 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.297817    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 08 11:30:25.297896 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.297817    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 08 11:30:25.298035 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.298022    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5f2gd\""
Sep 08 11:30:25.299237 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.299221    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb8wz"
Sep 08 11:30:25.299335 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:25.299309    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb8wz" podUID="b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679"
Sep 08 11:30:25.299557 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.299540    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 08 11:30:25.300249 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.300236    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-md8wx\""
Sep 08 11:30:25.301093 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.301080    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2tmp9"
Sep 08 11:30:25.301158 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:25.301141    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2tmp9" podUID="1df1b9eb-b388-4e05-af5d-9da7cfd4ce10"
Sep 08 11:30:25.301778 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.301763    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 11:30:25.303052 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.303039    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-62v7t"
Sep 08 11:30:25.305125 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.305109    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krfgv"
Sep 08 11:30:25.305231 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.305215    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 08 11:30:25.305307 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.305245    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wcm6b\""
Sep 08 11:30:25.305375 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.305363    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 11:30:25.305430 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.305419    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-127.ec2.internal"
Sep 08 11:30:25.306156 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.306140    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 08 11:30:25.307339 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.307323    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fdzwn\""
Sep 08 11:30:25.307391 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.307361    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.307687 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.307646    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 08 11:30:25.307851 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.307838    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 08 11:30:25.307923 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.307910    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 08 11:30:25.309406 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.309392    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hjb96\""
Sep 08 11:30:25.309843 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.309791    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.310122 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.310041    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 08 11:30:25.310122 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.310047    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 08 11:30:25.310122 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.310111    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 08 11:30:25.310323 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.310308    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 08 11:30:25.311063 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.311044    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 08 11:30:25.311063 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.311055    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 08 11:30:25.311968 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.311951    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 08 11:30:25.312269 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.312247    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jsb4t\""
Sep 08 11:30:25.312352 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.312343    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 08 11:30:25.312409 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.312348    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cf287"
Sep 08 11:30:25.314334 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.314311    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 11:30:25.314932 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.314915    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 08 11:30:25.315024 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.315007    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 08 11:30:25.315186 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.315172    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tkm2n\""
Sep 08 11:30:25.316359 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.316343    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bhshk"
Sep 08 11:30:25.318748 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.318728    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-127.ec2.internal"]
Sep 08 11:30:25.318829 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.318765    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-127.ec2.internal"]
Sep 08 11:30:25.318829 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.318801    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 08 11:30:25.318896 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.318804    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5x5z"
Sep 08 11:30:25.318943 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.318925    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 08 11:30:25.318990 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:25.318944    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5x5z" podUID="190e88db-a54a-4abb-bd46-1158e5bb71c6"
Sep 08 11:30:25.319307 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.319294    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 08 11:30:25.319307 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.319302    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8lvj4\""
Sep 08 11:30:25.332167 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.332151    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tsrfr"
Sep 08 11:30:25.341764 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.341749    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tsrfr"
Sep 08 11:30:25.366043 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.366009    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-07 11:25:25 +0000 UTC" deadline="2028-06-19 09:37:06.763813728 +0000 UTC"
Sep 08 11:30:25.366043 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.366041    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15598h6m41.397774903s"
Sep 08 11:30:25.392952 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.392936    2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 08 11:30:25.395580 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.395555    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-etc-kubernetes\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.395685 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.395590    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/927c9c1b-2e72-4316-94d9-58662176506e-host-var-lib-cni-multus\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.395685 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.395631    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/927c9c1b-2e72-4316-94d9-58662176506e-host-run-multus-certs\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.395768 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.395670    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-host-run-netns\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.395768 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.395720    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-etc-modprobe-d\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.395768 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.395752    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e75f13ca-f8fe-4d34-98e6-2bc02d335fe0-device-dir\") pod \"aws-ebs-csi-driver-node-krfgv\" (UID: \"e75f13ca-f8fe-4d34-98e6-2bc02d335fe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krfgv"
Sep 08 11:30:25.395893 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.395784    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-tmp\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.395893 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.395824    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/927c9c1b-2e72-4316-94d9-58662176506e-cnibin\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.395893 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.395849    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/927c9c1b-2e72-4316-94d9-58662176506e-multus-socket-dir-parent\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.395893 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.395865    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1df1b9eb-b388-4e05-af5d-9da7cfd4ce10-original-pull-secret\") pod \"global-pull-secret-syncer-2tmp9\" (UID: \"1df1b9eb-b388-4e05-af5d-9da7cfd4ce10\") " pod="kube-system/global-pull-secret-syncer-2tmp9"
Sep 08 11:30:25.395893 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.395887    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-systemd-units\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.396065 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.395902    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-etc-sysctl-conf\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.396065 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.395914    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-host\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.396065 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.395928    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51e41bf2-8be4-48a7-a3e7-6d17b4566f97-tmp-dir\") pod \"node-resolver-cf287\" (UID: \"51e41bf2-8be4-48a7-a3e7-6d17b4566f97\") " pod="openshift-dns/node-resolver-cf287"
Sep 08 11:30:25.396065 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.395981    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-host-run-ovn-kubernetes\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.396065 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.396014    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/63788019-f061-44d6-89a3-50c4a62e9fbf-ovnkube-script-lib\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.396065 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.396034    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/59c98920-00f1-4ea9-bf6e-8fca2c95244a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r9ksl\" (UID: \"59c98920-00f1-4ea9-bf6e-8fca2c95244a\") " pod="openshift-multus/multus-additional-cni-plugins-r9ksl"
Sep 08 11:30:25.396065 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.396053    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e75f13ca-f8fe-4d34-98e6-2bc02d335fe0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-krfgv\" (UID: \"e75f13ca-f8fe-4d34-98e6-2bc02d335fe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krfgv"
Sep 08 11:30:25.396271 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.396074    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvv6n\" (UniqueName: \"kubernetes.io/projected/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-kube-api-access-xvv6n\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.396271 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.396098    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1df1b9eb-b388-4e05-af5d-9da7cfd4ce10-dbus\") pod \"global-pull-secret-syncer-2tmp9\" (UID: \"1df1b9eb-b388-4e05-af5d-9da7cfd4ce10\") " pod="kube-system/global-pull-secret-syncer-2tmp9"
Sep 08 11:30:25.396271 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.396138    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e75f13ca-f8fe-4d34-98e6-2bc02d335fe0-socket-dir\") pod \"aws-ebs-csi-driver-node-krfgv\" (UID: \"e75f13ca-f8fe-4d34-98e6-2bc02d335fe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krfgv"
Sep 08 11:30:25.396271 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.396174    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e75f13ca-f8fe-4d34-98e6-2bc02d335fe0-etc-selinux\") pod \"aws-ebs-csi-driver-node-krfgv\" (UID: \"e75f13ca-f8fe-4d34-98e6-2bc02d335fe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krfgv"
Sep 08 11:30:25.396271 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.396197    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-etc-sysconfig\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.396271 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.396231    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/51e41bf2-8be4-48a7-a3e7-6d17b4566f97-hosts-file\") pod \"node-resolver-cf287\" (UID: \"51e41bf2-8be4-48a7-a3e7-6d17b4566f97\") " pod="openshift-dns/node-resolver-cf287"
Sep 08 11:30:25.396424 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.396270    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/598d45ef-a4d2-4d2a-b318-c3898319833a-serviceca\") pod \"node-ca-bhshk\" (UID: \"598d45ef-a4d2-4d2a-b318-c3898319833a\") " pod="openshift-image-registry/node-ca-bhshk"
Sep 08 11:30:25.396424 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.396294    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/927c9c1b-2e72-4316-94d9-58662176506e-system-cni-dir\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.396424 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.396308    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p79h\" (UniqueName: \"kubernetes.io/projected/b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679-kube-api-access-7p79h\") pod \"network-metrics-daemon-nb8wz\" (UID: \"b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679\") " pod="openshift-multus/network-metrics-daemon-nb8wz"
Sep 08 11:30:25.396424 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.396332    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e520e24a-82d2-4d15-9257-b6bf3df4bb16-agent-certs\") pod \"konnectivity-agent-62v7t\" (UID: \"e520e24a-82d2-4d15-9257-b6bf3df4bb16\") " pod="kube-system/konnectivity-agent-62v7t"
Sep 08 11:30:25.396424 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.396353    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-etc-tuned\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.396424 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.396369    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctdbq\" (UniqueName: \"kubernetes.io/projected/598d45ef-a4d2-4d2a-b318-c3898319833a-kube-api-access-ctdbq\") pod \"node-ca-bhshk\" (UID: \"598d45ef-a4d2-4d2a-b318-c3898319833a\") " pod="openshift-image-registry/node-ca-bhshk"
Sep 08 11:30:25.396424 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.396382    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/927c9c1b-2e72-4316-94d9-58662176506e-multus-cni-dir\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.396424 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.396396    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-host-slash\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.396424 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.396413    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-run-ovn\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.396684 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.396430    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-host-cni-bin\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.396684 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.396452    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/63788019-f061-44d6-89a3-50c4a62e9fbf-ovnkube-config\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.396684 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.396465    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e75f13ca-f8fe-4d34-98e6-2bc02d335fe0-sys-fs\") pod \"aws-ebs-csi-driver-node-krfgv\" (UID: \"e75f13ca-f8fe-4d34-98e6-2bc02d335fe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krfgv"
Sep 08 11:30:25.396684 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.396495    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg864\" (UniqueName: \"kubernetes.io/projected/927c9c1b-2e72-4316-94d9-58662176506e-kube-api-access-qg864\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.396684 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.396522    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e520e24a-82d2-4d15-9257-b6bf3df4bb16-konnectivity-ca\") pod \"konnectivity-agent-62v7t\" (UID: \"e520e24a-82d2-4d15-9257-b6bf3df4bb16\") " pod="kube-system/konnectivity-agent-62v7t"
Sep 08 11:30:25.396684 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.396545    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/63788019-f061-44d6-89a3-50c4a62e9fbf-ovn-node-metrics-cert\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.396684 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.396567    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvqcm\" (UniqueName: \"kubernetes.io/projected/59c98920-00f1-4ea9-bf6e-8fca2c95244a-kube-api-access-zvqcm\") pod \"multus-additional-cni-plugins-r9ksl\" (UID: \"59c98920-00f1-4ea9-bf6e-8fca2c95244a\") " pod="openshift-multus/multus-additional-cni-plugins-r9ksl"
Sep 08 11:30:25.396684 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.396590    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-sys\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.396684 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.396638    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bff59f33-b908-4b33-a6e6-670e91c50267-host-slash\") pod \"iptables-alerter-hvr4n\" (UID: \"bff59f33-b908-4b33-a6e6-670e91c50267\") " pod="openshift-network-operator/iptables-alerter-hvr4n"
Sep 08 11:30:25.396684 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.396660    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/927c9c1b-2e72-4316-94d9-58662176506e-multus-daemon-config\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.396684 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.396681    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-node-log\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.397064 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.396703    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.397064 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.396736    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e75f13ca-f8fe-4d34-98e6-2bc02d335fe0-registration-dir\") pod \"aws-ebs-csi-driver-node-krfgv\" (UID: \"e75f13ca-f8fe-4d34-98e6-2bc02d335fe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krfgv"
Sep 08 11:30:25.397064 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.396757    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-etc-sysctl-d\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.397064 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.396776    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-run\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.397064 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.396798    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-var-lib-openvswitch\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.397064 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.396818    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-var-lib-kubelet\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.397064 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.396842    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59c98920-00f1-4ea9-bf6e-8fca2c95244a-system-cni-dir\") pod \"multus-additional-cni-plugins-r9ksl\" (UID: \"59c98920-00f1-4ea9-bf6e-8fca2c95244a\") " pod="openshift-multus/multus-additional-cni-plugins-r9ksl"
Sep 08 11:30:25.397064 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.396876    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59c98920-00f1-4ea9-bf6e-8fca2c95244a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r9ksl\" (UID: \"59c98920-00f1-4ea9-bf6e-8fca2c95244a\") " pod="openshift-multus/multus-additional-cni-plugins-r9ksl"
Sep 08 11:30:25.397064 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.396896    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/59c98920-00f1-4ea9-bf6e-8fca2c95244a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r9ksl\" (UID: \"59c98920-00f1-4ea9-bf6e-8fca2c95244a\") " pod="openshift-multus/multus-additional-cni-plugins-r9ksl"
Sep 08 11:30:25.397064 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.396913    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/598d45ef-a4d2-4d2a-b318-c3898319833a-host\") pod \"node-ca-bhshk\" (UID: \"598d45ef-a4d2-4d2a-b318-c3898319833a\") " pod="openshift-image-registry/node-ca-bhshk"
Sep 08 11:30:25.397064 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.396940    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/927c9c1b-2e72-4316-94d9-58662176506e-host-run-k8s-cni-cncf-io\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.397064 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.396979    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679-metrics-certs\") pod \"network-metrics-daemon-nb8wz\" (UID: \"b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679\") " pod="openshift-multus/network-metrics-daemon-nb8wz"
Sep 08 11:30:25.397064 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.397009    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/927c9c1b-2e72-4316-94d9-58662176506e-etc-kubernetes\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.397064 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.397040    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-run-systemd\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.397064 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.397070    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/63788019-f061-44d6-89a3-50c4a62e9fbf-env-overrides\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.397798 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.397096    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-lib-modules\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.397798 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.397118    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/927c9c1b-2e72-4316-94d9-58662176506e-hostroot\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.397798 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.397140    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1df1b9eb-b388-4e05-af5d-9da7cfd4ce10-kubelet-config\") pod \"global-pull-secret-syncer-2tmp9\" (UID: \"1df1b9eb-b388-4e05-af5d-9da7cfd4ce10\") " pod="kube-system/global-pull-secret-syncer-2tmp9"
Sep 08 11:30:25.397798 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.397164    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-host-kubelet\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.397798 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.397185    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/927c9c1b-2e72-4316-94d9-58662176506e-host-var-lib-cni-bin\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.397798 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.397207    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/927c9c1b-2e72-4316-94d9-58662176506e-host-var-lib-kubelet\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.397798 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.397228    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-etc-openvswitch\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.397798 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.397251    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-run-openvswitch\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.397798 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.397289    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/927c9c1b-2e72-4316-94d9-58662176506e-multus-conf-dir\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.397798 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.397315    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-etc-systemd\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.397798 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.397338    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59c98920-00f1-4ea9-bf6e-8fca2c95244a-cnibin\") pod \"multus-additional-cni-plugins-r9ksl\" (UID: \"59c98920-00f1-4ea9-bf6e-8fca2c95244a\") " pod="openshift-multus/multus-additional-cni-plugins-r9ksl"
Sep 08 11:30:25.397798 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.397362    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45qw9\" (UniqueName: \"kubernetes.io/projected/e75f13ca-f8fe-4d34-98e6-2bc02d335fe0-kube-api-access-45qw9\") pod \"aws-ebs-csi-driver-node-krfgv\" (UID: \"e75f13ca-f8fe-4d34-98e6-2bc02d335fe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krfgv"
Sep 08 11:30:25.397798 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.397384    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bff59f33-b908-4b33-a6e6-670e91c50267-iptables-alerter-script\") pod \"iptables-alerter-hvr4n\" (UID: \"bff59f33-b908-4b33-a6e6-670e91c50267\") " pod="openshift-network-operator/iptables-alerter-hvr4n"
Sep 08 11:30:25.397798 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.397405    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/927c9c1b-2e72-4316-94d9-58662176506e-cni-binary-copy\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.397798 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.397426    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-log-socket\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.397798 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.397448    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99vjs\" (UniqueName: \"kubernetes.io/projected/51e41bf2-8be4-48a7-a3e7-6d17b4566f97-kube-api-access-99vjs\") pod \"node-resolver-cf287\" (UID: \"51e41bf2-8be4-48a7-a3e7-6d17b4566f97\") " pod="openshift-dns/node-resolver-cf287"
Sep 08 11:30:25.398234 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.397472    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qltzt\" (UniqueName: \"kubernetes.io/projected/bff59f33-b908-4b33-a6e6-670e91c50267-kube-api-access-qltzt\") pod \"iptables-alerter-hvr4n\" (UID: \"bff59f33-b908-4b33-a6e6-670e91c50267\") " pod="openshift-network-operator/iptables-alerter-hvr4n"
Sep 08 11:30:25.398234 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.397507    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59c98920-00f1-4ea9-bf6e-8fca2c95244a-cni-binary-copy\") pod \"multus-additional-cni-plugins-r9ksl\" (UID: \"59c98920-00f1-4ea9-bf6e-8fca2c95244a\") " pod="openshift-multus/multus-additional-cni-plugins-r9ksl"
Sep 08 11:30:25.398234 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.397552    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp2f9\" (UniqueName: \"kubernetes.io/projected/190e88db-a54a-4abb-bd46-1158e5bb71c6-kube-api-access-bp2f9\") pod \"network-check-target-m5x5z\" (UID: \"190e88db-a54a-4abb-bd46-1158e5bb71c6\") " pod="openshift-network-diagnostics/network-check-target-m5x5z"
Sep 08 11:30:25.398234 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.397576    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/927c9c1b-2e72-4316-94d9-58662176506e-host-run-netns\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.398234 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.397616    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-host-cni-netd\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.398234 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.397665    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcl84\" (UniqueName: \"kubernetes.io/projected/63788019-f061-44d6-89a3-50c4a62e9fbf-kube-api-access-lcl84\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.498257 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.498230    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qltzt\" (UniqueName: \"kubernetes.io/projected/bff59f33-b908-4b33-a6e6-670e91c50267-kube-api-access-qltzt\") pod \"iptables-alerter-hvr4n\" (UID: \"bff59f33-b908-4b33-a6e6-670e91c50267\") " pod="openshift-network-operator/iptables-alerter-hvr4n"
Sep 08 11:30:25.498257 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.498255    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59c98920-00f1-4ea9-bf6e-8fca2c95244a-cni-binary-copy\") pod \"multus-additional-cni-plugins-r9ksl\" (UID: \"59c98920-00f1-4ea9-bf6e-8fca2c95244a\") " pod="openshift-multus/multus-additional-cni-plugins-r9ksl"
Sep 08 11:30:25.498395 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.498271    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp2f9\" (UniqueName: \"kubernetes.io/projected/190e88db-a54a-4abb-bd46-1158e5bb71c6-kube-api-access-bp2f9\") pod \"network-check-target-m5x5z\" (UID: \"190e88db-a54a-4abb-bd46-1158e5bb71c6\") " pod="openshift-network-diagnostics/network-check-target-m5x5z"
Sep 08 11:30:25.498395 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.498285    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/927c9c1b-2e72-4316-94d9-58662176506e-host-run-netns\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.498469 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.498404    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-host-cni-netd\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.498469 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.498432    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcl84\" (UniqueName: \"kubernetes.io/projected/63788019-f061-44d6-89a3-50c4a62e9fbf-kube-api-access-lcl84\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.498469 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.498444    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/927c9c1b-2e72-4316-94d9-58662176506e-host-run-netns\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.498469 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.498458    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-etc-kubernetes\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.498675 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.498491    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/927c9c1b-2e72-4316-94d9-58662176506e-host-var-lib-cni-multus\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.498675 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.498490    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-host-cni-netd\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.498675 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.498514    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/927c9c1b-2e72-4316-94d9-58662176506e-host-run-multus-certs\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.498675 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.498536    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-host-run-netns\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.498675 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.498552    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/927c9c1b-2e72-4316-94d9-58662176506e-host-run-multus-certs\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.498675 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.498565    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-etc-modprobe-d\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.498675 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.498581    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-host-run-netns\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.498675 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.498579    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/927c9c1b-2e72-4316-94d9-58662176506e-host-var-lib-cni-multus\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.498675 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.498577    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-etc-kubernetes\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.498675 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.498587    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e75f13ca-f8fe-4d34-98e6-2bc02d335fe0-device-dir\") pod \"aws-ebs-csi-driver-node-krfgv\" (UID: \"e75f13ca-f8fe-4d34-98e6-2bc02d335fe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krfgv"
Sep 08 11:30:25.498675 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.498645    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e75f13ca-f8fe-4d34-98e6-2bc02d335fe0-device-dir\") pod \"aws-ebs-csi-driver-node-krfgv\" (UID: \"e75f13ca-f8fe-4d34-98e6-2bc02d335fe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krfgv"
Sep 08 11:30:25.498675 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.498658    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-tmp\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.498675 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.498682    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/927c9c1b-2e72-4316-94d9-58662176506e-cnibin\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.499245 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.498697    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-etc-modprobe-d\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.499245 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.498704    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/927c9c1b-2e72-4316-94d9-58662176506e-multus-socket-dir-parent\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.499245 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.498728    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1df1b9eb-b388-4e05-af5d-9da7cfd4ce10-original-pull-secret\") pod \"global-pull-secret-syncer-2tmp9\" (UID: \"1df1b9eb-b388-4e05-af5d-9da7cfd4ce10\") " pod="kube-system/global-pull-secret-syncer-2tmp9"
Sep 08 11:30:25.499245 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.498740    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/927c9c1b-2e72-4316-94d9-58662176506e-cnibin\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.499245 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.498750    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-systemd-units\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.499245 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.498773    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-etc-sysctl-conf\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.499245 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.498796    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-host\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.499245 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.498810    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/927c9c1b-2e72-4316-94d9-58662176506e-multus-socket-dir-parent\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.499245 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.498809    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-systemd-units\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.499245 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.498818    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51e41bf2-8be4-48a7-a3e7-6d17b4566f97-tmp-dir\") pod \"node-resolver-cf287\" (UID: \"51e41bf2-8be4-48a7-a3e7-6d17b4566f97\") " pod="openshift-dns/node-resolver-cf287"
Sep 08 11:30:25.499245 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.498837    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59c98920-00f1-4ea9-bf6e-8fca2c95244a-cni-binary-copy\") pod \"multus-additional-cni-plugins-r9ksl\" (UID: \"59c98920-00f1-4ea9-bf6e-8fca2c95244a\") " pod="openshift-multus/multus-additional-cni-plugins-r9ksl"
Sep 08 11:30:25.499245 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.498855    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-host-run-ovn-kubernetes\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.499245 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.498866    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-host\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.499245 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.498881    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/63788019-f061-44d6-89a3-50c4a62e9fbf-ovnkube-script-lib\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.499245 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:25.498828    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 11:30:25.499245 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.498919    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-host-run-ovn-kubernetes\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.499245 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.498922    2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 08 11:30:25.499245 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.498915    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/59c98920-00f1-4ea9-bf6e-8fca2c95244a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r9ksl\" (UID: \"59c98920-00f1-4ea9-bf6e-8fca2c95244a\") " pod="openshift-multus/multus-additional-cni-plugins-r9ksl"
Sep 08 11:30:25.500069 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.498938    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-etc-sysctl-conf\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.500069 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:25.498988    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1df1b9eb-b388-4e05-af5d-9da7cfd4ce10-original-pull-secret podName:1df1b9eb-b388-4e05-af5d-9da7cfd4ce10 nodeName:}" failed. No retries permitted until 2026-09-08 11:30:25.998947743 +0000 UTC m=+2.079392199 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1df1b9eb-b388-4e05-af5d-9da7cfd4ce10-original-pull-secret") pod "global-pull-secret-syncer-2tmp9" (UID: "1df1b9eb-b388-4e05-af5d-9da7cfd4ce10") : object "kube-system"/"original-pull-secret" not registered
Sep 08 11:30:25.500069 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499007    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e75f13ca-f8fe-4d34-98e6-2bc02d335fe0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-krfgv\" (UID: \"e75f13ca-f8fe-4d34-98e6-2bc02d335fe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krfgv"
Sep 08 11:30:25.500069 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499035    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvv6n\" (UniqueName: \"kubernetes.io/projected/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-kube-api-access-xvv6n\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.500069 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499059    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1df1b9eb-b388-4e05-af5d-9da7cfd4ce10-dbus\") pod \"global-pull-secret-syncer-2tmp9\" (UID: \"1df1b9eb-b388-4e05-af5d-9da7cfd4ce10\") " pod="kube-system/global-pull-secret-syncer-2tmp9"
Sep 08 11:30:25.500069 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499081    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e75f13ca-f8fe-4d34-98e6-2bc02d335fe0-socket-dir\") pod \"aws-ebs-csi-driver-node-krfgv\" (UID: \"e75f13ca-f8fe-4d34-98e6-2bc02d335fe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krfgv"
Sep 08 11:30:25.500069 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499102    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e75f13ca-f8fe-4d34-98e6-2bc02d335fe0-etc-selinux\") pod \"aws-ebs-csi-driver-node-krfgv\" (UID: \"e75f13ca-f8fe-4d34-98e6-2bc02d335fe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krfgv"
Sep 08 11:30:25.500069 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499125    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-etc-sysconfig\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.500069 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499148    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/51e41bf2-8be4-48a7-a3e7-6d17b4566f97-hosts-file\") pod \"node-resolver-cf287\" (UID: \"51e41bf2-8be4-48a7-a3e7-6d17b4566f97\") " pod="openshift-dns/node-resolver-cf287"
Sep 08 11:30:25.500069 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499194    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51e41bf2-8be4-48a7-a3e7-6d17b4566f97-tmp-dir\") pod \"node-resolver-cf287\" (UID: \"51e41bf2-8be4-48a7-a3e7-6d17b4566f97\") " pod="openshift-dns/node-resolver-cf287"
Sep 08 11:30:25.500069 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499203    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/51e41bf2-8be4-48a7-a3e7-6d17b4566f97-hosts-file\") pod \"node-resolver-cf287\" (UID: \"51e41bf2-8be4-48a7-a3e7-6d17b4566f97\") " pod="openshift-dns/node-resolver-cf287"
Sep 08 11:30:25.500069 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499257    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-etc-sysconfig\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.500069 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499255    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e75f13ca-f8fe-4d34-98e6-2bc02d335fe0-socket-dir\") pod \"aws-ebs-csi-driver-node-krfgv\" (UID: \"e75f13ca-f8fe-4d34-98e6-2bc02d335fe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krfgv"
Sep 08 11:30:25.500069 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499316    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e75f13ca-f8fe-4d34-98e6-2bc02d335fe0-etc-selinux\") pod \"aws-ebs-csi-driver-node-krfgv\" (UID: \"e75f13ca-f8fe-4d34-98e6-2bc02d335fe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krfgv"
Sep 08 11:30:25.500069 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499327    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/598d45ef-a4d2-4d2a-b318-c3898319833a-serviceca\") pod \"node-ca-bhshk\" (UID: \"598d45ef-a4d2-4d2a-b318-c3898319833a\") " pod="openshift-image-registry/node-ca-bhshk"
Sep 08 11:30:25.500069 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499337    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/59c98920-00f1-4ea9-bf6e-8fca2c95244a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r9ksl\" (UID: \"59c98920-00f1-4ea9-bf6e-8fca2c95244a\") " pod="openshift-multus/multus-additional-cni-plugins-r9ksl"
Sep 08 11:30:25.500826 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499350    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1df1b9eb-b388-4e05-af5d-9da7cfd4ce10-dbus\") pod \"global-pull-secret-syncer-2tmp9\" (UID: \"1df1b9eb-b388-4e05-af5d-9da7cfd4ce10\") " pod="kube-system/global-pull-secret-syncer-2tmp9"
Sep 08 11:30:25.500826 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499361    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/927c9c1b-2e72-4316-94d9-58662176506e-system-cni-dir\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.500826 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499398    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p79h\" (UniqueName: \"kubernetes.io/projected/b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679-kube-api-access-7p79h\") pod \"network-metrics-daemon-nb8wz\" (UID: \"b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679\") " pod="openshift-multus/network-metrics-daemon-nb8wz"
Sep 08 11:30:25.500826 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499409    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e75f13ca-f8fe-4d34-98e6-2bc02d335fe0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-krfgv\" (UID: \"e75f13ca-f8fe-4d34-98e6-2bc02d335fe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krfgv"
Sep 08 11:30:25.500826 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499421    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e520e24a-82d2-4d15-9257-b6bf3df4bb16-agent-certs\") pod \"konnectivity-agent-62v7t\" (UID: \"e520e24a-82d2-4d15-9257-b6bf3df4bb16\") " pod="kube-system/konnectivity-agent-62v7t"
Sep 08 11:30:25.500826 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499444    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-etc-tuned\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.500826 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499457    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/63788019-f061-44d6-89a3-50c4a62e9fbf-ovnkube-script-lib\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.500826 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499462    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/927c9c1b-2e72-4316-94d9-58662176506e-system-cni-dir\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.500826 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499467    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctdbq\" (UniqueName: \"kubernetes.io/projected/598d45ef-a4d2-4d2a-b318-c3898319833a-kube-api-access-ctdbq\") pod \"node-ca-bhshk\" (UID: \"598d45ef-a4d2-4d2a-b318-c3898319833a\") " pod="openshift-image-registry/node-ca-bhshk"
Sep 08 11:30:25.500826 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499497    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/927c9c1b-2e72-4316-94d9-58662176506e-multus-cni-dir\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.500826 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499521    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-host-slash\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.500826 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499543    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-run-ovn\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.500826 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499568    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-host-cni-bin\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.500826 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499592    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/63788019-f061-44d6-89a3-50c4a62e9fbf-ovnkube-config\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.500826 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499633    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e75f13ca-f8fe-4d34-98e6-2bc02d335fe0-sys-fs\") pod \"aws-ebs-csi-driver-node-krfgv\" (UID: \"e75f13ca-f8fe-4d34-98e6-2bc02d335fe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krfgv"
Sep 08 11:30:25.500826 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499640    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-host-cni-bin\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.500826 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499642    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-run-ovn\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.500826 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499591    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/927c9c1b-2e72-4316-94d9-58662176506e-multus-cni-dir\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.501655 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499660    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg864\" (UniqueName: \"kubernetes.io/projected/927c9c1b-2e72-4316-94d9-58662176506e-kube-api-access-qg864\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.501655 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499674    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-host-slash\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.501655 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499693    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e520e24a-82d2-4d15-9257-b6bf3df4bb16-konnectivity-ca\") pod \"konnectivity-agent-62v7t\" (UID: \"e520e24a-82d2-4d15-9257-b6bf3df4bb16\") " pod="kube-system/konnectivity-agent-62v7t"
Sep 08 11:30:25.501655 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499715    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/63788019-f061-44d6-89a3-50c4a62e9fbf-ovn-node-metrics-cert\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.501655 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499734    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvqcm\" (UniqueName: \"kubernetes.io/projected/59c98920-00f1-4ea9-bf6e-8fca2c95244a-kube-api-access-zvqcm\") pod \"multus-additional-cni-plugins-r9ksl\" (UID: \"59c98920-00f1-4ea9-bf6e-8fca2c95244a\") " pod="openshift-multus/multus-additional-cni-plugins-r9ksl"
Sep 08 11:30:25.501655 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499736    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e75f13ca-f8fe-4d34-98e6-2bc02d335fe0-sys-fs\") pod \"aws-ebs-csi-driver-node-krfgv\" (UID: \"e75f13ca-f8fe-4d34-98e6-2bc02d335fe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krfgv"
Sep 08 11:30:25.501655 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499737    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/598d45ef-a4d2-4d2a-b318-c3898319833a-serviceca\") pod \"node-ca-bhshk\" (UID: \"598d45ef-a4d2-4d2a-b318-c3898319833a\") " pod="openshift-image-registry/node-ca-bhshk"
Sep 08 11:30:25.501655 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499768    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-sys\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.501655 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499793    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bff59f33-b908-4b33-a6e6-670e91c50267-host-slash\") pod \"iptables-alerter-hvr4n\" (UID: \"bff59f33-b908-4b33-a6e6-670e91c50267\") " pod="openshift-network-operator/iptables-alerter-hvr4n"
Sep 08 11:30:25.501655 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499814    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/927c9c1b-2e72-4316-94d9-58662176506e-multus-daemon-config\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.501655 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499838    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-node-log\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.501655 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499861    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.501655 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499867    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bff59f33-b908-4b33-a6e6-670e91c50267-host-slash\") pod \"iptables-alerter-hvr4n\" (UID: \"bff59f33-b908-4b33-a6e6-670e91c50267\") " pod="openshift-network-operator/iptables-alerter-hvr4n"
Sep 08 11:30:25.501655 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499884    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e75f13ca-f8fe-4d34-98e6-2bc02d335fe0-registration-dir\") pod \"aws-ebs-csi-driver-node-krfgv\" (UID: \"e75f13ca-f8fe-4d34-98e6-2bc02d335fe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krfgv"
Sep 08 11:30:25.501655 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499903    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-etc-sysctl-d\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.501655 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499924    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-sys\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.501655 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499940    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-run\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.502390 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499947    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-node-log\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.502390 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499960    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-var-lib-openvswitch\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.502390 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.499979    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-var-lib-kubelet\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.502390 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500000    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59c98920-00f1-4ea9-bf6e-8fca2c95244a-system-cni-dir\") pod \"multus-additional-cni-plugins-r9ksl\" (UID: \"59c98920-00f1-4ea9-bf6e-8fca2c95244a\") " pod="openshift-multus/multus-additional-cni-plugins-r9ksl"
Sep 08 11:30:25.502390 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500000    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e75f13ca-f8fe-4d34-98e6-2bc02d335fe0-registration-dir\") pod \"aws-ebs-csi-driver-node-krfgv\" (UID: \"e75f13ca-f8fe-4d34-98e6-2bc02d335fe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krfgv"
Sep 08 11:30:25.502390 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500034    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.502390 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500063    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59c98920-00f1-4ea9-bf6e-8fca2c95244a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r9ksl\" (UID: \"59c98920-00f1-4ea9-bf6e-8fca2c95244a\") " pod="openshift-multus/multus-additional-cni-plugins-r9ksl"
Sep 08 11:30:25.502390 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500100    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-etc-sysctl-d\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.502390 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500146    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-run\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.502390 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500123    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/59c98920-00f1-4ea9-bf6e-8fca2c95244a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r9ksl\" (UID: \"59c98920-00f1-4ea9-bf6e-8fca2c95244a\") " pod="openshift-multus/multus-additional-cni-plugins-r9ksl"
Sep 08 11:30:25.502390 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500189    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-var-lib-openvswitch\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.502390 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500271    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/598d45ef-a4d2-4d2a-b318-c3898319833a-host\") pod \"node-ca-bhshk\" (UID: \"598d45ef-a4d2-4d2a-b318-c3898319833a\") " pod="openshift-image-registry/node-ca-bhshk"
Sep 08 11:30:25.502390 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500316    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/927c9c1b-2e72-4316-94d9-58662176506e-host-run-k8s-cni-cncf-io\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.502390 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500335    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679-metrics-certs\") pod \"network-metrics-daemon-nb8wz\" (UID: \"b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679\") " pod="openshift-multus/network-metrics-daemon-nb8wz"
Sep 08 11:30:25.502390 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500354    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/927c9c1b-2e72-4316-94d9-58662176506e-etc-kubernetes\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.502390 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500373    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-run-systemd\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.502390 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500391    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/63788019-f061-44d6-89a3-50c4a62e9fbf-env-overrides\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.503055 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500394    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-var-lib-kubelet\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.503055 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500411    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-lib-modules\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.503055 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500413    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/927c9c1b-2e72-4316-94d9-58662176506e-multus-daemon-config\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.503055 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500433    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/927c9c1b-2e72-4316-94d9-58662176506e-hostroot\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.503055 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500441    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59c98920-00f1-4ea9-bf6e-8fca2c95244a-system-cni-dir\") pod \"multus-additional-cni-plugins-r9ksl\" (UID: \"59c98920-00f1-4ea9-bf6e-8fca2c95244a\") " pod="openshift-multus/multus-additional-cni-plugins-r9ksl"
Sep 08 11:30:25.503055 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500453    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1df1b9eb-b388-4e05-af5d-9da7cfd4ce10-kubelet-config\") pod \"global-pull-secret-syncer-2tmp9\" (UID: \"1df1b9eb-b388-4e05-af5d-9da7cfd4ce10\") " pod="kube-system/global-pull-secret-syncer-2tmp9"
Sep 08 11:30:25.503055 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500472    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-host-kubelet\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.503055 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500492    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/927c9c1b-2e72-4316-94d9-58662176506e-host-var-lib-cni-bin\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.503055 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:25.500498    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 11:30:25.503055 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500529    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/927c9c1b-2e72-4316-94d9-58662176506e-host-var-lib-kubelet\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.503055 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:25.500555    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679-metrics-certs podName:b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679 nodeName:}" failed. No retries permitted until 2026-09-08 11:30:26.000538365 +0000 UTC m=+2.080982802 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679-metrics-certs") pod "network-metrics-daemon-nb8wz" (UID: "b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 11:30:25.503055 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500576    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/927c9c1b-2e72-4316-94d9-58662176506e-host-var-lib-kubelet\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.503055 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500584    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-etc-openvswitch\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.503055 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500631    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-run-openvswitch\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.503055 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500655    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/927c9c1b-2e72-4316-94d9-58662176506e-multus-conf-dir\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.503055 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500677    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-lib-modules\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.503055 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500683    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/927c9c1b-2e72-4316-94d9-58662176506e-etc-kubernetes\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.503650 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500680    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-etc-systemd\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.503650 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500719    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/927c9c1b-2e72-4316-94d9-58662176506e-hostroot\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.503650 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500721    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-etc-systemd\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.503650 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500724    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59c98920-00f1-4ea9-bf6e-8fca2c95244a-cnibin\") pod \"multus-additional-cni-plugins-r9ksl\" (UID: \"59c98920-00f1-4ea9-bf6e-8fca2c95244a\") " pod="openshift-multus/multus-additional-cni-plugins-r9ksl"
Sep 08 11:30:25.503650 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500763    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59c98920-00f1-4ea9-bf6e-8fca2c95244a-cnibin\") pod \"multus-additional-cni-plugins-r9ksl\" (UID: \"59c98920-00f1-4ea9-bf6e-8fca2c95244a\") " pod="openshift-multus/multus-additional-cni-plugins-r9ksl"
Sep 08 11:30:25.503650 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500763    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45qw9\" (UniqueName: \"kubernetes.io/projected/e75f13ca-f8fe-4d34-98e6-2bc02d335fe0-kube-api-access-45qw9\") pod \"aws-ebs-csi-driver-node-krfgv\" (UID: \"e75f13ca-f8fe-4d34-98e6-2bc02d335fe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krfgv"
Sep 08 11:30:25.503650 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500803    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bff59f33-b908-4b33-a6e6-670e91c50267-iptables-alerter-script\") pod \"iptables-alerter-hvr4n\" (UID: \"bff59f33-b908-4b33-a6e6-670e91c50267\") " pod="openshift-network-operator/iptables-alerter-hvr4n"
Sep 08 11:30:25.503650 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500810    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/63788019-f061-44d6-89a3-50c4a62e9fbf-env-overrides\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.503650 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500829    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/927c9c1b-2e72-4316-94d9-58662176506e-cni-binary-copy\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.503650 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500870    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-run-systemd\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.503650 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500922    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-log-socket\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.503650 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500953    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99vjs\" (UniqueName: \"kubernetes.io/projected/51e41bf2-8be4-48a7-a3e7-6d17b4566f97-kube-api-access-99vjs\") pod \"node-resolver-cf287\" (UID: \"51e41bf2-8be4-48a7-a3e7-6d17b4566f97\") " pod="openshift-dns/node-resolver-cf287"
Sep 08 11:30:25.503650 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.500975    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-host-kubelet\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.503650 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.501022    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/927c9c1b-2e72-4316-94d9-58662176506e-host-var-lib-cni-bin\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.503650 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.501035    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1df1b9eb-b388-4e05-af5d-9da7cfd4ce10-kubelet-config\") pod \"global-pull-secret-syncer-2tmp9\" (UID: \"1df1b9eb-b388-4e05-af5d-9da7cfd4ce10\") " pod="kube-system/global-pull-secret-syncer-2tmp9"
Sep 08 11:30:25.503650 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.501055    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-log-socket\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.503650 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.501081    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/598d45ef-a4d2-4d2a-b318-c3898319833a-host\") pod \"node-ca-bhshk\" (UID: \"598d45ef-a4d2-4d2a-b318-c3898319833a\") " pod="openshift-image-registry/node-ca-bhshk"
Sep 08 11:30:25.503650 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.501117    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/927c9c1b-2e72-4316-94d9-58662176506e-host-run-k8s-cni-cncf-io\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.504240 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.501183    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/59c98920-00f1-4ea9-bf6e-8fca2c95244a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r9ksl\" (UID: \"59c98920-00f1-4ea9-bf6e-8fca2c95244a\") " pod="openshift-multus/multus-additional-cni-plugins-r9ksl"
Sep 08 11:30:25.504240 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.501272    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/927c9c1b-2e72-4316-94d9-58662176506e-multus-conf-dir\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.504240 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.501294    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/927c9c1b-2e72-4316-94d9-58662176506e-cni-binary-copy\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.504240 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.501304    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-etc-openvswitch\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.504240 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.501315    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63788019-f061-44d6-89a3-50c4a62e9fbf-run-openvswitch\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.504240 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.501379    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/63788019-f061-44d6-89a3-50c4a62e9fbf-ovnkube-config\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.504240 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.501736    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bff59f33-b908-4b33-a6e6-670e91c50267-iptables-alerter-script\") pod \"iptables-alerter-hvr4n\" (UID: \"bff59f33-b908-4b33-a6e6-670e91c50267\") " pod="openshift-network-operator/iptables-alerter-hvr4n"
Sep 08 11:30:25.504240 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.501899    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59c98920-00f1-4ea9-bf6e-8fca2c95244a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r9ksl\" (UID: \"59c98920-00f1-4ea9-bf6e-8fca2c95244a\") " pod="openshift-multus/multus-additional-cni-plugins-r9ksl"
Sep 08 11:30:25.504240 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.502321    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e520e24a-82d2-4d15-9257-b6bf3df4bb16-konnectivity-ca\") pod \"konnectivity-agent-62v7t\" (UID: \"e520e24a-82d2-4d15-9257-b6bf3df4bb16\") " pod="kube-system/konnectivity-agent-62v7t"
Sep 08 11:30:25.504240 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.502875    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-tmp\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.504240 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.502917    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-etc-tuned\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.504240 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.502939    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/63788019-f061-44d6-89a3-50c4a62e9fbf-ovn-node-metrics-cert\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.504240 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.503878    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e520e24a-82d2-4d15-9257-b6bf3df4bb16-agent-certs\") pod \"konnectivity-agent-62v7t\" (UID: \"e520e24a-82d2-4d15-9257-b6bf3df4bb16\") " pod="kube-system/konnectivity-agent-62v7t"
Sep 08 11:30:25.507425 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:25.507409    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 11:30:25.507497 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:25.507428    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 11:30:25.507497 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:25.507436    2575 projected.go:196] Error preparing data for projected volume kube-api-access-bp2f9 for pod openshift-network-diagnostics/network-check-target-m5x5z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 11:30:25.507497 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:25.507477    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/190e88db-a54a-4abb-bd46-1158e5bb71c6-kube-api-access-bp2f9 podName:190e88db-a54a-4abb-bd46-1158e5bb71c6 nodeName:}" failed. No retries permitted until 2026-09-08 11:30:26.007466981 +0000 UTC m=+2.087911433 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bp2f9" (UniqueName: "kubernetes.io/projected/190e88db-a54a-4abb-bd46-1158e5bb71c6-kube-api-access-bp2f9") pod "network-check-target-m5x5z" (UID: "190e88db-a54a-4abb-bd46-1158e5bb71c6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 11:30:25.513643 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.513619    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99vjs\" (UniqueName: \"kubernetes.io/projected/51e41bf2-8be4-48a7-a3e7-6d17b4566f97-kube-api-access-99vjs\") pod \"node-resolver-cf287\" (UID: \"51e41bf2-8be4-48a7-a3e7-6d17b4566f97\") " pod="openshift-dns/node-resolver-cf287"
Sep 08 11:30:25.514019 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.513998    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45qw9\" (UniqueName: \"kubernetes.io/projected/e75f13ca-f8fe-4d34-98e6-2bc02d335fe0-kube-api-access-45qw9\") pod \"aws-ebs-csi-driver-node-krfgv\" (UID: \"e75f13ca-f8fe-4d34-98e6-2bc02d335fe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krfgv"
Sep 08 11:30:25.514343 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.514325    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvqcm\" (UniqueName: \"kubernetes.io/projected/59c98920-00f1-4ea9-bf6e-8fca2c95244a-kube-api-access-zvqcm\") pod \"multus-additional-cni-plugins-r9ksl\" (UID: \"59c98920-00f1-4ea9-bf6e-8fca2c95244a\") " pod="openshift-multus/multus-additional-cni-plugins-r9ksl"
Sep 08 11:30:25.514430 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.514354    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctdbq\" (UniqueName: \"kubernetes.io/projected/598d45ef-a4d2-4d2a-b318-c3898319833a-kube-api-access-ctdbq\") pod \"node-ca-bhshk\" (UID: \"598d45ef-a4d2-4d2a-b318-c3898319833a\") " pod="openshift-image-registry/node-ca-bhshk"
Sep 08 11:30:25.514582 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.514562    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcl84\" (UniqueName: \"kubernetes.io/projected/63788019-f061-44d6-89a3-50c4a62e9fbf-kube-api-access-lcl84\") pod \"ovnkube-node-m57jb\" (UID: \"63788019-f061-44d6-89a3-50c4a62e9fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.514802 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.514784    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p79h\" (UniqueName: \"kubernetes.io/projected/b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679-kube-api-access-7p79h\") pod \"network-metrics-daemon-nb8wz\" (UID: \"b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679\") " pod="openshift-multus/network-metrics-daemon-nb8wz"
Sep 08 11:30:25.515092 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.515071    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg864\" (UniqueName: \"kubernetes.io/projected/927c9c1b-2e72-4316-94d9-58662176506e-kube-api-access-qg864\") pod \"multus-54b8t\" (UID: \"927c9c1b-2e72-4316-94d9-58662176506e\") " pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.515166 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.515150    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qltzt\" (UniqueName: \"kubernetes.io/projected/bff59f33-b908-4b33-a6e6-670e91c50267-kube-api-access-qltzt\") pod \"iptables-alerter-hvr4n\" (UID: \"bff59f33-b908-4b33-a6e6-670e91c50267\") " pod="openshift-network-operator/iptables-alerter-hvr4n"
Sep 08 11:30:25.515673 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.515658    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvv6n\" (UniqueName: \"kubernetes.io/projected/f6625cdd-5c4c-4ed5-af3e-da054d8e3354-kube-api-access-xvv6n\") pod \"tuned-2b9cw\" (UID: \"f6625cdd-5c4c-4ed5-af3e-da054d8e3354\") " pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.621712 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.621648    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r9ksl"
Sep 08 11:30:25.627805 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.627787    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hvr4n"
Sep 08 11:30:25.648357 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.648337    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-54b8t"
Sep 08 11:30:25.664881 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.664863    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-62v7t"
Sep 08 11:30:25.678321 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.678305    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krfgv"
Sep 08 11:30:25.696045 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.696026    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:25.713417 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.713395    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2b9cw"
Sep 08 11:30:25.740017 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.740000    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cf287"
Sep 08 11:30:25.744386 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:25.744370    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bhshk"
Sep 08 11:30:27.434169 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:27.434105    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679-metrics-certs\") pod \"network-metrics-daemon-nb8wz\" (UID: \"b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679\") " pod="openshift-multus/network-metrics-daemon-nb8wz"
Sep 08 11:30:27.434169 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:27.434164    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1df1b9eb-b388-4e05-af5d-9da7cfd4ce10-original-pull-secret\") pod \"global-pull-secret-syncer-2tmp9\" (UID: \"1df1b9eb-b388-4e05-af5d-9da7cfd4ce10\") " pod="kube-system/global-pull-secret-syncer-2tmp9"
Sep 08 11:30:27.434429 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:27.434265    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 11:30:27.434429 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:27.434329    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679-metrics-certs podName:b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679 nodeName:}" failed. No retries permitted until 2026-09-08 11:30:28.434308412 +0000 UTC m=+3.086015183 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679-metrics-certs") pod "network-metrics-daemon-nb8wz" (UID: "b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 11:30:27.434429 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:27.434265    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 11:30:27.434429 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:27.434392    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1df1b9eb-b388-4e05-af5d-9da7cfd4ce10-original-pull-secret podName:1df1b9eb-b388-4e05-af5d-9da7cfd4ce10 nodeName:}" failed. No retries permitted until 2026-09-08 11:30:28.434381512 +0000 UTC m=+3.086088283 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1df1b9eb-b388-4e05-af5d-9da7cfd4ce10-original-pull-secret") pod "global-pull-secret-syncer-2tmp9" (UID: "1df1b9eb-b388-4e05-af5d-9da7cfd4ce10") : object "kube-system"/"original-pull-secret" not registered
Sep 08 11:30:27.521498 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:27.521459    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63788019_f061_44d6_89a3_50c4a62e9fbf.slice/crio-21787df151caebd19a7fb848d4bc46376a9cd003981a3cc4f4ad9277929caef8 WatchSource:0}: Error finding container 21787df151caebd19a7fb848d4bc46376a9cd003981a3cc4f4ad9277929caef8: Status 404 returned error can't find the container with id 21787df151caebd19a7fb848d4bc46376a9cd003981a3cc4f4ad9277929caef8
Sep 08 11:30:27.524029 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:27.524001    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50ad488f94e6200f7b23fbffec7fd91a.slice/crio-5ea6b22453d321b283798cd7429b455e5b639b9b8b3dfca09d5bc913970a4915 WatchSource:0}: Error finding container 5ea6b22453d321b283798cd7429b455e5b639b9b8b3dfca09d5bc913970a4915: Status 404 returned error can't find the container with id 5ea6b22453d321b283798cd7429b455e5b639b9b8b3dfca09d5bc913970a4915
Sep 08 11:30:27.524553 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:27.524532    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode75f13ca_f8fe_4d34_98e6_2bc02d335fe0.slice/crio-e81f075606fa0129121e5b39ed3b9a3897f7697aad14c26c65ae7be08705e904 WatchSource:0}: Error finding container e81f075606fa0129121e5b39ed3b9a3897f7697aad14c26c65ae7be08705e904: Status 404 returned error can't find the container with id e81f075606fa0129121e5b39ed3b9a3897f7697aad14c26c65ae7be08705e904
Sep 08 11:30:27.525273 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:27.525246    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod927c9c1b_2e72_4316_94d9_58662176506e.slice/crio-fc0cca334db83bc72279227ae5759356537031c275a473955996344a50285223 WatchSource:0}: Error finding container fc0cca334db83bc72279227ae5759356537031c275a473955996344a50285223: Status 404 returned error can't find the container with id fc0cca334db83bc72279227ae5759356537031c275a473955996344a50285223
Sep 08 11:30:27.527142 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:27.527097    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 11:30:27.535354 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:27.535321    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp2f9\" (UniqueName: \"kubernetes.io/projected/190e88db-a54a-4abb-bd46-1158e5bb71c6-kube-api-access-bp2f9\") pod \"network-check-target-m5x5z\" (UID: \"190e88db-a54a-4abb-bd46-1158e5bb71c6\") " pod="openshift-network-diagnostics/network-check-target-m5x5z"
Sep 08 11:30:27.535472 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:27.535458    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 11:30:27.535510 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:27.535478    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 11:30:27.535510 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:27.535487    2575 projected.go:196] Error preparing data for projected volume kube-api-access-bp2f9 for pod openshift-network-diagnostics/network-check-target-m5x5z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 11:30:27.535569 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:27.535532    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/190e88db-a54a-4abb-bd46-1158e5bb71c6-kube-api-access-bp2f9 podName:190e88db-a54a-4abb-bd46-1158e5bb71c6 nodeName:}" failed. No retries permitted until 2026-09-08 11:30:28.535515781 +0000 UTC m=+3.187222554 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bp2f9" (UniqueName: "kubernetes.io/projected/190e88db-a54a-4abb-bd46-1158e5bb71c6-kube-api-access-bp2f9") pod "network-check-target-m5x5z" (UID: "190e88db-a54a-4abb-bd46-1158e5bb71c6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 11:30:27.772962 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:27.772921    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 11:25:26 +0000 UTC" deadline="2028-06-16 07:05:59.27118306 +0000 UTC"
Sep 08 11:30:27.772962 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:27.772962    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15523h35m31.49822435s"
Sep 08 11:30:27.835599 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:27.835574    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb8wz"
Sep 08 11:30:27.835732 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:27.835687    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb8wz" podUID="b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679"
Sep 08 11:30:27.838801 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:27.838760    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-54b8t" event={"ID":"927c9c1b-2e72-4316-94d9-58662176506e","Type":"ContainerStarted","Data":"fc0cca334db83bc72279227ae5759356537031c275a473955996344a50285223"}
Sep 08 11:30:27.839787 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:27.839763    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krfgv" event={"ID":"e75f13ca-f8fe-4d34-98e6-2bc02d335fe0","Type":"ContainerStarted","Data":"e81f075606fa0129121e5b39ed3b9a3897f7697aad14c26c65ae7be08705e904"}
Sep 08 11:30:27.843628 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:27.843602    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-127.ec2.internal" event={"ID":"50ad488f94e6200f7b23fbffec7fd91a","Type":"ContainerStarted","Data":"5ea6b22453d321b283798cd7429b455e5b639b9b8b3dfca09d5bc913970a4915"}
Sep 08 11:30:27.846581 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:27.846560    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m57jb" event={"ID":"63788019-f061-44d6-89a3-50c4a62e9fbf","Type":"ContainerStarted","Data":"21787df151caebd19a7fb848d4bc46376a9cd003981a3cc4f4ad9277929caef8"}
Sep 08 11:30:27.950171 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:27.950148    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 11:30:28.442625 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:28.442586    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679-metrics-certs\") pod \"network-metrics-daemon-nb8wz\" (UID: \"b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679\") " pod="openshift-multus/network-metrics-daemon-nb8wz"
Sep 08 11:30:28.442814 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:28.442666    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1df1b9eb-b388-4e05-af5d-9da7cfd4ce10-original-pull-secret\") pod \"global-pull-secret-syncer-2tmp9\" (UID: \"1df1b9eb-b388-4e05-af5d-9da7cfd4ce10\") " pod="kube-system/global-pull-secret-syncer-2tmp9"
Sep 08 11:30:28.442881 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:28.442812    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 11:30:28.442881 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:28.442866    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1df1b9eb-b388-4e05-af5d-9da7cfd4ce10-original-pull-secret podName:1df1b9eb-b388-4e05-af5d-9da7cfd4ce10 nodeName:}" failed. No retries permitted until 2026-09-08 11:30:30.442851977 +0000 UTC m=+5.094558761 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1df1b9eb-b388-4e05-af5d-9da7cfd4ce10-original-pull-secret") pod "global-pull-secret-syncer-2tmp9" (UID: "1df1b9eb-b388-4e05-af5d-9da7cfd4ce10") : object "kube-system"/"original-pull-secret" not registered
Sep 08 11:30:28.443214 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:28.443197    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 11:30:28.443386 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:28.443237    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679-metrics-certs podName:b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679 nodeName:}" failed. No retries permitted until 2026-09-08 11:30:30.443226913 +0000 UTC m=+5.094933698 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679-metrics-certs") pod "network-metrics-daemon-nb8wz" (UID: "b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 11:30:28.543584 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:28.543544    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp2f9\" (UniqueName: \"kubernetes.io/projected/190e88db-a54a-4abb-bd46-1158e5bb71c6-kube-api-access-bp2f9\") pod \"network-check-target-m5x5z\" (UID: \"190e88db-a54a-4abb-bd46-1158e5bb71c6\") " pod="openshift-network-diagnostics/network-check-target-m5x5z"
Sep 08 11:30:28.543753 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:28.543715    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 11:30:28.543753 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:28.543736    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 11:30:28.543753 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:28.543749    2575 projected.go:196] Error preparing data for projected volume kube-api-access-bp2f9 for pod openshift-network-diagnostics/network-check-target-m5x5z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 11:30:28.543875 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:28.543807    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/190e88db-a54a-4abb-bd46-1158e5bb71c6-kube-api-access-bp2f9 podName:190e88db-a54a-4abb-bd46-1158e5bb71c6 nodeName:}" failed. No retries permitted until 2026-09-08 11:30:30.543790407 +0000 UTC m=+5.195497183 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bp2f9" (UniqueName: "kubernetes.io/projected/190e88db-a54a-4abb-bd46-1158e5bb71c6-kube-api-access-bp2f9") pod "network-check-target-m5x5z" (UID: "190e88db-a54a-4abb-bd46-1158e5bb71c6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 11:30:28.773463 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:28.773375    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 11:25:26 +0000 UTC" deadline="2028-03-16 12:39:50.673466943 +0000 UTC"
Sep 08 11:30:28.773463 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:28.773433    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13321h9m21.900037513s"
Sep 08 11:30:28.835733 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:28.835698    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2tmp9"
Sep 08 11:30:28.835888 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:28.835702    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5x5z"
Sep 08 11:30:28.835888 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:28.835867    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2tmp9" podUID="1df1b9eb-b388-4e05-af5d-9da7cfd4ce10"
Sep 08 11:30:28.835979 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:28.835957    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5x5z" podUID="190e88db-a54a-4abb-bd46-1158e5bb71c6"
Sep 08 11:30:29.184373 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:29.184282    2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 11:30:29.296392 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:29.296359    2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 11:30:29.648800 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:29.648598    2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 11:30:29.837874 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:29.837825    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb8wz"
Sep 08 11:30:29.838324 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:29.837932    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb8wz" podUID="b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679"
Sep 08 11:30:30.459979 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:30.459931    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679-metrics-certs\") pod \"network-metrics-daemon-nb8wz\" (UID: \"b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679\") " pod="openshift-multus/network-metrics-daemon-nb8wz"
Sep 08 11:30:30.460188 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:30.460018    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1df1b9eb-b388-4e05-af5d-9da7cfd4ce10-original-pull-secret\") pod \"global-pull-secret-syncer-2tmp9\" (UID: \"1df1b9eb-b388-4e05-af5d-9da7cfd4ce10\") " pod="kube-system/global-pull-secret-syncer-2tmp9"
Sep 08 11:30:30.460188 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:30.460180    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 11:30:30.460306 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:30.460249    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1df1b9eb-b388-4e05-af5d-9da7cfd4ce10-original-pull-secret podName:1df1b9eb-b388-4e05-af5d-9da7cfd4ce10 nodeName:}" failed. No retries permitted until 2026-09-08 11:30:34.460230315 +0000 UTC m=+9.111937106 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1df1b9eb-b388-4e05-af5d-9da7cfd4ce10-original-pull-secret") pod "global-pull-secret-syncer-2tmp9" (UID: "1df1b9eb-b388-4e05-af5d-9da7cfd4ce10") : object "kube-system"/"original-pull-secret" not registered
Sep 08 11:30:30.460556 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:30.460519    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 11:30:30.460684 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:30.460588    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679-metrics-certs podName:b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679 nodeName:}" failed. No retries permitted until 2026-09-08 11:30:34.460573923 +0000 UTC m=+9.112280694 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679-metrics-certs") pod "network-metrics-daemon-nb8wz" (UID: "b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 11:30:30.561231 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:30.561191    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp2f9\" (UniqueName: \"kubernetes.io/projected/190e88db-a54a-4abb-bd46-1158e5bb71c6-kube-api-access-bp2f9\") pod \"network-check-target-m5x5z\" (UID: \"190e88db-a54a-4abb-bd46-1158e5bb71c6\") " pod="openshift-network-diagnostics/network-check-target-m5x5z"
Sep 08 11:30:30.561425 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:30.561389    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 11:30:30.561425 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:30.561411    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 11:30:30.561425 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:30.561424    2575 projected.go:196] Error preparing data for projected volume kube-api-access-bp2f9 for pod openshift-network-diagnostics/network-check-target-m5x5z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 11:30:30.561568 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:30.561483    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/190e88db-a54a-4abb-bd46-1158e5bb71c6-kube-api-access-bp2f9 podName:190e88db-a54a-4abb-bd46-1158e5bb71c6 nodeName:}" failed. No retries permitted until 2026-09-08 11:30:34.561464461 +0000 UTC m=+9.213171247 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bp2f9" (UniqueName: "kubernetes.io/projected/190e88db-a54a-4abb-bd46-1158e5bb71c6-kube-api-access-bp2f9") pod "network-check-target-m5x5z" (UID: "190e88db-a54a-4abb-bd46-1158e5bb71c6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 11:30:30.835074 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:30.835045    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5x5z"
Sep 08 11:30:30.835269 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:30.835087    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2tmp9"
Sep 08 11:30:30.835269 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:30.835175    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5x5z" podUID="190e88db-a54a-4abb-bd46-1158e5bb71c6"
Sep 08 11:30:30.835409 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:30.835314    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2tmp9" podUID="1df1b9eb-b388-4e05-af5d-9da7cfd4ce10"
Sep 08 11:30:30.888903 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:30.888870    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod598d45ef_a4d2_4d2a_b318_c3898319833a.slice/crio-e123db6b037c37a57e99ad80e4441516b29ef9ae656bfa189138239c28c9ea60 WatchSource:0}: Error finding container e123db6b037c37a57e99ad80e4441516b29ef9ae656bfa189138239c28c9ea60: Status 404 returned error can't find the container with id e123db6b037c37a57e99ad80e4441516b29ef9ae656bfa189138239c28c9ea60
Sep 08 11:30:30.896813 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:30.896785    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59c98920_00f1_4ea9_bf6e_8fca2c95244a.slice/crio-69a963609fb1380bdbc2ea1b328044db2bb32db090053fcc2f772a4aef97b4bd WatchSource:0}: Error finding container 69a963609fb1380bdbc2ea1b328044db2bb32db090053fcc2f772a4aef97b4bd: Status 404 returned error can't find the container with id 69a963609fb1380bdbc2ea1b328044db2bb32db090053fcc2f772a4aef97b4bd
Sep 08 11:30:30.936884 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:30.936845    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb9ace496af7ba31c85ad967df3bc565.slice/crio-d2a8321de6239b1dc69265879afe4e82cb0e53e62a424bbc59194e7ba057681d WatchSource:0}: Error finding container d2a8321de6239b1dc69265879afe4e82cb0e53e62a424bbc59194e7ba057681d: Status 404 returned error can't find the container with id d2a8321de6239b1dc69265879afe4e82cb0e53e62a424bbc59194e7ba057681d
Sep 08 11:30:30.962449 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:30.962420    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbff59f33_b908_4b33_a6e6_670e91c50267.slice/crio-31cb778b7a17b831ada65e17d8b1bb23aa54bb8746efe0242f81953bb17bbe68 WatchSource:0}: Error finding container 31cb778b7a17b831ada65e17d8b1bb23aa54bb8746efe0242f81953bb17bbe68: Status 404 returned error can't find the container with id 31cb778b7a17b831ada65e17d8b1bb23aa54bb8746efe0242f81953bb17bbe68
Sep 08 11:30:31.417091 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:31.417041    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode520e24a_82d2_4d15_9257_b6bf3df4bb16.slice/crio-d1878b105d6d5b1fe9f1a06247c896982d10cf4d4026bfc60798b59df765bb20 WatchSource:0}: Error finding container d1878b105d6d5b1fe9f1a06247c896982d10cf4d4026bfc60798b59df765bb20: Status 404 returned error can't find the container with id d1878b105d6d5b1fe9f1a06247c896982d10cf4d4026bfc60798b59df765bb20
Sep 08 11:30:31.445564 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:30:31.445534    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6625cdd_5c4c_4ed5_af3e_da054d8e3354.slice/crio-d9e32f4bebd0baa08fc7e69258ad92699f877b221c21ec507800b67b322ec7bc WatchSource:0}: Error finding container d9e32f4bebd0baa08fc7e69258ad92699f877b221c21ec507800b67b322ec7bc: Status 404 returned error can't find the container with id d9e32f4bebd0baa08fc7e69258ad92699f877b221c21ec507800b67b322ec7bc
Sep 08 11:30:31.839885 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:31.839601    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb8wz"
Sep 08 11:30:31.839885 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:31.839725    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb8wz" podUID="b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679"
Sep 08 11:30:31.860787 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:31.860746    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-127.ec2.internal" event={"ID":"50ad488f94e6200f7b23fbffec7fd91a","Type":"ContainerStarted","Data":"1494b0095655867c05f221426a46297f6930f0a3864a1be47e1010f7aa1dfd34"}
Sep 08 11:30:31.872183 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:31.872153    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-127.ec2.internal" event={"ID":"eb9ace496af7ba31c85ad967df3bc565","Type":"ContainerStarted","Data":"d2a8321de6239b1dc69265879afe4e82cb0e53e62a424bbc59194e7ba057681d"}
Sep 08 11:30:31.873468 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:31.873438    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9ksl" event={"ID":"59c98920-00f1-4ea9-bf6e-8fca2c95244a","Type":"ContainerStarted","Data":"69a963609fb1380bdbc2ea1b328044db2bb32db090053fcc2f772a4aef97b4bd"}
Sep 08 11:30:31.876030 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:31.875992    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cf287" event={"ID":"51e41bf2-8be4-48a7-a3e7-6d17b4566f97","Type":"ContainerStarted","Data":"db12c096ef50a8bcb6463e2adde1e48baa1ea214adcef07a5aebe4bee4d60aa4"}
Sep 08 11:30:31.882615 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:31.882583    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bhshk" event={"ID":"598d45ef-a4d2-4d2a-b318-c3898319833a","Type":"ContainerStarted","Data":"e123db6b037c37a57e99ad80e4441516b29ef9ae656bfa189138239c28c9ea60"}
Sep 08 11:30:31.884104 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:31.884085    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2b9cw" event={"ID":"f6625cdd-5c4c-4ed5-af3e-da054d8e3354","Type":"ContainerStarted","Data":"d9e32f4bebd0baa08fc7e69258ad92699f877b221c21ec507800b67b322ec7bc"}
Sep 08 11:30:31.889980 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:31.889940    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-62v7t" event={"ID":"e520e24a-82d2-4d15-9257-b6bf3df4bb16","Type":"ContainerStarted","Data":"d1878b105d6d5b1fe9f1a06247c896982d10cf4d4026bfc60798b59df765bb20"}
Sep 08 11:30:31.893074 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:31.893012    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hvr4n" event={"ID":"bff59f33-b908-4b33-a6e6-670e91c50267","Type":"ContainerStarted","Data":"31cb778b7a17b831ada65e17d8b1bb23aa54bb8746efe0242f81953bb17bbe68"}
Sep 08 11:30:32.834978 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:32.834938    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5x5z"
Sep 08 11:30:32.835153 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:32.835075    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5x5z" podUID="190e88db-a54a-4abb-bd46-1158e5bb71c6"
Sep 08 11:30:32.835639 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:32.835482    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2tmp9"
Sep 08 11:30:32.835639 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:32.835574    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2tmp9" podUID="1df1b9eb-b388-4e05-af5d-9da7cfd4ce10"
Sep 08 11:30:33.836252 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:33.836011    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb8wz"
Sep 08 11:30:33.836695 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:33.836390    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb8wz" podUID="b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679"
Sep 08 11:30:34.493356 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:34.493305    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1df1b9eb-b388-4e05-af5d-9da7cfd4ce10-original-pull-secret\") pod \"global-pull-secret-syncer-2tmp9\" (UID: \"1df1b9eb-b388-4e05-af5d-9da7cfd4ce10\") " pod="kube-system/global-pull-secret-syncer-2tmp9"
Sep 08 11:30:34.493568 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:34.493380    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679-metrics-certs\") pod \"network-metrics-daemon-nb8wz\" (UID: \"b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679\") " pod="openshift-multus/network-metrics-daemon-nb8wz"
Sep 08 11:30:34.493568 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:34.493500    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 11:30:34.493568 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:34.493549    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 11:30:34.493738 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:34.493580    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679-metrics-certs podName:b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679 nodeName:}" failed. No retries permitted until 2026-09-08 11:30:42.493556715 +0000 UTC m=+17.145263538 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679-metrics-certs") pod "network-metrics-daemon-nb8wz" (UID: "b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 11:30:34.493738 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:34.493605    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1df1b9eb-b388-4e05-af5d-9da7cfd4ce10-original-pull-secret podName:1df1b9eb-b388-4e05-af5d-9da7cfd4ce10 nodeName:}" failed. No retries permitted until 2026-09-08 11:30:42.49359082 +0000 UTC m=+17.145297591 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1df1b9eb-b388-4e05-af5d-9da7cfd4ce10-original-pull-secret") pod "global-pull-secret-syncer-2tmp9" (UID: "1df1b9eb-b388-4e05-af5d-9da7cfd4ce10") : object "kube-system"/"original-pull-secret" not registered
Sep 08 11:30:34.594395 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:34.594299    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp2f9\" (UniqueName: \"kubernetes.io/projected/190e88db-a54a-4abb-bd46-1158e5bb71c6-kube-api-access-bp2f9\") pod \"network-check-target-m5x5z\" (UID: \"190e88db-a54a-4abb-bd46-1158e5bb71c6\") " pod="openshift-network-diagnostics/network-check-target-m5x5z"
Sep 08 11:30:34.594554 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:34.594496    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 11:30:34.594554 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:34.594519    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 11:30:34.594554 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:34.594531    2575 projected.go:196] Error preparing data for projected volume kube-api-access-bp2f9 for pod openshift-network-diagnostics/network-check-target-m5x5z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 11:30:34.594716 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:34.594589    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/190e88db-a54a-4abb-bd46-1158e5bb71c6-kube-api-access-bp2f9 podName:190e88db-a54a-4abb-bd46-1158e5bb71c6 nodeName:}" failed. No retries permitted until 2026-09-08 11:30:42.594569132 +0000 UTC m=+17.246275917 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bp2f9" (UniqueName: "kubernetes.io/projected/190e88db-a54a-4abb-bd46-1158e5bb71c6-kube-api-access-bp2f9") pod "network-check-target-m5x5z" (UID: "190e88db-a54a-4abb-bd46-1158e5bb71c6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 11:30:34.835425 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:34.834766    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2tmp9"
Sep 08 11:30:34.835425 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:34.834892    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2tmp9" podUID="1df1b9eb-b388-4e05-af5d-9da7cfd4ce10"
Sep 08 11:30:34.835425 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:34.835260    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5x5z"
Sep 08 11:30:34.835425 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:34.835379    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5x5z" podUID="190e88db-a54a-4abb-bd46-1158e5bb71c6"
Sep 08 11:30:35.839755 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:35.839316    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb8wz"
Sep 08 11:30:35.839755 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:35.839459    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb8wz" podUID="b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679"
Sep 08 11:30:36.835640 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:36.835603    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2tmp9"
Sep 08 11:30:36.835824 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:36.835650    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5x5z"
Sep 08 11:30:36.835824 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:36.835748    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2tmp9" podUID="1df1b9eb-b388-4e05-af5d-9da7cfd4ce10"
Sep 08 11:30:36.835940 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:36.835866    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5x5z" podUID="190e88db-a54a-4abb-bd46-1158e5bb71c6"
Sep 08 11:30:37.838492 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:37.838467    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb8wz"
Sep 08 11:30:37.838927 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:37.838589    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb8wz" podUID="b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679"
Sep 08 11:30:38.834957 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:38.834926    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5x5z"
Sep 08 11:30:38.835120 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:38.835024    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5x5z" podUID="190e88db-a54a-4abb-bd46-1158e5bb71c6"
Sep 08 11:30:38.835120 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:38.835093    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2tmp9"
Sep 08 11:30:38.835230 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:38.835209    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2tmp9" podUID="1df1b9eb-b388-4e05-af5d-9da7cfd4ce10"
Sep 08 11:30:39.838515 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:39.838478    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb8wz"
Sep 08 11:30:39.838900 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:39.838606    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb8wz" podUID="b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679"
Sep 08 11:30:40.835212 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:40.835174    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5x5z"
Sep 08 11:30:40.835419 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:40.835174    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2tmp9"
Sep 08 11:30:40.835419 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:40.835288    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5x5z" podUID="190e88db-a54a-4abb-bd46-1158e5bb71c6"
Sep 08 11:30:40.835419 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:40.835366    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2tmp9" podUID="1df1b9eb-b388-4e05-af5d-9da7cfd4ce10"
Sep 08 11:30:41.835890 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:41.835855    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb8wz"
Sep 08 11:30:41.836362 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:41.836044    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb8wz" podUID="b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679"
Sep 08 11:30:42.553304 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:42.553269    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1df1b9eb-b388-4e05-af5d-9da7cfd4ce10-original-pull-secret\") pod \"global-pull-secret-syncer-2tmp9\" (UID: \"1df1b9eb-b388-4e05-af5d-9da7cfd4ce10\") " pod="kube-system/global-pull-secret-syncer-2tmp9"
Sep 08 11:30:42.553503 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:42.553327    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679-metrics-certs\") pod \"network-metrics-daemon-nb8wz\" (UID: \"b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679\") " pod="openshift-multus/network-metrics-daemon-nb8wz"
Sep 08 11:30:42.553503 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:42.553438    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 11:30:42.553503 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:42.553438    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 11:30:42.553503 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:42.553504    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679-metrics-certs podName:b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679 nodeName:}" failed. No retries permitted until 2026-09-08 11:30:58.553488143 +0000 UTC m=+33.205194930 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679-metrics-certs") pod "network-metrics-daemon-nb8wz" (UID: "b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 11:30:42.553692 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:42.553519    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1df1b9eb-b388-4e05-af5d-9da7cfd4ce10-original-pull-secret podName:1df1b9eb-b388-4e05-af5d-9da7cfd4ce10 nodeName:}" failed. No retries permitted until 2026-09-08 11:30:58.553513419 +0000 UTC m=+33.205220191 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1df1b9eb-b388-4e05-af5d-9da7cfd4ce10-original-pull-secret") pod "global-pull-secret-syncer-2tmp9" (UID: "1df1b9eb-b388-4e05-af5d-9da7cfd4ce10") : object "kube-system"/"original-pull-secret" not registered
Sep 08 11:30:42.653728 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:42.653689    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp2f9\" (UniqueName: \"kubernetes.io/projected/190e88db-a54a-4abb-bd46-1158e5bb71c6-kube-api-access-bp2f9\") pod \"network-check-target-m5x5z\" (UID: \"190e88db-a54a-4abb-bd46-1158e5bb71c6\") " pod="openshift-network-diagnostics/network-check-target-m5x5z"
Sep 08 11:30:42.653885 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:42.653808    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 11:30:42.653885 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:42.653835    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 11:30:42.653885 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:42.653848    2575 projected.go:196] Error preparing data for projected volume kube-api-access-bp2f9 for pod openshift-network-diagnostics/network-check-target-m5x5z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 11:30:42.654004 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:42.653904    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/190e88db-a54a-4abb-bd46-1158e5bb71c6-kube-api-access-bp2f9 podName:190e88db-a54a-4abb-bd46-1158e5bb71c6 nodeName:}" failed. No retries permitted until 2026-09-08 11:30:58.653886587 +0000 UTC m=+33.305593358 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bp2f9" (UniqueName: "kubernetes.io/projected/190e88db-a54a-4abb-bd46-1158e5bb71c6-kube-api-access-bp2f9") pod "network-check-target-m5x5z" (UID: "190e88db-a54a-4abb-bd46-1158e5bb71c6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 11:30:42.835530 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:42.835444    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5x5z"
Sep 08 11:30:42.835530 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:42.835492    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2tmp9"
Sep 08 11:30:42.835738 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:42.835574    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5x5z" podUID="190e88db-a54a-4abb-bd46-1158e5bb71c6"
Sep 08 11:30:42.835738 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:42.835691    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2tmp9" podUID="1df1b9eb-b388-4e05-af5d-9da7cfd4ce10"
Sep 08 11:30:43.838010 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:43.837983    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb8wz"
Sep 08 11:30:43.838542 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:43.838142    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb8wz" podUID="b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679"
Sep 08 11:30:44.835810 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:44.835769    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2tmp9"
Sep 08 11:30:44.835983 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:44.835774    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5x5z"
Sep 08 11:30:44.835983 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:44.835893    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2tmp9" podUID="1df1b9eb-b388-4e05-af5d-9da7cfd4ce10"
Sep 08 11:30:44.835983 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:44.835973    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5x5z" podUID="190e88db-a54a-4abb-bd46-1158e5bb71c6"
Sep 08 11:30:45.837799 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:45.837771    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb8wz"
Sep 08 11:30:45.838216 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:45.837900    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb8wz" podUID="b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679"
Sep 08 11:30:46.835074 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:46.835042    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2tmp9"
Sep 08 11:30:46.835074 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:46.835068    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5x5z"
Sep 08 11:30:46.835222 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:46.835201    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2tmp9" podUID="1df1b9eb-b388-4e05-af5d-9da7cfd4ce10"
Sep 08 11:30:46.835289 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:46.835273    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5x5z" podUID="190e88db-a54a-4abb-bd46-1158e5bb71c6"
Sep 08 11:30:46.925930 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:46.924639    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-54b8t" event={"ID":"927c9c1b-2e72-4316-94d9-58662176506e","Type":"ContainerStarted","Data":"3bc364c57dbb5992d8305f22f735a6d7d74e57947261b012166804b538d43db8"}
Sep 08 11:30:46.928701 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:46.928682    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m57jb_63788019-f061-44d6-89a3-50c4a62e9fbf/ovn-acl-logging/0.log"
Sep 08 11:30:46.929055 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:46.929035    2575 generic.go:356] "Generic (PLEG): container finished" podID="63788019-f061-44d6-89a3-50c4a62e9fbf" containerID="05e2700b2936e87c6e12f39474b849261e489c88b9e8d21afddf1d166385b75f" exitCode=1
Sep 08 11:30:46.929119 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:46.929102    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m57jb" event={"ID":"63788019-f061-44d6-89a3-50c4a62e9fbf","Type":"ContainerStarted","Data":"5e9ca845cee59161218ad99984219765645efd039b70f2763239c9fd304197e8"}
Sep 08 11:30:46.929191 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:46.929178    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m57jb" event={"ID":"63788019-f061-44d6-89a3-50c4a62e9fbf","Type":"ContainerStarted","Data":"45c561c3a5515cd11f4cb9aed03e0cc71a02071309f5768cc99ba3f0ed3533db"}
Sep 08 11:30:46.929246 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:46.929234    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m57jb" event={"ID":"63788019-f061-44d6-89a3-50c4a62e9fbf","Type":"ContainerDied","Data":"05e2700b2936e87c6e12f39474b849261e489c88b9e8d21afddf1d166385b75f"}
Sep 08 11:30:46.929297 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:46.929283    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m57jb" event={"ID":"63788019-f061-44d6-89a3-50c4a62e9fbf","Type":"ContainerStarted","Data":"d03538f6b1e6fd64249f4961c6fb05bf9fac17d7df5ce2616ed920cae6bff166"}
Sep 08 11:30:46.930854 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:46.930832    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2b9cw" event={"ID":"f6625cdd-5c4c-4ed5-af3e-da054d8e3354","Type":"ContainerStarted","Data":"f50846d797535c864940ddd55caf2009c11c7ff11426ac37b76a92390ab7847d"}
Sep 08 11:30:46.945014 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:46.944960    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-127.ec2.internal" podStartSLOduration=20.944943893 podStartE2EDuration="20.944943893s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 11:30:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:30:31.878567666 +0000 UTC m=+6.530274461" watchObservedRunningTime="2026-09-08 11:30:46.944943893 +0000 UTC m=+21.596650688"
Sep 08 11:30:46.962641 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:46.962127    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2b9cw" podStartSLOduration=6.07468855 podStartE2EDuration="20.962108085s" totalImagesPullingTime="14.887419535s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 11:30:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:30:46.961654663 +0000 UTC m=+21.613361455" watchObservedRunningTime="2026-09-08 11:30:46.962108085 +0000 UTC m=+21.613814880"
Sep 08 11:30:46.962641 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:46.962533    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-54b8t" podStartSLOduration=3.1330323509999998 podStartE2EDuration="21.962517207s" totalImagesPullingTime="18.829484856s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 11:30:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:30:46.944152997 +0000 UTC m=+21.595859808" watchObservedRunningTime="2026-09-08 11:30:46.962517207 +0000 UTC m=+21.614224003"
Sep 08 11:30:47.838541 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:47.838469    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb8wz"
Sep 08 11:30:47.838667 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:47.838573    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb8wz" podUID="b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679"
Sep 08 11:30:47.934045 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:47.934004    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krfgv" event={"ID":"e75f13ca-f8fe-4d34-98e6-2bc02d335fe0","Type":"ContainerStarted","Data":"bd90221672d13955a2141afd22f8a35f95fb552efe85b74ac343bb1677457331"}
Sep 08 11:30:47.936861 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:47.936839    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m57jb_63788019-f061-44d6-89a3-50c4a62e9fbf/ovn-acl-logging/0.log"
Sep 08 11:30:47.937255 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:47.937213    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m57jb" event={"ID":"63788019-f061-44d6-89a3-50c4a62e9fbf","Type":"ContainerStarted","Data":"2f6daa743a57c0ee4633b2bb73bd25449d6c34c7bc1d00b95a656096a6a5d510"}
Sep 08 11:30:47.937402 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:47.937286    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m57jb" event={"ID":"63788019-f061-44d6-89a3-50c4a62e9fbf","Type":"ContainerStarted","Data":"95286c262c8d01f9f66756b07edf7a797e3c35d88b93c68f49982f1cf153d50f"}
Sep 08 11:30:47.938742 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:47.938711    2575 generic.go:356] "Generic (PLEG): container finished" podID="eb9ace496af7ba31c85ad967df3bc565" containerID="5860d1e6f1bfa2607395fd6740cdb3805ba4b891482d775fff602ecee7b8d404" exitCode=0
Sep 08 11:30:47.938812 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:47.938783    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-127.ec2.internal" event={"ID":"eb9ace496af7ba31c85ad967df3bc565","Type":"ContainerDied","Data":"5860d1e6f1bfa2607395fd6740cdb3805ba4b891482d775fff602ecee7b8d404"}
Sep 08 11:30:47.942400 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:47.942377    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9ksl" event={"ID":"59c98920-00f1-4ea9-bf6e-8fca2c95244a","Type":"ContainerDied","Data":"779ed9f197b33e6e1c2e7ca51469ae5d4f19e4667b07af8feea3256a25061f82"}
Sep 08 11:30:47.942400 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:47.942331    2575 generic.go:356] "Generic (PLEG): container finished" podID="59c98920-00f1-4ea9-bf6e-8fca2c95244a" containerID="779ed9f197b33e6e1c2e7ca51469ae5d4f19e4667b07af8feea3256a25061f82" exitCode=0
Sep 08 11:30:47.944144 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:47.944122    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cf287" event={"ID":"51e41bf2-8be4-48a7-a3e7-6d17b4566f97","Type":"ContainerStarted","Data":"8151a794f70149dc4fd2ec6b89dc5aca276fe6e39baa159d89a00a64acb13426"}
Sep 08 11:30:47.945696 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:47.945621    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bhshk" event={"ID":"598d45ef-a4d2-4d2a-b318-c3898319833a","Type":"ContainerStarted","Data":"c44a4cccfa669b0dde095e8a56da344ac60ec9dcd1eff6934ff9c79199747515"}
Sep 08 11:30:47.946983 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:47.946962    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-62v7t" event={"ID":"e520e24a-82d2-4d15-9257-b6bf3df4bb16","Type":"ContainerStarted","Data":"3175496da0fd6a0351fd27192599d9e2063b4e2e455afd0768406886dc53dd5b"}
Sep 08 11:30:47.948244 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:47.948217    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hvr4n" event={"ID":"bff59f33-b908-4b33-a6e6-670e91c50267","Type":"ContainerStarted","Data":"4cc9f6b14d6a494b46cbf5d657d6259f96dc9bcf351e0a85c4d7a8b42befe21d"}
Sep 08 11:30:47.970984 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:47.970942    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-cf287" podStartSLOduration=6.586604019 podStartE2EDuration="21.970927925s" totalImagesPullingTime="15.384323906s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 11:30:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:30:47.970709444 +0000 UTC m=+22.622416237" watchObservedRunningTime="2026-09-08 11:30:47.970927925 +0000 UTC m=+22.622634718"
Sep 08 11:30:47.991047 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:47.990796    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bhshk" podStartSLOduration=6.967666791 podStartE2EDuration="21.99077344s" totalImagesPullingTime="15.023106649s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 11:30:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:30:47.990169401 +0000 UTC m=+22.641876196" watchObservedRunningTime="2026-09-08 11:30:47.99077344 +0000 UTC m=+22.642480235"
Sep 08 11:30:48.033446 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:48.033403    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hvr4n" podStartSLOduration=7.662014484 podStartE2EDuration="23.033387629s" totalImagesPullingTime="15.371373145s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 11:30:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:30:48.033024139 +0000 UTC m=+22.684730949" watchObservedRunningTime="2026-09-08 11:30:48.033387629 +0000 UTC m=+22.685094422"
Sep 08 11:30:48.052071 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:48.052029    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-62v7t" podStartSLOduration=7.565424123 podStartE2EDuration="22.052015238s" totalImagesPullingTime="14.486591115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:30:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:30:48.051611728 +0000 UTC m=+22.703318526" watchObservedRunningTime="2026-09-08 11:30:48.052015238 +0000 UTC m=+22.703722033"
Sep 08 11:30:48.835050 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:48.835001    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2tmp9"
Sep 08 11:30:48.835217 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:48.835120    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2tmp9" podUID="1df1b9eb-b388-4e05-af5d-9da7cfd4ce10"
Sep 08 11:30:48.835217 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:48.835171    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5x5z"
Sep 08 11:30:48.835285 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:48.835261    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5x5z" podUID="190e88db-a54a-4abb-bd46-1158e5bb71c6"
Sep 08 11:30:48.952496 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:48.952420    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-127.ec2.internal" event={"ID":"eb9ace496af7ba31c85ad967df3bc565","Type":"ContainerStarted","Data":"5dabdb7f7c390721416acc89bc6172122a1fa30f19d774e3b26f50b73c0976ea"}
Sep 08 11:30:48.976087 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:48.976016    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-127.ec2.internal" podStartSLOduration=22.975994898 podStartE2EDuration="22.975994898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 11:30:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:30:48.975596453 +0000 UTC m=+23.627303247" watchObservedRunningTime="2026-09-08 11:30:48.975994898 +0000 UTC m=+23.627701691"
Sep 08 11:30:49.080429 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:49.080333    2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 08 11:30:49.803355 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:49.803238    2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-08T11:30:49.080422109Z","UUID":"579d6eed-dfba-4a66-a483-e765a75904d9","Handler":null,"Name":"","Endpoint":""}
Sep 08 11:30:49.805043 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:49.805006    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 08 11:30:49.805043 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:49.805039    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 08 11:30:49.835646 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:49.835615    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb8wz"
Sep 08 11:30:49.835830 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:49.835770    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb8wz" podUID="b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679"
Sep 08 11:30:49.957315 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:49.957275    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krfgv" event={"ID":"e75f13ca-f8fe-4d34-98e6-2bc02d335fe0","Type":"ContainerStarted","Data":"ee8a79f515230f42c4457490064f1df5ce6c323292301347208af9b97ae26602"}
Sep 08 11:30:49.963106 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:49.963082    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m57jb_63788019-f061-44d6-89a3-50c4a62e9fbf/ovn-acl-logging/0.log"
Sep 08 11:30:49.963665 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:49.963640    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m57jb" event={"ID":"63788019-f061-44d6-89a3-50c4a62e9fbf","Type":"ContainerStarted","Data":"71a0c31cb2c9ad2c30721d86ba3441de93f5e89e81706513e70dc5e7ae8ceb37"}
Sep 08 11:30:50.834984 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:50.834904    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5x5z"
Sep 08 11:30:50.834984 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:50.834911    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2tmp9"
Sep 08 11:30:50.835226 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:50.835041    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5x5z" podUID="190e88db-a54a-4abb-bd46-1158e5bb71c6"
Sep 08 11:30:50.835226 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:50.835177    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2tmp9" podUID="1df1b9eb-b388-4e05-af5d-9da7cfd4ce10"
Sep 08 11:30:50.969007 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:50.968971    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krfgv" event={"ID":"e75f13ca-f8fe-4d34-98e6-2bc02d335fe0","Type":"ContainerStarted","Data":"25b86cd89622b9518056ede074a998c7cb1cc4a5601eacab094082332c213883"}
Sep 08 11:30:50.991959 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:50.991876    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krfgv" podStartSLOduration=3.94039014 podStartE2EDuration="24.991854116s" totalImagesPullingTime="21.051463976s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 11:30:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:30:50.991295929 +0000 UTC m=+25.643002758" watchObservedRunningTime="2026-09-08 11:30:50.991854116 +0000 UTC m=+25.643560910"
Sep 08 11:30:51.100791 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:51.100709    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-62v7t"
Sep 08 11:30:51.101442 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:51.101415    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-62v7t"
Sep 08 11:30:51.835623 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:51.835584    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb8wz"
Sep 08 11:30:51.835806 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:51.835743    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb8wz" podUID="b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679"
Sep 08 11:30:51.972077 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:51.972041    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-62v7t"
Sep 08 11:30:51.972664 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:51.972628    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-62v7t"
Sep 08 11:30:52.835161 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:52.834986    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5x5z"
Sep 08 11:30:52.835250 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:52.834986    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2tmp9"
Sep 08 11:30:52.835250 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:52.835237    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5x5z" podUID="190e88db-a54a-4abb-bd46-1158e5bb71c6"
Sep 08 11:30:52.835332 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:52.835315    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2tmp9" podUID="1df1b9eb-b388-4e05-af5d-9da7cfd4ce10"
Sep 08 11:30:52.977466 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:52.977440    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m57jb_63788019-f061-44d6-89a3-50c4a62e9fbf/ovn-acl-logging/0.log"
Sep 08 11:30:52.977940 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:52.977820    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m57jb" event={"ID":"63788019-f061-44d6-89a3-50c4a62e9fbf","Type":"ContainerStarted","Data":"21c09051086d5ab3fe14258f2cc6f8cb4ef44e5fedd4152a8038590acc97daa7"}
Sep 08 11:30:52.978103 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:52.978086    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:52.978292 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:52.978275    2575 scope.go:117] "RemoveContainer" containerID="05e2700b2936e87c6e12f39474b849261e489c88b9e8d21afddf1d166385b75f"
Sep 08 11:30:52.979949 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:52.979904    2575 generic.go:356] "Generic (PLEG): container finished" podID="59c98920-00f1-4ea9-bf6e-8fca2c95244a" containerID="c7fecc29de85fe1cb43ea0716c74668ad4fdc05c91e0ca5ae50121492393dd0b" exitCode=0
Sep 08 11:30:52.980042 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:52.980012    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9ksl" event={"ID":"59c98920-00f1-4ea9-bf6e-8fca2c95244a","Type":"ContainerDied","Data":"c7fecc29de85fe1cb43ea0716c74668ad4fdc05c91e0ca5ae50121492393dd0b"}
Sep 08 11:30:52.995252 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:52.995232    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:53.836190 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:53.835417    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb8wz"
Sep 08 11:30:53.836190 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:53.835549    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb8wz" podUID="b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679"
Sep 08 11:30:53.986546 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:53.986521    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m57jb_63788019-f061-44d6-89a3-50c4a62e9fbf/ovn-acl-logging/0.log"
Sep 08 11:30:53.987098 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:53.986969    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m57jb" event={"ID":"63788019-f061-44d6-89a3-50c4a62e9fbf","Type":"ContainerStarted","Data":"16eac9a26f1c2e5f2324b6f85368079b02f7f5186f5882f59f75ceae86e036d6"}
Sep 08 11:30:53.987098 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:53.987042    2575 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 08 11:30:53.987478 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:53.987456    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:54.003913 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:54.003887    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:54.027964 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:54.027914    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-m57jb" podStartSLOduration=9.218643942 podStartE2EDuration="28.027897791s" totalImagesPullingTime="18.809253849s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 11:30:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:30:54.027625882 +0000 UTC m=+28.679332677" watchObservedRunningTime="2026-09-08 11:30:54.027897791 +0000 UTC m=+28.679604585"
Sep 08 11:30:54.614242 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:54.614044    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2tmp9"]
Sep 08 11:30:54.614417 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:54.614373    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2tmp9"
Sep 08 11:30:54.614484 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:54.614464    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2tmp9" podUID="1df1b9eb-b388-4e05-af5d-9da7cfd4ce10"
Sep 08 11:30:54.616698 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:54.616666    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nb8wz"]
Sep 08 11:30:54.616817 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:54.616789    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb8wz"
Sep 08 11:30:54.616923 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:54.616898    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb8wz" podUID="b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679"
Sep 08 11:30:54.617156 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:54.617140    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m5x5z"]
Sep 08 11:30:54.617235 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:54.617224    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5x5z"
Sep 08 11:30:54.617309 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:54.617295    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5x5z" podUID="190e88db-a54a-4abb-bd46-1158e5bb71c6"
Sep 08 11:30:54.991831 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:54.991795    2575 generic.go:356] "Generic (PLEG): container finished" podID="59c98920-00f1-4ea9-bf6e-8fca2c95244a" containerID="c74e4f621e7e65d4e48526a446c5da9736b6025b46bf7de893535ce04047dd51" exitCode=0
Sep 08 11:30:54.992299 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:54.991845    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9ksl" event={"ID":"59c98920-00f1-4ea9-bf6e-8fca2c95244a","Type":"ContainerDied","Data":"c74e4f621e7e65d4e48526a446c5da9736b6025b46bf7de893535ce04047dd51"}
Sep 08 11:30:54.992299 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:54.992003    2575 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 08 11:30:55.835478 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:55.835452    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2tmp9"
Sep 08 11:30:55.835601 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:55.835547    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5x5z"
Sep 08 11:30:55.835661 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:55.835642    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5x5z" podUID="190e88db-a54a-4abb-bd46-1158e5bb71c6"
Sep 08 11:30:55.835701 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:55.835545    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2tmp9" podUID="1df1b9eb-b388-4e05-af5d-9da7cfd4ce10"
Sep 08 11:30:55.997201 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:55.997160    2575 generic.go:356] "Generic (PLEG): container finished" podID="59c98920-00f1-4ea9-bf6e-8fca2c95244a" containerID="af6bbaf4946a883db1e9917a4ce6b54890e0a8c1a1aca8d7fac9fad7a1fe73fb" exitCode=0
Sep 08 11:30:55.997638 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:55.997246    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9ksl" event={"ID":"59c98920-00f1-4ea9-bf6e-8fca2c95244a","Type":"ContainerDied","Data":"af6bbaf4946a883db1e9917a4ce6b54890e0a8c1a1aca8d7fac9fad7a1fe73fb"}
Sep 08 11:30:55.997638 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:55.997306    2575 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 08 11:30:56.610499 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:56.610409    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:30:56.835014 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:56.834976    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb8wz"
Sep 08 11:30:56.835153 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:56.835105    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb8wz" podUID="b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679"
Sep 08 11:30:57.835734 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:57.835705    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2tmp9"
Sep 08 11:30:57.836150 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:57.835705    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5x5z"
Sep 08 11:30:57.836150 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:57.835846    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2tmp9" podUID="1df1b9eb-b388-4e05-af5d-9da7cfd4ce10"
Sep 08 11:30:57.836150 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:57.835881    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5x5z" podUID="190e88db-a54a-4abb-bd46-1158e5bb71c6"
Sep 08 11:30:58.569499 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:58.569454    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679-metrics-certs\") pod \"network-metrics-daemon-nb8wz\" (UID: \"b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679\") " pod="openshift-multus/network-metrics-daemon-nb8wz"
Sep 08 11:30:58.569678 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:58.569547    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1df1b9eb-b388-4e05-af5d-9da7cfd4ce10-original-pull-secret\") pod \"global-pull-secret-syncer-2tmp9\" (UID: \"1df1b9eb-b388-4e05-af5d-9da7cfd4ce10\") " pod="kube-system/global-pull-secret-syncer-2tmp9"
Sep 08 11:30:58.569678 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:58.569629    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 11:30:58.569678 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:58.569662    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 11:30:58.569837 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:58.569712    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679-metrics-certs podName:b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679 nodeName:}" failed. No retries permitted until 2026-09-08 11:31:30.569691182 +0000 UTC m=+65.221397959 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679-metrics-certs") pod "network-metrics-daemon-nb8wz" (UID: "b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 11:30:58.569837 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:58.569734    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1df1b9eb-b388-4e05-af5d-9da7cfd4ce10-original-pull-secret podName:1df1b9eb-b388-4e05-af5d-9da7cfd4ce10 nodeName:}" failed. No retries permitted until 2026-09-08 11:31:30.569723809 +0000 UTC m=+65.221430585 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1df1b9eb-b388-4e05-af5d-9da7cfd4ce10-original-pull-secret") pod "global-pull-secret-syncer-2tmp9" (UID: "1df1b9eb-b388-4e05-af5d-9da7cfd4ce10") : object "kube-system"/"original-pull-secret" not registered
Sep 08 11:30:58.670457 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:58.670418    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp2f9\" (UniqueName: \"kubernetes.io/projected/190e88db-a54a-4abb-bd46-1158e5bb71c6-kube-api-access-bp2f9\") pod \"network-check-target-m5x5z\" (UID: \"190e88db-a54a-4abb-bd46-1158e5bb71c6\") " pod="openshift-network-diagnostics/network-check-target-m5x5z"
Sep 08 11:30:58.670637 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:58.670564    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 11:30:58.670637 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:58.670578    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 11:30:58.670637 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:58.670587    2575 projected.go:196] Error preparing data for projected volume kube-api-access-bp2f9 for pod openshift-network-diagnostics/network-check-target-m5x5z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 11:30:58.670637 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:58.670636    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/190e88db-a54a-4abb-bd46-1158e5bb71c6-kube-api-access-bp2f9 podName:190e88db-a54a-4abb-bd46-1158e5bb71c6 nodeName:}" failed. No retries permitted until 2026-09-08 11:31:30.67062337 +0000 UTC m=+65.322330155 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bp2f9" (UniqueName: "kubernetes.io/projected/190e88db-a54a-4abb-bd46-1158e5bb71c6-kube-api-access-bp2f9") pod "network-check-target-m5x5z" (UID: "190e88db-a54a-4abb-bd46-1158e5bb71c6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 11:30:58.835251 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:58.835165    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb8wz"
Sep 08 11:30:58.835408 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:58.835285    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb8wz" podUID="b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679"
Sep 08 11:30:59.624536 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:59.624504    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-127.ec2.internal" event="NodeReady"
Sep 08 11:30:59.624952 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:59.624660    2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 08 11:30:59.675276 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:59.675242    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sdbbl"]
Sep 08 11:30:59.677009 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:59.676990    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sdbbl"
Sep 08 11:30:59.677786 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:59.677759    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-tf7sb"]
Sep 08 11:30:59.679195 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:59.679180    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tf7sb"
Sep 08 11:30:59.679475 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:59.679419    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 08 11:30:59.679677 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:59.679661    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 08 11:30:59.679726 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:59.679705    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2v99l\""
Sep 08 11:30:59.681842 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:59.681825    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 08 11:30:59.681842 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:59.681838    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 08 11:30:59.682076 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:59.682060    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-h4mlz\""
Sep 08 11:30:59.682366 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:59.682331    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 08 11:30:59.690376 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:59.690352    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tf7sb"]
Sep 08 11:30:59.693750 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:59.693727    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sdbbl"]
Sep 08 11:30:59.777659 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:59.777619    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c6fc3823-83c6-4d67-9068-48bff3a5b3ed-config-volume\") pod \"dns-default-sdbbl\" (UID: \"c6fc3823-83c6-4d67-9068-48bff3a5b3ed\") " pod="openshift-dns/dns-default-sdbbl"
Sep 08 11:30:59.777659 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:59.777656    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de1e135a-bd8c-4e20-be89-f7a2a2cbf98e-cert\") pod \"ingress-canary-tf7sb\" (UID: \"de1e135a-bd8c-4e20-be89-f7a2a2cbf98e\") " pod="openshift-ingress-canary/ingress-canary-tf7sb"
Sep 08 11:30:59.777871 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:59.777708    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbv9b\" (UniqueName: \"kubernetes.io/projected/de1e135a-bd8c-4e20-be89-f7a2a2cbf98e-kube-api-access-wbv9b\") pod \"ingress-canary-tf7sb\" (UID: \"de1e135a-bd8c-4e20-be89-f7a2a2cbf98e\") " pod="openshift-ingress-canary/ingress-canary-tf7sb"
Sep 08 11:30:59.777871 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:59.777754    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6fc3823-83c6-4d67-9068-48bff3a5b3ed-tmp-dir\") pod \"dns-default-sdbbl\" (UID: \"c6fc3823-83c6-4d67-9068-48bff3a5b3ed\") " pod="openshift-dns/dns-default-sdbbl"
Sep 08 11:30:59.777871 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:59.777802    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzbw2\" (UniqueName: \"kubernetes.io/projected/c6fc3823-83c6-4d67-9068-48bff3a5b3ed-kube-api-access-tzbw2\") pod \"dns-default-sdbbl\" (UID: \"c6fc3823-83c6-4d67-9068-48bff3a5b3ed\") " pod="openshift-dns/dns-default-sdbbl"
Sep 08 11:30:59.777871 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:59.777850    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6fc3823-83c6-4d67-9068-48bff3a5b3ed-metrics-tls\") pod \"dns-default-sdbbl\" (UID: \"c6fc3823-83c6-4d67-9068-48bff3a5b3ed\") " pod="openshift-dns/dns-default-sdbbl"
Sep 08 11:30:59.835216 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:59.835184    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5x5z"
Sep 08 11:30:59.835413 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:59.835396    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2tmp9"
Sep 08 11:30:59.838301 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:59.838274    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nwz6n\""
Sep 08 11:30:59.838594 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:59.838552    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 11:30:59.838701 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:59.838589    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 11:30:59.838701 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:59.838654    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 11:30:59.879394 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:59.879295    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c6fc3823-83c6-4d67-9068-48bff3a5b3ed-config-volume\") pod \"dns-default-sdbbl\" (UID: \"c6fc3823-83c6-4d67-9068-48bff3a5b3ed\") " pod="openshift-dns/dns-default-sdbbl"
Sep 08 11:30:59.879394 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:59.879357    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de1e135a-bd8c-4e20-be89-f7a2a2cbf98e-cert\") pod \"ingress-canary-tf7sb\" (UID: \"de1e135a-bd8c-4e20-be89-f7a2a2cbf98e\") " pod="openshift-ingress-canary/ingress-canary-tf7sb"
Sep 08 11:30:59.879613 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:59.879486    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbv9b\" (UniqueName: \"kubernetes.io/projected/de1e135a-bd8c-4e20-be89-f7a2a2cbf98e-kube-api-access-wbv9b\") pod \"ingress-canary-tf7sb\" (UID: \"de1e135a-bd8c-4e20-be89-f7a2a2cbf98e\") " pod="openshift-ingress-canary/ingress-canary-tf7sb"
Sep 08 11:30:59.879613 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:59.879527    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6fc3823-83c6-4d67-9068-48bff3a5b3ed-tmp-dir\") pod \"dns-default-sdbbl\" (UID: \"c6fc3823-83c6-4d67-9068-48bff3a5b3ed\") " pod="openshift-dns/dns-default-sdbbl"
Sep 08 11:30:59.879613 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:59.879564    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzbw2\" (UniqueName: \"kubernetes.io/projected/c6fc3823-83c6-4d67-9068-48bff3a5b3ed-kube-api-access-tzbw2\") pod \"dns-default-sdbbl\" (UID: \"c6fc3823-83c6-4d67-9068-48bff3a5b3ed\") " pod="openshift-dns/dns-default-sdbbl"
Sep 08 11:30:59.879613 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:59.879583    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6fc3823-83c6-4d67-9068-48bff3a5b3ed-metrics-tls\") pod \"dns-default-sdbbl\" (UID: \"c6fc3823-83c6-4d67-9068-48bff3a5b3ed\") " pod="openshift-dns/dns-default-sdbbl"
Sep 08 11:30:59.879798 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:59.879674    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 11:30:59.879798 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:30:59.879747    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6fc3823-83c6-4d67-9068-48bff3a5b3ed-metrics-tls podName:c6fc3823-83c6-4d67-9068-48bff3a5b3ed nodeName:}" failed. No retries permitted until 2026-09-08 11:31:00.379727143 +0000 UTC m=+35.031433930 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c6fc3823-83c6-4d67-9068-48bff3a5b3ed-metrics-tls") pod "dns-default-sdbbl" (UID: "c6fc3823-83c6-4d67-9068-48bff3a5b3ed") : secret "dns-default-metrics-tls" not found
Sep 08 11:30:59.879959 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:59.879935    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6fc3823-83c6-4d67-9068-48bff3a5b3ed-tmp-dir\") pod \"dns-default-sdbbl\" (UID: \"c6fc3823-83c6-4d67-9068-48bff3a5b3ed\") " pod="openshift-dns/dns-default-sdbbl"
Sep 08 11:30:59.880012 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:59.879991    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c6fc3823-83c6-4d67-9068-48bff3a5b3ed-config-volume\") pod \"dns-default-sdbbl\" (UID: \"c6fc3823-83c6-4d67-9068-48bff3a5b3ed\") " pod="openshift-dns/dns-default-sdbbl"
Sep 08 11:30:59.884918 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:59.884894    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de1e135a-bd8c-4e20-be89-f7a2a2cbf98e-cert\") pod \"ingress-canary-tf7sb\" (UID: \"de1e135a-bd8c-4e20-be89-f7a2a2cbf98e\") " pod="openshift-ingress-canary/ingress-canary-tf7sb"
Sep 08 11:30:59.890552 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:59.890520    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzbw2\" (UniqueName: \"kubernetes.io/projected/c6fc3823-83c6-4d67-9068-48bff3a5b3ed-kube-api-access-tzbw2\") pod \"dns-default-sdbbl\" (UID: \"c6fc3823-83c6-4d67-9068-48bff3a5b3ed\") " pod="openshift-dns/dns-default-sdbbl"
Sep 08 11:30:59.890689 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:59.890641    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbv9b\" (UniqueName: \"kubernetes.io/projected/de1e135a-bd8c-4e20-be89-f7a2a2cbf98e-kube-api-access-wbv9b\") pod \"ingress-canary-tf7sb\" (UID: \"de1e135a-bd8c-4e20-be89-f7a2a2cbf98e\") " pod="openshift-ingress-canary/ingress-canary-tf7sb"
Sep 08 11:30:59.991826 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:30:59.991789    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tf7sb"
Sep 08 11:31:00.287653 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:00.287393    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tf7sb"]
Sep 08 11:31:00.293906 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:31:00.293874    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde1e135a_bd8c_4e20_be89_f7a2a2cbf98e.slice/crio-a42a17970364d25dbc41a261c2f36f96b5ae07ebf0fc10ba1abed89be4cfbf14 WatchSource:0}: Error finding container a42a17970364d25dbc41a261c2f36f96b5ae07ebf0fc10ba1abed89be4cfbf14: Status 404 returned error can't find the container with id a42a17970364d25dbc41a261c2f36f96b5ae07ebf0fc10ba1abed89be4cfbf14
Sep 08 11:31:00.384881 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:00.384835    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6fc3823-83c6-4d67-9068-48bff3a5b3ed-metrics-tls\") pod \"dns-default-sdbbl\" (UID: \"c6fc3823-83c6-4d67-9068-48bff3a5b3ed\") " pod="openshift-dns/dns-default-sdbbl"
Sep 08 11:31:00.385066 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:00.384988    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 11:31:00.385066 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:00.385058    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6fc3823-83c6-4d67-9068-48bff3a5b3ed-metrics-tls podName:c6fc3823-83c6-4d67-9068-48bff3a5b3ed nodeName:}" failed. No retries permitted until 2026-09-08 11:31:01.385038304 +0000 UTC m=+36.036745098 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c6fc3823-83c6-4d67-9068-48bff3a5b3ed-metrics-tls") pod "dns-default-sdbbl" (UID: "c6fc3823-83c6-4d67-9068-48bff3a5b3ed") : secret "dns-default-metrics-tls" not found
Sep 08 11:31:00.835353 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:00.835301    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb8wz"
Sep 08 11:31:00.838828 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:00.838800    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 11:31:00.838973 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:00.838870    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xt4h2\""
Sep 08 11:31:01.013835 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:01.013795    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tf7sb" event={"ID":"de1e135a-bd8c-4e20-be89-f7a2a2cbf98e","Type":"ContainerStarted","Data":"a42a17970364d25dbc41a261c2f36f96b5ae07ebf0fc10ba1abed89be4cfbf14"}
Sep 08 11:31:01.393169 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:01.393136    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6fc3823-83c6-4d67-9068-48bff3a5b3ed-metrics-tls\") pod \"dns-default-sdbbl\" (UID: \"c6fc3823-83c6-4d67-9068-48bff3a5b3ed\") " pod="openshift-dns/dns-default-sdbbl"
Sep 08 11:31:01.393392 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:01.393281    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 11:31:01.393392 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:01.393359    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6fc3823-83c6-4d67-9068-48bff3a5b3ed-metrics-tls podName:c6fc3823-83c6-4d67-9068-48bff3a5b3ed nodeName:}" failed. No retries permitted until 2026-09-08 11:31:03.393325905 +0000 UTC m=+38.045032677 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c6fc3823-83c6-4d67-9068-48bff3a5b3ed-metrics-tls") pod "dns-default-sdbbl" (UID: "c6fc3823-83c6-4d67-9068-48bff3a5b3ed") : secret "dns-default-metrics-tls" not found
Sep 08 11:31:03.408847 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:03.408814    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6fc3823-83c6-4d67-9068-48bff3a5b3ed-metrics-tls\") pod \"dns-default-sdbbl\" (UID: \"c6fc3823-83c6-4d67-9068-48bff3a5b3ed\") " pod="openshift-dns/dns-default-sdbbl"
Sep 08 11:31:03.409460 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:03.408986    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 11:31:03.409460 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:03.409071    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6fc3823-83c6-4d67-9068-48bff3a5b3ed-metrics-tls podName:c6fc3823-83c6-4d67-9068-48bff3a5b3ed nodeName:}" failed. No retries permitted until 2026-09-08 11:31:07.409050478 +0000 UTC m=+42.060757251 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c6fc3823-83c6-4d67-9068-48bff3a5b3ed-metrics-tls") pod "dns-default-sdbbl" (UID: "c6fc3823-83c6-4d67-9068-48bff3a5b3ed") : secret "dns-default-metrics-tls" not found
Sep 08 11:31:05.026578 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:05.026375    2575 generic.go:356] "Generic (PLEG): container finished" podID="59c98920-00f1-4ea9-bf6e-8fca2c95244a" containerID="9865bf4765a442d2ab47f00bfc4a41664714d337181f05523782a0c82c7f6553" exitCode=0
Sep 08 11:31:05.027237 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:05.026459    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9ksl" event={"ID":"59c98920-00f1-4ea9-bf6e-8fca2c95244a","Type":"ContainerDied","Data":"9865bf4765a442d2ab47f00bfc4a41664714d337181f05523782a0c82c7f6553"}
Sep 08 11:31:05.028222 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:05.028201    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tf7sb" event={"ID":"de1e135a-bd8c-4e20-be89-f7a2a2cbf98e","Type":"ContainerStarted","Data":"7189df8ee99be306f689b03085b98f91149657f773257292b58399c78208da52"}
Sep 08 11:31:05.072020 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:05.071966    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-tf7sb" podStartSLOduration=2.451594044 podStartE2EDuration="6.071946247s" totalImagesPullingTime="3.620352203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:30:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:31:05.071025716 +0000 UTC m=+39.722732523" watchObservedRunningTime="2026-09-08 11:31:05.071946247 +0000 UTC m=+39.723653041"
Sep 08 11:31:06.033395 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:06.033360    2575 generic.go:356] "Generic (PLEG): container finished" podID="59c98920-00f1-4ea9-bf6e-8fca2c95244a" containerID="4976e26b29b4016ffa126c6e42d4e2ddc7a848dfa3cb53992f12beb2187bf96d" exitCode=0
Sep 08 11:31:06.033882 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:06.033426    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9ksl" event={"ID":"59c98920-00f1-4ea9-bf6e-8fca2c95244a","Type":"ContainerDied","Data":"4976e26b29b4016ffa126c6e42d4e2ddc7a848dfa3cb53992f12beb2187bf96d"}
Sep 08 11:31:07.039006 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:07.038970    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9ksl" event={"ID":"59c98920-00f1-4ea9-bf6e-8fca2c95244a","Type":"ContainerStarted","Data":"4e287f90c7beab5b689a378d9d00db723a5bb86267ec44a86f5ca464d9a90cb7"}
Sep 08 11:31:07.063802 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:07.063749    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-r9ksl" podStartSLOduration=12.181602282 podStartE2EDuration="42.06373104s" totalImagesPullingTime="29.882128758s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 11:30:25 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:31:07.063409481 +0000 UTC m=+41.715116302" watchObservedRunningTime="2026-09-08 11:31:07.06373104 +0000 UTC m=+41.715437858"
Sep 08 11:31:07.436082 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:07.435984    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6fc3823-83c6-4d67-9068-48bff3a5b3ed-metrics-tls\") pod \"dns-default-sdbbl\" (UID: \"c6fc3823-83c6-4d67-9068-48bff3a5b3ed\") " pod="openshift-dns/dns-default-sdbbl"
Sep 08 11:31:07.436234 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:07.436139    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 11:31:07.436234 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:07.436206    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6fc3823-83c6-4d67-9068-48bff3a5b3ed-metrics-tls podName:c6fc3823-83c6-4d67-9068-48bff3a5b3ed nodeName:}" failed. No retries permitted until 2026-09-08 11:31:15.436189564 +0000 UTC m=+50.087896336 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c6fc3823-83c6-4d67-9068-48bff3a5b3ed-metrics-tls") pod "dns-default-sdbbl" (UID: "c6fc3823-83c6-4d67-9068-48bff3a5b3ed") : secret "dns-default-metrics-tls" not found
Sep 08 11:31:15.493015 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:15.492968    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6fc3823-83c6-4d67-9068-48bff3a5b3ed-metrics-tls\") pod \"dns-default-sdbbl\" (UID: \"c6fc3823-83c6-4d67-9068-48bff3a5b3ed\") " pod="openshift-dns/dns-default-sdbbl"
Sep 08 11:31:15.493424 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:15.493085    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 11:31:15.493424 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:15.493147    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6fc3823-83c6-4d67-9068-48bff3a5b3ed-metrics-tls podName:c6fc3823-83c6-4d67-9068-48bff3a5b3ed nodeName:}" failed. No retries permitted until 2026-09-08 11:31:31.493133665 +0000 UTC m=+66.144840438 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c6fc3823-83c6-4d67-9068-48bff3a5b3ed-metrics-tls") pod "dns-default-sdbbl" (UID: "c6fc3823-83c6-4d67-9068-48bff3a5b3ed") : secret "dns-default-metrics-tls" not found
Sep 08 11:31:27.009570 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:27.009541    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m57jb"
Sep 08 11:31:30.604356 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:30.604298    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1df1b9eb-b388-4e05-af5d-9da7cfd4ce10-original-pull-secret\") pod \"global-pull-secret-syncer-2tmp9\" (UID: \"1df1b9eb-b388-4e05-af5d-9da7cfd4ce10\") " pod="kube-system/global-pull-secret-syncer-2tmp9"
Sep 08 11:31:30.604738 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:30.604376    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679-metrics-certs\") pod \"network-metrics-daemon-nb8wz\" (UID: \"b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679\") " pod="openshift-multus/network-metrics-daemon-nb8wz"
Sep 08 11:31:30.607153 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:30.607132    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 11:31:30.607237 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:30.607220    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 11:31:30.615501 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:30.615480    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 08 11:31:30.615586 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:30.615566    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679-metrics-certs podName:b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679 nodeName:}" failed. No retries permitted until 2026-09-08 11:32:34.615548008 +0000 UTC m=+129.267254785 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679-metrics-certs") pod "network-metrics-daemon-nb8wz" (UID: "b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679") : secret "metrics-daemon-secret" not found
Sep 08 11:31:30.618213 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:30.618180    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1df1b9eb-b388-4e05-af5d-9da7cfd4ce10-original-pull-secret\") pod \"global-pull-secret-syncer-2tmp9\" (UID: \"1df1b9eb-b388-4e05-af5d-9da7cfd4ce10\") " pod="kube-system/global-pull-secret-syncer-2tmp9"
Sep 08 11:31:30.704813 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:30.704779    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp2f9\" (UniqueName: \"kubernetes.io/projected/190e88db-a54a-4abb-bd46-1158e5bb71c6-kube-api-access-bp2f9\") pod \"network-check-target-m5x5z\" (UID: \"190e88db-a54a-4abb-bd46-1158e5bb71c6\") " pod="openshift-network-diagnostics/network-check-target-m5x5z"
Sep 08 11:31:30.707817 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:30.707799    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 11:31:30.717433 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:30.717415    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 11:31:30.728123 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:30.728099    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp2f9\" (UniqueName: \"kubernetes.io/projected/190e88db-a54a-4abb-bd46-1158e5bb71c6-kube-api-access-bp2f9\") pod \"network-check-target-m5x5z\" (UID: \"190e88db-a54a-4abb-bd46-1158e5bb71c6\") " pod="openshift-network-diagnostics/network-check-target-m5x5z"
Sep 08 11:31:30.750497 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:30.750469    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nwz6n\""
Sep 08 11:31:30.752760 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:30.752743    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2tmp9"
Sep 08 11:31:30.758103 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:30.758085    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5x5z"
Sep 08 11:31:31.025832 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:31.025798    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2tmp9"]
Sep 08 11:31:31.027193 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:31.027170    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m5x5z"]
Sep 08 11:31:31.030530 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:31:31.030494    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1df1b9eb_b388_4e05_af5d_9da7cfd4ce10.slice/crio-928862f041a7075692679788fe43f5d7fb29d1785da217f781fad229ae99d6e9 WatchSource:0}: Error finding container 928862f041a7075692679788fe43f5d7fb29d1785da217f781fad229ae99d6e9: Status 404 returned error can't find the container with id 928862f041a7075692679788fe43f5d7fb29d1785da217f781fad229ae99d6e9
Sep 08 11:31:31.031115 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:31:31.031090    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod190e88db_a54a_4abb_bd46_1158e5bb71c6.slice/crio-6977e730eee81680ea4763a4831560f21c50897c2cade1859eda35c276807733 WatchSource:0}: Error finding container 6977e730eee81680ea4763a4831560f21c50897c2cade1859eda35c276807733: Status 404 returned error can't find the container with id 6977e730eee81680ea4763a4831560f21c50897c2cade1859eda35c276807733
Sep 08 11:31:31.096285 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:31.096247    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m5x5z" event={"ID":"190e88db-a54a-4abb-bd46-1158e5bb71c6","Type":"ContainerStarted","Data":"6977e730eee81680ea4763a4831560f21c50897c2cade1859eda35c276807733"}
Sep 08 11:31:31.097251 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:31.097219    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2tmp9" event={"ID":"1df1b9eb-b388-4e05-af5d-9da7cfd4ce10","Type":"ContainerStarted","Data":"928862f041a7075692679788fe43f5d7fb29d1785da217f781fad229ae99d6e9"}
Sep 08 11:31:31.511510 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:31.511411    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6fc3823-83c6-4d67-9068-48bff3a5b3ed-metrics-tls\") pod \"dns-default-sdbbl\" (UID: \"c6fc3823-83c6-4d67-9068-48bff3a5b3ed\") " pod="openshift-dns/dns-default-sdbbl"
Sep 08 11:31:31.511681 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:31.511543    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 11:31:31.511681 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:31.511618    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6fc3823-83c6-4d67-9068-48bff3a5b3ed-metrics-tls podName:c6fc3823-83c6-4d67-9068-48bff3a5b3ed nodeName:}" failed. No retries permitted until 2026-09-08 11:32:03.511593304 +0000 UTC m=+98.163300091 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c6fc3823-83c6-4d67-9068-48bff3a5b3ed-metrics-tls") pod "dns-default-sdbbl" (UID: "c6fc3823-83c6-4d67-9068-48bff3a5b3ed") : secret "dns-default-metrics-tls" not found
Sep 08 11:31:36.112799 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:36.112765    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m5x5z" event={"ID":"190e88db-a54a-4abb-bd46-1158e5bb71c6","Type":"ContainerStarted","Data":"6484c8d75b9b274622af709dfddfc0d7389629872ae56c75f1ccba83b0a01d39"}
Sep 08 11:31:36.113251 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:36.112886    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-m5x5z"
Sep 08 11:31:36.114425 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:36.114401    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2tmp9" event={"ID":"1df1b9eb-b388-4e05-af5d-9da7cfd4ce10","Type":"ContainerStarted","Data":"5e14f087c482996d9b0654608b563df08e55aac55c0d7c9f5f4ef918dd1dd8d7"}
Sep 08 11:31:36.133786 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:36.133735    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-m5x5z" podStartSLOduration=65.4256846 podStartE2EDuration="1m10.133719808s" totalImagesPullingTime="4.708035208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:30:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:31:36.132506795 +0000 UTC m=+70.784213611" watchObservedRunningTime="2026-09-08 11:31:36.133719808 +0000 UTC m=+70.785426603"
Sep 08 11:31:36.151742 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:36.151691    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2tmp9" podStartSLOduration=65.439127218 podStartE2EDuration="1m10.151671396s" totalImagesPullingTime="4.712544178s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 11:30:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:31:36.15093658 +0000 UTC m=+70.802643373" watchObservedRunningTime="2026-09-08 11:31:36.151671396 +0000 UTC m=+70.803378192"
Sep 08 11:31:43.392317 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.392281    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-fphh6"]
Sep 08 11:31:43.394828 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.394806    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-fphh6"
Sep 08 11:31:43.398804 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.398778    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 08 11:31:43.400371 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.400325    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5tnv8\""
Sep 08 11:31:43.400497 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.400406    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 08 11:31:43.400497 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.400407    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 08 11:31:43.400497 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.400460    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 08 11:31:43.404684 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.404661    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-fphh6"]
Sep 08 11:31:43.495691 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.495655    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-2hc2h"]
Sep 08 11:31:43.497391 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.497374    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-jgtlq"]
Sep 08 11:31:43.497510 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.497491    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-2hc2h"
Sep 08 11:31:43.498979 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.498961    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-78d7dd88d4-wjvdt"]
Sep 08 11:31:43.499128 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.499110    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-jgtlq"
Sep 08 11:31:43.500267 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.500246    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 08 11:31:43.500528 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.500503    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 08 11:31:43.501315 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.501291    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-78d7dd88d4-wjvdt"
Sep 08 11:31:43.501536 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.501511    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 08 11:31:43.501639 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.501538    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 08 11:31:43.502616 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.502597    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 08 11:31:43.503395 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.503376    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-jfdbg\""
Sep 08 11:31:43.503986 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.503962    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 08 11:31:43.504130 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.504109    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5t2pr\""
Sep 08 11:31:43.505408 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.505389    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 08 11:31:43.506083 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.506067    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 08 11:31:43.506630 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.506608    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 08 11:31:43.506718 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.506630    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-nzbrq\""
Sep 08 11:31:43.507028 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.507010    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 08 11:31:43.507253 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.507232    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 08 11:31:43.507354 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.507262    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 08 11:31:43.507354 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.507321    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 08 11:31:43.509410 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.509391    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9s6s\" (UniqueName: \"kubernetes.io/projected/e106802e-8a43-4870-92a4-08741f4e05d2-kube-api-access-q9s6s\") pod \"cluster-monitoring-operator-6cdcc96965-fphh6\" (UID: \"e106802e-8a43-4870-92a4-08741f4e05d2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-fphh6"
Sep 08 11:31:43.509497 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.509427    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e106802e-8a43-4870-92a4-08741f4e05d2-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-fphh6\" (UID: \"e106802e-8a43-4870-92a4-08741f4e05d2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-fphh6"
Sep 08 11:31:43.509544 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.509513    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e106802e-8a43-4870-92a4-08741f4e05d2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-fphh6\" (UID: \"e106802e-8a43-4870-92a4-08741f4e05d2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-fphh6"
Sep 08 11:31:43.512184 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.512157    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-jgtlq"]
Sep 08 11:31:43.512840 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.512821    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-78d7dd88d4-wjvdt"]
Sep 08 11:31:43.513608 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.513584    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-2hc2h"]
Sep 08 11:31:43.610631 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.610600    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2713c4e2-3d07-454f-a92f-9f75689d226d-stats-auth\") pod \"router-default-78d7dd88d4-wjvdt\" (UID: \"2713c4e2-3d07-454f-a92f-9f75689d226d\") " pod="openshift-ingress/router-default-78d7dd88d4-wjvdt"
Sep 08 11:31:43.610631 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.610638    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksxpn\" (UniqueName: \"kubernetes.io/projected/7b6421d4-66bb-466a-b4fa-0d57d75e6d46-kube-api-access-ksxpn\") pod \"kube-storage-version-migrator-operator-8d7dd4675-2hc2h\" (UID: \"7b6421d4-66bb-466a-b4fa-0d57d75e6d46\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-2hc2h"
Sep 08 11:31:43.610864 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.610680    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7b6421d4-66bb-466a-b4fa-0d57d75e6d46-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-2hc2h\" (UID: \"7b6421d4-66bb-466a-b4fa-0d57d75e6d46\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-2hc2h"
Sep 08 11:31:43.610864 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.610725    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2713c4e2-3d07-454f-a92f-9f75689d226d-default-certificate\") pod \"router-default-78d7dd88d4-wjvdt\" (UID: \"2713c4e2-3d07-454f-a92f-9f75689d226d\") " pod="openshift-ingress/router-default-78d7dd88d4-wjvdt"
Sep 08 11:31:43.610864 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.610785    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2713c4e2-3d07-454f-a92f-9f75689d226d-metrics-certs\") pod \"router-default-78d7dd88d4-wjvdt\" (UID: \"2713c4e2-3d07-454f-a92f-9f75689d226d\") " pod="openshift-ingress/router-default-78d7dd88d4-wjvdt"
Sep 08 11:31:43.610864 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.610847    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e106802e-8a43-4870-92a4-08741f4e05d2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-fphh6\" (UID: \"e106802e-8a43-4870-92a4-08741f4e05d2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-fphh6"
Sep 08 11:31:43.611039 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.610868    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7b6421d4-66bb-466a-b4fa-0d57d75e6d46-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-2hc2h\" (UID: \"7b6421d4-66bb-466a-b4fa-0d57d75e6d46\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-2hc2h"
Sep 08 11:31:43.611039 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.610887    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2713c4e2-3d07-454f-a92f-9f75689d226d-service-ca-bundle\") pod \"router-default-78d7dd88d4-wjvdt\" (UID: \"2713c4e2-3d07-454f-a92f-9f75689d226d\") " pod="openshift-ingress/router-default-78d7dd88d4-wjvdt"
Sep 08 11:31:43.611039 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.610910    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwjpx\" (UniqueName: \"kubernetes.io/projected/2713c4e2-3d07-454f-a92f-9f75689d226d-kube-api-access-bwjpx\") pod \"router-default-78d7dd88d4-wjvdt\" (UID: \"2713c4e2-3d07-454f-a92f-9f75689d226d\") " pod="openshift-ingress/router-default-78d7dd88d4-wjvdt"
Sep 08 11:31:43.611039 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:43.610987    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 11:31:43.611039 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:43.611040    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e106802e-8a43-4870-92a4-08741f4e05d2-cluster-monitoring-operator-tls podName:e106802e-8a43-4870-92a4-08741f4e05d2 nodeName:}" failed. No retries permitted until 2026-09-08 11:31:44.111024961 +0000 UTC m=+78.762731733 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e106802e-8a43-4870-92a4-08741f4e05d2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-fphh6" (UID: "e106802e-8a43-4870-92a4-08741f4e05d2") : secret "cluster-monitoring-operator-tls" not found
Sep 08 11:31:43.611260 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.610985    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9s6s\" (UniqueName: \"kubernetes.io/projected/e106802e-8a43-4870-92a4-08741f4e05d2-kube-api-access-q9s6s\") pod \"cluster-monitoring-operator-6cdcc96965-fphh6\" (UID: \"e106802e-8a43-4870-92a4-08741f4e05d2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-fphh6"
Sep 08 11:31:43.611260 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.611070    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e106802e-8a43-4870-92a4-08741f4e05d2-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-fphh6\" (UID: \"e106802e-8a43-4870-92a4-08741f4e05d2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-fphh6"
Sep 08 11:31:43.611260 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.611088    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-jgtlq\" (UID: \"d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-jgtlq"
Sep 08 11:31:43.611260 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.611105    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhmmt\" (UniqueName: \"kubernetes.io/projected/d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea-kube-api-access-vhmmt\") pod \"cluster-samples-operator-7cdcfcf76c-jgtlq\" (UID: \"d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-jgtlq"
Sep 08 11:31:43.611733 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.611716    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e106802e-8a43-4870-92a4-08741f4e05d2-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-fphh6\" (UID: \"e106802e-8a43-4870-92a4-08741f4e05d2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-fphh6"
Sep 08 11:31:43.631095 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.631066    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9s6s\" (UniqueName: \"kubernetes.io/projected/e106802e-8a43-4870-92a4-08741f4e05d2-kube-api-access-q9s6s\") pod \"cluster-monitoring-operator-6cdcc96965-fphh6\" (UID: \"e106802e-8a43-4870-92a4-08741f4e05d2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-fphh6"
Sep 08 11:31:43.711638 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.711545    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-jgtlq\" (UID: \"d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-jgtlq"
Sep 08 11:31:43.711638 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.711581    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhmmt\" (UniqueName: \"kubernetes.io/projected/d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea-kube-api-access-vhmmt\") pod \"cluster-samples-operator-7cdcfcf76c-jgtlq\" (UID: \"d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-jgtlq"
Sep 08 11:31:43.711638 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.711603    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2713c4e2-3d07-454f-a92f-9f75689d226d-stats-auth\") pod \"router-default-78d7dd88d4-wjvdt\" (UID: \"2713c4e2-3d07-454f-a92f-9f75689d226d\") " pod="openshift-ingress/router-default-78d7dd88d4-wjvdt"
Sep 08 11:31:43.711884 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:43.711696    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 11:31:43.711884 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.711714    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksxpn\" (UniqueName: \"kubernetes.io/projected/7b6421d4-66bb-466a-b4fa-0d57d75e6d46-kube-api-access-ksxpn\") pod \"kube-storage-version-migrator-operator-8d7dd4675-2hc2h\" (UID: \"7b6421d4-66bb-466a-b4fa-0d57d75e6d46\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-2hc2h"
Sep 08 11:31:43.711884 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.711756    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7b6421d4-66bb-466a-b4fa-0d57d75e6d46-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-2hc2h\" (UID: \"7b6421d4-66bb-466a-b4fa-0d57d75e6d46\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-2hc2h"
Sep 08 11:31:43.711884 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:43.711780    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea-samples-operator-tls podName:d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea nodeName:}" failed. No retries permitted until 2026-09-08 11:31:44.21176014 +0000 UTC m=+78.863466913 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-jgtlq" (UID: "d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea") : secret "samples-operator-tls" not found
Sep 08 11:31:43.711884 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.711813    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2713c4e2-3d07-454f-a92f-9f75689d226d-default-certificate\") pod \"router-default-78d7dd88d4-wjvdt\" (UID: \"2713c4e2-3d07-454f-a92f-9f75689d226d\") " pod="openshift-ingress/router-default-78d7dd88d4-wjvdt"
Sep 08 11:31:43.711884 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.711837    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2713c4e2-3d07-454f-a92f-9f75689d226d-metrics-certs\") pod \"router-default-78d7dd88d4-wjvdt\" (UID: \"2713c4e2-3d07-454f-a92f-9f75689d226d\") " pod="openshift-ingress/router-default-78d7dd88d4-wjvdt"
Sep 08 11:31:43.711884 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.711884    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7b6421d4-66bb-466a-b4fa-0d57d75e6d46-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-2hc2h\" (UID: \"7b6421d4-66bb-466a-b4fa-0d57d75e6d46\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-2hc2h"
Sep 08 11:31:43.712234 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.711911    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2713c4e2-3d07-454f-a92f-9f75689d226d-service-ca-bundle\") pod \"router-default-78d7dd88d4-wjvdt\" (UID: \"2713c4e2-3d07-454f-a92f-9f75689d226d\") " pod="openshift-ingress/router-default-78d7dd88d4-wjvdt"
Sep 08 11:31:43.712234 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.711949    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwjpx\" (UniqueName: \"kubernetes.io/projected/2713c4e2-3d07-454f-a92f-9f75689d226d-kube-api-access-bwjpx\") pod \"router-default-78d7dd88d4-wjvdt\" (UID: \"2713c4e2-3d07-454f-a92f-9f75689d226d\") " pod="openshift-ingress/router-default-78d7dd88d4-wjvdt"
Sep 08 11:31:43.712234 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:43.711962    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 11:31:43.712234 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:43.712023    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2713c4e2-3d07-454f-a92f-9f75689d226d-metrics-certs podName:2713c4e2-3d07-454f-a92f-9f75689d226d nodeName:}" failed. No retries permitted until 2026-09-08 11:31:44.212005586 +0000 UTC m=+78.863712378 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2713c4e2-3d07-454f-a92f-9f75689d226d-metrics-certs") pod "router-default-78d7dd88d4-wjvdt" (UID: "2713c4e2-3d07-454f-a92f-9f75689d226d") : secret "router-metrics-certs-default" not found
Sep 08 11:31:43.712234 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:43.712096    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2713c4e2-3d07-454f-a92f-9f75689d226d-service-ca-bundle podName:2713c4e2-3d07-454f-a92f-9f75689d226d nodeName:}" failed. No retries permitted until 2026-09-08 11:31:44.212083557 +0000 UTC m=+78.863790357 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2713c4e2-3d07-454f-a92f-9f75689d226d-service-ca-bundle") pod "router-default-78d7dd88d4-wjvdt" (UID: "2713c4e2-3d07-454f-a92f-9f75689d226d") : configmap references non-existent config key: service-ca.crt
Sep 08 11:31:43.712521 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.712481    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7b6421d4-66bb-466a-b4fa-0d57d75e6d46-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-2hc2h\" (UID: \"7b6421d4-66bb-466a-b4fa-0d57d75e6d46\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-2hc2h"
Sep 08 11:31:43.714293 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.714248    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7b6421d4-66bb-466a-b4fa-0d57d75e6d46-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-2hc2h\" (UID: \"7b6421d4-66bb-466a-b4fa-0d57d75e6d46\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-2hc2h"
Sep 08 11:31:43.714433 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.714372    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2713c4e2-3d07-454f-a92f-9f75689d226d-default-certificate\") pod \"router-default-78d7dd88d4-wjvdt\" (UID: \"2713c4e2-3d07-454f-a92f-9f75689d226d\") " pod="openshift-ingress/router-default-78d7dd88d4-wjvdt"
Sep 08 11:31:43.714433 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.714381    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2713c4e2-3d07-454f-a92f-9f75689d226d-stats-auth\") pod \"router-default-78d7dd88d4-wjvdt\" (UID: \"2713c4e2-3d07-454f-a92f-9f75689d226d\") " pod="openshift-ingress/router-default-78d7dd88d4-wjvdt"
Sep 08 11:31:43.721491 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.721461    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhmmt\" (UniqueName: \"kubernetes.io/projected/d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea-kube-api-access-vhmmt\") pod \"cluster-samples-operator-7cdcfcf76c-jgtlq\" (UID: \"d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-jgtlq"
Sep 08 11:31:43.721616 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.721471    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwjpx\" (UniqueName: \"kubernetes.io/projected/2713c4e2-3d07-454f-a92f-9f75689d226d-kube-api-access-bwjpx\") pod \"router-default-78d7dd88d4-wjvdt\" (UID: \"2713c4e2-3d07-454f-a92f-9f75689d226d\") " pod="openshift-ingress/router-default-78d7dd88d4-wjvdt"
Sep 08 11:31:43.721795 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.721778    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksxpn\" (UniqueName: \"kubernetes.io/projected/7b6421d4-66bb-466a-b4fa-0d57d75e6d46-kube-api-access-ksxpn\") pod \"kube-storage-version-migrator-operator-8d7dd4675-2hc2h\" (UID: \"7b6421d4-66bb-466a-b4fa-0d57d75e6d46\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-2hc2h"
Sep 08 11:31:43.810817 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:43.810773    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-2hc2h"
Sep 08 11:31:44.082825 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:44.082803    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-2hc2h"]
Sep 08 11:31:44.086499 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:31:44.086447    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b6421d4_66bb_466a_b4fa_0d57d75e6d46.slice/crio-79f9529e3116b37be94240ee10b527d7bc6f5b6d91ed980936e91d6dc3bbde1a WatchSource:0}: Error finding container 79f9529e3116b37be94240ee10b527d7bc6f5b6d91ed980936e91d6dc3bbde1a: Status 404 returned error can't find the container with id 79f9529e3116b37be94240ee10b527d7bc6f5b6d91ed980936e91d6dc3bbde1a
Sep 08 11:31:44.115633 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:44.115595    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e106802e-8a43-4870-92a4-08741f4e05d2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-fphh6\" (UID: \"e106802e-8a43-4870-92a4-08741f4e05d2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-fphh6"
Sep 08 11:31:44.115844 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:44.115739    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 11:31:44.115844 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:44.115812    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e106802e-8a43-4870-92a4-08741f4e05d2-cluster-monitoring-operator-tls podName:e106802e-8a43-4870-92a4-08741f4e05d2 nodeName:}" failed. No retries permitted until 2026-09-08 11:31:45.115791622 +0000 UTC m=+79.767498393 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e106802e-8a43-4870-92a4-08741f4e05d2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-fphh6" (UID: "e106802e-8a43-4870-92a4-08741f4e05d2") : secret "cluster-monitoring-operator-tls" not found
Sep 08 11:31:44.135589 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:44.135549    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-2hc2h" event={"ID":"7b6421d4-66bb-466a-b4fa-0d57d75e6d46","Type":"ContainerStarted","Data":"79f9529e3116b37be94240ee10b527d7bc6f5b6d91ed980936e91d6dc3bbde1a"}
Sep 08 11:31:44.215995 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:44.215953    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-jgtlq\" (UID: \"d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-jgtlq"
Sep 08 11:31:44.216202 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:44.216017    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2713c4e2-3d07-454f-a92f-9f75689d226d-metrics-certs\") pod \"router-default-78d7dd88d4-wjvdt\" (UID: \"2713c4e2-3d07-454f-a92f-9f75689d226d\") " pod="openshift-ingress/router-default-78d7dd88d4-wjvdt"
Sep 08 11:31:44.216202 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:44.216057    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2713c4e2-3d07-454f-a92f-9f75689d226d-service-ca-bundle\") pod \"router-default-78d7dd88d4-wjvdt\" (UID: \"2713c4e2-3d07-454f-a92f-9f75689d226d\") " pod="openshift-ingress/router-default-78d7dd88d4-wjvdt"
Sep 08 11:31:44.216202 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:44.216117    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 11:31:44.216202 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:44.216159    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 11:31:44.216202 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:44.216204    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2713c4e2-3d07-454f-a92f-9f75689d226d-service-ca-bundle podName:2713c4e2-3d07-454f-a92f-9f75689d226d nodeName:}" failed. No retries permitted until 2026-09-08 11:31:45.216170848 +0000 UTC m=+79.867877621 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2713c4e2-3d07-454f-a92f-9f75689d226d-service-ca-bundle") pod "router-default-78d7dd88d4-wjvdt" (UID: "2713c4e2-3d07-454f-a92f-9f75689d226d") : configmap references non-existent config key: service-ca.crt
Sep 08 11:31:44.216444 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:44.216227    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea-samples-operator-tls podName:d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea nodeName:}" failed. No retries permitted until 2026-09-08 11:31:45.216214895 +0000 UTC m=+79.867921668 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-jgtlq" (UID: "d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea") : secret "samples-operator-tls" not found
Sep 08 11:31:44.216444 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:44.216251    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2713c4e2-3d07-454f-a92f-9f75689d226d-metrics-certs podName:2713c4e2-3d07-454f-a92f-9f75689d226d nodeName:}" failed. No retries permitted until 2026-09-08 11:31:45.216242528 +0000 UTC m=+79.867949302 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2713c4e2-3d07-454f-a92f-9f75689d226d-metrics-certs") pod "router-default-78d7dd88d4-wjvdt" (UID: "2713c4e2-3d07-454f-a92f-9f75689d226d") : secret "router-metrics-certs-default" not found
Sep 08 11:31:45.121977 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:45.121943    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e106802e-8a43-4870-92a4-08741f4e05d2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-fphh6\" (UID: \"e106802e-8a43-4870-92a4-08741f4e05d2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-fphh6"
Sep 08 11:31:45.122483 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:45.122124    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 11:31:45.122483 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:45.122223    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e106802e-8a43-4870-92a4-08741f4e05d2-cluster-monitoring-operator-tls podName:e106802e-8a43-4870-92a4-08741f4e05d2 nodeName:}" failed. No retries permitted until 2026-09-08 11:31:47.122202785 +0000 UTC m=+81.773909576 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e106802e-8a43-4870-92a4-08741f4e05d2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-fphh6" (UID: "e106802e-8a43-4870-92a4-08741f4e05d2") : secret "cluster-monitoring-operator-tls" not found
Sep 08 11:31:45.222382 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:45.222315    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-jgtlq\" (UID: \"d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-jgtlq"
Sep 08 11:31:45.222541 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:45.222404    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2713c4e2-3d07-454f-a92f-9f75689d226d-metrics-certs\") pod \"router-default-78d7dd88d4-wjvdt\" (UID: \"2713c4e2-3d07-454f-a92f-9f75689d226d\") " pod="openshift-ingress/router-default-78d7dd88d4-wjvdt"
Sep 08 11:31:45.222541 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:45.222449    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2713c4e2-3d07-454f-a92f-9f75689d226d-service-ca-bundle\") pod \"router-default-78d7dd88d4-wjvdt\" (UID: \"2713c4e2-3d07-454f-a92f-9f75689d226d\") " pod="openshift-ingress/router-default-78d7dd88d4-wjvdt"
Sep 08 11:31:45.222541 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:45.222490    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 11:31:45.222673 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:45.222551    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 11:31:45.222673 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:45.222560    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea-samples-operator-tls podName:d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea nodeName:}" failed. No retries permitted until 2026-09-08 11:31:47.222541599 +0000 UTC m=+81.874248388 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-jgtlq" (UID: "d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea") : secret "samples-operator-tls" not found
Sep 08 11:31:45.222673 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:45.222618    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2713c4e2-3d07-454f-a92f-9f75689d226d-service-ca-bundle podName:2713c4e2-3d07-454f-a92f-9f75689d226d nodeName:}" failed. No retries permitted until 2026-09-08 11:31:47.222604982 +0000 UTC m=+81.874311754 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2713c4e2-3d07-454f-a92f-9f75689d226d-service-ca-bundle") pod "router-default-78d7dd88d4-wjvdt" (UID: "2713c4e2-3d07-454f-a92f-9f75689d226d") : configmap references non-existent config key: service-ca.crt
Sep 08 11:31:45.222673 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:45.222636    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2713c4e2-3d07-454f-a92f-9f75689d226d-metrics-certs podName:2713c4e2-3d07-454f-a92f-9f75689d226d nodeName:}" failed. No retries permitted until 2026-09-08 11:31:47.222627888 +0000 UTC m=+81.874334660 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2713c4e2-3d07-454f-a92f-9f75689d226d-metrics-certs") pod "router-default-78d7dd88d4-wjvdt" (UID: "2713c4e2-3d07-454f-a92f-9f75689d226d") : secret "router-metrics-certs-default" not found
Sep 08 11:31:47.138869 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:47.138717    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e106802e-8a43-4870-92a4-08741f4e05d2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-fphh6\" (UID: \"e106802e-8a43-4870-92a4-08741f4e05d2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-fphh6"
Sep 08 11:31:47.138869 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:47.138846    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 11:31:47.139430 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:47.138905    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e106802e-8a43-4870-92a4-08741f4e05d2-cluster-monitoring-operator-tls podName:e106802e-8a43-4870-92a4-08741f4e05d2 nodeName:}" failed. No retries permitted until 2026-09-08 11:31:51.138890163 +0000 UTC m=+85.790596935 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e106802e-8a43-4870-92a4-08741f4e05d2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-fphh6" (UID: "e106802e-8a43-4870-92a4-08741f4e05d2") : secret "cluster-monitoring-operator-tls" not found
Sep 08 11:31:47.146292 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:47.146262    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-2hc2h" event={"ID":"7b6421d4-66bb-466a-b4fa-0d57d75e6d46","Type":"ContainerStarted","Data":"68bdfcb0ea45cfa726911b8328aa9251da776735844c1dd6bb5120e6abb4ec87"}
Sep 08 11:31:47.167845 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:47.167790    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-2hc2h" podStartSLOduration=2.016292147 podStartE2EDuration="4.167772246s" totalImagesPullingTime="2.151480099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:31:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:31:47.166645072 +0000 UTC m=+81.818351874" watchObservedRunningTime="2026-09-08 11:31:47.167772246 +0000 UTC m=+81.819479032"
Sep 08 11:31:47.239427 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:47.239377    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-jgtlq\" (UID: \"d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-jgtlq"
Sep 08 11:31:47.239625 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:47.239472    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2713c4e2-3d07-454f-a92f-9f75689d226d-metrics-certs\") pod \"router-default-78d7dd88d4-wjvdt\" (UID: \"2713c4e2-3d07-454f-a92f-9f75689d226d\") " pod="openshift-ingress/router-default-78d7dd88d4-wjvdt"
Sep 08 11:31:47.239625 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:47.239537    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 11:31:47.239625 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:47.239589    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2713c4e2-3d07-454f-a92f-9f75689d226d-service-ca-bundle\") pod \"router-default-78d7dd88d4-wjvdt\" (UID: \"2713c4e2-3d07-454f-a92f-9f75689d226d\") " pod="openshift-ingress/router-default-78d7dd88d4-wjvdt"
Sep 08 11:31:47.239625 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:47.239605    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea-samples-operator-tls podName:d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea nodeName:}" failed. No retries permitted until 2026-09-08 11:31:51.239586339 +0000 UTC m=+85.891293111 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-jgtlq" (UID: "d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea") : secret "samples-operator-tls" not found
Sep 08 11:31:47.239832 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:47.239651    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 11:31:47.239832 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:47.239717    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2713c4e2-3d07-454f-a92f-9f75689d226d-service-ca-bundle podName:2713c4e2-3d07-454f-a92f-9f75689d226d nodeName:}" failed. No retries permitted until 2026-09-08 11:31:51.239698048 +0000 UTC m=+85.891404852 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2713c4e2-3d07-454f-a92f-9f75689d226d-service-ca-bundle") pod "router-default-78d7dd88d4-wjvdt" (UID: "2713c4e2-3d07-454f-a92f-9f75689d226d") : configmap references non-existent config key: service-ca.crt
Sep 08 11:31:47.239832 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:47.239739    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2713c4e2-3d07-454f-a92f-9f75689d226d-metrics-certs podName:2713c4e2-3d07-454f-a92f-9f75689d226d nodeName:}" failed. No retries permitted until 2026-09-08 11:31:51.23973006 +0000 UTC m=+85.891436836 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2713c4e2-3d07-454f-a92f-9f75689d226d-metrics-certs") pod "router-default-78d7dd88d4-wjvdt" (UID: "2713c4e2-3d07-454f-a92f-9f75689d226d") : secret "router-metrics-certs-default" not found
Sep 08 11:31:47.834213 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:47.834176    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-cbhsg"]
Sep 08 11:31:47.836978 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:47.836953    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-cbhsg"
Sep 08 11:31:47.839195 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:47.839174    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 08 11:31:47.840451 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:47.840429    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 08 11:31:47.840553 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:47.840499    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-l8mcq\""
Sep 08 11:31:47.846261 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:47.846235    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-cbhsg"]
Sep 08 11:31:47.944853 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:47.944818    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzxrp\" (UniqueName: \"kubernetes.io/projected/fa5f78a4-5774-44c5-8e7e-5786eddd5dc8-kube-api-access-nzxrp\") pod \"migrator-fdbb8fdff-cbhsg\" (UID: \"fa5f78a4-5774-44c5-8e7e-5786eddd5dc8\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-cbhsg"
Sep 08 11:31:48.045477 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:48.045441    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzxrp\" (UniqueName: \"kubernetes.io/projected/fa5f78a4-5774-44c5-8e7e-5786eddd5dc8-kube-api-access-nzxrp\") pod \"migrator-fdbb8fdff-cbhsg\" (UID: \"fa5f78a4-5774-44c5-8e7e-5786eddd5dc8\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-cbhsg"
Sep 08 11:31:48.056077 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:48.056046    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzxrp\" (UniqueName: \"kubernetes.io/projected/fa5f78a4-5774-44c5-8e7e-5786eddd5dc8-kube-api-access-nzxrp\") pod \"migrator-fdbb8fdff-cbhsg\" (UID: \"fa5f78a4-5774-44c5-8e7e-5786eddd5dc8\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-cbhsg"
Sep 08 11:31:48.146831 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:48.146751    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-cbhsg"
Sep 08 11:31:48.420740 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:48.420660    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-cbhsg"]
Sep 08 11:31:48.423912 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:31:48.423889    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa5f78a4_5774_44c5_8e7e_5786eddd5dc8.slice/crio-927ffb1e7f46081aa288967ec3da9fbbda95650833412127135cfd3e841f6a34 WatchSource:0}: Error finding container 927ffb1e7f46081aa288967ec3da9fbbda95650833412127135cfd3e841f6a34: Status 404 returned error can't find the container with id 927ffb1e7f46081aa288967ec3da9fbbda95650833412127135cfd3e841f6a34
Sep 08 11:31:49.088103 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:49.088064    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qlxz4"]
Sep 08 11:31:49.090223 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:49.090190    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qlxz4"
Sep 08 11:31:49.093194 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:49.093168    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 08 11:31:49.093321 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:49.093215    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 08 11:31:49.093413 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:49.093380    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 08 11:31:49.093498 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:49.093462    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 08 11:31:49.094631 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:49.094608    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vrknd\""
Sep 08 11:31:49.104655 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:49.104626    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qlxz4"]
Sep 08 11:31:49.152880 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:49.152842    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fdd4c249-fda4-4507-bf19-31eb55553277-crio-socket\") pod \"insights-runtime-extractor-qlxz4\" (UID: \"fdd4c249-fda4-4507-bf19-31eb55553277\") " pod="openshift-insights/insights-runtime-extractor-qlxz4"
Sep 08 11:31:49.152880 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:49.152885    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fdd4c249-fda4-4507-bf19-31eb55553277-data-volume\") pod \"insights-runtime-extractor-qlxz4\" (UID: \"fdd4c249-fda4-4507-bf19-31eb55553277\") " pod="openshift-insights/insights-runtime-extractor-qlxz4"
Sep 08 11:31:49.153469 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:49.152923    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fdd4c249-fda4-4507-bf19-31eb55553277-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qlxz4\" (UID: \"fdd4c249-fda4-4507-bf19-31eb55553277\") " pod="openshift-insights/insights-runtime-extractor-qlxz4"
Sep 08 11:31:49.153469 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:49.152947    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7wqw\" (UniqueName: \"kubernetes.io/projected/fdd4c249-fda4-4507-bf19-31eb55553277-kube-api-access-n7wqw\") pod \"insights-runtime-extractor-qlxz4\" (UID: \"fdd4c249-fda4-4507-bf19-31eb55553277\") " pod="openshift-insights/insights-runtime-extractor-qlxz4"
Sep 08 11:31:49.153469 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:49.153029    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fdd4c249-fda4-4507-bf19-31eb55553277-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qlxz4\" (UID: \"fdd4c249-fda4-4507-bf19-31eb55553277\") " pod="openshift-insights/insights-runtime-extractor-qlxz4"
Sep 08 11:31:49.154094 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:49.154064    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-cbhsg" event={"ID":"fa5f78a4-5774-44c5-8e7e-5786eddd5dc8","Type":"ContainerStarted","Data":"927ffb1e7f46081aa288967ec3da9fbbda95650833412127135cfd3e841f6a34"}
Sep 08 11:31:49.254034 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:49.253981    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fdd4c249-fda4-4507-bf19-31eb55553277-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qlxz4\" (UID: \"fdd4c249-fda4-4507-bf19-31eb55553277\") " pod="openshift-insights/insights-runtime-extractor-qlxz4"
Sep 08 11:31:49.254209 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:49.254108    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fdd4c249-fda4-4507-bf19-31eb55553277-crio-socket\") pod \"insights-runtime-extractor-qlxz4\" (UID: \"fdd4c249-fda4-4507-bf19-31eb55553277\") " pod="openshift-insights/insights-runtime-extractor-qlxz4"
Sep 08 11:31:49.254209 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:49.254139    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fdd4c249-fda4-4507-bf19-31eb55553277-data-volume\") pod \"insights-runtime-extractor-qlxz4\" (UID: \"fdd4c249-fda4-4507-bf19-31eb55553277\") " pod="openshift-insights/insights-runtime-extractor-qlxz4"
Sep 08 11:31:49.254209 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:49.254148    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 11:31:49.254209 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:49.254182    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fdd4c249-fda4-4507-bf19-31eb55553277-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qlxz4\" (UID: \"fdd4c249-fda4-4507-bf19-31eb55553277\") " pod="openshift-insights/insights-runtime-extractor-qlxz4"
Sep 08 11:31:49.254421 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:49.254230    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdd4c249-fda4-4507-bf19-31eb55553277-insights-runtime-extractor-tls podName:fdd4c249-fda4-4507-bf19-31eb55553277 nodeName:}" failed. No retries permitted until 2026-09-08 11:31:49.754206477 +0000 UTC m=+84.405913268 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fdd4c249-fda4-4507-bf19-31eb55553277-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qlxz4" (UID: "fdd4c249-fda4-4507-bf19-31eb55553277") : secret "insights-runtime-extractor-tls" not found
Sep 08 11:31:49.254421 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:49.254259    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 11:31:49.254421 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:49.254257    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fdd4c249-fda4-4507-bf19-31eb55553277-crio-socket\") pod \"insights-runtime-extractor-qlxz4\" (UID: \"fdd4c249-fda4-4507-bf19-31eb55553277\") " pod="openshift-insights/insights-runtime-extractor-qlxz4"
Sep 08 11:31:49.254421 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:49.254300    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7wqw\" (UniqueName: \"kubernetes.io/projected/fdd4c249-fda4-4507-bf19-31eb55553277-kube-api-access-n7wqw\") pod \"insights-runtime-extractor-qlxz4\" (UID: \"fdd4c249-fda4-4507-bf19-31eb55553277\") " pod="openshift-insights/insights-runtime-extractor-qlxz4"
Sep 08 11:31:49.254421 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:49.254313    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fdd4c249-fda4-4507-bf19-31eb55553277-kube-rbac-proxy-cm podName:fdd4c249-fda4-4507-bf19-31eb55553277 nodeName:}" failed. No retries permitted until 2026-09-08 11:31:49.754296926 +0000 UTC m=+84.406003715 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fdd4c249-fda4-4507-bf19-31eb55553277-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qlxz4" (UID: "fdd4c249-fda4-4507-bf19-31eb55553277") : configmap "kube-rbac-proxy" not found
Sep 08 11:31:49.254727 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:49.254559    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fdd4c249-fda4-4507-bf19-31eb55553277-data-volume\") pod \"insights-runtime-extractor-qlxz4\" (UID: \"fdd4c249-fda4-4507-bf19-31eb55553277\") " pod="openshift-insights/insights-runtime-extractor-qlxz4"
Sep 08 11:31:49.265111 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:49.265081    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7wqw\" (UniqueName: \"kubernetes.io/projected/fdd4c249-fda4-4507-bf19-31eb55553277-kube-api-access-n7wqw\") pod \"insights-runtime-extractor-qlxz4\" (UID: \"fdd4c249-fda4-4507-bf19-31eb55553277\") " pod="openshift-insights/insights-runtime-extractor-qlxz4"
Sep 08 11:31:49.758645 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:49.758606    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fdd4c249-fda4-4507-bf19-31eb55553277-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qlxz4\" (UID: \"fdd4c249-fda4-4507-bf19-31eb55553277\") " pod="openshift-insights/insights-runtime-extractor-qlxz4"
Sep 08 11:31:49.758853 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:49.758725    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fdd4c249-fda4-4507-bf19-31eb55553277-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qlxz4\" (UID: \"fdd4c249-fda4-4507-bf19-31eb55553277\") " pod="openshift-insights/insights-runtime-extractor-qlxz4"
Sep 08 11:31:49.758853 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:49.758768    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 11:31:49.758853 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:49.758832    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdd4c249-fda4-4507-bf19-31eb55553277-insights-runtime-extractor-tls podName:fdd4c249-fda4-4507-bf19-31eb55553277 nodeName:}" failed. No retries permitted until 2026-09-08 11:31:50.758817045 +0000 UTC m=+85.410523817 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fdd4c249-fda4-4507-bf19-31eb55553277-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qlxz4" (UID: "fdd4c249-fda4-4507-bf19-31eb55553277") : secret "insights-runtime-extractor-tls" not found
Sep 08 11:31:49.758853 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:49.758839    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 11:31:49.759027 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:49.758889    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fdd4c249-fda4-4507-bf19-31eb55553277-kube-rbac-proxy-cm podName:fdd4c249-fda4-4507-bf19-31eb55553277 nodeName:}" failed. No retries permitted until 2026-09-08 11:31:50.758876924 +0000 UTC m=+85.410583695 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fdd4c249-fda4-4507-bf19-31eb55553277-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qlxz4" (UID: "fdd4c249-fda4-4507-bf19-31eb55553277") : configmap "kube-rbac-proxy" not found
Sep 08 11:31:50.159564 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:50.159530    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-cbhsg" event={"ID":"fa5f78a4-5774-44c5-8e7e-5786eddd5dc8","Type":"ContainerStarted","Data":"eda277303c2006832b1715447c5996544c83cda25ba1e33a82669eaa2a7ccf73"}
Sep 08 11:31:50.159956 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:50.159583    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-cbhsg" event={"ID":"fa5f78a4-5774-44c5-8e7e-5786eddd5dc8","Type":"ContainerStarted","Data":"63c4c10fc60fb29938979ac4a5ff9cc865d49d542a4af502a063fae05121afb1"}
Sep 08 11:31:50.179261 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:50.179213    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-cbhsg" podStartSLOduration=2.005261564 podStartE2EDuration="3.179195094s" totalImagesPullingTime="1.17393353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:31:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:31:50.178643312 +0000 UTC m=+84.830350106" watchObservedRunningTime="2026-09-08 11:31:50.179195094 +0000 UTC m=+84.830901888"
Sep 08 11:31:50.766554 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:50.766501    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fdd4c249-fda4-4507-bf19-31eb55553277-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qlxz4\" (UID: \"fdd4c249-fda4-4507-bf19-31eb55553277\") " pod="openshift-insights/insights-runtime-extractor-qlxz4"
Sep 08 11:31:50.766740 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:50.766584    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fdd4c249-fda4-4507-bf19-31eb55553277-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qlxz4\" (UID: \"fdd4c249-fda4-4507-bf19-31eb55553277\") " pod="openshift-insights/insights-runtime-extractor-qlxz4"
Sep 08 11:31:50.766740 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:50.766632    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 11:31:50.766740 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:50.766700    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fdd4c249-fda4-4507-bf19-31eb55553277-kube-rbac-proxy-cm podName:fdd4c249-fda4-4507-bf19-31eb55553277 nodeName:}" failed. No retries permitted until 2026-09-08 11:31:52.766685349 +0000 UTC m=+87.418392135 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fdd4c249-fda4-4507-bf19-31eb55553277-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qlxz4" (UID: "fdd4c249-fda4-4507-bf19-31eb55553277") : configmap "kube-rbac-proxy" not found
Sep 08 11:31:50.766740 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:50.766729    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 11:31:50.766875 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:50.766779    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdd4c249-fda4-4507-bf19-31eb55553277-insights-runtime-extractor-tls podName:fdd4c249-fda4-4507-bf19-31eb55553277 nodeName:}" failed. No retries permitted until 2026-09-08 11:31:52.76676633 +0000 UTC m=+87.418473101 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fdd4c249-fda4-4507-bf19-31eb55553277-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qlxz4" (UID: "fdd4c249-fda4-4507-bf19-31eb55553277") : secret "insights-runtime-extractor-tls" not found
Sep 08 11:31:51.170615 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:51.170577    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e106802e-8a43-4870-92a4-08741f4e05d2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-fphh6\" (UID: \"e106802e-8a43-4870-92a4-08741f4e05d2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-fphh6"
Sep 08 11:31:51.170971 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:51.170731    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 11:31:51.170971 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:51.170794    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e106802e-8a43-4870-92a4-08741f4e05d2-cluster-monitoring-operator-tls podName:e106802e-8a43-4870-92a4-08741f4e05d2 nodeName:}" failed. No retries permitted until 2026-09-08 11:31:59.170779416 +0000 UTC m=+93.822486188 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e106802e-8a43-4870-92a4-08741f4e05d2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-fphh6" (UID: "e106802e-8a43-4870-92a4-08741f4e05d2") : secret "cluster-monitoring-operator-tls" not found
Sep 08 11:31:51.271099 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:51.271052    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-jgtlq\" (UID: \"d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-jgtlq"
Sep 08 11:31:51.271274 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:51.271133    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2713c4e2-3d07-454f-a92f-9f75689d226d-metrics-certs\") pod \"router-default-78d7dd88d4-wjvdt\" (UID: \"2713c4e2-3d07-454f-a92f-9f75689d226d\") " pod="openshift-ingress/router-default-78d7dd88d4-wjvdt"
Sep 08 11:31:51.271274 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:51.271183    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2713c4e2-3d07-454f-a92f-9f75689d226d-service-ca-bundle\") pod \"router-default-78d7dd88d4-wjvdt\" (UID: \"2713c4e2-3d07-454f-a92f-9f75689d226d\") " pod="openshift-ingress/router-default-78d7dd88d4-wjvdt"
Sep 08 11:31:51.271274 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:51.271211    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 11:31:51.271403 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:51.271279    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea-samples-operator-tls podName:d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea nodeName:}" failed. No retries permitted until 2026-09-08 11:31:59.271260208 +0000 UTC m=+93.922967000 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-jgtlq" (UID: "d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea") : secret "samples-operator-tls" not found
Sep 08 11:31:51.271403 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:51.271276    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 11:31:51.271403 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:51.271330    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2713c4e2-3d07-454f-a92f-9f75689d226d-service-ca-bundle podName:2713c4e2-3d07-454f-a92f-9f75689d226d nodeName:}" failed. No retries permitted until 2026-09-08 11:31:59.271310781 +0000 UTC m=+93.923017577 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2713c4e2-3d07-454f-a92f-9f75689d226d-service-ca-bundle") pod "router-default-78d7dd88d4-wjvdt" (UID: "2713c4e2-3d07-454f-a92f-9f75689d226d") : configmap references non-existent config key: service-ca.crt
Sep 08 11:31:51.271403 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:51.271378    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2713c4e2-3d07-454f-a92f-9f75689d226d-metrics-certs podName:2713c4e2-3d07-454f-a92f-9f75689d226d nodeName:}" failed. No retries permitted until 2026-09-08 11:31:59.271367269 +0000 UTC m=+93.923074042 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2713c4e2-3d07-454f-a92f-9f75689d226d-metrics-certs") pod "router-default-78d7dd88d4-wjvdt" (UID: "2713c4e2-3d07-454f-a92f-9f75689d226d") : secret "router-metrics-certs-default" not found
Sep 08 11:31:51.830520 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:51.830495    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cf287_51e41bf2-8be4-48a7-a3e7-6d17b4566f97/dns-node-resolver/0.log"
Sep 08 11:31:52.782919 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:52.782873    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fdd4c249-fda4-4507-bf19-31eb55553277-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qlxz4\" (UID: \"fdd4c249-fda4-4507-bf19-31eb55553277\") " pod="openshift-insights/insights-runtime-extractor-qlxz4"
Sep 08 11:31:52.783402 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:52.782986    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fdd4c249-fda4-4507-bf19-31eb55553277-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qlxz4\" (UID: \"fdd4c249-fda4-4507-bf19-31eb55553277\") " pod="openshift-insights/insights-runtime-extractor-qlxz4"
Sep 08 11:31:52.783402 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:52.783031    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 11:31:52.783402 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:52.783072    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 11:31:52.783402 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:52.783108    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdd4c249-fda4-4507-bf19-31eb55553277-insights-runtime-extractor-tls podName:fdd4c249-fda4-4507-bf19-31eb55553277 nodeName:}" failed. No retries permitted until 2026-09-08 11:31:56.783092968 +0000 UTC m=+91.434799740 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fdd4c249-fda4-4507-bf19-31eb55553277-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qlxz4" (UID: "fdd4c249-fda4-4507-bf19-31eb55553277") : secret "insights-runtime-extractor-tls" not found
Sep 08 11:31:52.783402 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:52.783130    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fdd4c249-fda4-4507-bf19-31eb55553277-kube-rbac-proxy-cm podName:fdd4c249-fda4-4507-bf19-31eb55553277 nodeName:}" failed. No retries permitted until 2026-09-08 11:31:56.783114598 +0000 UTC m=+91.434821370 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fdd4c249-fda4-4507-bf19-31eb55553277-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qlxz4" (UID: "fdd4c249-fda4-4507-bf19-31eb55553277") : configmap "kube-rbac-proxy" not found
Sep 08 11:31:52.830802 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:52.830775    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bhshk_598d45ef-a4d2-4d2a-b318-c3898319833a/node-ca/0.log"
Sep 08 11:31:53.830316 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:53.830291    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tf7sb_de1e135a-bd8c-4e20-be89-f7a2a2cbf98e/serve-healthcheck-canary/0.log"
Sep 08 11:31:54.033778 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:54.033744    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-cbhsg_fa5f78a4-5774-44c5-8e7e-5786eddd5dc8/migrator/0.log"
Sep 08 11:31:54.230420 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:54.230333    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-cbhsg_fa5f78a4-5774-44c5-8e7e-5786eddd5dc8/graceful-termination/0.log"
Sep 08 11:31:54.431386 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:54.431357    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-2hc2h_7b6421d4-66bb-466a-b4fa-0d57d75e6d46/kube-storage-version-migrator-operator/0.log"
Sep 08 11:31:56.817598 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:56.817553    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fdd4c249-fda4-4507-bf19-31eb55553277-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qlxz4\" (UID: \"fdd4c249-fda4-4507-bf19-31eb55553277\") " pod="openshift-insights/insights-runtime-extractor-qlxz4"
Sep 08 11:31:56.818024 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:56.817633    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fdd4c249-fda4-4507-bf19-31eb55553277-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qlxz4\" (UID: \"fdd4c249-fda4-4507-bf19-31eb55553277\") " pod="openshift-insights/insights-runtime-extractor-qlxz4"
Sep 08 11:31:56.818024 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:56.817678    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 11:31:56.818024 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:56.817764    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 11:31:56.818024 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:56.817767    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fdd4c249-fda4-4507-bf19-31eb55553277-kube-rbac-proxy-cm podName:fdd4c249-fda4-4507-bf19-31eb55553277 nodeName:}" failed. No retries permitted until 2026-09-08 11:32:04.817748733 +0000 UTC m=+99.469455524 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fdd4c249-fda4-4507-bf19-31eb55553277-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qlxz4" (UID: "fdd4c249-fda4-4507-bf19-31eb55553277") : configmap "kube-rbac-proxy" not found
Sep 08 11:31:56.818024 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:56.817825    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdd4c249-fda4-4507-bf19-31eb55553277-insights-runtime-extractor-tls podName:fdd4c249-fda4-4507-bf19-31eb55553277 nodeName:}" failed. No retries permitted until 2026-09-08 11:32:04.817811869 +0000 UTC m=+99.469518641 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fdd4c249-fda4-4507-bf19-31eb55553277-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qlxz4" (UID: "fdd4c249-fda4-4507-bf19-31eb55553277") : secret "insights-runtime-extractor-tls" not found
Sep 08 11:31:59.237685 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:59.237642    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e106802e-8a43-4870-92a4-08741f4e05d2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-fphh6\" (UID: \"e106802e-8a43-4870-92a4-08741f4e05d2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-fphh6"
Sep 08 11:31:59.238086 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:59.237790    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 11:31:59.238086 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:59.237854    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e106802e-8a43-4870-92a4-08741f4e05d2-cluster-monitoring-operator-tls podName:e106802e-8a43-4870-92a4-08741f4e05d2 nodeName:}" failed. No retries permitted until 2026-09-08 11:32:15.237839264 +0000 UTC m=+109.889546035 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e106802e-8a43-4870-92a4-08741f4e05d2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-fphh6" (UID: "e106802e-8a43-4870-92a4-08741f4e05d2") : secret "cluster-monitoring-operator-tls" not found
Sep 08 11:31:59.339974 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:59.339937    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-jgtlq\" (UID: \"d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-jgtlq"
Sep 08 11:31:59.340135 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:59.340014    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2713c4e2-3d07-454f-a92f-9f75689d226d-metrics-certs\") pod \"router-default-78d7dd88d4-wjvdt\" (UID: \"2713c4e2-3d07-454f-a92f-9f75689d226d\") " pod="openshift-ingress/router-default-78d7dd88d4-wjvdt"
Sep 08 11:31:59.340135 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:59.340047    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2713c4e2-3d07-454f-a92f-9f75689d226d-service-ca-bundle\") pod \"router-default-78d7dd88d4-wjvdt\" (UID: \"2713c4e2-3d07-454f-a92f-9f75689d226d\") " pod="openshift-ingress/router-default-78d7dd88d4-wjvdt"
Sep 08 11:31:59.340205 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:31:59.340181    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2713c4e2-3d07-454f-a92f-9f75689d226d-service-ca-bundle podName:2713c4e2-3d07-454f-a92f-9f75689d226d nodeName:}" failed. No retries permitted until 2026-09-08 11:32:15.340167901 +0000 UTC m=+109.991874686 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2713c4e2-3d07-454f-a92f-9f75689d226d-service-ca-bundle") pod "router-default-78d7dd88d4-wjvdt" (UID: "2713c4e2-3d07-454f-a92f-9f75689d226d") : configmap references non-existent config key: service-ca.crt
Sep 08 11:31:59.342616 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:59.342593    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2713c4e2-3d07-454f-a92f-9f75689d226d-metrics-certs\") pod \"router-default-78d7dd88d4-wjvdt\" (UID: \"2713c4e2-3d07-454f-a92f-9f75689d226d\") " pod="openshift-ingress/router-default-78d7dd88d4-wjvdt"
Sep 08 11:31:59.342732 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:59.342619    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-jgtlq\" (UID: \"d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-jgtlq"
Sep 08 11:31:59.418746 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:59.418709    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-jgtlq"
Sep 08 11:31:59.692690 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:31:59.692535    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-jgtlq"]
Sep 08 11:32:00.193784 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:00.193753    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-jgtlq" event={"ID":"d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea","Type":"ContainerStarted","Data":"92147ca86d2bd5f4f700f5c2809d0b224e0a9d29b763121ba2f7f6a70600539a"}
Sep 08 11:32:02.202507 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:02.202472    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-jgtlq" event={"ID":"d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea","Type":"ContainerStarted","Data":"218a9287a1bc6eb588ee6aea38b5d05eb0fac6d9798af770c969272c7eebb3df"}
Sep 08 11:32:02.202910 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:02.202529    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-jgtlq" event={"ID":"d6762fe6-6ca0-4a91-99c3-9a3ac4ce3fea","Type":"ContainerStarted","Data":"7ed559792755b0bc8ebd2d5d0abb332ad01b875fcf71f1c42a10d28cd2aa5f22"}
Sep 08 11:32:03.576138 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:03.576101    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6fc3823-83c6-4d67-9068-48bff3a5b3ed-metrics-tls\") pod \"dns-default-sdbbl\" (UID: \"c6fc3823-83c6-4d67-9068-48bff3a5b3ed\") " pod="openshift-dns/dns-default-sdbbl"
Sep 08 11:32:03.578532 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:03.578512    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6fc3823-83c6-4d67-9068-48bff3a5b3ed-metrics-tls\") pod \"dns-default-sdbbl\" (UID: \"c6fc3823-83c6-4d67-9068-48bff3a5b3ed\") " pod="openshift-dns/dns-default-sdbbl"
Sep 08 11:32:03.590324 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:03.590300    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2v99l\""
Sep 08 11:32:03.598383 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:03.598365    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sdbbl"
Sep 08 11:32:03.868467 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:03.868380    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-jgtlq" podStartSLOduration=19.127325907 podStartE2EDuration="20.868362029s" totalImagesPullingTime="1.741036122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:31:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:32:02.226575039 +0000 UTC m=+96.878281834" watchObservedRunningTime="2026-09-08 11:32:03.868362029 +0000 UTC m=+98.520068823"
Sep 08 11:32:03.869352 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:03.869317    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sdbbl"]
Sep 08 11:32:03.871637 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:32:03.871616    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6fc3823_83c6_4d67_9068_48bff3a5b3ed.slice/crio-ae699ca43f4058603760e3299f958571ce31f19723ced17ee2031400601d6750 WatchSource:0}: Error finding container ae699ca43f4058603760e3299f958571ce31f19723ced17ee2031400601d6750: Status 404 returned error can't find the container with id ae699ca43f4058603760e3299f958571ce31f19723ced17ee2031400601d6750
Sep 08 11:32:04.209684 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:04.209653    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sdbbl" event={"ID":"c6fc3823-83c6-4d67-9068-48bff3a5b3ed","Type":"ContainerStarted","Data":"ae699ca43f4058603760e3299f958571ce31f19723ced17ee2031400601d6750"}
Sep 08 11:32:04.889175 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:04.889136    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fdd4c249-fda4-4507-bf19-31eb55553277-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qlxz4\" (UID: \"fdd4c249-fda4-4507-bf19-31eb55553277\") " pod="openshift-insights/insights-runtime-extractor-qlxz4"
Sep 08 11:32:04.889686 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:04.889207    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fdd4c249-fda4-4507-bf19-31eb55553277-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qlxz4\" (UID: \"fdd4c249-fda4-4507-bf19-31eb55553277\") " pod="openshift-insights/insights-runtime-extractor-qlxz4"
Sep 08 11:32:04.889860 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:04.889835    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fdd4c249-fda4-4507-bf19-31eb55553277-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qlxz4\" (UID: \"fdd4c249-fda4-4507-bf19-31eb55553277\") " pod="openshift-insights/insights-runtime-extractor-qlxz4"
Sep 08 11:32:04.891851 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:04.891831    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fdd4c249-fda4-4507-bf19-31eb55553277-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qlxz4\" (UID: \"fdd4c249-fda4-4507-bf19-31eb55553277\") " pod="openshift-insights/insights-runtime-extractor-qlxz4"
Sep 08 11:32:05.001445 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:05.001412    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qlxz4"
Sep 08 11:32:05.281191 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:05.281156    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qlxz4"]
Sep 08 11:32:05.661594 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:32:05.661503    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdd4c249_fda4_4507_bf19_31eb55553277.slice/crio-67b1916fa4159d17141be3d187e8482a79bad7045e7fce64c077161918fbe7e4 WatchSource:0}: Error finding container 67b1916fa4159d17141be3d187e8482a79bad7045e7fce64c077161918fbe7e4: Status 404 returned error can't find the container with id 67b1916fa4159d17141be3d187e8482a79bad7045e7fce64c077161918fbe7e4
Sep 08 11:32:06.218013 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:06.217967    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sdbbl" event={"ID":"c6fc3823-83c6-4d67-9068-48bff3a5b3ed","Type":"ContainerStarted","Data":"6e6788df3c05e88f5544c134adee62520a87f8dd3266e036c0295ed51f7bf515"}
Sep 08 11:32:06.220570 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:06.220465    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qlxz4" event={"ID":"fdd4c249-fda4-4507-bf19-31eb55553277","Type":"ContainerStarted","Data":"d275f9278eeb5bf47d8aebd056cddee3ac795f2ea631334c3bedf914b2bae078"}
Sep 08 11:32:06.220570 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:06.220523    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qlxz4" event={"ID":"fdd4c249-fda4-4507-bf19-31eb55553277","Type":"ContainerStarted","Data":"67b1916fa4159d17141be3d187e8482a79bad7045e7fce64c077161918fbe7e4"}
Sep 08 11:32:07.119473 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:07.119401    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-m5x5z"
Sep 08 11:32:07.225301 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:07.225267    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sdbbl" event={"ID":"c6fc3823-83c6-4d67-9068-48bff3a5b3ed","Type":"ContainerStarted","Data":"e28e9101ea41da24ab9cb7e9bba9946a83fcc8c1fe05bbc4a32c573e291ff53b"}
Sep 08 11:32:07.225761 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:07.225379    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sdbbl"
Sep 08 11:32:07.227165 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:07.227142    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qlxz4" event={"ID":"fdd4c249-fda4-4507-bf19-31eb55553277","Type":"ContainerStarted","Data":"4ffe74a43f432ed64d14b81db1ab855ff64a63a6018e117758adeb460c850452"}
Sep 08 11:32:07.244759 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:07.244708    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-sdbbl" podStartSLOduration=66.097687704 podStartE2EDuration="1m8.24469182s" totalImagesPullingTime="2.147004116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:30:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:32:07.244361079 +0000 UTC m=+101.896067876" watchObservedRunningTime="2026-09-08 11:32:07.24469182 +0000 UTC m=+101.896398612"
Sep 08 11:32:10.238194 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:10.238157    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qlxz4" event={"ID":"fdd4c249-fda4-4507-bf19-31eb55553277","Type":"ContainerStarted","Data":"75c4da57d529adec507809d1e0c52919378ad9628f9b89180702b8a45e07f3b5"}
Sep 08 11:32:15.270822 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:15.270769    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e106802e-8a43-4870-92a4-08741f4e05d2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-fphh6\" (UID: \"e106802e-8a43-4870-92a4-08741f4e05d2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-fphh6"
Sep 08 11:32:15.273567 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:15.273530    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e106802e-8a43-4870-92a4-08741f4e05d2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-fphh6\" (UID: \"e106802e-8a43-4870-92a4-08741f4e05d2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-fphh6"
Sep 08 11:32:15.371786 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:15.371733    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2713c4e2-3d07-454f-a92f-9f75689d226d-service-ca-bundle\") pod \"router-default-78d7dd88d4-wjvdt\" (UID: \"2713c4e2-3d07-454f-a92f-9f75689d226d\") " pod="openshift-ingress/router-default-78d7dd88d4-wjvdt"
Sep 08 11:32:15.372373 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:15.372327    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2713c4e2-3d07-454f-a92f-9f75689d226d-service-ca-bundle\") pod \"router-default-78d7dd88d4-wjvdt\" (UID: \"2713c4e2-3d07-454f-a92f-9f75689d226d\") " pod="openshift-ingress/router-default-78d7dd88d4-wjvdt"
Sep 08 11:32:15.503775 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:15.503729    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-fphh6"
Sep 08 11:32:15.624196 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:15.624162    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-78d7dd88d4-wjvdt"
Sep 08 11:32:15.777929 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:15.777878    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qlxz4" podStartSLOduration=23.291854533 podStartE2EDuration="26.777860446s" totalImagesPullingTime="3.486005913s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 11:31:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:32:10.266460659 +0000 UTC m=+104.918167454" watchObservedRunningTime="2026-09-08 11:32:15.777860446 +0000 UTC m=+110.429567240"
Sep 08 11:32:15.778814 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:15.778780    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-fphh6"]
Sep 08 11:32:15.782128 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:32:15.782096    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode106802e_8a43_4870_92a4_08741f4e05d2.slice/crio-c923591e8ddb5eecbf311f3cd67e037600ec84914a4a5f38b95473cf4f89c4d2 WatchSource:0}: Error finding container c923591e8ddb5eecbf311f3cd67e037600ec84914a4a5f38b95473cf4f89c4d2: Status 404 returned error can't find the container with id c923591e8ddb5eecbf311f3cd67e037600ec84914a4a5f38b95473cf4f89c4d2
Sep 08 11:32:15.903461 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:15.903375    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-78d7dd88d4-wjvdt"]
Sep 08 11:32:15.906060 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:32:15.906027    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2713c4e2_3d07_454f_a92f_9f75689d226d.slice/crio-73964cee212eadc23c31525362d6fd483bae0e9f18818c08a6772743ec45da6b WatchSource:0}: Error finding container 73964cee212eadc23c31525362d6fd483bae0e9f18818c08a6772743ec45da6b: Status 404 returned error can't find the container with id 73964cee212eadc23c31525362d6fd483bae0e9f18818c08a6772743ec45da6b
Sep 08 11:32:16.055575 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:16.055538    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-64f5c77786-bqrll"]
Sep 08 11:32:16.057532 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:16.057510    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64f5c77786-bqrll"
Sep 08 11:32:16.060111 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:16.060091    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-59gmm\""
Sep 08 11:32:16.060386 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:16.060334    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 08 11:32:16.060489 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:16.060390    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 08 11:32:16.060489 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:16.060416    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 08 11:32:16.065536 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:16.065514    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 08 11:32:16.071625 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:16.071603    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64f5c77786-bqrll"]
Sep 08 11:32:16.178424 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:16.178329    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e57c960d-1c0a-4c27-865b-ccd85df5fdb1-trusted-ca\") pod \"image-registry-64f5c77786-bqrll\" (UID: \"e57c960d-1c0a-4c27-865b-ccd85df5fdb1\") " pod="openshift-image-registry/image-registry-64f5c77786-bqrll"
Sep 08 11:32:16.178424 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:16.178412    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e57c960d-1c0a-4c27-865b-ccd85df5fdb1-ca-trust-extracted\") pod \"image-registry-64f5c77786-bqrll\" (UID: \"e57c960d-1c0a-4c27-865b-ccd85df5fdb1\") " pod="openshift-image-registry/image-registry-64f5c77786-bqrll"
Sep 08 11:32:16.178612 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:16.178448    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e57c960d-1c0a-4c27-865b-ccd85df5fdb1-registry-tls\") pod \"image-registry-64f5c77786-bqrll\" (UID: \"e57c960d-1c0a-4c27-865b-ccd85df5fdb1\") " pod="openshift-image-registry/image-registry-64f5c77786-bqrll"
Sep 08 11:32:16.178612 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:16.178471    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lb9gc\" (UniqueName: \"kubernetes.io/projected/e57c960d-1c0a-4c27-865b-ccd85df5fdb1-kube-api-access-lb9gc\") pod \"image-registry-64f5c77786-bqrll\" (UID: \"e57c960d-1c0a-4c27-865b-ccd85df5fdb1\") " pod="openshift-image-registry/image-registry-64f5c77786-bqrll"
Sep 08 11:32:16.178612 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:16.178510    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e57c960d-1c0a-4c27-865b-ccd85df5fdb1-image-registry-private-configuration\") pod \"image-registry-64f5c77786-bqrll\" (UID: \"e57c960d-1c0a-4c27-865b-ccd85df5fdb1\") " pod="openshift-image-registry/image-registry-64f5c77786-bqrll"
Sep 08 11:32:16.178612 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:16.178585    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e57c960d-1c0a-4c27-865b-ccd85df5fdb1-bound-sa-token\") pod \"image-registry-64f5c77786-bqrll\" (UID: \"e57c960d-1c0a-4c27-865b-ccd85df5fdb1\") " pod="openshift-image-registry/image-registry-64f5c77786-bqrll"
Sep 08 11:32:16.178762 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:16.178619    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e57c960d-1c0a-4c27-865b-ccd85df5fdb1-registry-certificates\") pod \"image-registry-64f5c77786-bqrll\" (UID: \"e57c960d-1c0a-4c27-865b-ccd85df5fdb1\") " pod="openshift-image-registry/image-registry-64f5c77786-bqrll"
Sep 08 11:32:16.178762 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:16.178637    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e57c960d-1c0a-4c27-865b-ccd85df5fdb1-installation-pull-secrets\") pod \"image-registry-64f5c77786-bqrll\" (UID: \"e57c960d-1c0a-4c27-865b-ccd85df5fdb1\") " pod="openshift-image-registry/image-registry-64f5c77786-bqrll"
Sep 08 11:32:16.257021 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:16.256985    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-fphh6" event={"ID":"e106802e-8a43-4870-92a4-08741f4e05d2","Type":"ContainerStarted","Data":"c923591e8ddb5eecbf311f3cd67e037600ec84914a4a5f38b95473cf4f89c4d2"}
Sep 08 11:32:16.258351 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:16.258309    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-78d7dd88d4-wjvdt" event={"ID":"2713c4e2-3d07-454f-a92f-9f75689d226d","Type":"ContainerStarted","Data":"935cc5f2fdda6bdbcc02e3ba1d0efcb743d596bf497d65e38d9c9ce86b985f81"}
Sep 08 11:32:16.258458 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:16.258363    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-78d7dd88d4-wjvdt" event={"ID":"2713c4e2-3d07-454f-a92f-9f75689d226d","Type":"ContainerStarted","Data":"73964cee212eadc23c31525362d6fd483bae0e9f18818c08a6772743ec45da6b"}
Sep 08 11:32:16.279599 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:16.279550    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-78d7dd88d4-wjvdt" podStartSLOduration=33.279534732 podStartE2EDuration="33.279534732s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:31:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:32:16.278241479 +0000 UTC m=+110.929948295" watchObservedRunningTime="2026-09-08 11:32:16.279534732 +0000 UTC m=+110.931241518"
Sep 08 11:32:16.279999 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:16.279832    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e57c960d-1c0a-4c27-865b-ccd85df5fdb1-image-registry-private-configuration\") pod \"image-registry-64f5c77786-bqrll\" (UID: \"e57c960d-1c0a-4c27-865b-ccd85df5fdb1\") " pod="openshift-image-registry/image-registry-64f5c77786-bqrll"
Sep 08 11:32:16.279999 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:16.279861    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e57c960d-1c0a-4c27-865b-ccd85df5fdb1-bound-sa-token\") pod \"image-registry-64f5c77786-bqrll\" (UID: \"e57c960d-1c0a-4c27-865b-ccd85df5fdb1\") " pod="openshift-image-registry/image-registry-64f5c77786-bqrll"
Sep 08 11:32:16.279999 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:16.279985    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e57c960d-1c0a-4c27-865b-ccd85df5fdb1-registry-certificates\") pod \"image-registry-64f5c77786-bqrll\" (UID: \"e57c960d-1c0a-4c27-865b-ccd85df5fdb1\") " pod="openshift-image-registry/image-registry-64f5c77786-bqrll"
Sep 08 11:32:16.280153 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:16.280013    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e57c960d-1c0a-4c27-865b-ccd85df5fdb1-installation-pull-secrets\") pod \"image-registry-64f5c77786-bqrll\" (UID: \"e57c960d-1c0a-4c27-865b-ccd85df5fdb1\") " pod="openshift-image-registry/image-registry-64f5c77786-bqrll"
Sep 08 11:32:16.280153 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:16.280061    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e57c960d-1c0a-4c27-865b-ccd85df5fdb1-trusted-ca\") pod \"image-registry-64f5c77786-bqrll\" (UID: \"e57c960d-1c0a-4c27-865b-ccd85df5fdb1\") " pod="openshift-image-registry/image-registry-64f5c77786-bqrll"
Sep 08 11:32:16.280153 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:16.280096    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e57c960d-1c0a-4c27-865b-ccd85df5fdb1-ca-trust-extracted\") pod \"image-registry-64f5c77786-bqrll\" (UID: \"e57c960d-1c0a-4c27-865b-ccd85df5fdb1\") " pod="openshift-image-registry/image-registry-64f5c77786-bqrll"
Sep 08 11:32:16.280153 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:16.280132    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e57c960d-1c0a-4c27-865b-ccd85df5fdb1-registry-tls\") pod \"image-registry-64f5c77786-bqrll\" (UID: \"e57c960d-1c0a-4c27-865b-ccd85df5fdb1\") " pod="openshift-image-registry/image-registry-64f5c77786-bqrll"
Sep 08 11:32:16.280378 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:16.280158    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lb9gc\" (UniqueName: \"kubernetes.io/projected/e57c960d-1c0a-4c27-865b-ccd85df5fdb1-kube-api-access-lb9gc\") pod \"image-registry-64f5c77786-bqrll\" (UID: \"e57c960d-1c0a-4c27-865b-ccd85df5fdb1\") " pod="openshift-image-registry/image-registry-64f5c77786-bqrll"
Sep 08 11:32:16.280581 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:16.280537    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e57c960d-1c0a-4c27-865b-ccd85df5fdb1-ca-trust-extracted\") pod \"image-registry-64f5c77786-bqrll\" (UID: \"e57c960d-1c0a-4c27-865b-ccd85df5fdb1\") " pod="openshift-image-registry/image-registry-64f5c77786-bqrll"
Sep 08 11:32:16.281117 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:16.281094    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e57c960d-1c0a-4c27-865b-ccd85df5fdb1-registry-certificates\") pod \"image-registry-64f5c77786-bqrll\" (UID: \"e57c960d-1c0a-4c27-865b-ccd85df5fdb1\") " pod="openshift-image-registry/image-registry-64f5c77786-bqrll"
Sep 08 11:32:16.281203 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:16.281182    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e57c960d-1c0a-4c27-865b-ccd85df5fdb1-trusted-ca\") pod \"image-registry-64f5c77786-bqrll\" (UID: \"e57c960d-1c0a-4c27-865b-ccd85df5fdb1\") " pod="openshift-image-registry/image-registry-64f5c77786-bqrll"
Sep 08 11:32:16.282434 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:16.282412    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e57c960d-1c0a-4c27-865b-ccd85df5fdb1-image-registry-private-configuration\") pod \"image-registry-64f5c77786-bqrll\" (UID: \"e57c960d-1c0a-4c27-865b-ccd85df5fdb1\") " pod="openshift-image-registry/image-registry-64f5c77786-bqrll"
Sep 08 11:32:16.282594 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:16.282576    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e57c960d-1c0a-4c27-865b-ccd85df5fdb1-installation-pull-secrets\") pod \"image-registry-64f5c77786-bqrll\" (UID: \"e57c960d-1c0a-4c27-865b-ccd85df5fdb1\") " pod="openshift-image-registry/image-registry-64f5c77786-bqrll"
Sep 08 11:32:16.282866 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:16.282845    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e57c960d-1c0a-4c27-865b-ccd85df5fdb1-registry-tls\") pod \"image-registry-64f5c77786-bqrll\" (UID: \"e57c960d-1c0a-4c27-865b-ccd85df5fdb1\") " pod="openshift-image-registry/image-registry-64f5c77786-bqrll"
Sep 08 11:32:16.294307 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:16.294283    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e57c960d-1c0a-4c27-865b-ccd85df5fdb1-bound-sa-token\") pod \"image-registry-64f5c77786-bqrll\" (UID: \"e57c960d-1c0a-4c27-865b-ccd85df5fdb1\") " pod="openshift-image-registry/image-registry-64f5c77786-bqrll"
Sep 08 11:32:16.294504 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:16.294485    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lb9gc\" (UniqueName: \"kubernetes.io/projected/e57c960d-1c0a-4c27-865b-ccd85df5fdb1-kube-api-access-lb9gc\") pod \"image-registry-64f5c77786-bqrll\" (UID: \"e57c960d-1c0a-4c27-865b-ccd85df5fdb1\") " pod="openshift-image-registry/image-registry-64f5c77786-bqrll"
Sep 08 11:32:16.366952 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:16.366922    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64f5c77786-bqrll"
Sep 08 11:32:16.624685 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:16.624651    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-78d7dd88d4-wjvdt"
Sep 08 11:32:16.627610 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:16.627586    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-78d7dd88d4-wjvdt"
Sep 08 11:32:16.643237 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:16.643209    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64f5c77786-bqrll"]
Sep 08 11:32:16.646532 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:32:16.646510    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode57c960d_1c0a_4c27_865b_ccd85df5fdb1.slice/crio-9f7f962db53fd171d240ab0169de5a85157e3da6d307ba02363f5f4b7cb985e3 WatchSource:0}: Error finding container 9f7f962db53fd171d240ab0169de5a85157e3da6d307ba02363f5f4b7cb985e3: Status 404 returned error can't find the container with id 9f7f962db53fd171d240ab0169de5a85157e3da6d307ba02363f5f4b7cb985e3
Sep 08 11:32:17.232276 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:17.232245    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sdbbl"
Sep 08 11:32:17.265454 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:17.265415    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64f5c77786-bqrll" event={"ID":"e57c960d-1c0a-4c27-865b-ccd85df5fdb1","Type":"ContainerStarted","Data":"146f8b25cd7cc624c2b70d1836e643982d494e15cbe600637a6380dac2860df1"}
Sep 08 11:32:17.266020 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:17.265995    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-78d7dd88d4-wjvdt"
Sep 08 11:32:17.266190 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:17.266048    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64f5c77786-bqrll" event={"ID":"e57c960d-1c0a-4c27-865b-ccd85df5fdb1","Type":"ContainerStarted","Data":"9f7f962db53fd171d240ab0169de5a85157e3da6d307ba02363f5f4b7cb985e3"}
Sep 08 11:32:17.267087 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:17.267071    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-78d7dd88d4-wjvdt"
Sep 08 11:32:17.290362 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:17.290285    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-64f5c77786-bqrll" podStartSLOduration=1.290264125 podStartE2EDuration="1.290264125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:32:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:32:17.289166025 +0000 UTC m=+111.940872840" watchObservedRunningTime="2026-09-08 11:32:17.290264125 +0000 UTC m=+111.941970923"
Sep 08 11:32:18.270385 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:18.270330    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-fphh6" event={"ID":"e106802e-8a43-4870-92a4-08741f4e05d2","Type":"ContainerStarted","Data":"f970b9906a38a7b530f7185548c9c41510b2106b0a6633ac4a0cceee923afcc2"}
Sep 08 11:32:18.270640 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:18.270623    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-64f5c77786-bqrll"
Sep 08 11:32:18.289778 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:18.289730    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-fphh6" podStartSLOduration=33.408751749 podStartE2EDuration="35.289716163s" totalImagesPullingTime="1.880964414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:31:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:32:18.288883947 +0000 UTC m=+112.940590740" watchObservedRunningTime="2026-09-08 11:32:18.289716163 +0000 UTC m=+112.941422957"
Sep 08 11:32:25.150381 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:25.150332    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-97fb98fdf-dlhj8"]
Sep 08 11:32:25.155047 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:25.155030    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97fb98fdf-dlhj8"
Sep 08 11:32:25.157507 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:25.157481    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 08 11:32:25.157659 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:25.157623    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 08 11:32:25.158801 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:25.158776    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 08 11:32:25.158918 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:25.158806    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 08 11:32:25.158918 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:25.158879    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 08 11:32:25.158918 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:25.158905    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 08 11:32:25.159070 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:25.158938    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 08 11:32:25.159070 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:25.158911    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4fm94\""
Sep 08 11:32:25.163219 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:25.163201    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 08 11:32:25.164315 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:25.164298    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-97fb98fdf-dlhj8"]
Sep 08 11:32:25.342580 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:25.342550    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9186cba5-5968-4a09-9297-9e9892d127ce-console-config\") pod \"console-97fb98fdf-dlhj8\" (UID: \"9186cba5-5968-4a09-9297-9e9892d127ce\") " pod="openshift-console/console-97fb98fdf-dlhj8"
Sep 08 11:32:25.342580 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:25.342581    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9186cba5-5968-4a09-9297-9e9892d127ce-console-oauth-config\") pod \"console-97fb98fdf-dlhj8\" (UID: \"9186cba5-5968-4a09-9297-9e9892d127ce\") " pod="openshift-console/console-97fb98fdf-dlhj8"
Sep 08 11:32:25.342770 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:25.342613    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9186cba5-5968-4a09-9297-9e9892d127ce-service-ca\") pod \"console-97fb98fdf-dlhj8\" (UID: \"9186cba5-5968-4a09-9297-9e9892d127ce\") " pod="openshift-console/console-97fb98fdf-dlhj8"
Sep 08 11:32:25.342770 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:25.342632    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9186cba5-5968-4a09-9297-9e9892d127ce-console-serving-cert\") pod \"console-97fb98fdf-dlhj8\" (UID: \"9186cba5-5968-4a09-9297-9e9892d127ce\") " pod="openshift-console/console-97fb98fdf-dlhj8"
Sep 08 11:32:25.342770 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:25.342668    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9186cba5-5968-4a09-9297-9e9892d127ce-trusted-ca-bundle\") pod \"console-97fb98fdf-dlhj8\" (UID: \"9186cba5-5968-4a09-9297-9e9892d127ce\") " pod="openshift-console/console-97fb98fdf-dlhj8"
Sep 08 11:32:25.342770 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:25.342698    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnvvb\" (UniqueName: \"kubernetes.io/projected/9186cba5-5968-4a09-9297-9e9892d127ce-kube-api-access-wnvvb\") pod \"console-97fb98fdf-dlhj8\" (UID: \"9186cba5-5968-4a09-9297-9e9892d127ce\") " pod="openshift-console/console-97fb98fdf-dlhj8"
Sep 08 11:32:25.342770 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:25.342716    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9186cba5-5968-4a09-9297-9e9892d127ce-oauth-serving-cert\") pod \"console-97fb98fdf-dlhj8\" (UID: \"9186cba5-5968-4a09-9297-9e9892d127ce\") " pod="openshift-console/console-97fb98fdf-dlhj8"
Sep 08 11:32:25.443853 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:25.443800    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9186cba5-5968-4a09-9297-9e9892d127ce-oauth-serving-cert\") pod \"console-97fb98fdf-dlhj8\" (UID: \"9186cba5-5968-4a09-9297-9e9892d127ce\") " pod="openshift-console/console-97fb98fdf-dlhj8"
Sep 08 11:32:25.443853 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:25.443843    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9186cba5-5968-4a09-9297-9e9892d127ce-console-config\") pod \"console-97fb98fdf-dlhj8\" (UID: \"9186cba5-5968-4a09-9297-9e9892d127ce\") " pod="openshift-console/console-97fb98fdf-dlhj8"
Sep 08 11:32:25.443958 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:25.443873    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9186cba5-5968-4a09-9297-9e9892d127ce-console-oauth-config\") pod \"console-97fb98fdf-dlhj8\" (UID: \"9186cba5-5968-4a09-9297-9e9892d127ce\") " pod="openshift-console/console-97fb98fdf-dlhj8"
Sep 08 11:32:25.443958 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:25.443930    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9186cba5-5968-4a09-9297-9e9892d127ce-service-ca\") pod \"console-97fb98fdf-dlhj8\" (UID: \"9186cba5-5968-4a09-9297-9e9892d127ce\") " pod="openshift-console/console-97fb98fdf-dlhj8"
Sep 08 11:32:25.444045 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:25.443959    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9186cba5-5968-4a09-9297-9e9892d127ce-console-serving-cert\") pod \"console-97fb98fdf-dlhj8\" (UID: \"9186cba5-5968-4a09-9297-9e9892d127ce\") " pod="openshift-console/console-97fb98fdf-dlhj8"
Sep 08 11:32:25.444045 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:25.443985    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9186cba5-5968-4a09-9297-9e9892d127ce-trusted-ca-bundle\") pod \"console-97fb98fdf-dlhj8\" (UID: \"9186cba5-5968-4a09-9297-9e9892d127ce\") " pod="openshift-console/console-97fb98fdf-dlhj8"
Sep 08 11:32:25.444045 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:25.444023    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnvvb\" (UniqueName: \"kubernetes.io/projected/9186cba5-5968-4a09-9297-9e9892d127ce-kube-api-access-wnvvb\") pod \"console-97fb98fdf-dlhj8\" (UID: \"9186cba5-5968-4a09-9297-9e9892d127ce\") " pod="openshift-console/console-97fb98fdf-dlhj8"
Sep 08 11:32:25.444585 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:25.444560    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9186cba5-5968-4a09-9297-9e9892d127ce-oauth-serving-cert\") pod \"console-97fb98fdf-dlhj8\" (UID: \"9186cba5-5968-4a09-9297-9e9892d127ce\") " pod="openshift-console/console-97fb98fdf-dlhj8"
Sep 08 11:32:25.444703 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:25.444646    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9186cba5-5968-4a09-9297-9e9892d127ce-service-ca\") pod \"console-97fb98fdf-dlhj8\" (UID: \"9186cba5-5968-4a09-9297-9e9892d127ce\") " pod="openshift-console/console-97fb98fdf-dlhj8"
Sep 08 11:32:25.444703 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:25.444688    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9186cba5-5968-4a09-9297-9e9892d127ce-console-config\") pod \"console-97fb98fdf-dlhj8\" (UID: \"9186cba5-5968-4a09-9297-9e9892d127ce\") " pod="openshift-console/console-97fb98fdf-dlhj8"
Sep 08 11:32:25.445256 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:25.445235    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9186cba5-5968-4a09-9297-9e9892d127ce-trusted-ca-bundle\") pod \"console-97fb98fdf-dlhj8\" (UID: \"9186cba5-5968-4a09-9297-9e9892d127ce\") " pod="openshift-console/console-97fb98fdf-dlhj8"
Sep 08 11:32:25.446609 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:25.446589    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9186cba5-5968-4a09-9297-9e9892d127ce-console-oauth-config\") pod \"console-97fb98fdf-dlhj8\" (UID: \"9186cba5-5968-4a09-9297-9e9892d127ce\") " pod="openshift-console/console-97fb98fdf-dlhj8"
Sep 08 11:32:25.446870 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:25.446849    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9186cba5-5968-4a09-9297-9e9892d127ce-console-serving-cert\") pod \"console-97fb98fdf-dlhj8\" (UID: \"9186cba5-5968-4a09-9297-9e9892d127ce\") " pod="openshift-console/console-97fb98fdf-dlhj8"
Sep 08 11:32:25.454100 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:25.454076    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnvvb\" (UniqueName: \"kubernetes.io/projected/9186cba5-5968-4a09-9297-9e9892d127ce-kube-api-access-wnvvb\") pod \"console-97fb98fdf-dlhj8\" (UID: \"9186cba5-5968-4a09-9297-9e9892d127ce\") " pod="openshift-console/console-97fb98fdf-dlhj8"
Sep 08 11:32:25.463800 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:25.463778    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97fb98fdf-dlhj8"
Sep 08 11:32:25.735148 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:25.735071    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-97fb98fdf-dlhj8"]
Sep 08 11:32:25.737899 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:32:25.737873    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9186cba5_5968_4a09_9297_9e9892d127ce.slice/crio-40b3cbae7ae9d9b433fe9ff52e59fc4fd8bb17ae8b4c37f7a7263a46362bb62f WatchSource:0}: Error finding container 40b3cbae7ae9d9b433fe9ff52e59fc4fd8bb17ae8b4c37f7a7263a46362bb62f: Status 404 returned error can't find the container with id 40b3cbae7ae9d9b433fe9ff52e59fc4fd8bb17ae8b4c37f7a7263a46362bb62f
Sep 08 11:32:26.296745 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:26.296711    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97fb98fdf-dlhj8" event={"ID":"9186cba5-5968-4a09-9297-9e9892d127ce","Type":"ContainerStarted","Data":"40b3cbae7ae9d9b433fe9ff52e59fc4fd8bb17ae8b4c37f7a7263a46362bb62f"}
Sep 08 11:32:29.310224 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.310186    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97fb98fdf-dlhj8" event={"ID":"9186cba5-5968-4a09-9297-9e9892d127ce","Type":"ContainerStarted","Data":"33875bb6f287fe61b507b805aa9c0bf97ca9a0135a7d01bad4ae32ae268b801f"}
Sep 08 11:32:29.586739 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.586495    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-97fb98fdf-dlhj8" podStartSLOduration=1.607756389 podStartE2EDuration="4.586475794s" totalImagesPullingTime="2.978719405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:32:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:32:29.342206294 +0000 UTC m=+123.993913107" watchObservedRunningTime="2026-09-08 11:32:29.586475794 +0000 UTC m=+124.238182585"
Sep 08 11:32:29.587763 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.587740    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-s52j9"]
Sep 08 11:32:29.591060 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.591040    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-s52j9"
Sep 08 11:32:29.593665 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.593616    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 08 11:32:29.593665 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.593629    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 08 11:32:29.593853 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.593719    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 08 11:32:29.593957 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.593937    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-p6dbx\""
Sep 08 11:32:29.604326 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.604306    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-s52j9"]
Sep 08 11:32:29.627576 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.627554    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-lgsft"]
Sep 08 11:32:29.630963 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.630934    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-lgsft"
Sep 08 11:32:29.633725 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.633538    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-58ffn\""
Sep 08 11:32:29.633929 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.633841    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 08 11:32:29.634902 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.634133    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 08 11:32:29.634902 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.634433    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 08 11:32:29.648651 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.648630    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-lgsft"]
Sep 08 11:32:29.649506 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.649487    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4rc2t"]
Sep 08 11:32:29.652582 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.652563    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4rc2t"
Sep 08 11:32:29.655300 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.655281    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 08 11:32:29.655483 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.655468    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 08 11:32:29.655585 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.655568    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-k7x8b\""
Sep 08 11:32:29.655646 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.655624    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 08 11:32:29.677458 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.677438    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4rc2t\" (UID: \"c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf\") " pod="openshift-monitoring/node-exporter-4rc2t"
Sep 08 11:32:29.677542 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.677466    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn4sq\" (UniqueName: \"kubernetes.io/projected/c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf-kube-api-access-rn4sq\") pod \"node-exporter-4rc2t\" (UID: \"c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf\") " pod="openshift-monitoring/node-exporter-4rc2t"
Sep 08 11:32:29.677542 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.677489    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ca4be75-c128-468b-8926-416c1a1b9f01-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-s52j9\" (UID: \"6ca4be75-c128-468b-8926-416c1a1b9f01\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-s52j9"
Sep 08 11:32:29.677542 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.677505    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tgzl\" (UniqueName: \"kubernetes.io/projected/6ca4be75-c128-468b-8926-416c1a1b9f01-kube-api-access-5tgzl\") pod \"openshift-state-metrics-657fd6c54-s52j9\" (UID: \"6ca4be75-c128-468b-8926-416c1a1b9f01\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-s52j9"
Sep 08 11:32:29.677651 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.677577    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzvlf\" (UniqueName: \"kubernetes.io/projected/6b125984-2429-429c-b144-efbca9df53ac-kube-api-access-rzvlf\") pod \"kube-state-metrics-74cb57df7-lgsft\" (UID: \"6b125984-2429-429c-b144-efbca9df53ac\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-lgsft"
Sep 08 11:32:29.677651 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.677605    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6b125984-2429-429c-b144-efbca9df53ac-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-lgsft\" (UID: \"6b125984-2429-429c-b144-efbca9df53ac\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-lgsft"
Sep 08 11:32:29.677651 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.677634    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf-metrics-client-ca\") pod \"node-exporter-4rc2t\" (UID: \"c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf\") " pod="openshift-monitoring/node-exporter-4rc2t"
Sep 08 11:32:29.677736 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.677653    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6ca4be75-c128-468b-8926-416c1a1b9f01-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-s52j9\" (UID: \"6ca4be75-c128-468b-8926-416c1a1b9f01\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-s52j9"
Sep 08 11:32:29.677736 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.677670    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf-root\") pod \"node-exporter-4rc2t\" (UID: \"c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf\") " pod="openshift-monitoring/node-exporter-4rc2t"
Sep 08 11:32:29.677736 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.677698    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b125984-2429-429c-b144-efbca9df53ac-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-lgsft\" (UID: \"6b125984-2429-429c-b144-efbca9df53ac\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-lgsft"
Sep 08 11:32:29.677736 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.677713    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf-sys\") pod \"node-exporter-4rc2t\" (UID: \"c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf\") " pod="openshift-monitoring/node-exporter-4rc2t"
Sep 08 11:32:29.677736 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.677729    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6b125984-2429-429c-b144-efbca9df53ac-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-lgsft\" (UID: \"6b125984-2429-429c-b144-efbca9df53ac\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-lgsft"
Sep 08 11:32:29.677882 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.677743    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf-node-exporter-wtmp\") pod \"node-exporter-4rc2t\" (UID: \"c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf\") " pod="openshift-monitoring/node-exporter-4rc2t"
Sep 08 11:32:29.677882 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.677768    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b125984-2429-429c-b144-efbca9df53ac-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-lgsft\" (UID: \"6b125984-2429-429c-b144-efbca9df53ac\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-lgsft"
Sep 08 11:32:29.677882 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.677805    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b125984-2429-429c-b144-efbca9df53ac-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-lgsft\" (UID: \"6b125984-2429-429c-b144-efbca9df53ac\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-lgsft"
Sep 08 11:32:29.677882 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.677831    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf-node-exporter-accelerators-collector-config\") pod \"node-exporter-4rc2t\" (UID: \"c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf\") " pod="openshift-monitoring/node-exporter-4rc2t"
Sep 08 11:32:29.677882 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.677866    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ca4be75-c128-468b-8926-416c1a1b9f01-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-s52j9\" (UID: \"6ca4be75-c128-468b-8926-416c1a1b9f01\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-s52j9"
Sep 08 11:32:29.678089 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.677882    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf-node-exporter-tls\") pod \"node-exporter-4rc2t\" (UID: \"c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf\") " pod="openshift-monitoring/node-exporter-4rc2t"
Sep 08 11:32:29.678089 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.677919    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf-node-exporter-textfile\") pod \"node-exporter-4rc2t\" (UID: \"c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf\") " pod="openshift-monitoring/node-exporter-4rc2t"
Sep 08 11:32:29.778979 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.778942    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b125984-2429-429c-b144-efbca9df53ac-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-lgsft\" (UID: \"6b125984-2429-429c-b144-efbca9df53ac\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-lgsft"
Sep 08 11:32:29.778979 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.778977    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf-sys\") pod \"node-exporter-4rc2t\" (UID: \"c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf\") " pod="openshift-monitoring/node-exporter-4rc2t"
Sep 08 11:32:29.779199 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.778996    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6b125984-2429-429c-b144-efbca9df53ac-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-lgsft\" (UID: \"6b125984-2429-429c-b144-efbca9df53ac\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-lgsft"
Sep 08 11:32:29.779199 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.779014    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf-node-exporter-wtmp\") pod \"node-exporter-4rc2t\" (UID: \"c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf\") " pod="openshift-monitoring/node-exporter-4rc2t"
Sep 08 11:32:29.779199 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.779028    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b125984-2429-429c-b144-efbca9df53ac-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-lgsft\" (UID: \"6b125984-2429-429c-b144-efbca9df53ac\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-lgsft"
Sep 08 11:32:29.779199 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.779091    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf-sys\") pod \"node-exporter-4rc2t\" (UID: \"c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf\") " pod="openshift-monitoring/node-exporter-4rc2t"
Sep 08 11:32:29.779199 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.779143    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b125984-2429-429c-b144-efbca9df53ac-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-lgsft\" (UID: \"6b125984-2429-429c-b144-efbca9df53ac\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-lgsft"
Sep 08 11:32:29.779199 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.779163    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf-node-exporter-wtmp\") pod \"node-exporter-4rc2t\" (UID: \"c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf\") " pod="openshift-monitoring/node-exporter-4rc2t"
Sep 08 11:32:29.779199 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.779173    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf-node-exporter-accelerators-collector-config\") pod \"node-exporter-4rc2t\" (UID: \"c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf\") " pod="openshift-monitoring/node-exporter-4rc2t"
Sep 08 11:32:29.779565 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.779212    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ca4be75-c128-468b-8926-416c1a1b9f01-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-s52j9\" (UID: \"6ca4be75-c128-468b-8926-416c1a1b9f01\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-s52j9"
Sep 08 11:32:29.779565 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.779243    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf-node-exporter-tls\") pod \"node-exporter-4rc2t\" (UID: \"c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf\") " pod="openshift-monitoring/node-exporter-4rc2t"
Sep 08 11:32:29.779565 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.779293    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf-node-exporter-textfile\") pod \"node-exporter-4rc2t\" (UID: \"c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf\") " pod="openshift-monitoring/node-exporter-4rc2t"
Sep 08 11:32:29.779565 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.779374    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4rc2t\" (UID: \"c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf\") " pod="openshift-monitoring/node-exporter-4rc2t"
Sep 08 11:32:29.779565 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.779409    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn4sq\" (UniqueName: \"kubernetes.io/projected/c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf-kube-api-access-rn4sq\") pod \"node-exporter-4rc2t\" (UID: \"c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf\") " pod="openshift-monitoring/node-exporter-4rc2t"
Sep 08 11:32:29.779565 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.779466    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ca4be75-c128-468b-8926-416c1a1b9f01-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-s52j9\" (UID: \"6ca4be75-c128-468b-8926-416c1a1b9f01\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-s52j9"
Sep 08 11:32:29.779565 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.779496    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tgzl\" (UniqueName: \"kubernetes.io/projected/6ca4be75-c128-468b-8926-416c1a1b9f01-kube-api-access-5tgzl\") pod \"openshift-state-metrics-657fd6c54-s52j9\" (UID: \"6ca4be75-c128-468b-8926-416c1a1b9f01\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-s52j9"
Sep 08 11:32:29.779565 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.779538    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzvlf\" (UniqueName: \"kubernetes.io/projected/6b125984-2429-429c-b144-efbca9df53ac-kube-api-access-rzvlf\") pod \"kube-state-metrics-74cb57df7-lgsft\" (UID: \"6b125984-2429-429c-b144-efbca9df53ac\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-lgsft"
Sep 08 11:32:29.779927 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.779566    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6b125984-2429-429c-b144-efbca9df53ac-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-lgsft\" (UID: \"6b125984-2429-429c-b144-efbca9df53ac\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-lgsft"
Sep 08 11:32:29.779927 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.779590    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf-metrics-client-ca\") pod \"node-exporter-4rc2t\" (UID: \"c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf\") " pod="openshift-monitoring/node-exporter-4rc2t"
Sep 08 11:32:29.779927 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.779618    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6ca4be75-c128-468b-8926-416c1a1b9f01-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-s52j9\" (UID: \"6ca4be75-c128-468b-8926-416c1a1b9f01\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-s52j9"
Sep 08 11:32:29.779927 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.779648    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf-root\") pod \"node-exporter-4rc2t\" (UID: \"c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf\") " pod="openshift-monitoring/node-exporter-4rc2t"
Sep 08 11:32:29.779927 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.779742    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf-root\") pod \"node-exporter-4rc2t\" (UID: \"c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf\") " pod="openshift-monitoring/node-exporter-4rc2t"
Sep 08 11:32:29.779927 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.779769    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b125984-2429-429c-b144-efbca9df53ac-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-lgsft\" (UID: \"6b125984-2429-429c-b144-efbca9df53ac\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-lgsft"
Sep 08 11:32:29.779927 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.779786    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf-node-exporter-accelerators-collector-config\") pod \"node-exporter-4rc2t\" (UID: \"c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf\") " pod="openshift-monitoring/node-exporter-4rc2t"
Sep 08 11:32:29.780252 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.779465    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6b125984-2429-429c-b144-efbca9df53ac-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-lgsft\" (UID: \"6b125984-2429-429c-b144-efbca9df53ac\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-lgsft"
Sep 08 11:32:29.780252 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.780134    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf-node-exporter-textfile\") pod \"node-exporter-4rc2t\" (UID: \"c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf\") " pod="openshift-monitoring/node-exporter-4rc2t"
Sep 08 11:32:29.780425 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.780398    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf-metrics-client-ca\") pod \"node-exporter-4rc2t\" (UID: \"c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf\") " pod="openshift-monitoring/node-exporter-4rc2t"
Sep 08 11:32:29.780703 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.780613    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ca4be75-c128-468b-8926-416c1a1b9f01-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-s52j9\" (UID: \"6ca4be75-c128-468b-8926-416c1a1b9f01\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-s52j9"
Sep 08 11:32:29.780887 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.780809    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6b125984-2429-429c-b144-efbca9df53ac-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-lgsft\" (UID: \"6b125984-2429-429c-b144-efbca9df53ac\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-lgsft"
Sep 08 11:32:29.782264 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.782201    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4rc2t\" (UID: \"c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf\") " pod="openshift-monitoring/node-exporter-4rc2t"
Sep 08 11:32:29.782415 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.782397    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b125984-2429-429c-b144-efbca9df53ac-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-lgsft\" (UID: \"6b125984-2429-429c-b144-efbca9df53ac\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-lgsft"
Sep 08 11:32:29.782545 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.782519    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b125984-2429-429c-b144-efbca9df53ac-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-lgsft\" (UID: \"6b125984-2429-429c-b144-efbca9df53ac\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-lgsft"
Sep 08 11:32:29.782627 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.782612    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ca4be75-c128-468b-8926-416c1a1b9f01-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-s52j9\" (UID: \"6ca4be75-c128-468b-8926-416c1a1b9f01\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-s52j9"
Sep 08 11:32:29.783113 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.783091    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6ca4be75-c128-468b-8926-416c1a1b9f01-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-s52j9\" (UID: \"6ca4be75-c128-468b-8926-416c1a1b9f01\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-s52j9"
Sep 08 11:32:29.783174 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.783137    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf-node-exporter-tls\") pod \"node-exporter-4rc2t\" (UID: \"c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf\") " pod="openshift-monitoring/node-exporter-4rc2t"
Sep 08 11:32:29.789104 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.789078    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn4sq\" (UniqueName: \"kubernetes.io/projected/c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf-kube-api-access-rn4sq\") pod \"node-exporter-4rc2t\" (UID: \"c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf\") " pod="openshift-monitoring/node-exporter-4rc2t"
Sep 08 11:32:29.789454 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.789434    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzvlf\" (UniqueName: \"kubernetes.io/projected/6b125984-2429-429c-b144-efbca9df53ac-kube-api-access-rzvlf\") pod \"kube-state-metrics-74cb57df7-lgsft\" (UID: \"6b125984-2429-429c-b144-efbca9df53ac\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-lgsft"
Sep 08 11:32:29.789525 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.789435    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tgzl\" (UniqueName: \"kubernetes.io/projected/6ca4be75-c128-468b-8926-416c1a1b9f01-kube-api-access-5tgzl\") pod \"openshift-state-metrics-657fd6c54-s52j9\" (UID: \"6ca4be75-c128-468b-8926-416c1a1b9f01\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-s52j9"
Sep 08 11:32:29.900302 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.900232    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-s52j9"
Sep 08 11:32:29.943274 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.943244    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-lgsft"
Sep 08 11:32:29.961060 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:29.960655    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4rc2t"
Sep 08 11:32:30.176485 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.176409    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-s52j9"]
Sep 08 11:32:30.180073 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:32:30.180048    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ca4be75_c128_468b_8926_416c1a1b9f01.slice/crio-244560df66d08c89f91ad48a4616443cefa34d9fa6faef155627a8deefd2eda8 WatchSource:0}: Error finding container 244560df66d08c89f91ad48a4616443cefa34d9fa6faef155627a8deefd2eda8: Status 404 returned error can't find the container with id 244560df66d08c89f91ad48a4616443cefa34d9fa6faef155627a8deefd2eda8
Sep 08 11:32:30.233061 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.233036    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-lgsft"]
Sep 08 11:32:30.235448 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:32:30.235426    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b125984_2429_429c_b144_efbca9df53ac.slice/crio-0ddd4ef8a755cad8a393fce68c3d4851ad8072fe2a1ced2181aaff7c537a243e WatchSource:0}: Error finding container 0ddd4ef8a755cad8a393fce68c3d4851ad8072fe2a1ced2181aaff7c537a243e: Status 404 returned error can't find the container with id 0ddd4ef8a755cad8a393fce68c3d4851ad8072fe2a1ced2181aaff7c537a243e
Sep 08 11:32:30.316292 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.316249    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-s52j9" event={"ID":"6ca4be75-c128-468b-8926-416c1a1b9f01","Type":"ContainerStarted","Data":"22a285201e9c1ba8cb40ff002b947859ce7e7f25eca9764b173d47c74000b680"}
Sep 08 11:32:30.316731 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.316318    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-s52j9" event={"ID":"6ca4be75-c128-468b-8926-416c1a1b9f01","Type":"ContainerStarted","Data":"3b30a1f2fce717b7b13b7293cfa886f957da33cca6097cd5a0a5865f62e3893b"}
Sep 08 11:32:30.316731 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.316372    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-s52j9" event={"ID":"6ca4be75-c128-468b-8926-416c1a1b9f01","Type":"ContainerStarted","Data":"244560df66d08c89f91ad48a4616443cefa34d9fa6faef155627a8deefd2eda8"}
Sep 08 11:32:30.318221 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.318192    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4rc2t" event={"ID":"c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf","Type":"ContainerStarted","Data":"2ac4283b8737ea7ef92c6ce32107aaa7c3f61bfc7d492ef4c267ada5a07bf172"}
Sep 08 11:32:30.319595 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.319574    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-lgsft" event={"ID":"6b125984-2429-429c-b144-efbca9df53ac","Type":"ContainerStarted","Data":"0ddd4ef8a755cad8a393fce68c3d4851ad8072fe2a1ced2181aaff7c537a243e"}
Sep 08 11:32:30.681210 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.681176    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 11:32:30.685297 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.685276    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:30.688141 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.688115    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 08 11:32:30.688241 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.688149    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kl999\""
Sep 08 11:32:30.688315 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.688295    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 08 11:32:30.688609 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.688591    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 08 11:32:30.688691 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.688622    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 08 11:32:30.688751 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.688742    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 08 11:32:30.688806 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.688790    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 08 11:32:30.688856 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.688597    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 08 11:32:30.689144 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.689129    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 08 11:32:30.689228 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.689129    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 08 11:32:30.705103 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.705080    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 11:32:30.787513 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.787485    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e0fb083-5f0a-4c4f-9789-004020617190-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0e0fb083-5f0a-4c4f-9789-004020617190\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:30.787513 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.787516    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e0fb083-5f0a-4c4f-9789-004020617190-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0e0fb083-5f0a-4c4f-9789-004020617190\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:30.787733 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.787538    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e0fb083-5f0a-4c4f-9789-004020617190-config-out\") pod \"alertmanager-main-0\" (UID: \"0e0fb083-5f0a-4c4f-9789-004020617190\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:30.787733 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.787552    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e0fb083-5f0a-4c4f-9789-004020617190-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0e0fb083-5f0a-4c4f-9789-004020617190\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:30.787733 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.787590    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cphrv\" (UniqueName: \"kubernetes.io/projected/0e0fb083-5f0a-4c4f-9789-004020617190-kube-api-access-cphrv\") pod \"alertmanager-main-0\" (UID: \"0e0fb083-5f0a-4c4f-9789-004020617190\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:30.787733 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.787675    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0e0fb083-5f0a-4c4f-9789-004020617190-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0e0fb083-5f0a-4c4f-9789-004020617190\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:30.787923 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.787739    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e0fb083-5f0a-4c4f-9789-004020617190-web-config\") pod \"alertmanager-main-0\" (UID: \"0e0fb083-5f0a-4c4f-9789-004020617190\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:30.787923 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.787812    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0e0fb083-5f0a-4c4f-9789-004020617190-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0e0fb083-5f0a-4c4f-9789-004020617190\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:30.787923 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.787845    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0e0fb083-5f0a-4c4f-9789-004020617190-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0e0fb083-5f0a-4c4f-9789-004020617190\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:30.787923 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.787892    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0e0fb083-5f0a-4c4f-9789-004020617190-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0e0fb083-5f0a-4c4f-9789-004020617190\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:30.788129 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.787925    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0e0fb083-5f0a-4c4f-9789-004020617190-config-volume\") pod \"alertmanager-main-0\" (UID: \"0e0fb083-5f0a-4c4f-9789-004020617190\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:30.788129 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.787959    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e0fb083-5f0a-4c4f-9789-004020617190-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0e0fb083-5f0a-4c4f-9789-004020617190\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:30.788129 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.788037    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e0fb083-5f0a-4c4f-9789-004020617190-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0e0fb083-5f0a-4c4f-9789-004020617190\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:30.889315 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.889278    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0e0fb083-5f0a-4c4f-9789-004020617190-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0e0fb083-5f0a-4c4f-9789-004020617190\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:30.889494 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.889328    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e0fb083-5f0a-4c4f-9789-004020617190-web-config\") pod \"alertmanager-main-0\" (UID: \"0e0fb083-5f0a-4c4f-9789-004020617190\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:30.889494 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.889385    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0e0fb083-5f0a-4c4f-9789-004020617190-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0e0fb083-5f0a-4c4f-9789-004020617190\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:30.889494 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.889408    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0e0fb083-5f0a-4c4f-9789-004020617190-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0e0fb083-5f0a-4c4f-9789-004020617190\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:30.889494 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.889432    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0e0fb083-5f0a-4c4f-9789-004020617190-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0e0fb083-5f0a-4c4f-9789-004020617190\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:30.889494 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.889465    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0e0fb083-5f0a-4c4f-9789-004020617190-config-volume\") pod \"alertmanager-main-0\" (UID: \"0e0fb083-5f0a-4c4f-9789-004020617190\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:30.889494 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.889489    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e0fb083-5f0a-4c4f-9789-004020617190-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0e0fb083-5f0a-4c4f-9789-004020617190\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:30.889806 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.889549    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e0fb083-5f0a-4c4f-9789-004020617190-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0e0fb083-5f0a-4c4f-9789-004020617190\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:30.889806 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.889584    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e0fb083-5f0a-4c4f-9789-004020617190-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0e0fb083-5f0a-4c4f-9789-004020617190\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:30.889806 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.889614    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e0fb083-5f0a-4c4f-9789-004020617190-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0e0fb083-5f0a-4c4f-9789-004020617190\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:30.889806 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.889645    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e0fb083-5f0a-4c4f-9789-004020617190-config-out\") pod \"alertmanager-main-0\" (UID: \"0e0fb083-5f0a-4c4f-9789-004020617190\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:30.889806 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.889669    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e0fb083-5f0a-4c4f-9789-004020617190-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0e0fb083-5f0a-4c4f-9789-004020617190\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:30.889806 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.889710    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cphrv\" (UniqueName: \"kubernetes.io/projected/0e0fb083-5f0a-4c4f-9789-004020617190-kube-api-access-cphrv\") pod \"alertmanager-main-0\" (UID: \"0e0fb083-5f0a-4c4f-9789-004020617190\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:30.890124 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.889808    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0e0fb083-5f0a-4c4f-9789-004020617190-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0e0fb083-5f0a-4c4f-9789-004020617190\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:30.891482 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:32:30.890290    2575 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Sep 08 11:32:30.891482 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:32:30.890371    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e0fb083-5f0a-4c4f-9789-004020617190-secret-alertmanager-main-tls podName:0e0fb083-5f0a-4c4f-9789-004020617190 nodeName:}" failed. No retries permitted until 2026-09-08 11:32:31.390354252 +0000 UTC m=+126.042061038 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/0e0fb083-5f0a-4c4f-9789-004020617190-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "0e0fb083-5f0a-4c4f-9789-004020617190") : secret "alertmanager-main-tls" not found
Sep 08 11:32:30.891482 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.890745    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e0fb083-5f0a-4c4f-9789-004020617190-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0e0fb083-5f0a-4c4f-9789-004020617190\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:30.891482 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.891397    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e0fb083-5f0a-4c4f-9789-004020617190-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0e0fb083-5f0a-4c4f-9789-004020617190\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:30.892884 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.892859    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0e0fb083-5f0a-4c4f-9789-004020617190-config-volume\") pod \"alertmanager-main-0\" (UID: \"0e0fb083-5f0a-4c4f-9789-004020617190\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:30.892983 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.892859    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e0fb083-5f0a-4c4f-9789-004020617190-web-config\") pod \"alertmanager-main-0\" (UID: \"0e0fb083-5f0a-4c4f-9789-004020617190\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:30.893439 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.893397    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0e0fb083-5f0a-4c4f-9789-004020617190-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0e0fb083-5f0a-4c4f-9789-004020617190\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:30.894276 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.894228    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e0fb083-5f0a-4c4f-9789-004020617190-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0e0fb083-5f0a-4c4f-9789-004020617190\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:30.894466 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.894445    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e0fb083-5f0a-4c4f-9789-004020617190-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0e0fb083-5f0a-4c4f-9789-004020617190\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:30.894550 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.894453    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0e0fb083-5f0a-4c4f-9789-004020617190-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0e0fb083-5f0a-4c4f-9789-004020617190\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:30.894600 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.894581    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e0fb083-5f0a-4c4f-9789-004020617190-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0e0fb083-5f0a-4c4f-9789-004020617190\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:30.894916 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.894899    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e0fb083-5f0a-4c4f-9789-004020617190-config-out\") pod \"alertmanager-main-0\" (UID: \"0e0fb083-5f0a-4c4f-9789-004020617190\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:30.899004 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:30.898971    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cphrv\" (UniqueName: \"kubernetes.io/projected/0e0fb083-5f0a-4c4f-9789-004020617190-kube-api-access-cphrv\") pod \"alertmanager-main-0\" (UID: \"0e0fb083-5f0a-4c4f-9789-004020617190\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:31.337458 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:31.337417    2575 generic.go:356] "Generic (PLEG): container finished" podID="c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf" containerID="aba0ebd570b9511ec48f08c9ab6378791b7bfcce5d75ea83f7c996f629e95ffd" exitCode=0
Sep 08 11:32:31.337858 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:31.337479    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4rc2t" event={"ID":"c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf","Type":"ContainerDied","Data":"aba0ebd570b9511ec48f08c9ab6378791b7bfcce5d75ea83f7c996f629e95ffd"}
Sep 08 11:32:31.396645 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:31.396608    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0e0fb083-5f0a-4c4f-9789-004020617190-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0e0fb083-5f0a-4c4f-9789-004020617190\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:31.399282 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:31.399260    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0e0fb083-5f0a-4c4f-9789-004020617190-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0e0fb083-5f0a-4c4f-9789-004020617190\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:31.596836 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:31.596763    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 11:32:32.228683 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:32.228652    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 11:32:32.231785 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:32:32.231746    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e0fb083_5f0a_4c4f_9789_004020617190.slice/crio-412a8c717666ca4f3f76f490ac81aca07ec57e320f62e406f2376c8df1763127 WatchSource:0}: Error finding container 412a8c717666ca4f3f76f490ac81aca07ec57e320f62e406f2376c8df1763127: Status 404 returned error can't find the container with id 412a8c717666ca4f3f76f490ac81aca07ec57e320f62e406f2376c8df1763127
Sep 08 11:32:32.343750 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:32.343714    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4rc2t" event={"ID":"c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf","Type":"ContainerStarted","Data":"a69a5de41e36444b206fd4900056882eab71383f1df05e70717f067a2cf5ed5f"}
Sep 08 11:32:32.344178 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:32.343768    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4rc2t" event={"ID":"c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf","Type":"ContainerStarted","Data":"4ea40bfa712ee163db438760ac8473c1f6494900897599cdb79a612c1f3985d1"}
Sep 08 11:32:32.345974 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:32.345947    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-lgsft" event={"ID":"6b125984-2429-429c-b144-efbca9df53ac","Type":"ContainerStarted","Data":"7d4716d941a3bd5b85b24f4df396e707f13fea5d78073080df1539a31729f5ed"}
Sep 08 11:32:32.346095 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:32.345999    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-lgsft" event={"ID":"6b125984-2429-429c-b144-efbca9df53ac","Type":"ContainerStarted","Data":"114e43156611e4d8535138f23fd22f8d8f43ccbbbc464c3005031ea8bac12f26"}
Sep 08 11:32:32.346095 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:32.346038    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-lgsft" event={"ID":"6b125984-2429-429c-b144-efbca9df53ac","Type":"ContainerStarted","Data":"fe3c0d8129cc17dcb267b4d35dec0feefb3326587f7b3a12a0a8aab0a64d0766"}
Sep 08 11:32:32.347387 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:32.347332    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0e0fb083-5f0a-4c4f-9789-004020617190","Type":"ContainerStarted","Data":"412a8c717666ca4f3f76f490ac81aca07ec57e320f62e406f2376c8df1763127"}
Sep 08 11:32:32.349550 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:32.349529    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-s52j9" event={"ID":"6ca4be75-c128-468b-8926-416c1a1b9f01","Type":"ContainerStarted","Data":"e3408933cd7b0a06e49e7c4fa1d66f11956296f253807e26529bd5a4555db15d"}
Sep 08 11:32:32.365298 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:32.365253    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4rc2t" podStartSLOduration=2.364910869 podStartE2EDuration="3.365239954s" totalImagesPullingTime="919.769409ms" totalInitContainerRuntime="80.559676ms" isStatefulPod=true podCreationTimestamp="2026-09-08 11:32:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:32:32.364286098 +0000 UTC m=+127.015992955" watchObservedRunningTime="2026-09-08 11:32:32.365239954 +0000 UTC m=+127.016946748"
Sep 08 11:32:32.391976 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:32.391931    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-s52j9" podStartSLOduration=1.745492365 podStartE2EDuration="3.391914679s" totalImagesPullingTime="1.646422314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:32:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:32:32.391565554 +0000 UTC m=+127.043272376" watchObservedRunningTime="2026-09-08 11:32:32.391914679 +0000 UTC m=+127.043621475"
Sep 08 11:32:32.415584 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:32.415502    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-lgsft" podStartSLOduration=1.7105889730000001 podStartE2EDuration="3.415489858s" totalImagesPullingTime="1.704900885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:32:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:32:32.414612674 +0000 UTC m=+127.066319488" watchObservedRunningTime="2026-09-08 11:32:32.415489858 +0000 UTC m=+127.067196654"
Sep 08 11:32:34.425975 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:34.425950    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-97fb98fdf-dlhj8"]
Sep 08 11:32:34.620925 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:34.620893    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679-metrics-certs\") pod \"network-metrics-daemon-nb8wz\" (UID: \"b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679\") " pod="openshift-multus/network-metrics-daemon-nb8wz"
Sep 08 11:32:34.623166 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:34.623133    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679-metrics-certs\") pod \"network-metrics-daemon-nb8wz\" (UID: \"b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679\") " pod="openshift-multus/network-metrics-daemon-nb8wz"
Sep 08 11:32:34.748838 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:34.748771    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xt4h2\""
Sep 08 11:32:34.756951 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:34.756933    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb8wz"
Sep 08 11:32:34.818890 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:34.818863    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-75cdf8555c-zg72s"]
Sep 08 11:32:34.824455 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:34.824433    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-75cdf8555c-zg72s"
Sep 08 11:32:34.827276 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:34.827120    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 08 11:32:34.827276 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:34.827135    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 08 11:32:34.827276 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:34.827172    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 08 11:32:34.827276 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:34.827198    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-jqsbk\""
Sep 08 11:32:34.827276 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:34.827237    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 08 11:32:34.827604 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:34.827496    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 08 11:32:34.832849 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:34.832829    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 08 11:32:34.836652 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:34.836632    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-75cdf8555c-zg72s"]
Sep 08 11:32:34.923684 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:34.923655    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e929af8-ea39-4034-a0dc-0fc17b565598-serving-certs-ca-bundle\") pod \"telemeter-client-75cdf8555c-zg72s\" (UID: \"5e929af8-ea39-4034-a0dc-0fc17b565598\") " pod="openshift-monitoring/telemeter-client-75cdf8555c-zg72s"
Sep 08 11:32:34.923806 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:34.923696    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5e929af8-ea39-4034-a0dc-0fc17b565598-telemeter-client-tls\") pod \"telemeter-client-75cdf8555c-zg72s\" (UID: \"5e929af8-ea39-4034-a0dc-0fc17b565598\") " pod="openshift-monitoring/telemeter-client-75cdf8555c-zg72s"
Sep 08 11:32:34.923806 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:34.923728    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5e929af8-ea39-4034-a0dc-0fc17b565598-federate-client-tls\") pod \"telemeter-client-75cdf8555c-zg72s\" (UID: \"5e929af8-ea39-4034-a0dc-0fc17b565598\") " pod="openshift-monitoring/telemeter-client-75cdf8555c-zg72s"
Sep 08 11:32:34.923806 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:34.923793    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5e929af8-ea39-4034-a0dc-0fc17b565598-secret-telemeter-client\") pod \"telemeter-client-75cdf8555c-zg72s\" (UID: \"5e929af8-ea39-4034-a0dc-0fc17b565598\") " pod="openshift-monitoring/telemeter-client-75cdf8555c-zg72s"
Sep 08 11:32:34.923914 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:34.923821    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e929af8-ea39-4034-a0dc-0fc17b565598-metrics-client-ca\") pod \"telemeter-client-75cdf8555c-zg72s\" (UID: \"5e929af8-ea39-4034-a0dc-0fc17b565598\") " pod="openshift-monitoring/telemeter-client-75cdf8555c-zg72s"
Sep 08 11:32:34.923914 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:34.923865    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e929af8-ea39-4034-a0dc-0fc17b565598-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75cdf8555c-zg72s\" (UID: \"5e929af8-ea39-4034-a0dc-0fc17b565598\") " pod="openshift-monitoring/telemeter-client-75cdf8555c-zg72s"
Sep 08 11:32:34.923914 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:34.923885    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e929af8-ea39-4034-a0dc-0fc17b565598-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75cdf8555c-zg72s\" (UID: \"5e929af8-ea39-4034-a0dc-0fc17b565598\") " pod="openshift-monitoring/telemeter-client-75cdf8555c-zg72s"
Sep 08 11:32:34.923914 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:34.923907    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5cd7\" (UniqueName: \"kubernetes.io/projected/5e929af8-ea39-4034-a0dc-0fc17b565598-kube-api-access-m5cd7\") pod \"telemeter-client-75cdf8555c-zg72s\" (UID: \"5e929af8-ea39-4034-a0dc-0fc17b565598\") " pod="openshift-monitoring/telemeter-client-75cdf8555c-zg72s"
Sep 08 11:32:35.024568 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.024538    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e929af8-ea39-4034-a0dc-0fc17b565598-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75cdf8555c-zg72s\" (UID: \"5e929af8-ea39-4034-a0dc-0fc17b565598\") " pod="openshift-monitoring/telemeter-client-75cdf8555c-zg72s"
Sep 08 11:32:35.024735 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.024577    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e929af8-ea39-4034-a0dc-0fc17b565598-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75cdf8555c-zg72s\" (UID: \"5e929af8-ea39-4034-a0dc-0fc17b565598\") " pod="openshift-monitoring/telemeter-client-75cdf8555c-zg72s"
Sep 08 11:32:35.024735 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.024602    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5cd7\" (UniqueName: \"kubernetes.io/projected/5e929af8-ea39-4034-a0dc-0fc17b565598-kube-api-access-m5cd7\") pod \"telemeter-client-75cdf8555c-zg72s\" (UID: \"5e929af8-ea39-4034-a0dc-0fc17b565598\") " pod="openshift-monitoring/telemeter-client-75cdf8555c-zg72s"
Sep 08 11:32:35.024735 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.024637    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e929af8-ea39-4034-a0dc-0fc17b565598-serving-certs-ca-bundle\") pod \"telemeter-client-75cdf8555c-zg72s\" (UID: \"5e929af8-ea39-4034-a0dc-0fc17b565598\") " pod="openshift-monitoring/telemeter-client-75cdf8555c-zg72s"
Sep 08 11:32:35.024735 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.024697    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5e929af8-ea39-4034-a0dc-0fc17b565598-telemeter-client-tls\") pod \"telemeter-client-75cdf8555c-zg72s\" (UID: \"5e929af8-ea39-4034-a0dc-0fc17b565598\") " pod="openshift-monitoring/telemeter-client-75cdf8555c-zg72s"
Sep 08 11:32:35.024925 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.024746    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5e929af8-ea39-4034-a0dc-0fc17b565598-federate-client-tls\") pod \"telemeter-client-75cdf8555c-zg72s\" (UID: \"5e929af8-ea39-4034-a0dc-0fc17b565598\") " pod="openshift-monitoring/telemeter-client-75cdf8555c-zg72s"
Sep 08 11:32:35.024925 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.024788    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5e929af8-ea39-4034-a0dc-0fc17b565598-secret-telemeter-client\") pod \"telemeter-client-75cdf8555c-zg72s\" (UID: \"5e929af8-ea39-4034-a0dc-0fc17b565598\") " pod="openshift-monitoring/telemeter-client-75cdf8555c-zg72s"
Sep 08 11:32:35.024925 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.024812    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e929af8-ea39-4034-a0dc-0fc17b565598-metrics-client-ca\") pod \"telemeter-client-75cdf8555c-zg72s\" (UID: \"5e929af8-ea39-4034-a0dc-0fc17b565598\") " pod="openshift-monitoring/telemeter-client-75cdf8555c-zg72s"
Sep 08 11:32:35.025745 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.025721    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e929af8-ea39-4034-a0dc-0fc17b565598-metrics-client-ca\") pod \"telemeter-client-75cdf8555c-zg72s\" (UID: \"5e929af8-ea39-4034-a0dc-0fc17b565598\") " pod="openshift-monitoring/telemeter-client-75cdf8555c-zg72s"
Sep 08 11:32:35.025871 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.025792    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e929af8-ea39-4034-a0dc-0fc17b565598-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75cdf8555c-zg72s\" (UID: \"5e929af8-ea39-4034-a0dc-0fc17b565598\") " pod="openshift-monitoring/telemeter-client-75cdf8555c-zg72s"
Sep 08 11:32:35.025949 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.025915    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e929af8-ea39-4034-a0dc-0fc17b565598-serving-certs-ca-bundle\") pod \"telemeter-client-75cdf8555c-zg72s\" (UID: \"5e929af8-ea39-4034-a0dc-0fc17b565598\") " pod="openshift-monitoring/telemeter-client-75cdf8555c-zg72s"
Sep 08 11:32:35.027667 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.027537    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e929af8-ea39-4034-a0dc-0fc17b565598-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75cdf8555c-zg72s\" (UID: \"5e929af8-ea39-4034-a0dc-0fc17b565598\") " pod="openshift-monitoring/telemeter-client-75cdf8555c-zg72s"
Sep 08 11:32:35.028280 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.028262    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5e929af8-ea39-4034-a0dc-0fc17b565598-federate-client-tls\") pod \"telemeter-client-75cdf8555c-zg72s\" (UID: \"5e929af8-ea39-4034-a0dc-0fc17b565598\") " pod="openshift-monitoring/telemeter-client-75cdf8555c-zg72s"
Sep 08 11:32:35.028412 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.028287    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5e929af8-ea39-4034-a0dc-0fc17b565598-secret-telemeter-client\") pod \"telemeter-client-75cdf8555c-zg72s\" (UID: \"5e929af8-ea39-4034-a0dc-0fc17b565598\") " pod="openshift-monitoring/telemeter-client-75cdf8555c-zg72s"
Sep 08 11:32:35.028833 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.028814    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5e929af8-ea39-4034-a0dc-0fc17b565598-telemeter-client-tls\") pod \"telemeter-client-75cdf8555c-zg72s\" (UID: \"5e929af8-ea39-4034-a0dc-0fc17b565598\") " pod="openshift-monitoring/telemeter-client-75cdf8555c-zg72s"
Sep 08 11:32:35.030365 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.030331    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nb8wz"]
Sep 08 11:32:35.032350 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:32:35.032316    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0f4bfd9_1a62_4d5d_b6f5_0d8199c4d679.slice/crio-5c49c9a16610a6d315c3a7b6cc014e1c58b15914a181d3a9150674957977f59d WatchSource:0}: Error finding container 5c49c9a16610a6d315c3a7b6cc014e1c58b15914a181d3a9150674957977f59d: Status 404 returned error can't find the container with id 5c49c9a16610a6d315c3a7b6cc014e1c58b15914a181d3a9150674957977f59d
Sep 08 11:32:35.034604 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.034583    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5cd7\" (UniqueName: \"kubernetes.io/projected/5e929af8-ea39-4034-a0dc-0fc17b565598-kube-api-access-m5cd7\") pod \"telemeter-client-75cdf8555c-zg72s\" (UID: \"5e929af8-ea39-4034-a0dc-0fc17b565598\") " pod="openshift-monitoring/telemeter-client-75cdf8555c-zg72s"
Sep 08 11:32:35.136289 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.136256    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-75cdf8555c-zg72s"
Sep 08 11:32:35.365481 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.365404    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nb8wz" event={"ID":"b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679","Type":"ContainerStarted","Data":"5c49c9a16610a6d315c3a7b6cc014e1c58b15914a181d3a9150674957977f59d"}
Sep 08 11:32:35.366917 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.366890    2575 generic.go:356] "Generic (PLEG): container finished" podID="0e0fb083-5f0a-4c4f-9789-004020617190" containerID="a49eb949bc00ac743ea0e1de836f9b05facfd84b6a219a1cd050ea379646a692" exitCode=0
Sep 08 11:32:35.367040 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.366928    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0e0fb083-5f0a-4c4f-9789-004020617190","Type":"ContainerDied","Data":"a49eb949bc00ac743ea0e1de836f9b05facfd84b6a219a1cd050ea379646a692"}
Sep 08 11:32:35.422189 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.422162    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-75cdf8555c-zg72s"]
Sep 08 11:32:35.426192 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:32:35.426161    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e929af8_ea39_4034_a0dc_0fc17b565598.slice/crio-e270303ab8f7c32453cec5aef453ff7f605ceff8259852eb25c2492211da25dc WatchSource:0}: Error finding container e270303ab8f7c32453cec5aef453ff7f605ceff8259852eb25c2492211da25dc: Status 404 returned error can't find the container with id e270303ab8f7c32453cec5aef453ff7f605ceff8259852eb25c2492211da25dc
Sep 08 11:32:35.464616 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.464593    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-97fb98fdf-dlhj8"
Sep 08 11:32:35.959247 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.958026    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 11:32:35.962711 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.962683    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:35.965195 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.965172    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 08 11:32:35.965735 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.965716    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 08 11:32:35.965996 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.965973    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 08 11:32:35.966252 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.966228    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 08 11:32:35.966252 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.966246    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 08 11:32:35.966450 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.966234    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 08 11:32:35.966694 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.966671    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 08 11:32:35.966772 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.966759    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 08 11:32:35.966868 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.966854    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 08 11:32:35.967177 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.967158    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 08 11:32:35.967402 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.967385    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-76t3h0n9eovc3\""
Sep 08 11:32:35.967596 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.967580    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 08 11:32:35.967805 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.967789    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 08 11:32:35.967885 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.967871    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5dpbz\""
Sep 08 11:32:35.968029 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.968007    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 08 11:32:35.970289 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.970268    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 08 11:32:35.973294 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.973274    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 08 11:32:35.978463 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:35.978434    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 11:32:36.031902 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.031875    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e6b1732e-6dcd-4234-8a47-a39ca47f866c-web-config\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.032038 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.031909    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e6b1732e-6dcd-4234-8a47-a39ca47f866c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.032038 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.031935    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e6b1732e-6dcd-4234-8a47-a39ca47f866c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.032038 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.031975    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm2cn\" (UniqueName: \"kubernetes.io/projected/e6b1732e-6dcd-4234-8a47-a39ca47f866c-kube-api-access-nm2cn\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.032186 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.032050    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6b1732e-6dcd-4234-8a47-a39ca47f866c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.032186 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.032091    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e6b1732e-6dcd-4234-8a47-a39ca47f866c-config-out\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.032186 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.032124    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e6b1732e-6dcd-4234-8a47-a39ca47f866c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.032186 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.032162    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e6b1732e-6dcd-4234-8a47-a39ca47f866c-config\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.032370 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.032187    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e6b1732e-6dcd-4234-8a47-a39ca47f866c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.032370 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.032210    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e6b1732e-6dcd-4234-8a47-a39ca47f866c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.032370 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.032254    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e6b1732e-6dcd-4234-8a47-a39ca47f866c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.032370 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.032279    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6b1732e-6dcd-4234-8a47-a39ca47f866c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.032370 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.032295    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e6b1732e-6dcd-4234-8a47-a39ca47f866c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.032370 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.032324    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e6b1732e-6dcd-4234-8a47-a39ca47f866c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.032370 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.032363    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e6b1732e-6dcd-4234-8a47-a39ca47f866c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.032690 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.032408    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e6b1732e-6dcd-4234-8a47-a39ca47f866c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.032690 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.032447    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6b1732e-6dcd-4234-8a47-a39ca47f866c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.032690 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.032493    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e6b1732e-6dcd-4234-8a47-a39ca47f866c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.032690 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.032521    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6b1732e-6dcd-4234-8a47-a39ca47f866c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.032690 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.032550    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e6b1732e-6dcd-4234-8a47-a39ca47f866c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.133253 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.133224    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e6b1732e-6dcd-4234-8a47-a39ca47f866c-config\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.133364 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.133256    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e6b1732e-6dcd-4234-8a47-a39ca47f866c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.133364 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.133277    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e6b1732e-6dcd-4234-8a47-a39ca47f866c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.133442 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.133399    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e6b1732e-6dcd-4234-8a47-a39ca47f866c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.133472 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.133448    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6b1732e-6dcd-4234-8a47-a39ca47f866c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.133504 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.133473    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e6b1732e-6dcd-4234-8a47-a39ca47f866c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.133504 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.133499    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e6b1732e-6dcd-4234-8a47-a39ca47f866c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.133598 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.133528    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e6b1732e-6dcd-4234-8a47-a39ca47f866c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.133598 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.133552    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e6b1732e-6dcd-4234-8a47-a39ca47f866c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.133598 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.133582    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6b1732e-6dcd-4234-8a47-a39ca47f866c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.133721 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.133627    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e6b1732e-6dcd-4234-8a47-a39ca47f866c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.133721 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.133651    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6b1732e-6dcd-4234-8a47-a39ca47f866c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.133721 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.133681    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e6b1732e-6dcd-4234-8a47-a39ca47f866c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.133864 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.133727    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e6b1732e-6dcd-4234-8a47-a39ca47f866c-web-config\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.133864 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.133761    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e6b1732e-6dcd-4234-8a47-a39ca47f866c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.133864 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.133800    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e6b1732e-6dcd-4234-8a47-a39ca47f866c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.133864 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.133823    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm2cn\" (UniqueName: \"kubernetes.io/projected/e6b1732e-6dcd-4234-8a47-a39ca47f866c-kube-api-access-nm2cn\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.133864 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.133858    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6b1732e-6dcd-4234-8a47-a39ca47f866c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.134111 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.133904    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e6b1732e-6dcd-4234-8a47-a39ca47f866c-config-out\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.134111 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.133938    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e6b1732e-6dcd-4234-8a47-a39ca47f866c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.134208 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.134145    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e6b1732e-6dcd-4234-8a47-a39ca47f866c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.134379 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.134358    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6b1732e-6dcd-4234-8a47-a39ca47f866c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.136306 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.136272    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e6b1732e-6dcd-4234-8a47-a39ca47f866c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.136416 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.136402    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e6b1732e-6dcd-4234-8a47-a39ca47f866c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.137008 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.136710    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e6b1732e-6dcd-4234-8a47-a39ca47f866c-config\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.137008 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.136803    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e6b1732e-6dcd-4234-8a47-a39ca47f866c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.137151 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.137032    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6b1732e-6dcd-4234-8a47-a39ca47f866c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.137622 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.137573    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e6b1732e-6dcd-4234-8a47-a39ca47f866c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.137622 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.137597    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6b1732e-6dcd-4234-8a47-a39ca47f866c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.137770 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.137618    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e6b1732e-6dcd-4234-8a47-a39ca47f866c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.138061 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.138033    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6b1732e-6dcd-4234-8a47-a39ca47f866c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.138515 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.138471    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e6b1732e-6dcd-4234-8a47-a39ca47f866c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.138773 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.138752    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e6b1732e-6dcd-4234-8a47-a39ca47f866c-web-config\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.139770 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.139748    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e6b1732e-6dcd-4234-8a47-a39ca47f866c-config-out\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.139945 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.139918    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e6b1732e-6dcd-4234-8a47-a39ca47f866c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.140119 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.140099    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e6b1732e-6dcd-4234-8a47-a39ca47f866c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.140308 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.140291    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e6b1732e-6dcd-4234-8a47-a39ca47f866c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.142016 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.141991    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e6b1732e-6dcd-4234-8a47-a39ca47f866c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.142170 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.142153    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e6b1732e-6dcd-4234-8a47-a39ca47f866c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.144018 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.143993    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm2cn\" (UniqueName: \"kubernetes.io/projected/e6b1732e-6dcd-4234-8a47-a39ca47f866c-kube-api-access-nm2cn\") pod \"prometheus-k8s-0\" (UID: \"e6b1732e-6dcd-4234-8a47-a39ca47f866c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.275849 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.275819    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:36.374885 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.374779    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nb8wz" event={"ID":"b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679","Type":"ContainerStarted","Data":"780e85ebba598ee3a3671efc7f1301f6e997f9a249ef7dd103942f3f33321c11"}
Sep 08 11:32:36.374885 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.374855    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nb8wz" event={"ID":"b0f4bfd9-1a62-4d5d-b6f5-0d8199c4d679","Type":"ContainerStarted","Data":"15cc2c6092fa8299e61a6234d2af35e6f3dc54c7d4a435137f082f39599b97ea"}
Sep 08 11:32:36.376375 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.376313    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75cdf8555c-zg72s" event={"ID":"5e929af8-ea39-4034-a0dc-0fc17b565598","Type":"ContainerStarted","Data":"e270303ab8f7c32453cec5aef453ff7f605ceff8259852eb25c2492211da25dc"}
Sep 08 11:32:36.393072 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.392878    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nb8wz" podStartSLOduration=130.355718945 podStartE2EDuration="2m11.392863718s" totalImagesPullingTime="1.037144773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:30:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:32:36.392327425 +0000 UTC m=+131.044034247" watchObservedRunningTime="2026-09-08 11:32:36.392863718 +0000 UTC m=+131.044570534"
Sep 08 11:32:36.558061 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:36.558027    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 11:32:36.563610 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:32:36.562269    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6b1732e_6dcd_4234_8a47_a39ca47f866c.slice/crio-ae4c55921b1702a76123afd8cd74351dd875226929bcfc147c4ebdfa90238d06 WatchSource:0}: Error finding container ae4c55921b1702a76123afd8cd74351dd875226929bcfc147c4ebdfa90238d06: Status 404 returned error can't find the container with id ae4c55921b1702a76123afd8cd74351dd875226929bcfc147c4ebdfa90238d06
Sep 08 11:32:37.383447 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:37.383413    2575 generic.go:356] "Generic (PLEG): container finished" podID="e6b1732e-6dcd-4234-8a47-a39ca47f866c" containerID="6895d86c676f06194ca8c2a802ecedadeb70a79370dd07fc83dc8ec1f99b4db3" exitCode=0
Sep 08 11:32:37.383614 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:37.383505    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6b1732e-6dcd-4234-8a47-a39ca47f866c","Type":"ContainerDied","Data":"6895d86c676f06194ca8c2a802ecedadeb70a79370dd07fc83dc8ec1f99b4db3"}
Sep 08 11:32:37.383614 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:37.383589    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6b1732e-6dcd-4234-8a47-a39ca47f866c","Type":"ContainerStarted","Data":"ae4c55921b1702a76123afd8cd74351dd875226929bcfc147c4ebdfa90238d06"}
Sep 08 11:32:38.391901 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:38.391808    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75cdf8555c-zg72s" event={"ID":"5e929af8-ea39-4034-a0dc-0fc17b565598","Type":"ContainerStarted","Data":"92831165fd809e237295e740470441e7c285901ddc1fe2e963c38d52c7cadccc"}
Sep 08 11:32:38.391901 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:38.391884    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75cdf8555c-zg72s" event={"ID":"5e929af8-ea39-4034-a0dc-0fc17b565598","Type":"ContainerStarted","Data":"7a1b7b9e2f7b5c384876520b7eb14dfb9affd04c72a46c80bfd6cbcf6e0c38e7"}
Sep 08 11:32:38.392395 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:38.391917    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75cdf8555c-zg72s" event={"ID":"5e929af8-ea39-4034-a0dc-0fc17b565598","Type":"ContainerStarted","Data":"3c2cf50d893ae6171df728ec15fc5afba00e99d510eb135c30f66aced466b925"}
Sep 08 11:32:38.395516 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:38.395486    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0e0fb083-5f0a-4c4f-9789-004020617190","Type":"ContainerStarted","Data":"a180b8946897f398907d631fdda2484556e301eb6719c51f4673c064c97cfd9d"}
Sep 08 11:32:38.395639 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:38.395562    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0e0fb083-5f0a-4c4f-9789-004020617190","Type":"ContainerStarted","Data":"63a182d23b62d28590b21ae1e1c44c9d9a082275a08a0aed5c7848cc71120509"}
Sep 08 11:32:38.395639 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:38.395595    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0e0fb083-5f0a-4c4f-9789-004020617190","Type":"ContainerStarted","Data":"25ca49abba70a7cc78fe3df9a729cdb86548babb69cfdcdca266f696e95ec839"}
Sep 08 11:32:38.395639 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:38.395620    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0e0fb083-5f0a-4c4f-9789-004020617190","Type":"ContainerStarted","Data":"e4cda6af17ba077b29afb4ff9a37da14c60f90918536de7d1410d605d03f521a"}
Sep 08 11:32:38.395800 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:38.395650    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0e0fb083-5f0a-4c4f-9789-004020617190","Type":"ContainerStarted","Data":"12390df6420fa92aed02269cf625fc0784b3f12ed97e3b5e87dcffa07e45d6d2"}
Sep 08 11:32:38.416455 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:38.416401    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-75cdf8555c-zg72s" podStartSLOduration=2.043031792 podStartE2EDuration="4.416380147s" totalImagesPullingTime="2.373348355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:32:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:32:38.415019034 +0000 UTC m=+133.066725850" watchObservedRunningTime="2026-09-08 11:32:38.416380147 +0000 UTC m=+133.068086942"
Sep 08 11:32:39.279395 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:39.279366    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-64f5c77786-bqrll"
Sep 08 11:32:39.404709 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:39.404669    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0e0fb083-5f0a-4c4f-9789-004020617190","Type":"ContainerStarted","Data":"f61238880fec8c250a3152cfba993ee2fd80decb038307548042bdbdbd10f803"}
Sep 08 11:32:39.438683 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:39.438626    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.060339136 podStartE2EDuration="9.438605068s" totalImagesPullingTime="5.358226625s" totalInitContainerRuntime="20.039307ms" isStatefulPod=false podCreationTimestamp="2026-09-08 11:32:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:32:39.437844569 +0000 UTC m=+134.089551576" watchObservedRunningTime="2026-09-08 11:32:39.438605068 +0000 UTC m=+134.090311861"
Sep 08 11:32:41.416627 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:41.416583    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6b1732e-6dcd-4234-8a47-a39ca47f866c","Type":"ContainerStarted","Data":"d1aed51b71c166d5b8f40626402a5316e319bc60558b263dd6531597c06e6509"}
Sep 08 11:32:41.417118 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:41.416661    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6b1732e-6dcd-4234-8a47-a39ca47f866c","Type":"ContainerStarted","Data":"f3901d6544a13ab859aee4bfe462c61b7eb3e90b2ca49e897e5dce2ca4baab19"}
Sep 08 11:32:43.428683 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:43.428649    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6b1732e-6dcd-4234-8a47-a39ca47f866c","Type":"ContainerStarted","Data":"b91638b08f9330e76c981ffb85bf92c437efa44be8977d3a938537a53e330fd1"}
Sep 08 11:32:43.429043 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:43.428709    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6b1732e-6dcd-4234-8a47-a39ca47f866c","Type":"ContainerStarted","Data":"be6ad522bdd074b696b39f6f7045d87bc9ac4785b23070f24afb3c4d918d9ffa"}
Sep 08 11:32:43.429043 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:43.428736    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6b1732e-6dcd-4234-8a47-a39ca47f866c","Type":"ContainerStarted","Data":"5a530666cde4b7572eea9935b323c9b31c3b9c031ba059b5ce3af9d0e069ef5d"}
Sep 08 11:32:43.429043 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:43.428760    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6b1732e-6dcd-4234-8a47-a39ca47f866c","Type":"ContainerStarted","Data":"9f5c691bd83198bcef78c892959c169c8e09283ffa0afd35d88b8dfcea98c3f5"}
Sep 08 11:32:43.462919 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:43.462866    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.08347219 podStartE2EDuration="8.462846781s" totalImagesPullingTime="5.353424343s" totalInitContainerRuntime="25.950248ms" isStatefulPod=false podCreationTimestamp="2026-09-08 11:32:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:32:43.461644259 +0000 UTC m=+138.113351053" watchObservedRunningTime="2026-09-08 11:32:43.462846781 +0000 UTC m=+138.114553575"
Sep 08 11:32:46.276232 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:46.276196    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:32:52.466271 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:52.466237    2575 generic.go:356] "Generic (PLEG): container finished" podID="7b6421d4-66bb-466a-b4fa-0d57d75e6d46" containerID="68bdfcb0ea45cfa726911b8328aa9251da776735844c1dd6bb5120e6abb4ec87" exitCode=0
Sep 08 11:32:52.466631 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:52.466278    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-2hc2h" event={"ID":"7b6421d4-66bb-466a-b4fa-0d57d75e6d46","Type":"ContainerDied","Data":"68bdfcb0ea45cfa726911b8328aa9251da776735844c1dd6bb5120e6abb4ec87"}
Sep 08 11:32:52.466631 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:52.466601    2575 scope.go:117] "RemoveContainer" containerID="68bdfcb0ea45cfa726911b8328aa9251da776735844c1dd6bb5120e6abb4ec87"
Sep 08 11:32:53.471936 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:53.471904    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-2hc2h" event={"ID":"7b6421d4-66bb-466a-b4fa-0d57d75e6d46","Type":"ContainerStarted","Data":"65b80cc6a4ef00929b66a4e351e90a1e4456581cb25e357f27e785ef293b6376"}
Sep 08 11:32:59.446534 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:59.446469    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-97fb98fdf-dlhj8" podUID="9186cba5-5968-4a09-9297-9e9892d127ce" containerName="console" containerID="cri-o://33875bb6f287fe61b507b805aa9c0bf97ca9a0135a7d01bad4ae32ae268b801f" gracePeriod=15
Sep 08 11:32:59.682201 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:59.682180    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97fb98fdf-dlhj8"
Sep 08 11:32:59.736215 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:59.736146    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9186cba5-5968-4a09-9297-9e9892d127ce-service-ca\") pod \"9186cba5-5968-4a09-9297-9e9892d127ce\" (UID: \"9186cba5-5968-4a09-9297-9e9892d127ce\") "
Sep 08 11:32:59.736215 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:59.736191    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9186cba5-5968-4a09-9297-9e9892d127ce-console-serving-cert\") pod \"9186cba5-5968-4a09-9297-9e9892d127ce\" (UID: \"9186cba5-5968-4a09-9297-9e9892d127ce\") "
Sep 08 11:32:59.736429 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:59.736231    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnvvb\" (UniqueName: \"kubernetes.io/projected/9186cba5-5968-4a09-9297-9e9892d127ce-kube-api-access-wnvvb\") pod \"9186cba5-5968-4a09-9297-9e9892d127ce\" (UID: \"9186cba5-5968-4a09-9297-9e9892d127ce\") "
Sep 08 11:32:59.736429 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:59.736253    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9186cba5-5968-4a09-9297-9e9892d127ce-trusted-ca-bundle\") pod \"9186cba5-5968-4a09-9297-9e9892d127ce\" (UID: \"9186cba5-5968-4a09-9297-9e9892d127ce\") "
Sep 08 11:32:59.736429 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:59.736284    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9186cba5-5968-4a09-9297-9e9892d127ce-console-config\") pod \"9186cba5-5968-4a09-9297-9e9892d127ce\" (UID: \"9186cba5-5968-4a09-9297-9e9892d127ce\") "
Sep 08 11:32:59.736429 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:59.736405    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9186cba5-5968-4a09-9297-9e9892d127ce-console-oauth-config\") pod \"9186cba5-5968-4a09-9297-9e9892d127ce\" (UID: \"9186cba5-5968-4a09-9297-9e9892d127ce\") "
Sep 08 11:32:59.736623 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:59.736448    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9186cba5-5968-4a09-9297-9e9892d127ce-oauth-serving-cert\") pod \"9186cba5-5968-4a09-9297-9e9892d127ce\" (UID: \"9186cba5-5968-4a09-9297-9e9892d127ce\") "
Sep 08 11:32:59.736623 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:59.736599    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9186cba5-5968-4a09-9297-9e9892d127ce-service-ca" (OuterVolumeSpecName: "service-ca") pod "9186cba5-5968-4a09-9297-9e9892d127ce" (UID: "9186cba5-5968-4a09-9297-9e9892d127ce"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:32:59.736729 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:59.736664    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9186cba5-5968-4a09-9297-9e9892d127ce-console-config" (OuterVolumeSpecName: "console-config") pod "9186cba5-5968-4a09-9297-9e9892d127ce" (UID: "9186cba5-5968-4a09-9297-9e9892d127ce"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:32:59.736795 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:59.736777    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9186cba5-5968-4a09-9297-9e9892d127ce-service-ca\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:32:59.736847 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:59.736798    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9186cba5-5968-4a09-9297-9e9892d127ce-console-config\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:32:59.736847 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:59.736795    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9186cba5-5968-4a09-9297-9e9892d127ce-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9186cba5-5968-4a09-9297-9e9892d127ce" (UID: "9186cba5-5968-4a09-9297-9e9892d127ce"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:32:59.736920 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:59.736899    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9186cba5-5968-4a09-9297-9e9892d127ce-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9186cba5-5968-4a09-9297-9e9892d127ce" (UID: "9186cba5-5968-4a09-9297-9e9892d127ce"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:32:59.738811 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:59.738789    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9186cba5-5968-4a09-9297-9e9892d127ce-kube-api-access-wnvvb" (OuterVolumeSpecName: "kube-api-access-wnvvb") pod "9186cba5-5968-4a09-9297-9e9892d127ce" (UID: "9186cba5-5968-4a09-9297-9e9892d127ce"). InnerVolumeSpecName "kube-api-access-wnvvb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:32:59.738993 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:59.738967    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9186cba5-5968-4a09-9297-9e9892d127ce-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9186cba5-5968-4a09-9297-9e9892d127ce" (UID: "9186cba5-5968-4a09-9297-9e9892d127ce"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:32:59.739088 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:59.738989    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9186cba5-5968-4a09-9297-9e9892d127ce-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9186cba5-5968-4a09-9297-9e9892d127ce" (UID: "9186cba5-5968-4a09-9297-9e9892d127ce"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:32:59.837597 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:59.837569    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9186cba5-5968-4a09-9297-9e9892d127ce-console-serving-cert\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:32:59.837597 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:59.837598    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnvvb\" (UniqueName: \"kubernetes.io/projected/9186cba5-5968-4a09-9297-9e9892d127ce-kube-api-access-wnvvb\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:32:59.837743 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:59.837611    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9186cba5-5968-4a09-9297-9e9892d127ce-trusted-ca-bundle\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:32:59.837743 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:59.837624    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9186cba5-5968-4a09-9297-9e9892d127ce-console-oauth-config\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:32:59.837743 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:32:59.837638    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9186cba5-5968-4a09-9297-9e9892d127ce-oauth-serving-cert\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:33:00.503385 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:33:00.503330    2575 generic.go:356] "Generic (PLEG): container finished" podID="9186cba5-5968-4a09-9297-9e9892d127ce" containerID="33875bb6f287fe61b507b805aa9c0bf97ca9a0135a7d01bad4ae32ae268b801f" exitCode=0
Sep 08 11:33:00.503802 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:33:00.503399    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97fb98fdf-dlhj8"
Sep 08 11:33:00.503802 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:33:00.503406    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97fb98fdf-dlhj8" event={"ID":"9186cba5-5968-4a09-9297-9e9892d127ce","Type":"ContainerDied","Data":"33875bb6f287fe61b507b805aa9c0bf97ca9a0135a7d01bad4ae32ae268b801f"}
Sep 08 11:33:00.503802 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:33:00.503481    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97fb98fdf-dlhj8" event={"ID":"9186cba5-5968-4a09-9297-9e9892d127ce","Type":"ContainerDied","Data":"40b3cbae7ae9d9b433fe9ff52e59fc4fd8bb17ae8b4c37f7a7263a46362bb62f"}
Sep 08 11:33:00.504096 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:33:00.504080    2575 scope.go:117] "RemoveContainer" containerID="33875bb6f287fe61b507b805aa9c0bf97ca9a0135a7d01bad4ae32ae268b801f"
Sep 08 11:33:00.512436 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:33:00.512417    2575 scope.go:117] "RemoveContainer" containerID="33875bb6f287fe61b507b805aa9c0bf97ca9a0135a7d01bad4ae32ae268b801f"
Sep 08 11:33:00.512744 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:33:00.512724    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33875bb6f287fe61b507b805aa9c0bf97ca9a0135a7d01bad4ae32ae268b801f\": container with ID starting with 33875bb6f287fe61b507b805aa9c0bf97ca9a0135a7d01bad4ae32ae268b801f not found: ID does not exist" containerID="33875bb6f287fe61b507b805aa9c0bf97ca9a0135a7d01bad4ae32ae268b801f"
Sep 08 11:33:00.512828 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:33:00.512764    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33875bb6f287fe61b507b805aa9c0bf97ca9a0135a7d01bad4ae32ae268b801f"} err="failed to get container status \"33875bb6f287fe61b507b805aa9c0bf97ca9a0135a7d01bad4ae32ae268b801f\": rpc error: code = NotFound desc = could not find container \"33875bb6f287fe61b507b805aa9c0bf97ca9a0135a7d01bad4ae32ae268b801f\": container with ID starting with 33875bb6f287fe61b507b805aa9c0bf97ca9a0135a7d01bad4ae32ae268b801f not found: ID does not exist"
Sep 08 11:33:00.523394 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:33:00.523373    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-97fb98fdf-dlhj8"]
Sep 08 11:33:00.529815 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:33:00.529796    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-97fb98fdf-dlhj8"]
Sep 08 11:33:01.839843 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:33:01.839811    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9186cba5-5968-4a09-9297-9e9892d127ce" path="/var/lib/kubelet/pods/9186cba5-5968-4a09-9297-9e9892d127ce/volumes"
Sep 08 11:33:36.276821 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:33:36.276785    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:33:36.293026 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:33:36.293001    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:33:36.684334 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:33:36.684263    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:35:25.744947 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:35:25.744916    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m57jb_63788019-f061-44d6-89a3-50c4a62e9fbf/ovn-acl-logging/0.log"
Sep 08 11:35:25.747184 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:35:25.747162    2575 kubelet.go:1648] "Image garbage collection succeeded"
Sep 08 11:35:25.748194 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:35:25.748174    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m57jb_63788019-f061-44d6-89a3-50c4a62e9fbf/ovn-acl-logging/0.log"
Sep 08 11:36:02.088471 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:02.088442    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dd45fbd48-4c2x2"]
Sep 08 11:36:02.090858 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:02.089408    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9186cba5-5968-4a09-9297-9e9892d127ce" containerName="console"
Sep 08 11:36:02.090858 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:02.089430    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9186cba5-5968-4a09-9297-9e9892d127ce" containerName="console"
Sep 08 11:36:02.090858 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:02.089530    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9186cba5-5968-4a09-9297-9e9892d127ce" containerName="console"
Sep 08 11:36:02.093040 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:02.093023    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dd45fbd48-4c2x2"
Sep 08 11:36:02.097496 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:02.097473    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 08 11:36:02.097626 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:02.097538    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 08 11:36:02.097796 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:02.097780    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-646dc\""
Sep 08 11:36:02.098020 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:02.097999    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 08 11:36:02.098824 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:02.098801    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 08 11:36:02.135126 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:02.135098    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dd45fbd48-4c2x2"]
Sep 08 11:36:02.176037 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:02.175999    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qng2f\" (UniqueName: \"kubernetes.io/projected/f8527972-0b8a-4de0-b888-cab3cba1935b-kube-api-access-qng2f\") pod \"opendatahub-operator-controller-manager-7dd45fbd48-4c2x2\" (UID: \"f8527972-0b8a-4de0-b888-cab3cba1935b\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd45fbd48-4c2x2"
Sep 08 11:36:02.176206 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:02.176090    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f8527972-0b8a-4de0-b888-cab3cba1935b-manifests\") pod \"opendatahub-operator-controller-manager-7dd45fbd48-4c2x2\" (UID: \"f8527972-0b8a-4de0-b888-cab3cba1935b\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd45fbd48-4c2x2"
Sep 08 11:36:02.176206 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:02.176122    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8527972-0b8a-4de0-b888-cab3cba1935b-tmp\") pod \"opendatahub-operator-controller-manager-7dd45fbd48-4c2x2\" (UID: \"f8527972-0b8a-4de0-b888-cab3cba1935b\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd45fbd48-4c2x2"
Sep 08 11:36:02.176206 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:02.176184    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f8527972-0b8a-4de0-b888-cab3cba1935b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dd45fbd48-4c2x2\" (UID: \"f8527972-0b8a-4de0-b888-cab3cba1935b\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd45fbd48-4c2x2"
Sep 08 11:36:02.176378 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:02.176235    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f8527972-0b8a-4de0-b888-cab3cba1935b-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dd45fbd48-4c2x2\" (UID: \"f8527972-0b8a-4de0-b888-cab3cba1935b\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd45fbd48-4c2x2"
Sep 08 11:36:02.277146 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:02.277102    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8527972-0b8a-4de0-b888-cab3cba1935b-tmp\") pod \"opendatahub-operator-controller-manager-7dd45fbd48-4c2x2\" (UID: \"f8527972-0b8a-4de0-b888-cab3cba1935b\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd45fbd48-4c2x2"
Sep 08 11:36:02.277146 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:02.277139    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f8527972-0b8a-4de0-b888-cab3cba1935b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dd45fbd48-4c2x2\" (UID: \"f8527972-0b8a-4de0-b888-cab3cba1935b\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd45fbd48-4c2x2"
Sep 08 11:36:02.277423 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:02.277173    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f8527972-0b8a-4de0-b888-cab3cba1935b-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dd45fbd48-4c2x2\" (UID: \"f8527972-0b8a-4de0-b888-cab3cba1935b\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd45fbd48-4c2x2"
Sep 08 11:36:02.277423 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:02.277377    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qng2f\" (UniqueName: \"kubernetes.io/projected/f8527972-0b8a-4de0-b888-cab3cba1935b-kube-api-access-qng2f\") pod \"opendatahub-operator-controller-manager-7dd45fbd48-4c2x2\" (UID: \"f8527972-0b8a-4de0-b888-cab3cba1935b\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd45fbd48-4c2x2"
Sep 08 11:36:02.277547 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:02.277484    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f8527972-0b8a-4de0-b888-cab3cba1935b-manifests\") pod \"opendatahub-operator-controller-manager-7dd45fbd48-4c2x2\" (UID: \"f8527972-0b8a-4de0-b888-cab3cba1935b\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd45fbd48-4c2x2"
Sep 08 11:36:02.277870 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:02.277840    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f8527972-0b8a-4de0-b888-cab3cba1935b-manifests\") pod \"opendatahub-operator-controller-manager-7dd45fbd48-4c2x2\" (UID: \"f8527972-0b8a-4de0-b888-cab3cba1935b\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd45fbd48-4c2x2"
Sep 08 11:36:02.279674 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:02.279652    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8527972-0b8a-4de0-b888-cab3cba1935b-tmp\") pod \"opendatahub-operator-controller-manager-7dd45fbd48-4c2x2\" (UID: \"f8527972-0b8a-4de0-b888-cab3cba1935b\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd45fbd48-4c2x2"
Sep 08 11:36:02.279872 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:02.279854    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f8527972-0b8a-4de0-b888-cab3cba1935b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dd45fbd48-4c2x2\" (UID: \"f8527972-0b8a-4de0-b888-cab3cba1935b\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd45fbd48-4c2x2"
Sep 08 11:36:02.279980 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:02.279958    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f8527972-0b8a-4de0-b888-cab3cba1935b-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dd45fbd48-4c2x2\" (UID: \"f8527972-0b8a-4de0-b888-cab3cba1935b\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd45fbd48-4c2x2"
Sep 08 11:36:02.287924 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:02.287901    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qng2f\" (UniqueName: \"kubernetes.io/projected/f8527972-0b8a-4de0-b888-cab3cba1935b-kube-api-access-qng2f\") pod \"opendatahub-operator-controller-manager-7dd45fbd48-4c2x2\" (UID: \"f8527972-0b8a-4de0-b888-cab3cba1935b\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd45fbd48-4c2x2"
Sep 08 11:36:02.407850 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:02.407761    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dd45fbd48-4c2x2"
Sep 08 11:36:02.687906 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:02.687834    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dd45fbd48-4c2x2"]
Sep 08 11:36:02.690973 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:36:02.690939    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8527972_0b8a_4de0_b888_cab3cba1935b.slice/crio-f644ae39c6a5ed4fe55341ce016b74bccafb30e98e8c202ba453cfd6dc70411e WatchSource:0}: Error finding container f644ae39c6a5ed4fe55341ce016b74bccafb30e98e8c202ba453cfd6dc70411e: Status 404 returned error can't find the container with id f644ae39c6a5ed4fe55341ce016b74bccafb30e98e8c202ba453cfd6dc70411e
Sep 08 11:36:02.692785 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:02.692768    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 11:36:03.250945 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:03.250910    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dd45fbd48-4c2x2" event={"ID":"f8527972-0b8a-4de0-b888-cab3cba1935b","Type":"ContainerStarted","Data":"f644ae39c6a5ed4fe55341ce016b74bccafb30e98e8c202ba453cfd6dc70411e"}
Sep 08 11:36:06.267303 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:06.267221    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dd45fbd48-4c2x2" event={"ID":"f8527972-0b8a-4de0-b888-cab3cba1935b","Type":"ContainerStarted","Data":"1f93e09bc7b7df3a268f592f3ea27c97791bbe36cff3e929824d36c0435e821b"}
Sep 08 11:36:07.273640 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:07.273611    2575 generic.go:356] "Generic (PLEG): container finished" podID="f8527972-0b8a-4de0-b888-cab3cba1935b" containerID="1f93e09bc7b7df3a268f592f3ea27c97791bbe36cff3e929824d36c0435e821b" exitCode=0
Sep 08 11:36:07.274005 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:07.273657    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dd45fbd48-4c2x2" event={"ID":"f8527972-0b8a-4de0-b888-cab3cba1935b","Type":"ContainerDied","Data":"1f93e09bc7b7df3a268f592f3ea27c97791bbe36cff3e929824d36c0435e821b"}
Sep 08 11:36:08.280154 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:08.280090    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dd45fbd48-4c2x2" event={"ID":"f8527972-0b8a-4de0-b888-cab3cba1935b","Type":"ContainerStarted","Data":"aad16c2c6f8bab14ad6c3a4fa54912d0654f77442218c5d7498ae90467d80378"}
Sep 08 11:36:08.280764 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:08.280361    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7dd45fbd48-4c2x2"
Sep 08 11:36:08.315177 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:08.315110    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7dd45fbd48-4c2x2" podStartSLOduration=1.481642709 podStartE2EDuration="6.315086393s" totalImagesPullingTime="3.797608398s" totalInitContainerRuntime="1.035835286s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:36:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:36:08.313694035 +0000 UTC m=+342.965400829" watchObservedRunningTime="2026-09-08 11:36:08.315086393 +0000 UTC m=+342.966793188"
Sep 08 11:36:19.287520 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:19.287450    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7dd45fbd48-4c2x2"
Sep 08 11:36:21.988369 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:21.986898    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-b949f5b5c-gckw5"]
Sep 08 11:36:21.994890 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:21.994861    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-b949f5b5c-gckw5"
Sep 08 11:36:21.998872 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:21.998852    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 08 11:36:21.999505 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:21.999486    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 08 11:36:21.999965 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:21.999945    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 08 11:36:21.999965 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:21.999957    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 08 11:36:22.000414 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:22.000394    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-rlc4f\""
Sep 08 11:36:22.000414 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:22.000410    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 08 11:36:22.006115 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:22.006093    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-b949f5b5c-gckw5"]
Sep 08 11:36:22.046722 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:22.046692    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2d7511b1-4d6b-415e-8f40-aecb65224d2e-metrics-cert\") pod \"lws-controller-manager-b949f5b5c-gckw5\" (UID: \"2d7511b1-4d6b-415e-8f40-aecb65224d2e\") " pod="openshift-lws-operator/lws-controller-manager-b949f5b5c-gckw5"
Sep 08 11:36:22.046874 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:22.046734    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d7511b1-4d6b-415e-8f40-aecb65224d2e-cert\") pod \"lws-controller-manager-b949f5b5c-gckw5\" (UID: \"2d7511b1-4d6b-415e-8f40-aecb65224d2e\") " pod="openshift-lws-operator/lws-controller-manager-b949f5b5c-gckw5"
Sep 08 11:36:22.046874 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:22.046813    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd4q8\" (UniqueName: \"kubernetes.io/projected/2d7511b1-4d6b-415e-8f40-aecb65224d2e-kube-api-access-dd4q8\") pod \"lws-controller-manager-b949f5b5c-gckw5\" (UID: \"2d7511b1-4d6b-415e-8f40-aecb65224d2e\") " pod="openshift-lws-operator/lws-controller-manager-b949f5b5c-gckw5"
Sep 08 11:36:22.046874 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:22.046845    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2d7511b1-4d6b-415e-8f40-aecb65224d2e-manager-config\") pod \"lws-controller-manager-b949f5b5c-gckw5\" (UID: \"2d7511b1-4d6b-415e-8f40-aecb65224d2e\") " pod="openshift-lws-operator/lws-controller-manager-b949f5b5c-gckw5"
Sep 08 11:36:22.148068 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:22.148033    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d7511b1-4d6b-415e-8f40-aecb65224d2e-cert\") pod \"lws-controller-manager-b949f5b5c-gckw5\" (UID: \"2d7511b1-4d6b-415e-8f40-aecb65224d2e\") " pod="openshift-lws-operator/lws-controller-manager-b949f5b5c-gckw5"
Sep 08 11:36:22.148271 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:22.148095    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd4q8\" (UniqueName: \"kubernetes.io/projected/2d7511b1-4d6b-415e-8f40-aecb65224d2e-kube-api-access-dd4q8\") pod \"lws-controller-manager-b949f5b5c-gckw5\" (UID: \"2d7511b1-4d6b-415e-8f40-aecb65224d2e\") " pod="openshift-lws-operator/lws-controller-manager-b949f5b5c-gckw5"
Sep 08 11:36:22.148271 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:22.148129    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2d7511b1-4d6b-415e-8f40-aecb65224d2e-manager-config\") pod \"lws-controller-manager-b949f5b5c-gckw5\" (UID: \"2d7511b1-4d6b-415e-8f40-aecb65224d2e\") " pod="openshift-lws-operator/lws-controller-manager-b949f5b5c-gckw5"
Sep 08 11:36:22.148271 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:22.148161    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2d7511b1-4d6b-415e-8f40-aecb65224d2e-metrics-cert\") pod \"lws-controller-manager-b949f5b5c-gckw5\" (UID: \"2d7511b1-4d6b-415e-8f40-aecb65224d2e\") " pod="openshift-lws-operator/lws-controller-manager-b949f5b5c-gckw5"
Sep 08 11:36:22.148907 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:22.148811    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2d7511b1-4d6b-415e-8f40-aecb65224d2e-manager-config\") pod \"lws-controller-manager-b949f5b5c-gckw5\" (UID: \"2d7511b1-4d6b-415e-8f40-aecb65224d2e\") " pod="openshift-lws-operator/lws-controller-manager-b949f5b5c-gckw5"
Sep 08 11:36:22.150761 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:22.150738    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2d7511b1-4d6b-415e-8f40-aecb65224d2e-metrics-cert\") pod \"lws-controller-manager-b949f5b5c-gckw5\" (UID: \"2d7511b1-4d6b-415e-8f40-aecb65224d2e\") " pod="openshift-lws-operator/lws-controller-manager-b949f5b5c-gckw5"
Sep 08 11:36:22.150867 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:22.150852    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d7511b1-4d6b-415e-8f40-aecb65224d2e-cert\") pod \"lws-controller-manager-b949f5b5c-gckw5\" (UID: \"2d7511b1-4d6b-415e-8f40-aecb65224d2e\") " pod="openshift-lws-operator/lws-controller-manager-b949f5b5c-gckw5"
Sep 08 11:36:22.157904 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:22.157885    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd4q8\" (UniqueName: \"kubernetes.io/projected/2d7511b1-4d6b-415e-8f40-aecb65224d2e-kube-api-access-dd4q8\") pod \"lws-controller-manager-b949f5b5c-gckw5\" (UID: \"2d7511b1-4d6b-415e-8f40-aecb65224d2e\") " pod="openshift-lws-operator/lws-controller-manager-b949f5b5c-gckw5"
Sep 08 11:36:22.305019 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:22.304993    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-b949f5b5c-gckw5"
Sep 08 11:36:22.583572 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:22.583500    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-b949f5b5c-gckw5"]
Sep 08 11:36:22.587310 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:36:22.587270    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d7511b1_4d6b_415e_8f40_aecb65224d2e.slice/crio-63cce23495db27bc0f2fe605d2a5279a79a250e5c4754e191def4bfeb76cd7be WatchSource:0}: Error finding container 63cce23495db27bc0f2fe605d2a5279a79a250e5c4754e191def4bfeb76cd7be: Status 404 returned error can't find the container with id 63cce23495db27bc0f2fe605d2a5279a79a250e5c4754e191def4bfeb76cd7be
Sep 08 11:36:23.347513 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:23.347476    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-b949f5b5c-gckw5" event={"ID":"2d7511b1-4d6b-415e-8f40-aecb65224d2e","Type":"ContainerStarted","Data":"63cce23495db27bc0f2fe605d2a5279a79a250e5c4754e191def4bfeb76cd7be"}
Sep 08 11:36:25.359041 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:25.359008    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-b949f5b5c-gckw5" event={"ID":"2d7511b1-4d6b-415e-8f40-aecb65224d2e","Type":"ContainerStarted","Data":"f874cc8450e3bece04620f4a4302ad190d80d920902a946657521393fd9259ed"}
Sep 08 11:36:25.359441 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:25.359073    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-b949f5b5c-gckw5"
Sep 08 11:36:25.379178 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:25.379121    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-b949f5b5c-gckw5" podStartSLOduration=1.7194748880000001 podStartE2EDuration="4.379106487s" totalImagesPullingTime="2.659631599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:36:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:36:25.378144435 +0000 UTC m=+360.029851247" watchObservedRunningTime="2026-09-08 11:36:25.379106487 +0000 UTC m=+360.030813282"
Sep 08 11:36:29.035477 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:29.035443    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb"]
Sep 08 11:36:29.040247 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:29.040225    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb"
Sep 08 11:36:29.042939 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:29.042919    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 08 11:36:29.043056 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:29.042922    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-zlnbp\""
Sep 08 11:36:29.052970 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:29.052942    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb"]
Sep 08 11:36:29.109519 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:29.109480    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e09a6b8c-164d-414d-a80e-1bd05d882785-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb\" (UID: \"e09a6b8c-164d-414d-a80e-1bd05d882785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb"
Sep 08 11:36:29.109519 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:29.109531    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e09a6b8c-164d-414d-a80e-1bd05d882785-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb\" (UID: \"e09a6b8c-164d-414d-a80e-1bd05d882785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb"
Sep 08 11:36:29.109734 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:29.109561    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e09a6b8c-164d-414d-a80e-1bd05d882785-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb\" (UID: \"e09a6b8c-164d-414d-a80e-1bd05d882785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb"
Sep 08 11:36:29.109734 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:29.109627    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e09a6b8c-164d-414d-a80e-1bd05d882785-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb\" (UID: \"e09a6b8c-164d-414d-a80e-1bd05d882785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb"
Sep 08 11:36:29.109734 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:29.109661    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldgvk\" (UniqueName: \"kubernetes.io/projected/e09a6b8c-164d-414d-a80e-1bd05d882785-kube-api-access-ldgvk\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb\" (UID: \"e09a6b8c-164d-414d-a80e-1bd05d882785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb"
Sep 08 11:36:29.109734 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:29.109680    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e09a6b8c-164d-414d-a80e-1bd05d882785-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb\" (UID: \"e09a6b8c-164d-414d-a80e-1bd05d882785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb"
Sep 08 11:36:29.109734 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:29.109703    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e09a6b8c-164d-414d-a80e-1bd05d882785-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb\" (UID: \"e09a6b8c-164d-414d-a80e-1bd05d882785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb"
Sep 08 11:36:29.109891 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:29.109778    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e09a6b8c-164d-414d-a80e-1bd05d882785-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb\" (UID: \"e09a6b8c-164d-414d-a80e-1bd05d882785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb"
Sep 08 11:36:29.109891 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:29.109823    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e09a6b8c-164d-414d-a80e-1bd05d882785-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb\" (UID: \"e09a6b8c-164d-414d-a80e-1bd05d882785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb"
Sep 08 11:36:29.210571 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:29.210540    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e09a6b8c-164d-414d-a80e-1bd05d882785-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb\" (UID: \"e09a6b8c-164d-414d-a80e-1bd05d882785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb"
Sep 08 11:36:29.210764 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:29.210580    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e09a6b8c-164d-414d-a80e-1bd05d882785-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb\" (UID: \"e09a6b8c-164d-414d-a80e-1bd05d882785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb"
Sep 08 11:36:29.210764 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:29.210610    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e09a6b8c-164d-414d-a80e-1bd05d882785-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb\" (UID: \"e09a6b8c-164d-414d-a80e-1bd05d882785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb"
Sep 08 11:36:29.210764 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:29.210638    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e09a6b8c-164d-414d-a80e-1bd05d882785-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb\" (UID: \"e09a6b8c-164d-414d-a80e-1bd05d882785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb"
Sep 08 11:36:29.210764 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:29.210657    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e09a6b8c-164d-414d-a80e-1bd05d882785-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb\" (UID: \"e09a6b8c-164d-414d-a80e-1bd05d882785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb"
Sep 08 11:36:29.210764 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:29.210673    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldgvk\" (UniqueName: \"kubernetes.io/projected/e09a6b8c-164d-414d-a80e-1bd05d882785-kube-api-access-ldgvk\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb\" (UID: \"e09a6b8c-164d-414d-a80e-1bd05d882785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb"
Sep 08 11:36:29.210764 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:29.210695    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e09a6b8c-164d-414d-a80e-1bd05d882785-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb\" (UID: \"e09a6b8c-164d-414d-a80e-1bd05d882785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb"
Sep 08 11:36:29.210764 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:29.210732    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e09a6b8c-164d-414d-a80e-1bd05d882785-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb\" (UID: \"e09a6b8c-164d-414d-a80e-1bd05d882785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb"
Sep 08 11:36:29.211105 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:29.210810    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e09a6b8c-164d-414d-a80e-1bd05d882785-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb\" (UID: \"e09a6b8c-164d-414d-a80e-1bd05d882785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb"
Sep 08 11:36:29.211105 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:29.211009    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e09a6b8c-164d-414d-a80e-1bd05d882785-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb\" (UID: \"e09a6b8c-164d-414d-a80e-1bd05d882785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb"
Sep 08 11:36:29.211105 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:29.211021    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e09a6b8c-164d-414d-a80e-1bd05d882785-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb\" (UID: \"e09a6b8c-164d-414d-a80e-1bd05d882785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb"
Sep 08 11:36:29.211309 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:29.211289    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e09a6b8c-164d-414d-a80e-1bd05d882785-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb\" (UID: \"e09a6b8c-164d-414d-a80e-1bd05d882785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb"
Sep 08 11:36:29.211431 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:29.211408    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e09a6b8c-164d-414d-a80e-1bd05d882785-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb\" (UID: \"e09a6b8c-164d-414d-a80e-1bd05d882785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb"
Sep 08 11:36:29.211484 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:29.211430    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e09a6b8c-164d-414d-a80e-1bd05d882785-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb\" (UID: \"e09a6b8c-164d-414d-a80e-1bd05d882785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb"
Sep 08 11:36:29.213155 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:29.213139    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e09a6b8c-164d-414d-a80e-1bd05d882785-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb\" (UID: \"e09a6b8c-164d-414d-a80e-1bd05d882785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb"
Sep 08 11:36:29.213485 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:29.213466    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e09a6b8c-164d-414d-a80e-1bd05d882785-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb\" (UID: \"e09a6b8c-164d-414d-a80e-1bd05d882785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb"
Sep 08 11:36:29.220789 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:29.220760    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e09a6b8c-164d-414d-a80e-1bd05d882785-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb\" (UID: \"e09a6b8c-164d-414d-a80e-1bd05d882785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb"
Sep 08 11:36:29.220888 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:29.220870    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldgvk\" (UniqueName: \"kubernetes.io/projected/e09a6b8c-164d-414d-a80e-1bd05d882785-kube-api-access-ldgvk\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb\" (UID: \"e09a6b8c-164d-414d-a80e-1bd05d882785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb"
Sep 08 11:36:29.350674 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:29.350575    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb"
Sep 08 11:36:29.633320 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:29.633173    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb"]
Sep 08 11:36:29.635980 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:36:29.635955    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode09a6b8c_164d_414d_a80e_1bd05d882785.slice/crio-baef8e3fe66d8df199065c0e3a6f8b45667a3a86e053d3c2d2967a88ebc84828 WatchSource:0}: Error finding container baef8e3fe66d8df199065c0e3a6f8b45667a3a86e053d3c2d2967a88ebc84828: Status 404 returned error can't find the container with id baef8e3fe66d8df199065c0e3a6f8b45667a3a86e053d3c2d2967a88ebc84828
Sep 08 11:36:30.382270 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:30.382234    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb" event={"ID":"e09a6b8c-164d-414d-a80e-1bd05d882785","Type":"ContainerStarted","Data":"baef8e3fe66d8df199065c0e3a6f8b45667a3a86e053d3c2d2967a88ebc84828"}
Sep 08 11:36:32.375156 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:32.375115    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-kzlrt"]
Sep 08 11:36:32.378487 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:32.378467    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-kzlrt"
Sep 08 11:36:32.381152 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:32.381132    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-jzpbh\""
Sep 08 11:36:32.381363 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:32.381330    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 08 11:36:32.389468 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:32.389406    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-kzlrt"]
Sep 08 11:36:32.441690 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:32.441654    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25acf891-b23c-418b-8abd-8850ed352df9-cert\") pod \"odh-model-controller-7998c67dc4-kzlrt\" (UID: \"25acf891-b23c-418b-8abd-8850ed352df9\") " pod="opendatahub/odh-model-controller-7998c67dc4-kzlrt"
Sep 08 11:36:32.441878 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:32.441797    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqv9b\" (UniqueName: \"kubernetes.io/projected/25acf891-b23c-418b-8abd-8850ed352df9-kube-api-access-rqv9b\") pod \"odh-model-controller-7998c67dc4-kzlrt\" (UID: \"25acf891-b23c-418b-8abd-8850ed352df9\") " pod="opendatahub/odh-model-controller-7998c67dc4-kzlrt"
Sep 08 11:36:32.543193 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:32.543152    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqv9b\" (UniqueName: \"kubernetes.io/projected/25acf891-b23c-418b-8abd-8850ed352df9-kube-api-access-rqv9b\") pod \"odh-model-controller-7998c67dc4-kzlrt\" (UID: \"25acf891-b23c-418b-8abd-8850ed352df9\") " pod="opendatahub/odh-model-controller-7998c67dc4-kzlrt"
Sep 08 11:36:32.543368 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:32.543214    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25acf891-b23c-418b-8abd-8850ed352df9-cert\") pod \"odh-model-controller-7998c67dc4-kzlrt\" (UID: \"25acf891-b23c-418b-8abd-8850ed352df9\") " pod="opendatahub/odh-model-controller-7998c67dc4-kzlrt"
Sep 08 11:36:32.543368 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:36:32.543311    2575 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 08 11:36:32.543442 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:36:32.543396    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25acf891-b23c-418b-8abd-8850ed352df9-cert podName:25acf891-b23c-418b-8abd-8850ed352df9 nodeName:}" failed. No retries permitted until 2026-09-08 11:36:33.043378007 +0000 UTC m=+367.695084779 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/25acf891-b23c-418b-8abd-8850ed352df9-cert") pod "odh-model-controller-7998c67dc4-kzlrt" (UID: "25acf891-b23c-418b-8abd-8850ed352df9") : secret "odh-model-controller-webhook-cert" not found
Sep 08 11:36:32.552729 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:32.552697    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqv9b\" (UniqueName: \"kubernetes.io/projected/25acf891-b23c-418b-8abd-8850ed352df9-kube-api-access-rqv9b\") pod \"odh-model-controller-7998c67dc4-kzlrt\" (UID: \"25acf891-b23c-418b-8abd-8850ed352df9\") " pod="opendatahub/odh-model-controller-7998c67dc4-kzlrt"
Sep 08 11:36:33.047256 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:33.047221    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25acf891-b23c-418b-8abd-8850ed352df9-cert\") pod \"odh-model-controller-7998c67dc4-kzlrt\" (UID: \"25acf891-b23c-418b-8abd-8850ed352df9\") " pod="opendatahub/odh-model-controller-7998c67dc4-kzlrt"
Sep 08 11:36:33.049593 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:33.049574    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25acf891-b23c-418b-8abd-8850ed352df9-cert\") pod \"odh-model-controller-7998c67dc4-kzlrt\" (UID: \"25acf891-b23c-418b-8abd-8850ed352df9\") " pod="opendatahub/odh-model-controller-7998c67dc4-kzlrt"
Sep 08 11:36:33.072753 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:33.072721    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-n5glp"]
Sep 08 11:36:33.076072 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:33.076051    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-n5glp"
Sep 08 11:36:33.078496 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:33.078478    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 08 11:36:33.078608 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:33.078569    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-jgns7\""
Sep 08 11:36:33.086769 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:33.086749    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-n5glp"]
Sep 08 11:36:33.148589 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:33.148559    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb6tj\" (UniqueName: \"kubernetes.io/projected/12832668-e866-44f0-946f-64ff21a7f8e5-kube-api-access-gb6tj\") pod \"model-serving-api-54d89bd5fc-n5glp\" (UID: \"12832668-e866-44f0-946f-64ff21a7f8e5\") " pod="opendatahub/model-serving-api-54d89bd5fc-n5glp"
Sep 08 11:36:33.148739 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:33.148608    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12832668-e866-44f0-946f-64ff21a7f8e5-tls-certs\") pod \"model-serving-api-54d89bd5fc-n5glp\" (UID: \"12832668-e866-44f0-946f-64ff21a7f8e5\") " pod="opendatahub/model-serving-api-54d89bd5fc-n5glp"
Sep 08 11:36:33.250094 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:33.250060    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb6tj\" (UniqueName: \"kubernetes.io/projected/12832668-e866-44f0-946f-64ff21a7f8e5-kube-api-access-gb6tj\") pod \"model-serving-api-54d89bd5fc-n5glp\" (UID: \"12832668-e866-44f0-946f-64ff21a7f8e5\") " pod="opendatahub/model-serving-api-54d89bd5fc-n5glp"
Sep 08 11:36:33.250252 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:33.250111    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12832668-e866-44f0-946f-64ff21a7f8e5-tls-certs\") pod \"model-serving-api-54d89bd5fc-n5glp\" (UID: \"12832668-e866-44f0-946f-64ff21a7f8e5\") " pod="opendatahub/model-serving-api-54d89bd5fc-n5glp"
Sep 08 11:36:33.250314 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:36:33.250266    2575 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 08 11:36:33.250390 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:36:33.250333    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12832668-e866-44f0-946f-64ff21a7f8e5-tls-certs podName:12832668-e866-44f0-946f-64ff21a7f8e5 nodeName:}" failed. No retries permitted until 2026-09-08 11:36:33.750313941 +0000 UTC m=+368.402020735 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/12832668-e866-44f0-946f-64ff21a7f8e5-tls-certs") pod "model-serving-api-54d89bd5fc-n5glp" (UID: "12832668-e866-44f0-946f-64ff21a7f8e5") : secret "model-serving-api-tls" not found
Sep 08 11:36:33.260928 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:33.260903    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb6tj\" (UniqueName: \"kubernetes.io/projected/12832668-e866-44f0-946f-64ff21a7f8e5-kube-api-access-gb6tj\") pod \"model-serving-api-54d89bd5fc-n5glp\" (UID: \"12832668-e866-44f0-946f-64ff21a7f8e5\") " pod="opendatahub/model-serving-api-54d89bd5fc-n5glp"
Sep 08 11:36:33.292749 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:33.292718    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-kzlrt"
Sep 08 11:36:33.754964 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:33.754868    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12832668-e866-44f0-946f-64ff21a7f8e5-tls-certs\") pod \"model-serving-api-54d89bd5fc-n5glp\" (UID: \"12832668-e866-44f0-946f-64ff21a7f8e5\") " pod="opendatahub/model-serving-api-54d89bd5fc-n5glp"
Sep 08 11:36:33.757856 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:33.757834    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12832668-e866-44f0-946f-64ff21a7f8e5-tls-certs\") pod \"model-serving-api-54d89bd5fc-n5glp\" (UID: \"12832668-e866-44f0-946f-64ff21a7f8e5\") " pod="opendatahub/model-serving-api-54d89bd5fc-n5glp"
Sep 08 11:36:33.986864 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:33.986832    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-n5glp"
Sep 08 11:36:34.251317 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:34.251265    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:36:34.251451 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:34.251408    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:36:34.251513 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:34.251456    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:36:34.406417 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:34.406380    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb" event={"ID":"e09a6b8c-164d-414d-a80e-1bd05d882785","Type":"ContainerStarted","Data":"8cc7820a7b2da69dd9d38366e298c5b25f6d23535db9d5ec526e4e744b886707"}
Sep 08 11:36:34.429726 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:34.429620    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb" podStartSLOduration=0.816766807 podStartE2EDuration="5.429599344s" totalImagesPullingTime="4.612832537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:36:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:36:34.427893066 +0000 UTC m=+369.079599885" watchObservedRunningTime="2026-09-08 11:36:34.429599344 +0000 UTC m=+369.081306139"
Sep 08 11:36:34.450756 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:34.450680    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-kzlrt"]
Sep 08 11:36:34.453221 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:34.453103    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-n5glp"]
Sep 08 11:36:34.454484 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:36:34.454455    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25acf891_b23c_418b_8abd_8850ed352df9.slice/crio-b29667acd4298a0e61768fcd0af404e204ab9cd9b7d498fb63868d845a3f78bf WatchSource:0}: Error finding container b29667acd4298a0e61768fcd0af404e204ab9cd9b7d498fb63868d845a3f78bf: Status 404 returned error can't find the container with id b29667acd4298a0e61768fcd0af404e204ab9cd9b7d498fb63868d845a3f78bf
Sep 08 11:36:34.455210 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:36:34.455186    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12832668_e866_44f0_946f_64ff21a7f8e5.slice/crio-363f6f4ce7d936487043af7fa485f2248c8f3c4c408d9e5d90da08e829f97f1c WatchSource:0}: Error finding container 363f6f4ce7d936487043af7fa485f2248c8f3c4c408d9e5d90da08e829f97f1c: Status 404 returned error can't find the container with id 363f6f4ce7d936487043af7fa485f2248c8f3c4c408d9e5d90da08e829f97f1c
Sep 08 11:36:35.351605 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:35.351528    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb"
Sep 08 11:36:35.357331 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:35.357300    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb"
Sep 08 11:36:35.415896 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:35.415856    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-kzlrt" event={"ID":"25acf891-b23c-418b-8abd-8850ed352df9","Type":"ContainerStarted","Data":"b29667acd4298a0e61768fcd0af404e204ab9cd9b7d498fb63868d845a3f78bf"}
Sep 08 11:36:35.419100 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:35.418877    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-n5glp" event={"ID":"12832668-e866-44f0-946f-64ff21a7f8e5","Type":"ContainerStarted","Data":"363f6f4ce7d936487043af7fa485f2248c8f3c4c408d9e5d90da08e829f97f1c"}
Sep 08 11:36:35.419100 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:35.418932    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb"
Sep 08 11:36:35.420023 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:35.419830    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb"
Sep 08 11:36:36.366310 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:36.366279    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-b949f5b5c-gckw5"
Sep 08 11:36:39.442726 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:39.442687    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-kzlrt" event={"ID":"25acf891-b23c-418b-8abd-8850ed352df9","Type":"ContainerStarted","Data":"0174c31757c4e877a824d013b5a53af20caa9077f01acf37433cf226677cd9a1"}
Sep 08 11:36:39.443179 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:39.442776    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-kzlrt"
Sep 08 11:36:39.444294 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:39.444272    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-n5glp" event={"ID":"12832668-e866-44f0-946f-64ff21a7f8e5","Type":"ContainerStarted","Data":"c8da0d7671c50bec00bf35c4b49b5bd1b4030c32872f93fa4351eef552cf4046"}
Sep 08 11:36:39.444409 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:39.444322    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-n5glp"
Sep 08 11:36:39.463086 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:39.463036    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-kzlrt" podStartSLOduration=3.398235475 podStartE2EDuration="7.463020285s" totalImagesPullingTime="4.06478481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:36:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:36:39.461365061 +0000 UTC m=+374.113071856" watchObservedRunningTime="2026-09-08 11:36:39.463020285 +0000 UTC m=+374.114727079"
Sep 08 11:36:39.483165 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:39.483115    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-n5glp" podStartSLOduration=2.464413612 podStartE2EDuration="6.483099337s" totalImagesPullingTime="4.018685725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:36:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:36:39.481469517 +0000 UTC m=+374.133176329" watchObservedRunningTime="2026-09-08 11:36:39.483099337 +0000 UTC m=+374.134806132"
Sep 08 11:36:42.040780 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:42.040751    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-smdxl"]
Sep 08 11:36:42.044265 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:42.044246    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-smdxl"
Sep 08 11:36:42.047630 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:42.047600    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 08 11:36:42.047948 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:42.047928    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-q982d\""
Sep 08 11:36:42.058779 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:42.058749    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-smdxl"]
Sep 08 11:36:42.138888 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:42.138853    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3385a1d2-4297-4648-8d60-0e44b5532167-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-smdxl\" (UID: \"3385a1d2-4297-4648-8d60-0e44b5532167\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-smdxl"
Sep 08 11:36:42.139065 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:42.138950    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9t6j\" (UniqueName: \"kubernetes.io/projected/3385a1d2-4297-4648-8d60-0e44b5532167-kube-api-access-x9t6j\") pod \"llmisvc-controller-manager-777c6bd7d5-smdxl\" (UID: \"3385a1d2-4297-4648-8d60-0e44b5532167\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-smdxl"
Sep 08 11:36:42.240219 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:42.240188    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9t6j\" (UniqueName: \"kubernetes.io/projected/3385a1d2-4297-4648-8d60-0e44b5532167-kube-api-access-x9t6j\") pod \"llmisvc-controller-manager-777c6bd7d5-smdxl\" (UID: \"3385a1d2-4297-4648-8d60-0e44b5532167\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-smdxl"
Sep 08 11:36:42.246600 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:42.240249    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3385a1d2-4297-4648-8d60-0e44b5532167-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-smdxl\" (UID: \"3385a1d2-4297-4648-8d60-0e44b5532167\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-smdxl"
Sep 08 11:36:42.247793 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:42.247762    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3385a1d2-4297-4648-8d60-0e44b5532167-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-smdxl\" (UID: \"3385a1d2-4297-4648-8d60-0e44b5532167\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-smdxl"
Sep 08 11:36:42.268902 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:42.268874    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9t6j\" (UniqueName: \"kubernetes.io/projected/3385a1d2-4297-4648-8d60-0e44b5532167-kube-api-access-x9t6j\") pod \"llmisvc-controller-manager-777c6bd7d5-smdxl\" (UID: \"3385a1d2-4297-4648-8d60-0e44b5532167\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-smdxl"
Sep 08 11:36:42.354880 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:42.354795    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-smdxl"
Sep 08 11:36:42.630066 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:42.630043    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-smdxl"]
Sep 08 11:36:42.632351 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:36:42.632314    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3385a1d2_4297_4648_8d60_0e44b5532167.slice/crio-d78ad18440211ed42ff8bd480e9de446a202cad391d27f457f3d4e96571eee96 WatchSource:0}: Error finding container d78ad18440211ed42ff8bd480e9de446a202cad391d27f457f3d4e96571eee96: Status 404 returned error can't find the container with id d78ad18440211ed42ff8bd480e9de446a202cad391d27f457f3d4e96571eee96
Sep 08 11:36:43.465043 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:43.465006    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-smdxl" event={"ID":"3385a1d2-4297-4648-8d60-0e44b5532167","Type":"ContainerStarted","Data":"d78ad18440211ed42ff8bd480e9de446a202cad391d27f457f3d4e96571eee96"}
Sep 08 11:36:46.482444 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:46.482410    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-smdxl" event={"ID":"3385a1d2-4297-4648-8d60-0e44b5532167","Type":"ContainerStarted","Data":"bf7684790a89d3286fff4865ec28f9d339951a911a91aaf83de4baed2374338e"}
Sep 08 11:36:46.482848 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:46.482580    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-smdxl"
Sep 08 11:36:46.501884 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:46.501839    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-smdxl" podStartSLOduration=1.501899362 podStartE2EDuration="4.501825682s" totalImagesPullingTime="2.99992632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:36:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:36:46.500878196 +0000 UTC m=+381.152585010" watchObservedRunningTime="2026-09-08 11:36:46.501825682 +0000 UTC m=+381.153532477"
Sep 08 11:36:50.451463 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:50.451435    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-kzlrt"
Sep 08 11:36:50.453553 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:36:50.453535    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-n5glp"
Sep 08 11:37:17.489777 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:37:17.489746    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-smdxl"
Sep 08 11:37:52.656875 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:37:52.656787    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-s2rff"]
Sep 08 11:37:52.660260 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:37:52.660239    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-s2rff"
Sep 08 11:37:52.663228 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:37:52.663212    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 08 11:37:52.663353 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:37:52.663216    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 08 11:37:52.664393 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:37:52.664374    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-x528m\""
Sep 08 11:37:52.670450 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:37:52.670430    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-s2rff"]
Sep 08 11:37:52.756114 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:37:52.756086    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnv8q\" (UniqueName: \"kubernetes.io/projected/82ab5e58-cdc6-4e98-9911-b78aed419be8-kube-api-access-rnv8q\") pod \"limitador-operator-controller-manager-6c549b6d85-s2rff\" (UID: \"82ab5e58-cdc6-4e98-9911-b78aed419be8\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-s2rff"
Sep 08 11:37:52.856707 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:37:52.856669    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnv8q\" (UniqueName: \"kubernetes.io/projected/82ab5e58-cdc6-4e98-9911-b78aed419be8-kube-api-access-rnv8q\") pod \"limitador-operator-controller-manager-6c549b6d85-s2rff\" (UID: \"82ab5e58-cdc6-4e98-9911-b78aed419be8\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-s2rff"
Sep 08 11:37:52.868640 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:37:52.868618    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnv8q\" (UniqueName: \"kubernetes.io/projected/82ab5e58-cdc6-4e98-9911-b78aed419be8-kube-api-access-rnv8q\") pod \"limitador-operator-controller-manager-6c549b6d85-s2rff\" (UID: \"82ab5e58-cdc6-4e98-9911-b78aed419be8\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-s2rff"
Sep 08 11:37:52.970746 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:37:52.970688    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-s2rff"
Sep 08 11:37:53.256204 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:37:53.256176    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-s2rff"]
Sep 08 11:37:53.259563 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:37:53.259522    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82ab5e58_cdc6_4e98_9911_b78aed419be8.slice/crio-bf2733c35c7909ebf48add7fab5f13bda40617174869c377ccdfaa4ff25ab29f WatchSource:0}: Error finding container bf2733c35c7909ebf48add7fab5f13bda40617174869c377ccdfaa4ff25ab29f: Status 404 returned error can't find the container with id bf2733c35c7909ebf48add7fab5f13bda40617174869c377ccdfaa4ff25ab29f
Sep 08 11:37:53.791972 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:37:53.791938    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-s2rff" event={"ID":"82ab5e58-cdc6-4e98-9911-b78aed419be8","Type":"ContainerStarted","Data":"bf2733c35c7909ebf48add7fab5f13bda40617174869c377ccdfaa4ff25ab29f"}
Sep 08 11:37:56.808120 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:37:56.808030    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-s2rff" event={"ID":"82ab5e58-cdc6-4e98-9911-b78aed419be8","Type":"ContainerStarted","Data":"3a4aed7f910081f840e20a4726ffe3b9fbfc9e680c8be74dcfbcd48ccba31b25"}
Sep 08 11:37:56.808120 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:37:56.808093    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-s2rff"
Sep 08 11:37:56.829139 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:37:56.829091    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-s2rff" podStartSLOduration=1.560231733 podStartE2EDuration="4.829075771s" totalImagesPullingTime="3.268844038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:37:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:37:56.828469079 +0000 UTC m=+451.480175904" watchObservedRunningTime="2026-09-08 11:37:56.829075771 +0000 UTC m=+451.480782565"
Sep 08 11:38:07.815656 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:07.815621    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-s2rff"
Sep 08 11:38:11.889472 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:11.889438    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-fb8mh"]
Sep 08 11:38:11.895881 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:11.895863    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-fb8mh"
Sep 08 11:38:11.898721 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:11.898700    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-d9c72\""
Sep 08 11:38:11.907277 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:11.907255    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-fb8mh"]
Sep 08 11:38:12.033926 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:12.033864    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/96e4a0f4-8867-4920-9223-44265bab844a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-fb8mh\" (UID: \"96e4a0f4-8867-4920-9223-44265bab844a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-fb8mh"
Sep 08 11:38:12.034130 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:12.033999    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9tck\" (UniqueName: \"kubernetes.io/projected/96e4a0f4-8867-4920-9223-44265bab844a-kube-api-access-h9tck\") pod \"kuadrant-operator-controller-manager-96db98c47-fb8mh\" (UID: \"96e4a0f4-8867-4920-9223-44265bab844a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-fb8mh"
Sep 08 11:38:12.135057 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:12.135025    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9tck\" (UniqueName: \"kubernetes.io/projected/96e4a0f4-8867-4920-9223-44265bab844a-kube-api-access-h9tck\") pod \"kuadrant-operator-controller-manager-96db98c47-fb8mh\" (UID: \"96e4a0f4-8867-4920-9223-44265bab844a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-fb8mh"
Sep 08 11:38:12.135231 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:12.135081    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/96e4a0f4-8867-4920-9223-44265bab844a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-fb8mh\" (UID: \"96e4a0f4-8867-4920-9223-44265bab844a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-fb8mh"
Sep 08 11:38:12.135427 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:12.135408    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/96e4a0f4-8867-4920-9223-44265bab844a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-fb8mh\" (UID: \"96e4a0f4-8867-4920-9223-44265bab844a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-fb8mh"
Sep 08 11:38:12.147264 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:12.147200    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9tck\" (UniqueName: \"kubernetes.io/projected/96e4a0f4-8867-4920-9223-44265bab844a-kube-api-access-h9tck\") pod \"kuadrant-operator-controller-manager-96db98c47-fb8mh\" (UID: \"96e4a0f4-8867-4920-9223-44265bab844a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-fb8mh"
Sep 08 11:38:12.205781 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:12.205751    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-fb8mh"
Sep 08 11:38:12.490514 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:12.490491    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-fb8mh"]
Sep 08 11:38:12.492761 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:38:12.492733    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96e4a0f4_8867_4920_9223_44265bab844a.slice/crio-5ac45728d6cc02014e19dd22b4f30e61ba66b8f20a260fae61d2674655b8b41c WatchSource:0}: Error finding container 5ac45728d6cc02014e19dd22b4f30e61ba66b8f20a260fae61d2674655b8b41c: Status 404 returned error can't find the container with id 5ac45728d6cc02014e19dd22b4f30e61ba66b8f20a260fae61d2674655b8b41c
Sep 08 11:38:12.887031 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:12.886997    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-fb8mh" event={"ID":"96e4a0f4-8867-4920-9223-44265bab844a","Type":"ContainerStarted","Data":"5ac45728d6cc02014e19dd22b4f30e61ba66b8f20a260fae61d2674655b8b41c"}
Sep 08 11:38:12.944487 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:12.944452    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-fb8mh"]
Sep 08 11:38:12.954704 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:12.954674    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-fb8mh"]
Sep 08 11:38:12.972120 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:12.972092    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-s2rff"]
Sep 08 11:38:12.972415 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:12.972360    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-s2rff" podUID="82ab5e58-cdc6-4e98-9911-b78aed419be8" containerName="manager" containerID="cri-o://3a4aed7f910081f840e20a4726ffe3b9fbfc9e680c8be74dcfbcd48ccba31b25" gracePeriod=2
Sep 08 11:38:12.976759 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:12.976732    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-c75ns"]
Sep 08 11:38:12.983250 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:12.983228    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-c75ns"
Sep 08 11:38:12.987161 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:38:12.987122    2575 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"82ab5e58-cdc6-4e98-9911-b78aed419be8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-6c549b6d85-s2rff\": pods \"limitador-operator-controller-manager-6c549b6d85-s2rff\" not found" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-s2rff"
Sep 08 11:38:12.998763 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:12.998742    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-s2rff"]
Sep 08 11:38:13.002384 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:13.002172    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-c75ns"]
Sep 08 11:38:13.003987 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:13.003963    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-96fj8"]
Sep 08 11:38:13.004544 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:13.004526    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82ab5e58-cdc6-4e98-9911-b78aed419be8" containerName="manager"
Sep 08 11:38:13.004622 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:13.004548    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="82ab5e58-cdc6-4e98-9911-b78aed419be8" containerName="manager"
Sep 08 11:38:13.004679 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:13.004638    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="82ab5e58-cdc6-4e98-9911-b78aed419be8" containerName="manager"
Sep 08 11:38:13.008181 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:13.008162    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-96fj8"
Sep 08 11:38:13.015168 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:38:13.015138    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-s2rff\" is forbidden: User \"system:node:ip-10-0-136-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-127.ec2.internal' and this object" podUID="82ab5e58-cdc6-4e98-9911-b78aed419be8" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-s2rff"
Sep 08 11:38:13.017826 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:38:13.017795    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-s2rff\" is forbidden: User \"system:node:ip-10-0-136-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-127.ec2.internal' and this object" podUID="82ab5e58-cdc6-4e98-9911-b78aed419be8" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-s2rff"
Sep 08 11:38:13.018559 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:13.018537    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-96fj8"]
Sep 08 11:38:13.144333 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:13.144250    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp8m6\" (UniqueName: \"kubernetes.io/projected/a61f855f-c61a-4cdd-bc0a-c9f9d47b56c9-kube-api-access-kp8m6\") pod \"limitador-operator-controller-manager-6c549b6d85-96fj8\" (UID: \"a61f855f-c61a-4cdd-bc0a-c9f9d47b56c9\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-96fj8"
Sep 08 11:38:13.144478 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:13.144415    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfl65\" (UniqueName: \"kubernetes.io/projected/d0dc6472-6350-4467-8d38-32bee93e060d-kube-api-access-bfl65\") pod \"kuadrant-operator-controller-manager-96db98c47-c75ns\" (UID: \"d0dc6472-6350-4467-8d38-32bee93e060d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-c75ns"
Sep 08 11:38:13.144534 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:13.144499    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0dc6472-6350-4467-8d38-32bee93e060d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-c75ns\" (UID: \"d0dc6472-6350-4467-8d38-32bee93e060d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-c75ns"
Sep 08 11:38:13.218123 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:13.218095    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-s2rff"
Sep 08 11:38:13.220590 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:38:13.220559    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-s2rff\" is forbidden: User \"system:node:ip-10-0-136-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-127.ec2.internal' and this object" podUID="82ab5e58-cdc6-4e98-9911-b78aed419be8" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-s2rff"
Sep 08 11:38:13.245043 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:13.245002    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfl65\" (UniqueName: \"kubernetes.io/projected/d0dc6472-6350-4467-8d38-32bee93e060d-kube-api-access-bfl65\") pod \"kuadrant-operator-controller-manager-96db98c47-c75ns\" (UID: \"d0dc6472-6350-4467-8d38-32bee93e060d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-c75ns"
Sep 08 11:38:13.245184 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:13.245099    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0dc6472-6350-4467-8d38-32bee93e060d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-c75ns\" (UID: \"d0dc6472-6350-4467-8d38-32bee93e060d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-c75ns"
Sep 08 11:38:13.245184 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:13.245152    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp8m6\" (UniqueName: \"kubernetes.io/projected/a61f855f-c61a-4cdd-bc0a-c9f9d47b56c9-kube-api-access-kp8m6\") pod \"limitador-operator-controller-manager-6c549b6d85-96fj8\" (UID: \"a61f855f-c61a-4cdd-bc0a-c9f9d47b56c9\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-96fj8"
Sep 08 11:38:13.245582 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:13.245557    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0dc6472-6350-4467-8d38-32bee93e060d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-c75ns\" (UID: \"d0dc6472-6350-4467-8d38-32bee93e060d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-c75ns"
Sep 08 11:38:13.254555 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:13.254530    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp8m6\" (UniqueName: \"kubernetes.io/projected/a61f855f-c61a-4cdd-bc0a-c9f9d47b56c9-kube-api-access-kp8m6\") pod \"limitador-operator-controller-manager-6c549b6d85-96fj8\" (UID: \"a61f855f-c61a-4cdd-bc0a-c9f9d47b56c9\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-96fj8"
Sep 08 11:38:13.254782 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:13.254765    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfl65\" (UniqueName: \"kubernetes.io/projected/d0dc6472-6350-4467-8d38-32bee93e060d-kube-api-access-bfl65\") pod \"kuadrant-operator-controller-manager-96db98c47-c75ns\" (UID: \"d0dc6472-6350-4467-8d38-32bee93e060d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-c75ns"
Sep 08 11:38:13.346187 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:13.346156    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnv8q\" (UniqueName: \"kubernetes.io/projected/82ab5e58-cdc6-4e98-9911-b78aed419be8-kube-api-access-rnv8q\") pod \"82ab5e58-cdc6-4e98-9911-b78aed419be8\" (UID: \"82ab5e58-cdc6-4e98-9911-b78aed419be8\") "
Sep 08 11:38:13.348696 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:13.348665    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82ab5e58-cdc6-4e98-9911-b78aed419be8-kube-api-access-rnv8q" (OuterVolumeSpecName: "kube-api-access-rnv8q") pod "82ab5e58-cdc6-4e98-9911-b78aed419be8" (UID: "82ab5e58-cdc6-4e98-9911-b78aed419be8"). InnerVolumeSpecName "kube-api-access-rnv8q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:38:13.354992 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:13.354952    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-c75ns"
Sep 08 11:38:13.360204 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:13.360186    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-96fj8"
Sep 08 11:38:13.447649 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:13.447619    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnv8q\" (UniqueName: \"kubernetes.io/projected/82ab5e58-cdc6-4e98-9911-b78aed419be8-kube-api-access-rnv8q\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:38:13.641431 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:13.641404    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-96fj8"]
Sep 08 11:38:13.643832 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:38:13.643804    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda61f855f_c61a_4cdd_bc0a_c9f9d47b56c9.slice/crio-c13a5ca2580477a364150fab311a24fcbc30659a2b5c16dc0c6a08542b1a4ce9 WatchSource:0}: Error finding container c13a5ca2580477a364150fab311a24fcbc30659a2b5c16dc0c6a08542b1a4ce9: Status 404 returned error can't find the container with id c13a5ca2580477a364150fab311a24fcbc30659a2b5c16dc0c6a08542b1a4ce9
Sep 08 11:38:13.645072 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:13.644986    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-c75ns"]
Sep 08 11:38:13.647079 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:38:13.647058    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0dc6472_6350_4467_8d38_32bee93e060d.slice/crio-1d4ed3170002362948a794d28d12f62cdad0674b646231e0c662744aabe8d102 WatchSource:0}: Error finding container 1d4ed3170002362948a794d28d12f62cdad0674b646231e0c662744aabe8d102: Status 404 returned error can't find the container with id 1d4ed3170002362948a794d28d12f62cdad0674b646231e0c662744aabe8d102
Sep 08 11:38:13.840742 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:13.840699    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82ab5e58-cdc6-4e98-9911-b78aed419be8" path="/var/lib/kubelet/pods/82ab5e58-cdc6-4e98-9911-b78aed419be8/volumes"
Sep 08 11:38:13.894123 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:13.894089    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-c75ns" event={"ID":"d0dc6472-6350-4467-8d38-32bee93e060d","Type":"ContainerStarted","Data":"1d4ed3170002362948a794d28d12f62cdad0674b646231e0c662744aabe8d102"}
Sep 08 11:38:13.895578 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:13.895557    2575 generic.go:356] "Generic (PLEG): container finished" podID="82ab5e58-cdc6-4e98-9911-b78aed419be8" containerID="3a4aed7f910081f840e20a4726ffe3b9fbfc9e680c8be74dcfbcd48ccba31b25" exitCode=0
Sep 08 11:38:13.895668 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:13.895601    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-s2rff"
Sep 08 11:38:13.895668 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:13.895630    2575 scope.go:117] "RemoveContainer" containerID="3a4aed7f910081f840e20a4726ffe3b9fbfc9e680c8be74dcfbcd48ccba31b25"
Sep 08 11:38:13.898597 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:13.898568    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-96fj8" event={"ID":"a61f855f-c61a-4cdd-bc0a-c9f9d47b56c9","Type":"ContainerStarted","Data":"a8abfff5e539bcfc08e9aca04c782a9afccf0540036c91f0a365e1fab2099c55"}
Sep 08 11:38:13.898704 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:13.898624    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-96fj8" event={"ID":"a61f855f-c61a-4cdd-bc0a-c9f9d47b56c9","Type":"ContainerStarted","Data":"c13a5ca2580477a364150fab311a24fcbc30659a2b5c16dc0c6a08542b1a4ce9"}
Sep 08 11:38:13.898704 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:13.898665    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-96fj8"
Sep 08 11:38:13.904779 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:13.904766    2575 scope.go:117] "RemoveContainer" containerID="3a4aed7f910081f840e20a4726ffe3b9fbfc9e680c8be74dcfbcd48ccba31b25"
Sep 08 11:38:13.905039 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:38:13.905023    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a4aed7f910081f840e20a4726ffe3b9fbfc9e680c8be74dcfbcd48ccba31b25\": container with ID starting with 3a4aed7f910081f840e20a4726ffe3b9fbfc9e680c8be74dcfbcd48ccba31b25 not found: ID does not exist" containerID="3a4aed7f910081f840e20a4726ffe3b9fbfc9e680c8be74dcfbcd48ccba31b25"
Sep 08 11:38:13.905082 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:13.905047    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a4aed7f910081f840e20a4726ffe3b9fbfc9e680c8be74dcfbcd48ccba31b25"} err="failed to get container status \"3a4aed7f910081f840e20a4726ffe3b9fbfc9e680c8be74dcfbcd48ccba31b25\": rpc error: code = NotFound desc = could not find container \"3a4aed7f910081f840e20a4726ffe3b9fbfc9e680c8be74dcfbcd48ccba31b25\": container with ID starting with 3a4aed7f910081f840e20a4726ffe3b9fbfc9e680c8be74dcfbcd48ccba31b25 not found: ID does not exist"
Sep 08 11:38:13.919655 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:13.919392    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-96fj8" podStartSLOduration=1.91937222 podStartE2EDuration="1.91937222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:38:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:38:13.918651241 +0000 UTC m=+468.570358052" watchObservedRunningTime="2026-09-08 11:38:13.91937222 +0000 UTC m=+468.571079014"
Sep 08 11:38:19.933550 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:19.933508    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-fb8mh" podUID="96e4a0f4-8867-4920-9223-44265bab844a" containerName="manager" containerID="cri-o://c827685b5450bbafb481fc370d833f1707aa11d51bef1eb745c4f6314188c13d" gracePeriod=2
Sep 08 11:38:19.935144 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:19.935116    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-c75ns" event={"ID":"d0dc6472-6350-4467-8d38-32bee93e060d","Type":"ContainerStarted","Data":"31558000f966473b3a6e41ab14f18702aeeb0c5912ea31e45263c68f416d8108"}
Sep 08 11:38:19.935273 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:19.935262    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-c75ns"
Sep 08 11:38:19.936506 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:38:19.936470    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-fb8mh\" is forbidden: User \"system:node:ip-10-0-136-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-127.ec2.internal' and this object" podUID="96e4a0f4-8867-4920-9223-44265bab844a" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-fb8mh"
Sep 08 11:38:19.962635 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:38:19.962606    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-fb8mh\" is forbidden: User \"system:node:ip-10-0-136-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-127.ec2.internal' and this object" podUID="96e4a0f4-8867-4920-9223-44265bab844a" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-fb8mh"
Sep 08 11:38:19.963588 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:19.963535    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-c75ns" podStartSLOduration=2.620186781 podStartE2EDuration="7.963515214s" totalImagesPullingTime="5.343328433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:38:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:38:19.960225779 +0000 UTC m=+474.611932593" watchObservedRunningTime="2026-09-08 11:38:19.963515214 +0000 UTC m=+474.615222018"
Sep 08 11:38:20.175830 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:20.175809    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-fb8mh"
Sep 08 11:38:20.178683 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:38:20.178657    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-fb8mh\" is forbidden: User \"system:node:ip-10-0-136-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-127.ec2.internal' and this object" podUID="96e4a0f4-8867-4920-9223-44265bab844a" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-fb8mh"
Sep 08 11:38:20.310028 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:20.309997    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/96e4a0f4-8867-4920-9223-44265bab844a-extensions-socket-volume\") pod \"96e4a0f4-8867-4920-9223-44265bab844a\" (UID: \"96e4a0f4-8867-4920-9223-44265bab844a\") "
Sep 08 11:38:20.310185 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:20.310118    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9tck\" (UniqueName: \"kubernetes.io/projected/96e4a0f4-8867-4920-9223-44265bab844a-kube-api-access-h9tck\") pod \"96e4a0f4-8867-4920-9223-44265bab844a\" (UID: \"96e4a0f4-8867-4920-9223-44265bab844a\") "
Sep 08 11:38:20.310299 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:20.310277    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96e4a0f4-8867-4920-9223-44265bab844a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "96e4a0f4-8867-4920-9223-44265bab844a" (UID: "96e4a0f4-8867-4920-9223-44265bab844a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:38:20.312270 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:20.312252    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96e4a0f4-8867-4920-9223-44265bab844a-kube-api-access-h9tck" (OuterVolumeSpecName: "kube-api-access-h9tck") pod "96e4a0f4-8867-4920-9223-44265bab844a" (UID: "96e4a0f4-8867-4920-9223-44265bab844a"). InnerVolumeSpecName "kube-api-access-h9tck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:38:20.411408 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:20.411370    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9tck\" (UniqueName: \"kubernetes.io/projected/96e4a0f4-8867-4920-9223-44265bab844a-kube-api-access-h9tck\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:38:20.411408 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:20.411407    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/96e4a0f4-8867-4920-9223-44265bab844a-extensions-socket-volume\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:38:20.941301 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:20.941265    2575 generic.go:356] "Generic (PLEG): container finished" podID="96e4a0f4-8867-4920-9223-44265bab844a" containerID="c827685b5450bbafb481fc370d833f1707aa11d51bef1eb745c4f6314188c13d" exitCode=2
Sep 08 11:38:20.941730 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:20.941312    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-fb8mh"
Sep 08 11:38:20.941730 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:20.941380    2575 scope.go:117] "RemoveContainer" containerID="c827685b5450bbafb481fc370d833f1707aa11d51bef1eb745c4f6314188c13d"
Sep 08 11:38:20.943700 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:38:20.943675    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-fb8mh\" is forbidden: User \"system:node:ip-10-0-136-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-127.ec2.internal' and this object" podUID="96e4a0f4-8867-4920-9223-44265bab844a" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-fb8mh"
Sep 08 11:38:20.950719 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:20.950704    2575 scope.go:117] "RemoveContainer" containerID="c827685b5450bbafb481fc370d833f1707aa11d51bef1eb745c4f6314188c13d"
Sep 08 11:38:20.950965 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:38:20.950948    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c827685b5450bbafb481fc370d833f1707aa11d51bef1eb745c4f6314188c13d\": container with ID starting with c827685b5450bbafb481fc370d833f1707aa11d51bef1eb745c4f6314188c13d not found: ID does not exist" containerID="c827685b5450bbafb481fc370d833f1707aa11d51bef1eb745c4f6314188c13d"
Sep 08 11:38:20.951003 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:20.950973    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c827685b5450bbafb481fc370d833f1707aa11d51bef1eb745c4f6314188c13d"} err="failed to get container status \"c827685b5450bbafb481fc370d833f1707aa11d51bef1eb745c4f6314188c13d\": rpc error: code = NotFound desc = could not find container \"c827685b5450bbafb481fc370d833f1707aa11d51bef1eb745c4f6314188c13d\": container with ID starting with c827685b5450bbafb481fc370d833f1707aa11d51bef1eb745c4f6314188c13d not found: ID does not exist"
Sep 08 11:38:20.951153 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:38:20.951133    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-fb8mh\" is forbidden: User \"system:node:ip-10-0-136-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-127.ec2.internal' and this object" podUID="96e4a0f4-8867-4920-9223-44265bab844a" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-fb8mh"
Sep 08 11:38:21.841818 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:21.841787    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96e4a0f4-8867-4920-9223-44265bab844a" path="/var/lib/kubelet/pods/96e4a0f4-8867-4920-9223-44265bab844a/volumes"
Sep 08 11:38:24.908315 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:24.908277    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-96fj8"
Sep 08 11:38:30.944494 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:30.944467    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-c75ns"
Sep 08 11:38:43.038992 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:43.038953    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-c75ns"]
Sep 08 11:38:43.039430 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:43.039184    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-c75ns" podUID="d0dc6472-6350-4467-8d38-32bee93e060d" containerName="manager" containerID="cri-o://31558000f966473b3a6e41ab14f18702aeeb0c5912ea31e45263c68f416d8108" gracePeriod=10
Sep 08 11:38:43.274616 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:43.274595    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-c75ns"
Sep 08 11:38:43.307412 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:43.307298    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bfl65\" (UniqueName: \"kubernetes.io/projected/d0dc6472-6350-4467-8d38-32bee93e060d-kube-api-access-bfl65\") pod \"d0dc6472-6350-4467-8d38-32bee93e060d\" (UID: \"d0dc6472-6350-4467-8d38-32bee93e060d\") "
Sep 08 11:38:43.307412 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:43.307392    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0dc6472-6350-4467-8d38-32bee93e060d-extensions-socket-volume\") pod \"d0dc6472-6350-4467-8d38-32bee93e060d\" (UID: \"d0dc6472-6350-4467-8d38-32bee93e060d\") "
Sep 08 11:38:43.307780 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:43.307754    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0dc6472-6350-4467-8d38-32bee93e060d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d0dc6472-6350-4467-8d38-32bee93e060d" (UID: "d0dc6472-6350-4467-8d38-32bee93e060d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:38:43.309594 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:43.309565    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0dc6472-6350-4467-8d38-32bee93e060d-kube-api-access-bfl65" (OuterVolumeSpecName: "kube-api-access-bfl65") pod "d0dc6472-6350-4467-8d38-32bee93e060d" (UID: "d0dc6472-6350-4467-8d38-32bee93e060d"). InnerVolumeSpecName "kube-api-access-bfl65". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:38:43.408920 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:43.408893    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0dc6472-6350-4467-8d38-32bee93e060d-extensions-socket-volume\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:38:43.409023 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:43.408936    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bfl65\" (UniqueName: \"kubernetes.io/projected/d0dc6472-6350-4467-8d38-32bee93e060d-kube-api-access-bfl65\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:38:44.049790 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:44.049759    2575 generic.go:356] "Generic (PLEG): container finished" podID="d0dc6472-6350-4467-8d38-32bee93e060d" containerID="31558000f966473b3a6e41ab14f18702aeeb0c5912ea31e45263c68f416d8108" exitCode=0
Sep 08 11:38:44.050184 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:44.049805    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-c75ns"
Sep 08 11:38:44.050184 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:44.049810    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-c75ns" event={"ID":"d0dc6472-6350-4467-8d38-32bee93e060d","Type":"ContainerDied","Data":"31558000f966473b3a6e41ab14f18702aeeb0c5912ea31e45263c68f416d8108"}
Sep 08 11:38:44.050184 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:44.049916    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-c75ns" event={"ID":"d0dc6472-6350-4467-8d38-32bee93e060d","Type":"ContainerDied","Data":"1d4ed3170002362948a794d28d12f62cdad0674b646231e0c662744aabe8d102"}
Sep 08 11:38:44.050184 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:44.049938    2575 scope.go:117] "RemoveContainer" containerID="31558000f966473b3a6e41ab14f18702aeeb0c5912ea31e45263c68f416d8108"
Sep 08 11:38:44.058070 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:44.058037    2575 scope.go:117] "RemoveContainer" containerID="31558000f966473b3a6e41ab14f18702aeeb0c5912ea31e45263c68f416d8108"
Sep 08 11:38:44.058369 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:38:44.058324    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31558000f966473b3a6e41ab14f18702aeeb0c5912ea31e45263c68f416d8108\": container with ID starting with 31558000f966473b3a6e41ab14f18702aeeb0c5912ea31e45263c68f416d8108 not found: ID does not exist" containerID="31558000f966473b3a6e41ab14f18702aeeb0c5912ea31e45263c68f416d8108"
Sep 08 11:38:44.058445 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:44.058382    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31558000f966473b3a6e41ab14f18702aeeb0c5912ea31e45263c68f416d8108"} err="failed to get container status \"31558000f966473b3a6e41ab14f18702aeeb0c5912ea31e45263c68f416d8108\": rpc error: code = NotFound desc = could not find container \"31558000f966473b3a6e41ab14f18702aeeb0c5912ea31e45263c68f416d8108\": container with ID starting with 31558000f966473b3a6e41ab14f18702aeeb0c5912ea31e45263c68f416d8108 not found: ID does not exist"
Sep 08 11:38:44.073948 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:44.073927    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-c75ns"]
Sep 08 11:38:44.078942 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:44.078922    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-c75ns"]
Sep 08 11:38:45.841034 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:45.841002    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0dc6472-6350-4467-8d38-32bee93e060d" path="/var/lib/kubelet/pods/d0dc6472-6350-4467-8d38-32bee93e060d/volumes"
Sep 08 11:38:47.357459 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.357426    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt"]
Sep 08 11:38:47.357890 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.357835    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0dc6472-6350-4467-8d38-32bee93e060d" containerName="manager"
Sep 08 11:38:47.357890 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.357846    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0dc6472-6350-4467-8d38-32bee93e060d" containerName="manager"
Sep 08 11:38:47.357890 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.357881    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96e4a0f4-8867-4920-9223-44265bab844a" containerName="manager"
Sep 08 11:38:47.357890 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.357887    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="96e4a0f4-8867-4920-9223-44265bab844a" containerName="manager"
Sep 08 11:38:47.358087 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.357965    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0dc6472-6350-4467-8d38-32bee93e060d" containerName="manager"
Sep 08 11:38:47.358087 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.357974    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="96e4a0f4-8867-4920-9223-44265bab844a" containerName="manager"
Sep 08 11:38:47.362546 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.362526    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt"
Sep 08 11:38:47.365254 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.365231    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-fwmpj\""
Sep 08 11:38:47.373380 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.373359    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt"]
Sep 08 11:38:47.445207 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.445171    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4bzvt\" (UID: \"2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt"
Sep 08 11:38:47.445392 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.445220    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4bzvt\" (UID: \"2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt"
Sep 08 11:38:47.445392 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.445252    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4bzvt\" (UID: \"2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt"
Sep 08 11:38:47.445392 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.445271    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4bzvt\" (UID: \"2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt"
Sep 08 11:38:47.445392 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.445285    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4bzvt\" (UID: \"2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt"
Sep 08 11:38:47.445392 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.445301    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwjzd\" (UniqueName: \"kubernetes.io/projected/2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4-kube-api-access-qwjzd\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4bzvt\" (UID: \"2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt"
Sep 08 11:38:47.445589 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.445405    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4bzvt\" (UID: \"2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt"
Sep 08 11:38:47.445589 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.445429    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4bzvt\" (UID: \"2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt"
Sep 08 11:38:47.445589 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.445451    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4bzvt\" (UID: \"2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt"
Sep 08 11:38:47.546698 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.546655    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4bzvt\" (UID: \"2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt"
Sep 08 11:38:47.546698 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.546703    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4bzvt\" (UID: \"2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt"
Sep 08 11:38:47.546919 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.546738    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4bzvt\" (UID: \"2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt"
Sep 08 11:38:47.546919 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.546783    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4bzvt\" (UID: \"2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt"
Sep 08 11:38:47.546919 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.546830    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4bzvt\" (UID: \"2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt"
Sep 08 11:38:47.546919 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.546863    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4bzvt\" (UID: \"2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt"
Sep 08 11:38:47.546919 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.546893    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4bzvt\" (UID: \"2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt"
Sep 08 11:38:47.546919 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.546919    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4bzvt\" (UID: \"2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt"
Sep 08 11:38:47.547215 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.546942    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwjzd\" (UniqueName: \"kubernetes.io/projected/2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4-kube-api-access-qwjzd\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4bzvt\" (UID: \"2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt"
Sep 08 11:38:47.547215 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.547178    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4bzvt\" (UID: \"2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt"
Sep 08 11:38:47.547369 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.547232    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4bzvt\" (UID: \"2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt"
Sep 08 11:38:47.547369 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.547257    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4bzvt\" (UID: \"2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt"
Sep 08 11:38:47.547483 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.547365    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4bzvt\" (UID: \"2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt"
Sep 08 11:38:47.547483 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.547456    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4bzvt\" (UID: \"2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt"
Sep 08 11:38:47.549363 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.549326    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4bzvt\" (UID: \"2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt"
Sep 08 11:38:47.549585 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.549566    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4bzvt\" (UID: \"2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt"
Sep 08 11:38:47.556359 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.556308    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4bzvt\" (UID: \"2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt"
Sep 08 11:38:47.556452 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.556417    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwjzd\" (UniqueName: \"kubernetes.io/projected/2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4-kube-api-access-qwjzd\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4bzvt\" (UID: \"2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt"
Sep 08 11:38:47.674016 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.673932    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt"
Sep 08 11:38:47.953284 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.953261    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt"]
Sep 08 11:38:47.955629 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:38:47.955605    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dabf0b5_a85d_4889_9b6c_4230a0f1fbb4.slice/crio-ec42a3f3eafce6f4975687b9781859439a035a4a0b51e4c8ad88dac7d4892ab0 WatchSource:0}: Error finding container ec42a3f3eafce6f4975687b9781859439a035a4a0b51e4c8ad88dac7d4892ab0: Status 404 returned error can't find the container with id ec42a3f3eafce6f4975687b9781859439a035a4a0b51e4c8ad88dac7d4892ab0
Sep 08 11:38:47.958134 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.958099    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:38:47.958219 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.958182    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:38:47.958257 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:47.958219    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:38:48.074411 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:48.074377    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt" event={"ID":"2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4","Type":"ContainerStarted","Data":"1371d7cc306c2988a54ebc750bcbf0d18c6bdce026252f3c874f722826d80140"}
Sep 08 11:38:48.074614 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:48.074441    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt" event={"ID":"2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4","Type":"ContainerStarted","Data":"ec42a3f3eafce6f4975687b9781859439a035a4a0b51e4c8ad88dac7d4892ab0"}
Sep 08 11:38:48.105062 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:48.105002    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt" podStartSLOduration=1.104986975 podStartE2EDuration="1.104986975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:38:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:38:48.102948218 +0000 UTC m=+502.754655013" watchObservedRunningTime="2026-09-08 11:38:48.104986975 +0000 UTC m=+502.756693769"
Sep 08 11:38:48.674017 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:48.673978    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt"
Sep 08 11:38:49.679261 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:49.679233    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt"
Sep 08 11:38:50.085099 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:50.085068    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt"
Sep 08 11:38:50.085896 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:50.085878    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt"
Sep 08 11:38:50.155538 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:50.155511    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-zskbt"]
Sep 08 11:38:50.159691 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:50.159670    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-zskbt"
Sep 08 11:38:50.162181 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:50.162162    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vjdc9\""
Sep 08 11:38:50.162290 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:50.162164    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 08 11:38:50.167480 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:50.167459    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-zskbt"]
Sep 08 11:38:50.252784 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:50.252751    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-zskbt"]
Sep 08 11:38:50.273237 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:50.273206    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k9nr\" (UniqueName: \"kubernetes.io/projected/f78a737e-9350-404c-a725-2e21861cfa96-kube-api-access-8k9nr\") pod \"limitador-limitador-859c4d96d6-zskbt\" (UID: \"f78a737e-9350-404c-a725-2e21861cfa96\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-zskbt"
Sep 08 11:38:50.273407 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:50.273273    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f78a737e-9350-404c-a725-2e21861cfa96-config-file\") pod \"limitador-limitador-859c4d96d6-zskbt\" (UID: \"f78a737e-9350-404c-a725-2e21861cfa96\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-zskbt"
Sep 08 11:38:50.374780 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:50.374700    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f78a737e-9350-404c-a725-2e21861cfa96-config-file\") pod \"limitador-limitador-859c4d96d6-zskbt\" (UID: \"f78a737e-9350-404c-a725-2e21861cfa96\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-zskbt"
Sep 08 11:38:50.374780 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:50.374768    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k9nr\" (UniqueName: \"kubernetes.io/projected/f78a737e-9350-404c-a725-2e21861cfa96-kube-api-access-8k9nr\") pod \"limitador-limitador-859c4d96d6-zskbt\" (UID: \"f78a737e-9350-404c-a725-2e21861cfa96\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-zskbt"
Sep 08 11:38:50.375315 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:50.375297    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f78a737e-9350-404c-a725-2e21861cfa96-config-file\") pod \"limitador-limitador-859c4d96d6-zskbt\" (UID: \"f78a737e-9350-404c-a725-2e21861cfa96\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-zskbt"
Sep 08 11:38:50.384501 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:50.384478    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k9nr\" (UniqueName: \"kubernetes.io/projected/f78a737e-9350-404c-a725-2e21861cfa96-kube-api-access-8k9nr\") pod \"limitador-limitador-859c4d96d6-zskbt\" (UID: \"f78a737e-9350-404c-a725-2e21861cfa96\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-zskbt"
Sep 08 11:38:50.473928 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:50.473904    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-zskbt"
Sep 08 11:38:50.767806 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:50.767783    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-zskbt"]
Sep 08 11:38:50.769791 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:38:50.769766    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf78a737e_9350_404c_a725_2e21861cfa96.slice/crio-99d846d91f1ae5744957879ff925b096e033d0c56297e63158f80e1185e02ad5 WatchSource:0}: Error finding container 99d846d91f1ae5744957879ff925b096e033d0c56297e63158f80e1185e02ad5: Status 404 returned error can't find the container with id 99d846d91f1ae5744957879ff925b096e033d0c56297e63158f80e1185e02ad5
Sep 08 11:38:51.090998 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:51.090967    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-zskbt" event={"ID":"f78a737e-9350-404c-a725-2e21861cfa96","Type":"ContainerStarted","Data":"99d846d91f1ae5744957879ff925b096e033d0c56297e63158f80e1185e02ad5"}
Sep 08 11:38:53.102233 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:53.102195    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-zskbt" event={"ID":"f78a737e-9350-404c-a725-2e21861cfa96","Type":"ContainerStarted","Data":"d5e9aaed4beb5ce3d5fe964f08fefaaedc51c144212fb8585b1fc531edd94762"}
Sep 08 11:38:53.102638 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:53.102253    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-zskbt"
Sep 08 11:38:53.122455 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:38:53.122410    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-859c4d96d6-zskbt" podStartSLOduration=1.523864284 podStartE2EDuration="3.122395113s" totalImagesPullingTime="1.598530829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:38:53.120610316 +0000 UTC m=+507.772317152" watchObservedRunningTime="2026-09-08 11:38:53.122395113 +0000 UTC m=+507.774101906"
Sep 08 11:39:04.107692 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:04.107662    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-zskbt"
Sep 08 11:39:05.158894 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:05.158859    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-zskbt"]
Sep 08 11:39:05.159388 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:05.159073    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-859c4d96d6-zskbt" podUID="f78a737e-9350-404c-a725-2e21861cfa96" containerName="limitador" containerID="cri-o://d5e9aaed4beb5ce3d5fe964f08fefaaedc51c144212fb8585b1fc531edd94762" gracePeriod=30
Sep 08 11:39:05.711660 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:05.711638    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-zskbt"
Sep 08 11:39:05.813080 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:05.813052    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8k9nr\" (UniqueName: \"kubernetes.io/projected/f78a737e-9350-404c-a725-2e21861cfa96-kube-api-access-8k9nr\") pod \"f78a737e-9350-404c-a725-2e21861cfa96\" (UID: \"f78a737e-9350-404c-a725-2e21861cfa96\") "
Sep 08 11:39:05.813221 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:05.813089    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f78a737e-9350-404c-a725-2e21861cfa96-config-file\") pod \"f78a737e-9350-404c-a725-2e21861cfa96\" (UID: \"f78a737e-9350-404c-a725-2e21861cfa96\") "
Sep 08 11:39:05.813496 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:05.813468    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f78a737e-9350-404c-a725-2e21861cfa96-config-file" (OuterVolumeSpecName: "config-file") pod "f78a737e-9350-404c-a725-2e21861cfa96" (UID: "f78a737e-9350-404c-a725-2e21861cfa96"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:39:05.815347 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:05.815317    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f78a737e-9350-404c-a725-2e21861cfa96-kube-api-access-8k9nr" (OuterVolumeSpecName: "kube-api-access-8k9nr") pod "f78a737e-9350-404c-a725-2e21861cfa96" (UID: "f78a737e-9350-404c-a725-2e21861cfa96"). InnerVolumeSpecName "kube-api-access-8k9nr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:39:05.914791 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:05.914752    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8k9nr\" (UniqueName: \"kubernetes.io/projected/f78a737e-9350-404c-a725-2e21861cfa96-kube-api-access-8k9nr\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:39:05.914791 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:05.914781    2575 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f78a737e-9350-404c-a725-2e21861cfa96-config-file\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:39:06.167455 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:06.167334    2575 generic.go:356] "Generic (PLEG): container finished" podID="f78a737e-9350-404c-a725-2e21861cfa96" containerID="d5e9aaed4beb5ce3d5fe964f08fefaaedc51c144212fb8585b1fc531edd94762" exitCode=0
Sep 08 11:39:06.167455 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:06.167407    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-zskbt"
Sep 08 11:39:06.167935 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:06.167446    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-zskbt" event={"ID":"f78a737e-9350-404c-a725-2e21861cfa96","Type":"ContainerDied","Data":"d5e9aaed4beb5ce3d5fe964f08fefaaedc51c144212fb8585b1fc531edd94762"}
Sep 08 11:39:06.167935 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:06.167515    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-zskbt" event={"ID":"f78a737e-9350-404c-a725-2e21861cfa96","Type":"ContainerDied","Data":"99d846d91f1ae5744957879ff925b096e033d0c56297e63158f80e1185e02ad5"}
Sep 08 11:39:06.167935 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:06.167547    2575 scope.go:117] "RemoveContainer" containerID="d5e9aaed4beb5ce3d5fe964f08fefaaedc51c144212fb8585b1fc531edd94762"
Sep 08 11:39:06.176390 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:06.176375    2575 scope.go:117] "RemoveContainer" containerID="d5e9aaed4beb5ce3d5fe964f08fefaaedc51c144212fb8585b1fc531edd94762"
Sep 08 11:39:06.176654 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:39:06.176636    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5e9aaed4beb5ce3d5fe964f08fefaaedc51c144212fb8585b1fc531edd94762\": container with ID starting with d5e9aaed4beb5ce3d5fe964f08fefaaedc51c144212fb8585b1fc531edd94762 not found: ID does not exist" containerID="d5e9aaed4beb5ce3d5fe964f08fefaaedc51c144212fb8585b1fc531edd94762"
Sep 08 11:39:06.176715 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:06.176663    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5e9aaed4beb5ce3d5fe964f08fefaaedc51c144212fb8585b1fc531edd94762"} err="failed to get container status \"d5e9aaed4beb5ce3d5fe964f08fefaaedc51c144212fb8585b1fc531edd94762\": rpc error: code = NotFound desc = could not find container \"d5e9aaed4beb5ce3d5fe964f08fefaaedc51c144212fb8585b1fc531edd94762\": container with ID starting with d5e9aaed4beb5ce3d5fe964f08fefaaedc51c144212fb8585b1fc531edd94762 not found: ID does not exist"
Sep 08 11:39:06.187902 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:06.187882    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-zskbt"]
Sep 08 11:39:06.190181 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:06.190160    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-zskbt"]
Sep 08 11:39:07.841277 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:07.841247    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f78a737e-9350-404c-a725-2e21861cfa96" path="/var/lib/kubelet/pods/f78a737e-9350-404c-a725-2e21861cfa96/volumes"
Sep 08 11:39:10.862207 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:10.862163    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-8bnk5"]
Sep 08 11:39:10.862615 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:10.862552    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f78a737e-9350-404c-a725-2e21861cfa96" containerName="limitador"
Sep 08 11:39:10.862615 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:10.862564    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f78a737e-9350-404c-a725-2e21861cfa96" containerName="limitador"
Sep 08 11:39:10.862700 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:10.862648    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f78a737e-9350-404c-a725-2e21861cfa96" containerName="limitador"
Sep 08 11:39:10.867099 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:10.867078    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8bnk5"
Sep 08 11:39:10.869680 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:10.869659    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 08 11:39:10.869798 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:10.869660    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 11:39:10.869798 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:10.869714    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-lpx7w\""
Sep 08 11:39:10.870759 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:10.870740    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 08 11:39:10.874501 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:10.874176    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-8bnk5"]
Sep 08 11:39:10.962302 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:10.962265    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/fd57be3c-295c-41dd-a168-de4610c1a596-data\") pod \"postgres-69fb4594cf-8bnk5\" (UID: \"fd57be3c-295c-41dd-a168-de4610c1a596\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8bnk5"
Sep 08 11:39:10.962482 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:10.962355    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv69b\" (UniqueName: \"kubernetes.io/projected/fd57be3c-295c-41dd-a168-de4610c1a596-kube-api-access-vv69b\") pod \"postgres-69fb4594cf-8bnk5\" (UID: \"fd57be3c-295c-41dd-a168-de4610c1a596\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8bnk5"
Sep 08 11:39:11.063670 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:11.063644    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/fd57be3c-295c-41dd-a168-de4610c1a596-data\") pod \"postgres-69fb4594cf-8bnk5\" (UID: \"fd57be3c-295c-41dd-a168-de4610c1a596\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8bnk5"
Sep 08 11:39:11.063823 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:11.063684    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv69b\" (UniqueName: \"kubernetes.io/projected/fd57be3c-295c-41dd-a168-de4610c1a596-kube-api-access-vv69b\") pod \"postgres-69fb4594cf-8bnk5\" (UID: \"fd57be3c-295c-41dd-a168-de4610c1a596\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8bnk5"
Sep 08 11:39:11.064013 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:11.063994    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/fd57be3c-295c-41dd-a168-de4610c1a596-data\") pod \"postgres-69fb4594cf-8bnk5\" (UID: \"fd57be3c-295c-41dd-a168-de4610c1a596\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8bnk5"
Sep 08 11:39:11.072916 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:11.072882    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv69b\" (UniqueName: \"kubernetes.io/projected/fd57be3c-295c-41dd-a168-de4610c1a596-kube-api-access-vv69b\") pod \"postgres-69fb4594cf-8bnk5\" (UID: \"fd57be3c-295c-41dd-a168-de4610c1a596\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8bnk5"
Sep 08 11:39:11.178451 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:11.178362    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8bnk5"
Sep 08 11:39:11.453270 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:11.453247    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-8bnk5"]
Sep 08 11:39:11.455923 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:39:11.455894    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd57be3c_295c_41dd_a168_de4610c1a596.slice/crio-108af468e405cf7d51be6558cae41b39096aac0a94a0bed602dc76c5ffb27ba8 WatchSource:0}: Error finding container 108af468e405cf7d51be6558cae41b39096aac0a94a0bed602dc76c5ffb27ba8: Status 404 returned error can't find the container with id 108af468e405cf7d51be6558cae41b39096aac0a94a0bed602dc76c5ffb27ba8
Sep 08 11:39:12.198217 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:12.198177    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8bnk5" event={"ID":"fd57be3c-295c-41dd-a168-de4610c1a596","Type":"ContainerStarted","Data":"108af468e405cf7d51be6558cae41b39096aac0a94a0bed602dc76c5ffb27ba8"}
Sep 08 11:39:28.471156 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:28.471135    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 08 11:39:29.288401 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:29.288361    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8bnk5" event={"ID":"fd57be3c-295c-41dd-a168-de4610c1a596","Type":"ContainerStarted","Data":"6ce28abf8faa8f8ca420e4984a96312bb43879dbcec30bb191a6ab4bab9650fe"}
Sep 08 11:39:29.288564 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:29.288496    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8bnk5"
Sep 08 11:39:29.312192 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:29.312147    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8bnk5" podStartSLOduration=2.304514982 podStartE2EDuration="19.312131966s" totalImagesPullingTime="17.007616984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:39:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:39:29.309975918 +0000 UTC m=+543.961682731" watchObservedRunningTime="2026-09-08 11:39:29.312131966 +0000 UTC m=+543.963838757"
Sep 08 11:39:35.323607 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:39:35.323580    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8bnk5"
Sep 08 11:40:20.002019 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:20.001978    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7df9d55888-fvb5x"]
Sep 08 11:40:20.005323 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:20.005307    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7df9d55888-fvb5x"
Sep 08 11:40:20.009354 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:20.009320    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 08 11:40:20.009471 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:20.009332    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 08 11:40:20.009471 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:20.009324    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-b5t6p\""
Sep 08 11:40:20.019013 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:20.018990    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7df9d55888-fvb5x"]
Sep 08 11:40:20.090870 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:20.090837    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7abaece7-f447-4eb0-9069-55e77403f630-maas-api-tls\") pod \"maas-api-7df9d55888-fvb5x\" (UID: \"7abaece7-f447-4eb0-9069-55e77403f630\") " pod="odh-ai-gateway-infra/maas-api-7df9d55888-fvb5x"
Sep 08 11:40:20.091055 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:20.090899    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7abaece7-f447-4eb0-9069-55e77403f630-metrics-certs\") pod \"maas-api-7df9d55888-fvb5x\" (UID: \"7abaece7-f447-4eb0-9069-55e77403f630\") " pod="odh-ai-gateway-infra/maas-api-7df9d55888-fvb5x"
Sep 08 11:40:20.091055 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:20.090960    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7abaece7-f447-4eb0-9069-55e77403f630-openshift-service-ca\") pod \"maas-api-7df9d55888-fvb5x\" (UID: \"7abaece7-f447-4eb0-9069-55e77403f630\") " pod="odh-ai-gateway-infra/maas-api-7df9d55888-fvb5x"
Sep 08 11:40:20.091055 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:20.090987    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7qlg\" (UniqueName: \"kubernetes.io/projected/7abaece7-f447-4eb0-9069-55e77403f630-kube-api-access-f7qlg\") pod \"maas-api-7df9d55888-fvb5x\" (UID: \"7abaece7-f447-4eb0-9069-55e77403f630\") " pod="odh-ai-gateway-infra/maas-api-7df9d55888-fvb5x"
Sep 08 11:40:20.192253 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:20.192223    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7abaece7-f447-4eb0-9069-55e77403f630-metrics-certs\") pod \"maas-api-7df9d55888-fvb5x\" (UID: \"7abaece7-f447-4eb0-9069-55e77403f630\") " pod="odh-ai-gateway-infra/maas-api-7df9d55888-fvb5x"
Sep 08 11:40:20.192253 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:20.192257    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7abaece7-f447-4eb0-9069-55e77403f630-openshift-service-ca\") pod \"maas-api-7df9d55888-fvb5x\" (UID: \"7abaece7-f447-4eb0-9069-55e77403f630\") " pod="odh-ai-gateway-infra/maas-api-7df9d55888-fvb5x"
Sep 08 11:40:20.192490 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:20.192282    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7qlg\" (UniqueName: \"kubernetes.io/projected/7abaece7-f447-4eb0-9069-55e77403f630-kube-api-access-f7qlg\") pod \"maas-api-7df9d55888-fvb5x\" (UID: \"7abaece7-f447-4eb0-9069-55e77403f630\") " pod="odh-ai-gateway-infra/maas-api-7df9d55888-fvb5x"
Sep 08 11:40:20.192490 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:20.192320    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7abaece7-f447-4eb0-9069-55e77403f630-maas-api-tls\") pod \"maas-api-7df9d55888-fvb5x\" (UID: \"7abaece7-f447-4eb0-9069-55e77403f630\") " pod="odh-ai-gateway-infra/maas-api-7df9d55888-fvb5x"
Sep 08 11:40:20.192490 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:40:20.192407    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-metrics-tls: secret "maas-api-metrics-tls" not found
Sep 08 11:40:20.192490 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:40:20.192487    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7abaece7-f447-4eb0-9069-55e77403f630-metrics-certs podName:7abaece7-f447-4eb0-9069-55e77403f630 nodeName:}" failed. No retries permitted until 2026-09-08 11:40:20.692465988 +0000 UTC m=+595.344172762 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7abaece7-f447-4eb0-9069-55e77403f630-metrics-certs") pod "maas-api-7df9d55888-fvb5x" (UID: "7abaece7-f447-4eb0-9069-55e77403f630") : secret "maas-api-metrics-tls" not found
Sep 08 11:40:20.193031 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:20.192967    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7abaece7-f447-4eb0-9069-55e77403f630-openshift-service-ca\") pod \"maas-api-7df9d55888-fvb5x\" (UID: \"7abaece7-f447-4eb0-9069-55e77403f630\") " pod="odh-ai-gateway-infra/maas-api-7df9d55888-fvb5x"
Sep 08 11:40:20.194831 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:20.194812    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7abaece7-f447-4eb0-9069-55e77403f630-maas-api-tls\") pod \"maas-api-7df9d55888-fvb5x\" (UID: \"7abaece7-f447-4eb0-9069-55e77403f630\") " pod="odh-ai-gateway-infra/maas-api-7df9d55888-fvb5x"
Sep 08 11:40:20.201832 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:20.201809    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7qlg\" (UniqueName: \"kubernetes.io/projected/7abaece7-f447-4eb0-9069-55e77403f630-kube-api-access-f7qlg\") pod \"maas-api-7df9d55888-fvb5x\" (UID: \"7abaece7-f447-4eb0-9069-55e77403f630\") " pod="odh-ai-gateway-infra/maas-api-7df9d55888-fvb5x"
Sep 08 11:40:20.671789 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:20.671757    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-5mkwm"]
Sep 08 11:40:20.675351 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:20.675324    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-5mkwm"
Sep 08 11:40:20.678510 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:20.678489    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-nngfg\""
Sep 08 11:40:20.678610 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:20.678513    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 08 11:40:20.685512 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:20.685489    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-5mkwm"]
Sep 08 11:40:20.697196 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:20.697168    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7abaece7-f447-4eb0-9069-55e77403f630-metrics-certs\") pod \"maas-api-7df9d55888-fvb5x\" (UID: \"7abaece7-f447-4eb0-9069-55e77403f630\") " pod="odh-ai-gateway-infra/maas-api-7df9d55888-fvb5x"
Sep 08 11:40:20.699640 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:20.699617    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7abaece7-f447-4eb0-9069-55e77403f630-metrics-certs\") pod \"maas-api-7df9d55888-fvb5x\" (UID: \"7abaece7-f447-4eb0-9069-55e77403f630\") " pod="odh-ai-gateway-infra/maas-api-7df9d55888-fvb5x"
Sep 08 11:40:20.798077 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:20.798030    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e4e40b15-6a61-41d4-8f31-3477f98974a3-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-5mkwm\" (UID: \"e4e40b15-6a61-41d4-8f31-3477f98974a3\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-5mkwm"
Sep 08 11:40:20.798231 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:20.798104    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdpb4\" (UniqueName: \"kubernetes.io/projected/e4e40b15-6a61-41d4-8f31-3477f98974a3-kube-api-access-xdpb4\") pod \"payload-processing-5b54b7fbb7-5mkwm\" (UID: \"e4e40b15-6a61-41d4-8f31-3477f98974a3\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-5mkwm"
Sep 08 11:40:20.899387 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:20.899355    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdpb4\" (UniqueName: \"kubernetes.io/projected/e4e40b15-6a61-41d4-8f31-3477f98974a3-kube-api-access-xdpb4\") pod \"payload-processing-5b54b7fbb7-5mkwm\" (UID: \"e4e40b15-6a61-41d4-8f31-3477f98974a3\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-5mkwm"
Sep 08 11:40:20.899550 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:20.899459    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e4e40b15-6a61-41d4-8f31-3477f98974a3-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-5mkwm\" (UID: \"e4e40b15-6a61-41d4-8f31-3477f98974a3\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-5mkwm"
Sep 08 11:40:20.900103 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:20.900086    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e4e40b15-6a61-41d4-8f31-3477f98974a3-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-5mkwm\" (UID: \"e4e40b15-6a61-41d4-8f31-3477f98974a3\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-5mkwm"
Sep 08 11:40:20.908546 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:20.908519    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdpb4\" (UniqueName: \"kubernetes.io/projected/e4e40b15-6a61-41d4-8f31-3477f98974a3-kube-api-access-xdpb4\") pod \"payload-processing-5b54b7fbb7-5mkwm\" (UID: \"e4e40b15-6a61-41d4-8f31-3477f98974a3\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-5mkwm"
Sep 08 11:40:20.915327 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:20.915306    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7df9d55888-fvb5x"
Sep 08 11:40:20.986649 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:20.986620    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-5mkwm"
Sep 08 11:40:21.190939 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:21.190904    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7df9d55888-fvb5x"]
Sep 08 11:40:21.191932 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:40:21.191910    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7abaece7_f447_4eb0_9069_55e77403f630.slice/crio-1a1d11a5a22dbce1634897984e6ba519beaf778c3ce8a888f41c91e840e02c60 WatchSource:0}: Error finding container 1a1d11a5a22dbce1634897984e6ba519beaf778c3ce8a888f41c91e840e02c60: Status 404 returned error can't find the container with id 1a1d11a5a22dbce1634897984e6ba519beaf778c3ce8a888f41c91e840e02c60
Sep 08 11:40:21.264104 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:21.264055    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-5mkwm"]
Sep 08 11:40:21.543121 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:21.543085    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7df9d55888-fvb5x" event={"ID":"7abaece7-f447-4eb0-9069-55e77403f630","Type":"ContainerStarted","Data":"1a1d11a5a22dbce1634897984e6ba519beaf778c3ce8a888f41c91e840e02c60"}
Sep 08 11:40:21.544255 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:21.544225    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-5mkwm" event={"ID":"e4e40b15-6a61-41d4-8f31-3477f98974a3","Type":"ContainerStarted","Data":"80decb13e6a22683c879959bd548148cb73f32fd780d1d9f6ba0bbb6d12497b1"}
Sep 08 11:40:25.836984 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:25.836962    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m57jb_63788019-f061-44d6-89a3-50c4a62e9fbf/ovn-acl-logging/0.log"
Sep 08 11:40:25.838055 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:25.838034    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m57jb_63788019-f061-44d6-89a3-50c4a62e9fbf/ovn-acl-logging/0.log"
Sep 08 11:40:26.598083 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:26.598050    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7df9d55888-fvb5x" event={"ID":"7abaece7-f447-4eb0-9069-55e77403f630","Type":"ContainerStarted","Data":"34dad5a776a6e1565729b6b9acb508d9cd6598ce3e5b248634b2205aa6ac8ebf"}
Sep 08 11:40:26.598322 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:26.598197    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7df9d55888-fvb5x"
Sep 08 11:40:26.599629 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:26.599600    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-5mkwm" event={"ID":"e4e40b15-6a61-41d4-8f31-3477f98974a3","Type":"ContainerStarted","Data":"60e2dd9887befbf349a7dde0692c5b97961a5f57e1baa13a3078304023350ac2"}
Sep 08 11:40:26.599740 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:26.599683    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-5mkwm"
Sep 08 11:40:26.617202 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:26.617155    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7df9d55888-fvb5x" podStartSLOduration=3.0086745 podStartE2EDuration="7.617137646s" totalImagesPullingTime="4.608463146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:40:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:40:26.615768248 +0000 UTC m=+601.267475057" watchObservedRunningTime="2026-09-08 11:40:26.617137646 +0000 UTC m=+601.268844442"
Sep 08 11:40:26.633332 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:26.633292    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-5mkwm" podStartSLOduration=2.111770872 podStartE2EDuration="6.633277863s" totalImagesPullingTime="4.521506991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:40:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:40:26.63287729 +0000 UTC m=+601.284584113" watchObservedRunningTime="2026-09-08 11:40:26.633277863 +0000 UTC m=+601.284984657"
Sep 08 11:40:30.619846 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:30.619810    2575 generic.go:356] "Generic (PLEG): container finished" podID="2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4" containerID="1371d7cc306c2988a54ebc750bcbf0d18c6bdce026252f3c874f722826d80140" exitCode=0
Sep 08 11:40:30.620273 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:30.619881    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt" event={"ID":"2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4","Type":"ContainerDied","Data":"1371d7cc306c2988a54ebc750bcbf0d18c6bdce026252f3c874f722826d80140"}
Sep 08 11:40:30.620273 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:30.620222    2575 scope.go:117] "RemoveContainer" containerID="1371d7cc306c2988a54ebc750bcbf0d18c6bdce026252f3c874f722826d80140"
Sep 08 11:40:30.621173 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:30.621148    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:40:30.621254 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:30.621211    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:40:30.621294 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:30.621259    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:40:31.626835 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:31.626801    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt" event={"ID":"2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4","Type":"ContainerStarted","Data":"60b5046388f7f22a6f8e1ce3d410c6fdf9ebfd955c5840e8c73e15d7016d1f6c"}
Sep 08 11:40:31.678318 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:31.678267    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt"
Sep 08 11:40:31.678522 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:31.678460    2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-4bzvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Sep 08 11:40:31.678597 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:31.678509    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt" podUID="2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Sep 08 11:40:32.610092 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:32.610063    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7df9d55888-fvb5x"
Sep 08 11:40:32.677369 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:32.676676    2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-4bzvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Sep 08 11:40:32.677369 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:32.676739    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt" podUID="2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Sep 08 11:40:33.675139 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:33.675098    2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-4bzvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Sep 08 11:40:33.675369 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:33.675170    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt" podUID="2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Sep 08 11:40:34.674630 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:34.674589    2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-4bzvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Sep 08 11:40:34.675129 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:34.674659    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt" podUID="2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Sep 08 11:40:35.085509 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:35.085469    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt"
Sep 08 11:40:35.674912 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:35.674874    2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-4bzvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Sep 08 11:40:35.675537 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:35.675505    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt" podUID="2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Sep 08 11:40:36.678309 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:36.678282    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt"
Sep 08 11:40:36.679424 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:36.679401    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt"
Sep 08 11:40:37.607309 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:37.607281    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-5mkwm"
Sep 08 11:40:54.118711 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:54.118628    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9"]
Sep 08 11:40:54.122293 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:54.122259    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9"
Sep 08 11:40:54.125129 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:54.125104    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 08 11:40:54.126937 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:54.126916    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 08 11:40:54.127053 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:54.126919    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 08 11:40:54.127053 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:54.126938    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-pkvgk\""
Sep 08 11:40:54.132306 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:54.132287    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9"]
Sep 08 11:40:54.316909 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:54.316876    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1853033a-31a1-431d-acf6-a658fc0969d7-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9\" (UID: \"1853033a-31a1-431d-acf6-a658fc0969d7\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9"
Sep 08 11:40:54.317085 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:54.316918    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb84j\" (UniqueName: \"kubernetes.io/projected/1853033a-31a1-431d-acf6-a658fc0969d7-kube-api-access-pb84j\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9\" (UID: \"1853033a-31a1-431d-acf6-a658fc0969d7\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9"
Sep 08 11:40:54.317085 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:54.316939    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1853033a-31a1-431d-acf6-a658fc0969d7-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9\" (UID: \"1853033a-31a1-431d-acf6-a658fc0969d7\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9"
Sep 08 11:40:54.317085 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:54.316967    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1853033a-31a1-431d-acf6-a658fc0969d7-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9\" (UID: \"1853033a-31a1-431d-acf6-a658fc0969d7\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9"
Sep 08 11:40:54.317085 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:54.317046    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1853033a-31a1-431d-acf6-a658fc0969d7-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9\" (UID: \"1853033a-31a1-431d-acf6-a658fc0969d7\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9"
Sep 08 11:40:54.317085 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:54.317076    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1853033a-31a1-431d-acf6-a658fc0969d7-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9\" (UID: \"1853033a-31a1-431d-acf6-a658fc0969d7\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9"
Sep 08 11:40:54.417605 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:54.417538    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1853033a-31a1-431d-acf6-a658fc0969d7-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9\" (UID: \"1853033a-31a1-431d-acf6-a658fc0969d7\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9"
Sep 08 11:40:54.417605 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:54.417590    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1853033a-31a1-431d-acf6-a658fc0969d7-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9\" (UID: \"1853033a-31a1-431d-acf6-a658fc0969d7\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9"
Sep 08 11:40:54.417807 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:54.417618    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1853033a-31a1-431d-acf6-a658fc0969d7-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9\" (UID: \"1853033a-31a1-431d-acf6-a658fc0969d7\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9"
Sep 08 11:40:54.417807 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:54.417667    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1853033a-31a1-431d-acf6-a658fc0969d7-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9\" (UID: \"1853033a-31a1-431d-acf6-a658fc0969d7\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9"
Sep 08 11:40:54.417807 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:54.417693    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb84j\" (UniqueName: \"kubernetes.io/projected/1853033a-31a1-431d-acf6-a658fc0969d7-kube-api-access-pb84j\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9\" (UID: \"1853033a-31a1-431d-acf6-a658fc0969d7\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9"
Sep 08 11:40:54.417807 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:54.417719    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1853033a-31a1-431d-acf6-a658fc0969d7-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9\" (UID: \"1853033a-31a1-431d-acf6-a658fc0969d7\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9"
Sep 08 11:40:54.418027 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:54.417994    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1853033a-31a1-431d-acf6-a658fc0969d7-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9\" (UID: \"1853033a-31a1-431d-acf6-a658fc0969d7\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9"
Sep 08 11:40:54.418088 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:54.418043    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1853033a-31a1-431d-acf6-a658fc0969d7-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9\" (UID: \"1853033a-31a1-431d-acf6-a658fc0969d7\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9"
Sep 08 11:40:54.418146 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:54.418103    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1853033a-31a1-431d-acf6-a658fc0969d7-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9\" (UID: \"1853033a-31a1-431d-acf6-a658fc0969d7\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9"
Sep 08 11:40:54.420050 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:54.420022    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1853033a-31a1-431d-acf6-a658fc0969d7-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9\" (UID: \"1853033a-31a1-431d-acf6-a658fc0969d7\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9"
Sep 08 11:40:54.420283 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:54.420267    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1853033a-31a1-431d-acf6-a658fc0969d7-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9\" (UID: \"1853033a-31a1-431d-acf6-a658fc0969d7\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9"
Sep 08 11:40:54.426728 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:54.426709    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb84j\" (UniqueName: \"kubernetes.io/projected/1853033a-31a1-431d-acf6-a658fc0969d7-kube-api-access-pb84j\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9\" (UID: \"1853033a-31a1-431d-acf6-a658fc0969d7\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9"
Sep 08 11:40:54.433621 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:54.433602    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9"
Sep 08 11:40:54.706399 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:54.706376    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9"]
Sep 08 11:40:54.743034 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:54.742995    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9" event={"ID":"1853033a-31a1-431d-acf6-a658fc0969d7","Type":"ContainerStarted","Data":"8160478b43d65f0776d7a5586ef69c19620d8870087e998a1dbb349afe90685c"}
Sep 08 11:40:56.754785 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:56.754746    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9" event={"ID":"1853033a-31a1-431d-acf6-a658fc0969d7","Type":"ContainerStarted","Data":"04e253b37283bba56358c624ff85b5b75cbd64857cf5475d0fd1fabaf299443c"}
Sep 08 11:40:56.775210 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:40:56.775164    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9" podStartSLOduration=1.7505800580000002 podStartE2EDuration="2.775148983s" totalImagesPullingTime="1.024568925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:40:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:40:56.77452228 +0000 UTC m=+631.426229075" watchObservedRunningTime="2026-09-08 11:40:56.775148983 +0000 UTC m=+631.426855777"
Sep 08 11:41:04.434441 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:41:04.434324    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9"
Sep 08 11:41:04.434441 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:41:04.434417    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9"
Sep 08 11:41:04.446762 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:41:04.446740    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9"
Sep 08 11:41:04.804158 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:41:04.804127    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9"
Sep 08 11:41:37.429259 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:41:37.429224    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-q2hk9"]
Sep 08 11:41:37.435266 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:41:37.435249    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q2hk9"
Sep 08 11:41:37.437852 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:41:37.437832    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 08 11:41:37.445002 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:41:37.444976    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-q2hk9"]
Sep 08 11:41:37.526889 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:41:37.526856    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgzrv\" (UniqueName: \"kubernetes.io/projected/fde1f76d-2dfc-447b-a4ad-8e8f09f5f92d-kube-api-access-vgzrv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-q2hk9\" (UID: \"fde1f76d-2dfc-447b-a4ad-8e8f09f5f92d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q2hk9"
Sep 08 11:41:37.526889 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:41:37.526895    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fde1f76d-2dfc-447b-a4ad-8e8f09f5f92d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-q2hk9\" (UID: \"fde1f76d-2dfc-447b-a4ad-8e8f09f5f92d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q2hk9"
Sep 08 11:41:37.527082 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:41:37.526922    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fde1f76d-2dfc-447b-a4ad-8e8f09f5f92d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-q2hk9\" (UID: \"fde1f76d-2dfc-447b-a4ad-8e8f09f5f92d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q2hk9"
Sep 08 11:41:37.527082 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:41:37.526948    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fde1f76d-2dfc-447b-a4ad-8e8f09f5f92d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-q2hk9\" (UID: \"fde1f76d-2dfc-447b-a4ad-8e8f09f5f92d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q2hk9"
Sep 08 11:41:37.527082 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:41:37.527006    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fde1f76d-2dfc-447b-a4ad-8e8f09f5f92d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-q2hk9\" (UID: \"fde1f76d-2dfc-447b-a4ad-8e8f09f5f92d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q2hk9"
Sep 08 11:41:37.527082 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:41:37.527022    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fde1f76d-2dfc-447b-a4ad-8e8f09f5f92d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-q2hk9\" (UID: \"fde1f76d-2dfc-447b-a4ad-8e8f09f5f92d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q2hk9"
Sep 08 11:41:37.628021 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:41:37.627990    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgzrv\" (UniqueName: \"kubernetes.io/projected/fde1f76d-2dfc-447b-a4ad-8e8f09f5f92d-kube-api-access-vgzrv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-q2hk9\" (UID: \"fde1f76d-2dfc-447b-a4ad-8e8f09f5f92d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q2hk9"
Sep 08 11:41:37.628021 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:41:37.628025    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fde1f76d-2dfc-447b-a4ad-8e8f09f5f92d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-q2hk9\" (UID: \"fde1f76d-2dfc-447b-a4ad-8e8f09f5f92d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q2hk9"
Sep 08 11:41:37.628261 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:41:37.628053    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fde1f76d-2dfc-447b-a4ad-8e8f09f5f92d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-q2hk9\" (UID: \"fde1f76d-2dfc-447b-a4ad-8e8f09f5f92d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q2hk9"
Sep 08 11:41:37.628261 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:41:37.628074    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fde1f76d-2dfc-447b-a4ad-8e8f09f5f92d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-q2hk9\" (UID: \"fde1f76d-2dfc-447b-a4ad-8e8f09f5f92d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q2hk9"
Sep 08 11:41:37.628261 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:41:37.628122    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fde1f76d-2dfc-447b-a4ad-8e8f09f5f92d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-q2hk9\" (UID: \"fde1f76d-2dfc-447b-a4ad-8e8f09f5f92d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q2hk9"
Sep 08 11:41:37.628261 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:41:37.628138    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fde1f76d-2dfc-447b-a4ad-8e8f09f5f92d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-q2hk9\" (UID: \"fde1f76d-2dfc-447b-a4ad-8e8f09f5f92d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q2hk9"
Sep 08 11:41:37.628487 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:41:37.628400    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fde1f76d-2dfc-447b-a4ad-8e8f09f5f92d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-q2hk9\" (UID: \"fde1f76d-2dfc-447b-a4ad-8e8f09f5f92d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q2hk9"
Sep 08 11:41:37.628588 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:41:37.628569    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fde1f76d-2dfc-447b-a4ad-8e8f09f5f92d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-q2hk9\" (UID: \"fde1f76d-2dfc-447b-a4ad-8e8f09f5f92d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q2hk9"
Sep 08 11:41:37.628653 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:41:37.628576    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fde1f76d-2dfc-447b-a4ad-8e8f09f5f92d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-q2hk9\" (UID: \"fde1f76d-2dfc-447b-a4ad-8e8f09f5f92d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q2hk9"
Sep 08 11:41:37.630451 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:41:37.630429    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fde1f76d-2dfc-447b-a4ad-8e8f09f5f92d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-q2hk9\" (UID: \"fde1f76d-2dfc-447b-a4ad-8e8f09f5f92d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q2hk9"
Sep 08 11:41:37.630851 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:41:37.630832    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fde1f76d-2dfc-447b-a4ad-8e8f09f5f92d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-q2hk9\" (UID: \"fde1f76d-2dfc-447b-a4ad-8e8f09f5f92d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q2hk9"
Sep 08 11:41:37.637543 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:41:37.637522    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgzrv\" (UniqueName: \"kubernetes.io/projected/fde1f76d-2dfc-447b-a4ad-8e8f09f5f92d-kube-api-access-vgzrv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-q2hk9\" (UID: \"fde1f76d-2dfc-447b-a4ad-8e8f09f5f92d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q2hk9"
Sep 08 11:41:37.746174 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:41:37.746092    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q2hk9"
Sep 08 11:41:38.027582 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:41:38.027557    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-q2hk9"]
Sep 08 11:41:38.028603 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:41:38.028577    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfde1f76d_2dfc_447b_a4ad_8e8f09f5f92d.slice/crio-0e837b1952ea9d757b5cd058ed71d9a120b8281677deb2ad374b1dcb87353f98 WatchSource:0}: Error finding container 0e837b1952ea9d757b5cd058ed71d9a120b8281677deb2ad374b1dcb87353f98: Status 404 returned error can't find the container with id 0e837b1952ea9d757b5cd058ed71d9a120b8281677deb2ad374b1dcb87353f98
Sep 08 11:41:38.030028 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:41:38.030009    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 11:41:38.960737 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:41:38.960699    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q2hk9" event={"ID":"fde1f76d-2dfc-447b-a4ad-8e8f09f5f92d","Type":"ContainerStarted","Data":"9fe3bf555c3e8e046f3441f258bcb3698412ebf58ca0ee887987dc2bd228a170"}
Sep 08 11:41:38.961228 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:41:38.960759    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q2hk9" event={"ID":"fde1f76d-2dfc-447b-a4ad-8e8f09f5f92d","Type":"ContainerStarted","Data":"0e837b1952ea9d757b5cd058ed71d9a120b8281677deb2ad374b1dcb87353f98"}
Sep 08 11:41:38.983133 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:41:38.983083    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q2hk9" podStartSLOduration=1.803125839 podStartE2EDuration="1.983068028s" totalImagesPullingTime="179.942189ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:41:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:41:38.981014875 +0000 UTC m=+673.632721703" watchObservedRunningTime="2026-09-08 11:41:38.983068028 +0000 UTC m=+673.634774823"
Sep 08 11:41:47.746612 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:41:47.746579    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q2hk9"
Sep 08 11:41:47.747056 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:41:47.746653    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q2hk9"
Sep 08 11:41:47.759261 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:41:47.759233    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q2hk9"
Sep 08 11:41:48.017472 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:41:48.017398    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q2hk9"
Sep 08 11:42:51.462423 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:51.462319    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"]
Sep 08 11:42:51.466059 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:51.466036    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"
Sep 08 11:42:51.469322 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:51.469292    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-95669b-openshift-default-dockercfg-rnxjk\""
Sep 08 11:42:51.482025 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:51.481989    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"]
Sep 08 11:42:51.622062 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:51.622026    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7cca131-5a8c-41e2-860b-fc2277495a2c-workload-certs\") pod \"e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8\" (UID: \"a7cca131-5a8c-41e2-860b-fc2277495a2c\") " pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"
Sep 08 11:42:51.622062 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:51.622062    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7cca131-5a8c-41e2-860b-fc2277495a2c-istiod-ca-cert\") pod \"e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8\" (UID: \"a7cca131-5a8c-41e2-860b-fc2277495a2c\") " pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"
Sep 08 11:42:51.622251 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:51.622096    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7cca131-5a8c-41e2-860b-fc2277495a2c-istio-data\") pod \"e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8\" (UID: \"a7cca131-5a8c-41e2-860b-fc2277495a2c\") " pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"
Sep 08 11:42:51.622251 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:51.622173    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7cca131-5a8c-41e2-860b-fc2277495a2c-istio-token\") pod \"e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8\" (UID: \"a7cca131-5a8c-41e2-860b-fc2277495a2c\") " pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"
Sep 08 11:42:51.622251 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:51.622205    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7cca131-5a8c-41e2-860b-fc2277495a2c-workload-socket\") pod \"e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8\" (UID: \"a7cca131-5a8c-41e2-860b-fc2277495a2c\") " pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"
Sep 08 11:42:51.622379 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:51.622307    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2zfq\" (UniqueName: \"kubernetes.io/projected/a7cca131-5a8c-41e2-860b-fc2277495a2c-kube-api-access-f2zfq\") pod \"e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8\" (UID: \"a7cca131-5a8c-41e2-860b-fc2277495a2c\") " pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"
Sep 08 11:42:51.622379 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:51.622362    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7cca131-5a8c-41e2-860b-fc2277495a2c-istio-envoy\") pod \"e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8\" (UID: \"a7cca131-5a8c-41e2-860b-fc2277495a2c\") " pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"
Sep 08 11:42:51.622448 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:51.622406    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7cca131-5a8c-41e2-860b-fc2277495a2c-credential-socket\") pod \"e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8\" (UID: \"a7cca131-5a8c-41e2-860b-fc2277495a2c\") " pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"
Sep 08 11:42:51.622448 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:51.622423    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7cca131-5a8c-41e2-860b-fc2277495a2c-istio-podinfo\") pod \"e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8\" (UID: \"a7cca131-5a8c-41e2-860b-fc2277495a2c\") " pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"
Sep 08 11:42:51.723742 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:51.723663    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7cca131-5a8c-41e2-860b-fc2277495a2c-workload-certs\") pod \"e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8\" (UID: \"a7cca131-5a8c-41e2-860b-fc2277495a2c\") " pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"
Sep 08 11:42:51.723742 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:51.723694    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7cca131-5a8c-41e2-860b-fc2277495a2c-istiod-ca-cert\") pod \"e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8\" (UID: \"a7cca131-5a8c-41e2-860b-fc2277495a2c\") " pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"
Sep 08 11:42:51.723742 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:51.723723    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7cca131-5a8c-41e2-860b-fc2277495a2c-istio-data\") pod \"e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8\" (UID: \"a7cca131-5a8c-41e2-860b-fc2277495a2c\") " pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"
Sep 08 11:42:51.724014 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:51.723761    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7cca131-5a8c-41e2-860b-fc2277495a2c-istio-token\") pod \"e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8\" (UID: \"a7cca131-5a8c-41e2-860b-fc2277495a2c\") " pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"
Sep 08 11:42:51.724014 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:51.723793    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7cca131-5a8c-41e2-860b-fc2277495a2c-workload-socket\") pod \"e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8\" (UID: \"a7cca131-5a8c-41e2-860b-fc2277495a2c\") " pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"
Sep 08 11:42:51.724014 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:51.723869    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2zfq\" (UniqueName: \"kubernetes.io/projected/a7cca131-5a8c-41e2-860b-fc2277495a2c-kube-api-access-f2zfq\") pod \"e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8\" (UID: \"a7cca131-5a8c-41e2-860b-fc2277495a2c\") " pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"
Sep 08 11:42:51.724014 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:51.723916    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7cca131-5a8c-41e2-860b-fc2277495a2c-istio-envoy\") pod \"e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8\" (UID: \"a7cca131-5a8c-41e2-860b-fc2277495a2c\") " pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"
Sep 08 11:42:51.724014 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:51.723968    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7cca131-5a8c-41e2-860b-fc2277495a2c-credential-socket\") pod \"e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8\" (UID: \"a7cca131-5a8c-41e2-860b-fc2277495a2c\") " pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"
Sep 08 11:42:51.724267 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:51.724074    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7cca131-5a8c-41e2-860b-fc2277495a2c-workload-certs\") pod \"e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8\" (UID: \"a7cca131-5a8c-41e2-860b-fc2277495a2c\") " pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"
Sep 08 11:42:51.724267 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:51.724115    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7cca131-5a8c-41e2-860b-fc2277495a2c-istio-podinfo\") pod \"e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8\" (UID: \"a7cca131-5a8c-41e2-860b-fc2277495a2c\") " pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"
Sep 08 11:42:51.724267 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:51.724188    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7cca131-5a8c-41e2-860b-fc2277495a2c-workload-socket\") pod \"e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8\" (UID: \"a7cca131-5a8c-41e2-860b-fc2277495a2c\") " pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"
Sep 08 11:42:51.724267 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:51.724234    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7cca131-5a8c-41e2-860b-fc2277495a2c-istio-data\") pod \"e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8\" (UID: \"a7cca131-5a8c-41e2-860b-fc2277495a2c\") " pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"
Sep 08 11:42:51.724553 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:51.724529    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7cca131-5a8c-41e2-860b-fc2277495a2c-credential-socket\") pod \"e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8\" (UID: \"a7cca131-5a8c-41e2-860b-fc2277495a2c\") " pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"
Sep 08 11:42:51.724799 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:51.724780    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7cca131-5a8c-41e2-860b-fc2277495a2c-istiod-ca-cert\") pod \"e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8\" (UID: \"a7cca131-5a8c-41e2-860b-fc2277495a2c\") " pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"
Sep 08 11:42:51.726323 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:51.726302    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7cca131-5a8c-41e2-860b-fc2277495a2c-istio-envoy\") pod \"e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8\" (UID: \"a7cca131-5a8c-41e2-860b-fc2277495a2c\") " pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"
Sep 08 11:42:51.726762 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:51.726744    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7cca131-5a8c-41e2-860b-fc2277495a2c-istio-podinfo\") pod \"e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8\" (UID: \"a7cca131-5a8c-41e2-860b-fc2277495a2c\") " pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"
Sep 08 11:42:51.732813 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:51.732791    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7cca131-5a8c-41e2-860b-fc2277495a2c-istio-token\") pod \"e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8\" (UID: \"a7cca131-5a8c-41e2-860b-fc2277495a2c\") " pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"
Sep 08 11:42:51.732959 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:51.732938    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2zfq\" (UniqueName: \"kubernetes.io/projected/a7cca131-5a8c-41e2-860b-fc2277495a2c-kube-api-access-f2zfq\") pod \"e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8\" (UID: \"a7cca131-5a8c-41e2-860b-fc2277495a2c\") " pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"
Sep 08 11:42:51.776724 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:51.776678    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"
Sep 08 11:42:52.056279 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:52.056255    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"]
Sep 08 11:42:52.058035 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:42:52.058008    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7cca131_5a8c_41e2_860b_fc2277495a2c.slice/crio-2ecf0748064a31dea5065cb520cb3660e36c06da7c229a48e2d622e9fb8282be WatchSource:0}: Error finding container 2ecf0748064a31dea5065cb520cb3660e36c06da7c229a48e2d622e9fb8282be: Status 404 returned error can't find the container with id 2ecf0748064a31dea5065cb520cb3660e36c06da7c229a48e2d622e9fb8282be
Sep 08 11:42:52.060683 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:52.060649    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:42:52.060750 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:52.060731    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:42:52.060790 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:52.060770    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:42:52.333352 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:52.333254    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8" event={"ID":"a7cca131-5a8c-41e2-860b-fc2277495a2c","Type":"ContainerStarted","Data":"bfea41053a147c4fe160d52392271b45017ec9a51c7496788c647abd6c7cdac7"}
Sep 08 11:42:52.333499 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:52.333422    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8" event={"ID":"a7cca131-5a8c-41e2-860b-fc2277495a2c","Type":"ContainerStarted","Data":"2ecf0748064a31dea5065cb520cb3660e36c06da7c229a48e2d622e9fb8282be"}
Sep 08 11:42:52.360423 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:52.360326    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8" podStartSLOduration=1.360310534 podStartE2EDuration="1.360310534s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:42:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:42:52.358598734 +0000 UTC m=+747.010305560" watchObservedRunningTime="2026-09-08 11:42:52.360310534 +0000 UTC m=+747.012017349"
Sep 08 11:42:52.777140 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:52.777115    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"
Sep 08 11:42:53.782495 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:53.782458    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"
Sep 08 11:42:54.344753 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:54.344722    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"
Sep 08 11:42:54.345474 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:54.345456    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"
Sep 08 11:42:55.447689 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:55.447659    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs"]
Sep 08 11:42:55.451466 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:55.451450    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs"
Sep 08 11:42:55.453963 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:55.453942    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-95669b-serving-cert\""
Sep 08 11:42:55.462419 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:55.462397    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs"]
Sep 08 11:42:55.569702 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:55.569670    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/088f99a1-9124-48de-9d7e-d18743e2a9ee-maas-api-tls\") pod \"maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs\" (UID: \"088f99a1-9124-48de-9d7e-d18743e2a9ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs"
Sep 08 11:42:55.569871 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:55.569731    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hb64\" (UniqueName: \"kubernetes.io/projected/088f99a1-9124-48de-9d7e-d18743e2a9ee-kube-api-access-9hb64\") pod \"maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs\" (UID: \"088f99a1-9124-48de-9d7e-d18743e2a9ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs"
Sep 08 11:42:55.569871 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:55.569770    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/088f99a1-9124-48de-9d7e-d18743e2a9ee-metrics-certs\") pod \"maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs\" (UID: \"088f99a1-9124-48de-9d7e-d18743e2a9ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs"
Sep 08 11:42:55.569992 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:55.569894    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/088f99a1-9124-48de-9d7e-d18743e2a9ee-openshift-service-ca\") pod \"maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs\" (UID: \"088f99a1-9124-48de-9d7e-d18743e2a9ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs"
Sep 08 11:42:55.670934 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:55.670898    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/088f99a1-9124-48de-9d7e-d18743e2a9ee-openshift-service-ca\") pod \"maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs\" (UID: \"088f99a1-9124-48de-9d7e-d18743e2a9ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs"
Sep 08 11:42:55.671106 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:55.670957    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/088f99a1-9124-48de-9d7e-d18743e2a9ee-maas-api-tls\") pod \"maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs\" (UID: \"088f99a1-9124-48de-9d7e-d18743e2a9ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs"
Sep 08 11:42:55.671106 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:55.671014    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hb64\" (UniqueName: \"kubernetes.io/projected/088f99a1-9124-48de-9d7e-d18743e2a9ee-kube-api-access-9hb64\") pod \"maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs\" (UID: \"088f99a1-9124-48de-9d7e-d18743e2a9ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs"
Sep 08 11:42:55.671106 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:55.671049    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/088f99a1-9124-48de-9d7e-d18743e2a9ee-metrics-certs\") pod \"maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs\" (UID: \"088f99a1-9124-48de-9d7e-d18743e2a9ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs"
Sep 08 11:42:55.671269 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:42:55.671148    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-95669b-serving-cert: secret "maas-api-e2e-inf-a-95669b-serving-cert" not found
Sep 08 11:42:55.671269 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:42:55.671224    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/088f99a1-9124-48de-9d7e-d18743e2a9ee-maas-api-tls podName:088f99a1-9124-48de-9d7e-d18743e2a9ee nodeName:}" failed. No retries permitted until 2026-09-08 11:42:56.171203095 +0000 UTC m=+750.822909885 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/088f99a1-9124-48de-9d7e-d18743e2a9ee-maas-api-tls") pod "maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs" (UID: "088f99a1-9124-48de-9d7e-d18743e2a9ee") : secret "maas-api-e2e-inf-a-95669b-serving-cert" not found
Sep 08 11:42:55.671722 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:55.671703    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/088f99a1-9124-48de-9d7e-d18743e2a9ee-openshift-service-ca\") pod \"maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs\" (UID: \"088f99a1-9124-48de-9d7e-d18743e2a9ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs"
Sep 08 11:42:55.673628 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:55.673611    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/088f99a1-9124-48de-9d7e-d18743e2a9ee-metrics-certs\") pod \"maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs\" (UID: \"088f99a1-9124-48de-9d7e-d18743e2a9ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs"
Sep 08 11:42:55.679652 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:55.679628    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hb64\" (UniqueName: \"kubernetes.io/projected/088f99a1-9124-48de-9d7e-d18743e2a9ee-kube-api-access-9hb64\") pod \"maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs\" (UID: \"088f99a1-9124-48de-9d7e-d18743e2a9ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs"
Sep 08 11:42:56.176473 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:56.176444    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/088f99a1-9124-48de-9d7e-d18743e2a9ee-maas-api-tls\") pod \"maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs\" (UID: \"088f99a1-9124-48de-9d7e-d18743e2a9ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs"
Sep 08 11:42:56.179194 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:56.179167    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/088f99a1-9124-48de-9d7e-d18743e2a9ee-maas-api-tls\") pod \"maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs\" (UID: \"088f99a1-9124-48de-9d7e-d18743e2a9ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs"
Sep 08 11:42:56.362872 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:56.362832    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs"
Sep 08 11:42:56.646307 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:56.646285    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs"]
Sep 08 11:42:56.648005 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:42:56.647982    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod088f99a1_9124_48de_9d7e_d18743e2a9ee.slice/crio-57353c078454095a2b2b59c565b5c24ada581fda81cc7b96424f1c0f6fa6cc49 WatchSource:0}: Error finding container 57353c078454095a2b2b59c565b5c24ada581fda81cc7b96424f1c0f6fa6cc49: Status 404 returned error can't find the container with id 57353c078454095a2b2b59c565b5c24ada581fda81cc7b96424f1c0f6fa6cc49
Sep 08 11:42:57.362221 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:57.362185    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs" event={"ID":"088f99a1-9124-48de-9d7e-d18743e2a9ee","Type":"ContainerStarted","Data":"3834c61efa7e4d905f67f6277fce684e30c1b61f06cf5403617583a1a0ebd76a"}
Sep 08 11:42:57.362445 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:57.362245    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs" event={"ID":"088f99a1-9124-48de-9d7e-d18743e2a9ee","Type":"ContainerStarted","Data":"57353c078454095a2b2b59c565b5c24ada581fda81cc7b96424f1c0f6fa6cc49"}
Sep 08 11:42:57.362445 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:57.362330    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs"
Sep 08 11:42:57.382754 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:42:57.382708    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs" podStartSLOduration=1.868101654 podStartE2EDuration="2.382693814s" totalImagesPullingTime="514.59216ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:42:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:42:57.381127998 +0000 UTC m=+752.032834841" watchObservedRunningTime="2026-09-08 11:42:57.382693814 +0000 UTC m=+752.034400607"
Sep 08 11:43:00.329839 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:00.329808    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"]
Sep 08 11:43:00.334352 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:00.334314    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"
Sep 08 11:43:00.338464 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:00.338441    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-7d3a6048-openshift-default-dockercfg-6vlqh\""
Sep 08 11:43:00.359900 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:00.359862    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"]
Sep 08 11:43:00.417508 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:00.417397    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-istiod-ca-cert\") pod \"e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d\" (UID: \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\") " pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"
Sep 08 11:43:00.417508 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:00.417476    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-istio-data\") pod \"e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d\" (UID: \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\") " pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"
Sep 08 11:43:00.417508 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:00.417545    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-istio-podinfo\") pod \"e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d\" (UID: \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\") " pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"
Sep 08 11:43:00.417889 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:00.417595    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4644m\" (UniqueName: \"kubernetes.io/projected/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-kube-api-access-4644m\") pod \"e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d\" (UID: \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\") " pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"
Sep 08 11:43:00.417889 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:00.417627    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-credential-socket\") pod \"e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d\" (UID: \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\") " pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"
Sep 08 11:43:00.417889 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:00.417686    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-istio-envoy\") pod \"e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d\" (UID: \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\") " pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"
Sep 08 11:43:00.417889 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:00.417813    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-workload-certs\") pod \"e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d\" (UID: \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\") " pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"
Sep 08 11:43:00.417889 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:00.417864    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-workload-socket\") pod \"e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d\" (UID: \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\") " pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"
Sep 08 11:43:00.417889 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:00.417889    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-istio-token\") pod \"e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d\" (UID: \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\") " pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"
Sep 08 11:43:00.518944 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:00.518905    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-workload-certs\") pod \"e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d\" (UID: \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\") " pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"
Sep 08 11:43:00.519193 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:00.518953    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-workload-socket\") pod \"e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d\" (UID: \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\") " pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"
Sep 08 11:43:00.519193 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:00.518978    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-istio-token\") pod \"e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d\" (UID: \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\") " pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"
Sep 08 11:43:00.519193 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:00.519015    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-istiod-ca-cert\") pod \"e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d\" (UID: \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\") " pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"
Sep 08 11:43:00.519193 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:00.519076    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-istio-data\") pod \"e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d\" (UID: \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\") " pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"
Sep 08 11:43:00.519193 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:00.519137    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-istio-podinfo\") pod \"e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d\" (UID: \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\") " pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"
Sep 08 11:43:00.519193 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:00.519176    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4644m\" (UniqueName: \"kubernetes.io/projected/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-kube-api-access-4644m\") pod \"e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d\" (UID: \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\") " pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"
Sep 08 11:43:00.519557 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:00.519213    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-credential-socket\") pod \"e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d\" (UID: \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\") " pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"
Sep 08 11:43:00.519557 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:00.519254    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-istio-envoy\") pod \"e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d\" (UID: \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\") " pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"
Sep 08 11:43:00.519557 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:00.519424    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-workload-certs\") pod \"e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d\" (UID: \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\") " pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"
Sep 08 11:43:00.519716 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:00.519617    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-workload-socket\") pod \"e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d\" (UID: \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\") " pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"
Sep 08 11:43:00.519905 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:00.519882    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-credential-socket\") pod \"e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d\" (UID: \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\") " pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"
Sep 08 11:43:00.520177 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:00.520038    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-istio-data\") pod \"e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d\" (UID: \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\") " pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"
Sep 08 11:43:00.520244 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:00.520165    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-istiod-ca-cert\") pod \"e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d\" (UID: \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\") " pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"
Sep 08 11:43:00.522330 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:00.522301    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-istio-envoy\") pod \"e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d\" (UID: \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\") " pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"
Sep 08 11:43:00.522864 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:00.522840    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-istio-podinfo\") pod \"e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d\" (UID: \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\") " pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"
Sep 08 11:43:00.528912 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:00.528882    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4644m\" (UniqueName: \"kubernetes.io/projected/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-kube-api-access-4644m\") pod \"e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d\" (UID: \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\") " pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"
Sep 08 11:43:00.529032 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:00.528966    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-istio-token\") pod \"e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d\" (UID: \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\") " pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"
Sep 08 11:43:00.657306 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:00.657234    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"
Sep 08 11:43:00.975582 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:00.975530    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"]
Sep 08 11:43:00.989901 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:00.988234    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:43:00.989901 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:00.988316    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:43:00.989901 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:00.988376    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:43:01.403886 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:01.403850    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d" event={"ID":"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04","Type":"ContainerStarted","Data":"8a8f7e6e4e1cc0c600eeb176609f99a07a7af808b665c72a6b446089c6a54ad8"}
Sep 08 11:43:01.404255 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:01.403903    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d" event={"ID":"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04","Type":"ContainerStarted","Data":"0eca746d6c33c8d6a732941994b9cb44bd41414a210f2ae3cc40b9c1c46c96ed"}
Sep 08 11:43:01.426173 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:01.426129    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d" podStartSLOduration=1.426110829 podStartE2EDuration="1.426110829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:43:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:43:01.423721425 +0000 UTC m=+756.075428243" watchObservedRunningTime="2026-09-08 11:43:01.426110829 +0000 UTC m=+756.077817623"
Sep 08 11:43:01.657624 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:01.657545    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"
Sep 08 11:43:02.679918 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:02.679879    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"
Sep 08 11:43:03.377166 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:03.377133    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs"
Sep 08 11:43:03.414140 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:03.414108    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"
Sep 08 11:43:03.415304 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:03.415280    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"
Sep 08 11:43:03.902455 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:03.902419    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9"]
Sep 08 11:43:03.906656 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:03.906633    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9"
Sep 08 11:43:03.909361 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:03.909142    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-7d3a6048-serving-cert\""
Sep 08 11:43:03.922292 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:03.922263    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9"]
Sep 08 11:43:03.955875 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:03.955845    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm9mn\" (UniqueName: \"kubernetes.io/projected/a5568bac-5502-493c-88f9-1cc2baaa4c74-kube-api-access-wm9mn\") pod \"maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9\" (UID: \"a5568bac-5502-493c-88f9-1cc2baaa4c74\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9"
Sep 08 11:43:03.956036 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:03.955903    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5568bac-5502-493c-88f9-1cc2baaa4c74-metrics-certs\") pod \"maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9\" (UID: \"a5568bac-5502-493c-88f9-1cc2baaa4c74\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9"
Sep 08 11:43:03.956036 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:03.955987    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5568bac-5502-493c-88f9-1cc2baaa4c74-openshift-service-ca\") pod \"maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9\" (UID: \"a5568bac-5502-493c-88f9-1cc2baaa4c74\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9"
Sep 08 11:43:03.956111 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:03.956048    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5568bac-5502-493c-88f9-1cc2baaa4c74-maas-api-tls\") pod \"maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9\" (UID: \"a5568bac-5502-493c-88f9-1cc2baaa4c74\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9"
Sep 08 11:43:04.057188 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:04.057148    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm9mn\" (UniqueName: \"kubernetes.io/projected/a5568bac-5502-493c-88f9-1cc2baaa4c74-kube-api-access-wm9mn\") pod \"maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9\" (UID: \"a5568bac-5502-493c-88f9-1cc2baaa4c74\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9"
Sep 08 11:43:04.057386 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:04.057194    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5568bac-5502-493c-88f9-1cc2baaa4c74-metrics-certs\") pod \"maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9\" (UID: \"a5568bac-5502-493c-88f9-1cc2baaa4c74\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9"
Sep 08 11:43:04.057386 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:04.057255    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5568bac-5502-493c-88f9-1cc2baaa4c74-openshift-service-ca\") pod \"maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9\" (UID: \"a5568bac-5502-493c-88f9-1cc2baaa4c74\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9"
Sep 08 11:43:04.057386 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:04.057293    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5568bac-5502-493c-88f9-1cc2baaa4c74-maas-api-tls\") pod \"maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9\" (UID: \"a5568bac-5502-493c-88f9-1cc2baaa4c74\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9"
Sep 08 11:43:04.057949 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:04.057925    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5568bac-5502-493c-88f9-1cc2baaa4c74-openshift-service-ca\") pod \"maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9\" (UID: \"a5568bac-5502-493c-88f9-1cc2baaa4c74\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9"
Sep 08 11:43:04.059688 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:04.059667    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5568bac-5502-493c-88f9-1cc2baaa4c74-maas-api-tls\") pod \"maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9\" (UID: \"a5568bac-5502-493c-88f9-1cc2baaa4c74\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9"
Sep 08 11:43:04.064364 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:04.060522    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5568bac-5502-493c-88f9-1cc2baaa4c74-metrics-certs\") pod \"maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9\" (UID: \"a5568bac-5502-493c-88f9-1cc2baaa4c74\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9"
Sep 08 11:43:04.070360 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:04.069680    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm9mn\" (UniqueName: \"kubernetes.io/projected/a5568bac-5502-493c-88f9-1cc2baaa4c74-kube-api-access-wm9mn\") pod \"maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9\" (UID: \"a5568bac-5502-493c-88f9-1cc2baaa4c74\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9"
Sep 08 11:43:04.219936 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:04.219852    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9"
Sep 08 11:43:04.524924 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:04.524874    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9"]
Sep 08 11:43:04.525591 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:43:04.525562    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5568bac_5502_493c_88f9_1cc2baaa4c74.slice/crio-2892c6d866229716e4230a6d4814747750d6233e3fd43c59825acfe6bbe734b3 WatchSource:0}: Error finding container 2892c6d866229716e4230a6d4814747750d6233e3fd43c59825acfe6bbe734b3: Status 404 returned error can't find the container with id 2892c6d866229716e4230a6d4814747750d6233e3fd43c59825acfe6bbe734b3
Sep 08 11:43:05.425899 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:05.425858    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9" event={"ID":"a5568bac-5502-493c-88f9-1cc2baaa4c74","Type":"ContainerStarted","Data":"2892c6d866229716e4230a6d4814747750d6233e3fd43c59825acfe6bbe734b3"}
Sep 08 11:43:07.440543 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:07.440519    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9" event={"ID":"a5568bac-5502-493c-88f9-1cc2baaa4c74","Type":"ContainerStarted","Data":"23de05c768a83785c49eef619f057d2f0aeef5ae14debe79a590d0e5e0dc38b8"}
Sep 08 11:43:07.440852 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:07.440608    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9"
Sep 08 11:43:07.460991 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:07.460929    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9" podStartSLOduration=1.6390018610000001 podStartE2EDuration="4.460906133s" totalImagesPullingTime="2.821904272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:43:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:43:07.459201837 +0000 UTC m=+762.110908656" watchObservedRunningTime="2026-09-08 11:43:07.460906133 +0000 UTC m=+762.112612929"
Sep 08 11:43:09.346048 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:09.346017    2575 patch_prober.go:28] interesting pod/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 08 11:43:09.346526 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:09.346074    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8" podUID="a7cca131-5a8c-41e2-860b-fc2277495a2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 08 11:43:09.453147 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:09.453120    2575 generic.go:356] "Generic (PLEG): container finished" podID="a7cca131-5a8c-41e2-860b-fc2277495a2c" containerID="bfea41053a147c4fe160d52392271b45017ec9a51c7496788c647abd6c7cdac7" exitCode=0
Sep 08 11:43:09.453307 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:09.453200    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8" event={"ID":"a7cca131-5a8c-41e2-860b-fc2277495a2c","Type":"ContainerDied","Data":"bfea41053a147c4fe160d52392271b45017ec9a51c7496788c647abd6c7cdac7"}
Sep 08 11:43:09.453661 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:09.453646    2575 scope.go:117] "RemoveContainer" containerID="bfea41053a147c4fe160d52392271b45017ec9a51c7496788c647abd6c7cdac7"
Sep 08 11:43:09.454735 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:09.454708    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:43:09.454797 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:09.454782    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:43:09.454846 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:09.454814    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:43:10.460634 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:10.460594    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8" event={"ID":"a7cca131-5a8c-41e2-860b-fc2277495a2c","Type":"ContainerStarted","Data":"709700c393848c7f32efcee8efff112bcb76260f9899cb3b544b59aa5ce623b5"}
Sep 08 11:43:10.777451 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:10.777407    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"
Sep 08 11:43:10.777626 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:10.777572    2575 patch_prober.go:28] interesting pod/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 08 11:43:10.777719 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:10.777627    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8" podUID="a7cca131-5a8c-41e2-860b-fc2277495a2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 08 11:43:11.780467 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:11.780429    2575 patch_prober.go:28] interesting pod/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 08 11:43:11.781046 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:11.781013    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8" podUID="a7cca131-5a8c-41e2-860b-fc2277495a2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 08 11:43:12.778206 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:12.778168    2575 patch_prober.go:28] interesting pod/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 08 11:43:12.778521 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:12.778492    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8" podUID="a7cca131-5a8c-41e2-860b-fc2277495a2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 08 11:43:13.451893 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:13.451867    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9"
Sep 08 11:43:13.778091 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:13.778050    2575 patch_prober.go:28] interesting pod/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 08 11:43:13.778279 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:13.778128    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8" podUID="a7cca131-5a8c-41e2-860b-fc2277495a2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 08 11:43:14.777576 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:14.777528    2575 patch_prober.go:28] interesting pod/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 08 11:43:14.778073 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:14.777600    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8" podUID="a7cca131-5a8c-41e2-860b-fc2277495a2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 08 11:43:15.908189 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:15.908158    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"
Sep 08 11:43:15.908703 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:15.908538    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"
Sep 08 11:43:15.909506 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:15.909489    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"
Sep 08 11:43:24.552750 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:24.552717    2575 generic.go:356] "Generic (PLEG): container finished" podID="cc2c1f5d-cdae-4f76-b7d8-e1087a617b04" containerID="8a8f7e6e4e1cc0c600eeb176609f99a07a7af808b665c72a6b446089c6a54ad8" exitCode=0
Sep 08 11:43:24.553236 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:24.552798    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d" event={"ID":"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04","Type":"ContainerDied","Data":"8a8f7e6e4e1cc0c600eeb176609f99a07a7af808b665c72a6b446089c6a54ad8"}
Sep 08 11:43:24.553375 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:24.553333    2575 scope.go:117] "RemoveContainer" containerID="8a8f7e6e4e1cc0c600eeb176609f99a07a7af808b665c72a6b446089c6a54ad8"
Sep 08 11:43:24.554555 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:24.554530    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:43:24.554623 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:24.554603    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:43:24.554658 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:24.554639    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:43:25.561242 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:25.560327    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d" event={"ID":"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04","Type":"ContainerStarted","Data":"1e9d07715fb7d440aaa93c178a63d848173ea3cf1f2c971a12b0c978f52eae08"}
Sep 08 11:43:25.602978 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:25.602947    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-425b2c-854978865d-mksn4"]
Sep 08 11:43:25.605587 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:25.605565    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-425b2c-854978865d-mksn4"
Sep 08 11:43:25.608378 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:25.608362    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-425b2c\""
Sep 08 11:43:25.614622 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:25.614597    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2e2eebe-dd6e-44ec-8c02-badbc022f774-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-425b2c-854978865d-mksn4\" (UID: \"b2e2eebe-dd6e-44ec-8c02-badbc022f774\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-425b2c-854978865d-mksn4"
Sep 08 11:43:25.614795 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:25.614774    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9vdl\" (UniqueName: \"kubernetes.io/projected/b2e2eebe-dd6e-44ec-8c02-badbc022f774-kube-api-access-v9vdl\") pod \"payload-pre-processing-e2e-inf-b-425b2c-854978865d-mksn4\" (UID: \"b2e2eebe-dd6e-44ec-8c02-badbc022f774\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-425b2c-854978865d-mksn4"
Sep 08 11:43:25.619425 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:25.619404    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-425b2c-854978865d-mksn4"]
Sep 08 11:43:25.658188 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:25.658164    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"
Sep 08 11:43:25.658483 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:25.658463    2575 patch_prober.go:28] interesting pod/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 08 11:43:25.658548 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:25.658513    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d" podUID="cc2c1f5d-cdae-4f76-b7d8-e1087a617b04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 08 11:43:25.715895 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:25.715861    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9vdl\" (UniqueName: \"kubernetes.io/projected/b2e2eebe-dd6e-44ec-8c02-badbc022f774-kube-api-access-v9vdl\") pod \"payload-pre-processing-e2e-inf-b-425b2c-854978865d-mksn4\" (UID: \"b2e2eebe-dd6e-44ec-8c02-badbc022f774\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-425b2c-854978865d-mksn4"
Sep 08 11:43:25.716076 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:25.715958    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2e2eebe-dd6e-44ec-8c02-badbc022f774-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-425b2c-854978865d-mksn4\" (UID: \"b2e2eebe-dd6e-44ec-8c02-badbc022f774\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-425b2c-854978865d-mksn4"
Sep 08 11:43:25.718762 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:25.718741    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-425b2c\""
Sep 08 11:43:25.725688 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:25.725664    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9vdl\" (UniqueName: \"kubernetes.io/projected/b2e2eebe-dd6e-44ec-8c02-badbc022f774-kube-api-access-v9vdl\") pod \"payload-pre-processing-e2e-inf-b-425b2c-854978865d-mksn4\" (UID: \"b2e2eebe-dd6e-44ec-8c02-badbc022f774\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-425b2c-854978865d-mksn4"
Sep 08 11:43:25.726876 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:25.726848    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2e2eebe-dd6e-44ec-8c02-badbc022f774-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-425b2c-854978865d-mksn4\" (UID: \"b2e2eebe-dd6e-44ec-8c02-badbc022f774\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-425b2c-854978865d-mksn4"
Sep 08 11:43:25.916946 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:25.916859    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-425b2c-854978865d-mksn4"
Sep 08 11:43:26.212979 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:26.212954    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-425b2c-854978865d-mksn4"]
Sep 08 11:43:26.214964 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:43:26.214937    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2e2eebe_dd6e_44ec_8c02_badbc022f774.slice/crio-bce4fca459c4fa36d9ea80a62d4d4dca0744f112f5c613d6ab59280de8bf1ac6 WatchSource:0}: Error finding container bce4fca459c4fa36d9ea80a62d4d4dca0744f112f5c613d6ab59280de8bf1ac6: Status 404 returned error can't find the container with id bce4fca459c4fa36d9ea80a62d4d4dca0744f112f5c613d6ab59280de8bf1ac6
Sep 08 11:43:26.572151 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:26.572110    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-425b2c-854978865d-mksn4" event={"ID":"b2e2eebe-dd6e-44ec-8c02-badbc022f774","Type":"ContainerStarted","Data":"35d0a041254e106c29d5598c0f0c5b6455e454d8f0c1d5c0cd882254b1798ff0"}
Sep 08 11:43:26.572627 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:26.572176    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-425b2c-854978865d-mksn4" event={"ID":"b2e2eebe-dd6e-44ec-8c02-badbc022f774","Type":"ContainerStarted","Data":"bce4fca459c4fa36d9ea80a62d4d4dca0744f112f5c613d6ab59280de8bf1ac6"}
Sep 08 11:43:26.572627 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:26.572231    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-425b2c-854978865d-mksn4"
Sep 08 11:43:26.592817 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:26.592751    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-425b2c-854978865d-mksn4" podStartSLOduration=1.592727043 podStartE2EDuration="1.592727043s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:43:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:43:26.591427956 +0000 UTC m=+781.243134776" watchObservedRunningTime="2026-09-08 11:43:26.592727043 +0000 UTC m=+781.244433840"
Sep 08 11:43:26.657664 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:26.657635    2575 patch_prober.go:28] interesting pod/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 08 11:43:26.657824 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:26.657685    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d" podUID="cc2c1f5d-cdae-4f76-b7d8-e1087a617b04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 08 11:43:27.658551 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:27.658514    2575 patch_prober.go:28] interesting pod/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 08 11:43:27.658926 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:27.658582    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d" podUID="cc2c1f5d-cdae-4f76-b7d8-e1087a617b04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 08 11:43:28.657770 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:28.657736    2575 patch_prober.go:28] interesting pod/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 08 11:43:28.658020 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:28.657798    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d" podUID="cc2c1f5d-cdae-4f76-b7d8-e1087a617b04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 08 11:43:29.658095 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:29.658057    2575 patch_prober.go:28] interesting pod/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 08 11:43:29.658551 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:29.658111    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d" podUID="cc2c1f5d-cdae-4f76-b7d8-e1087a617b04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 08 11:43:30.661939 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:30.661913    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"
Sep 08 11:43:30.662425 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:30.662218    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"
Sep 08 11:43:30.662994 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:30.662979    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"
Sep 08 11:43:38.601521 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:38.601485    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-425b2c-854978865d-mksn4"
Sep 08 11:43:44.831605 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:44.831568    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9"]
Sep 08 11:43:44.832070 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:44.831786    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9" podUID="a5568bac-5502-493c-88f9-1cc2baaa4c74" containerName="maas-api" containerID="cri-o://23de05c768a83785c49eef619f057d2f0aeef5ae14debe79a590d0e5e0dc38b8" gracePeriod=30
Sep 08 11:43:45.077257 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:45.077229    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9"
Sep 08 11:43:45.219407 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:45.215280    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"]
Sep 08 11:43:45.219407 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:45.218534    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d" podUID="cc2c1f5d-cdae-4f76-b7d8-e1087a617b04" containerName="istio-proxy" containerID="cri-o://1e9d07715fb7d440aaa93c178a63d848173ea3cf1f2c971a12b0c978f52eae08" gracePeriod=30
Sep 08 11:43:45.219407 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:45.217569    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5568bac-5502-493c-88f9-1cc2baaa4c74-openshift-service-ca\") pod \"a5568bac-5502-493c-88f9-1cc2baaa4c74\" (UID: \"a5568bac-5502-493c-88f9-1cc2baaa4c74\") "
Sep 08 11:43:45.219407 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:45.218818    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5568bac-5502-493c-88f9-1cc2baaa4c74-maas-api-tls\") pod \"a5568bac-5502-493c-88f9-1cc2baaa4c74\" (UID: \"a5568bac-5502-493c-88f9-1cc2baaa4c74\") "
Sep 08 11:43:45.219407 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:45.218856    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5568bac-5502-493c-88f9-1cc2baaa4c74-metrics-certs\") pod \"a5568bac-5502-493c-88f9-1cc2baaa4c74\" (UID: \"a5568bac-5502-493c-88f9-1cc2baaa4c74\") "
Sep 08 11:43:45.219407 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:45.218935    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wm9mn\" (UniqueName: \"kubernetes.io/projected/a5568bac-5502-493c-88f9-1cc2baaa4c74-kube-api-access-wm9mn\") pod \"a5568bac-5502-493c-88f9-1cc2baaa4c74\" (UID: \"a5568bac-5502-493c-88f9-1cc2baaa4c74\") "
Sep 08 11:43:45.226419 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:45.217888    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5568bac-5502-493c-88f9-1cc2baaa4c74-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a5568bac-5502-493c-88f9-1cc2baaa4c74" (UID: "a5568bac-5502-493c-88f9-1cc2baaa4c74"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:43:45.226816 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:45.226776    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5568bac-5502-493c-88f9-1cc2baaa4c74-kube-api-access-wm9mn" (OuterVolumeSpecName: "kube-api-access-wm9mn") pod "a5568bac-5502-493c-88f9-1cc2baaa4c74" (UID: "a5568bac-5502-493c-88f9-1cc2baaa4c74"). InnerVolumeSpecName "kube-api-access-wm9mn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:43:45.234571 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:45.232796    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5568bac-5502-493c-88f9-1cc2baaa4c74-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a5568bac-5502-493c-88f9-1cc2baaa4c74" (UID: "a5568bac-5502-493c-88f9-1cc2baaa4c74"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:43:45.234571 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:45.233217    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5568bac-5502-493c-88f9-1cc2baaa4c74-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a5568bac-5502-493c-88f9-1cc2baaa4c74" (UID: "a5568bac-5502-493c-88f9-1cc2baaa4c74"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:43:45.320832 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:45.320783    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5568bac-5502-493c-88f9-1cc2baaa4c74-maas-api-tls\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:43:45.320832 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:45.320821    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5568bac-5502-493c-88f9-1cc2baaa4c74-metrics-certs\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:43:45.320832 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:45.320835    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wm9mn\" (UniqueName: \"kubernetes.io/projected/a5568bac-5502-493c-88f9-1cc2baaa4c74-kube-api-access-wm9mn\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:43:45.321133 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:45.320850    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5568bac-5502-493c-88f9-1cc2baaa4c74-openshift-service-ca\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:43:45.665549 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:45.665506    2575 patch_prober.go:28] interesting pod/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 11:43:45.665721 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:45.665572    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d" podUID="cc2c1f5d-cdae-4f76-b7d8-e1087a617b04" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 11:43:45.694146 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:45.694113    2575 generic.go:356] "Generic (PLEG): container finished" podID="a5568bac-5502-493c-88f9-1cc2baaa4c74" containerID="23de05c768a83785c49eef619f057d2f0aeef5ae14debe79a590d0e5e0dc38b8" exitCode=0
Sep 08 11:43:45.694306 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:45.694156    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9"
Sep 08 11:43:45.694306 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:45.694193    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9" event={"ID":"a5568bac-5502-493c-88f9-1cc2baaa4c74","Type":"ContainerDied","Data":"23de05c768a83785c49eef619f057d2f0aeef5ae14debe79a590d0e5e0dc38b8"}
Sep 08 11:43:45.694306 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:45.694248    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9" event={"ID":"a5568bac-5502-493c-88f9-1cc2baaa4c74","Type":"ContainerDied","Data":"2892c6d866229716e4230a6d4814747750d6233e3fd43c59825acfe6bbe734b3"}
Sep 08 11:43:45.694306 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:45.694277    2575 scope.go:117] "RemoveContainer" containerID="23de05c768a83785c49eef619f057d2f0aeef5ae14debe79a590d0e5e0dc38b8"
Sep 08 11:43:45.704497 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:45.704480    2575 scope.go:117] "RemoveContainer" containerID="23de05c768a83785c49eef619f057d2f0aeef5ae14debe79a590d0e5e0dc38b8"
Sep 08 11:43:45.704770 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:43:45.704753    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23de05c768a83785c49eef619f057d2f0aeef5ae14debe79a590d0e5e0dc38b8\": container with ID starting with 23de05c768a83785c49eef619f057d2f0aeef5ae14debe79a590d0e5e0dc38b8 not found: ID does not exist" containerID="23de05c768a83785c49eef619f057d2f0aeef5ae14debe79a590d0e5e0dc38b8"
Sep 08 11:43:45.704816 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:45.704780    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23de05c768a83785c49eef619f057d2f0aeef5ae14debe79a590d0e5e0dc38b8"} err="failed to get container status \"23de05c768a83785c49eef619f057d2f0aeef5ae14debe79a590d0e5e0dc38b8\": rpc error: code = NotFound desc = could not find container \"23de05c768a83785c49eef619f057d2f0aeef5ae14debe79a590d0e5e0dc38b8\": container with ID starting with 23de05c768a83785c49eef619f057d2f0aeef5ae14debe79a590d0e5e0dc38b8 not found: ID does not exist"
Sep 08 11:43:45.724643 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:45.724606    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9"]
Sep 08 11:43:45.734276 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:45.734255    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7d3a6048-59fd99b94b-v5ps9"]
Sep 08 11:43:45.842688 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:45.842659    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5568bac-5502-493c-88f9-1cc2baaa4c74" path="/var/lib/kubelet/pods/a5568bac-5502-493c-88f9-1cc2baaa4c74/volumes"
Sep 08 11:43:46.245418 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:46.245383    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"]
Sep 08 11:43:46.245879 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:46.245858    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5568bac-5502-493c-88f9-1cc2baaa4c74" containerName="maas-api"
Sep 08 11:43:46.245879 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:46.245879    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5568bac-5502-493c-88f9-1cc2baaa4c74" containerName="maas-api"
Sep 08 11:43:46.246035 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:46.245967    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5568bac-5502-493c-88f9-1cc2baaa4c74" containerName="maas-api"
Sep 08 11:43:46.248804 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:46.248780    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"
Sep 08 11:43:46.252089 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:46.252070    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-ac040d69-gw-openshift-default-dockercfg-gpvch\""
Sep 08 11:43:46.266706 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:46.266681    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"]
Sep 08 11:43:46.330214 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:46.330188    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/827afd0b-acca-4950-b572-af636a6cbbca-istio-envoy\") pod \"e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb\" (UID: \"827afd0b-acca-4950-b572-af636a6cbbca\") " pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"
Sep 08 11:43:46.330373 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:46.330223    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/827afd0b-acca-4950-b572-af636a6cbbca-istio-data\") pod \"e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb\" (UID: \"827afd0b-acca-4950-b572-af636a6cbbca\") " pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"
Sep 08 11:43:46.330373 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:46.330244    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcqnx\" (UniqueName: \"kubernetes.io/projected/827afd0b-acca-4950-b572-af636a6cbbca-kube-api-access-gcqnx\") pod \"e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb\" (UID: \"827afd0b-acca-4950-b572-af636a6cbbca\") " pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"
Sep 08 11:43:46.330373 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:46.330260    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/827afd0b-acca-4950-b572-af636a6cbbca-istiod-ca-cert\") pod \"e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb\" (UID: \"827afd0b-acca-4950-b572-af636a6cbbca\") " pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"
Sep 08 11:43:46.330481 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:46.330365    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/827afd0b-acca-4950-b572-af636a6cbbca-workload-socket\") pod \"e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb\" (UID: \"827afd0b-acca-4950-b572-af636a6cbbca\") " pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"
Sep 08 11:43:46.330481 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:46.330411    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/827afd0b-acca-4950-b572-af636a6cbbca-credential-socket\") pod \"e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb\" (UID: \"827afd0b-acca-4950-b572-af636a6cbbca\") " pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"
Sep 08 11:43:46.330481 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:46.330433    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/827afd0b-acca-4950-b572-af636a6cbbca-istio-token\") pod \"e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb\" (UID: \"827afd0b-acca-4950-b572-af636a6cbbca\") " pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"
Sep 08 11:43:46.330481 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:46.330473    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/827afd0b-acca-4950-b572-af636a6cbbca-istio-podinfo\") pod \"e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb\" (UID: \"827afd0b-acca-4950-b572-af636a6cbbca\") " pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"
Sep 08 11:43:46.330598 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:46.330517    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/827afd0b-acca-4950-b572-af636a6cbbca-workload-certs\") pod \"e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb\" (UID: \"827afd0b-acca-4950-b572-af636a6cbbca\") " pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"
Sep 08 11:43:46.431375 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:46.431307    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/827afd0b-acca-4950-b572-af636a6cbbca-credential-socket\") pod \"e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb\" (UID: \"827afd0b-acca-4950-b572-af636a6cbbca\") " pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"
Sep 08 11:43:46.431375 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:46.431380    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/827afd0b-acca-4950-b572-af636a6cbbca-istio-token\") pod \"e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb\" (UID: \"827afd0b-acca-4950-b572-af636a6cbbca\") " pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"
Sep 08 11:43:46.431623 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:46.431408    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/827afd0b-acca-4950-b572-af636a6cbbca-istio-podinfo\") pod \"e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb\" (UID: \"827afd0b-acca-4950-b572-af636a6cbbca\") " pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"
Sep 08 11:43:46.431623 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:46.431465    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/827afd0b-acca-4950-b572-af636a6cbbca-workload-certs\") pod \"e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb\" (UID: \"827afd0b-acca-4950-b572-af636a6cbbca\") " pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"
Sep 08 11:43:46.431623 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:46.431585    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/827afd0b-acca-4950-b572-af636a6cbbca-istio-envoy\") pod \"e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb\" (UID: \"827afd0b-acca-4950-b572-af636a6cbbca\") " pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"
Sep 08 11:43:46.431623 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:46.431619    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/827afd0b-acca-4950-b572-af636a6cbbca-istio-data\") pod \"e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb\" (UID: \"827afd0b-acca-4950-b572-af636a6cbbca\") " pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"
Sep 08 11:43:46.431825 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:46.431649    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcqnx\" (UniqueName: \"kubernetes.io/projected/827afd0b-acca-4950-b572-af636a6cbbca-kube-api-access-gcqnx\") pod \"e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb\" (UID: \"827afd0b-acca-4950-b572-af636a6cbbca\") " pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"
Sep 08 11:43:46.431825 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:46.431675    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/827afd0b-acca-4950-b572-af636a6cbbca-istiod-ca-cert\") pod \"e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb\" (UID: \"827afd0b-acca-4950-b572-af636a6cbbca\") " pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"
Sep 08 11:43:46.431825 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:46.431727    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/827afd0b-acca-4950-b572-af636a6cbbca-workload-socket\") pod \"e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb\" (UID: \"827afd0b-acca-4950-b572-af636a6cbbca\") " pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"
Sep 08 11:43:46.431825 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:46.431738    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/827afd0b-acca-4950-b572-af636a6cbbca-credential-socket\") pod \"e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb\" (UID: \"827afd0b-acca-4950-b572-af636a6cbbca\") " pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"
Sep 08 11:43:46.432030 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:46.431822    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/827afd0b-acca-4950-b572-af636a6cbbca-workload-certs\") pod \"e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb\" (UID: \"827afd0b-acca-4950-b572-af636a6cbbca\") " pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"
Sep 08 11:43:46.432087 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:46.432028    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/827afd0b-acca-4950-b572-af636a6cbbca-istio-data\") pod \"e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb\" (UID: \"827afd0b-acca-4950-b572-af636a6cbbca\") " pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"
Sep 08 11:43:46.432141 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:46.432109    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/827afd0b-acca-4950-b572-af636a6cbbca-workload-socket\") pod \"e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb\" (UID: \"827afd0b-acca-4950-b572-af636a6cbbca\") " pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"
Sep 08 11:43:46.432398 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:46.432379    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/827afd0b-acca-4950-b572-af636a6cbbca-istiod-ca-cert\") pod \"e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb\" (UID: \"827afd0b-acca-4950-b572-af636a6cbbca\") " pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"
Sep 08 11:43:46.433861 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:46.433841    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/827afd0b-acca-4950-b572-af636a6cbbca-istio-envoy\") pod \"e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb\" (UID: \"827afd0b-acca-4950-b572-af636a6cbbca\") " pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"
Sep 08 11:43:46.433969 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:46.433953    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/827afd0b-acca-4950-b572-af636a6cbbca-istio-podinfo\") pod \"e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb\" (UID: \"827afd0b-acca-4950-b572-af636a6cbbca\") " pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"
Sep 08 11:43:46.441528 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:46.441501    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcqnx\" (UniqueName: \"kubernetes.io/projected/827afd0b-acca-4950-b572-af636a6cbbca-kube-api-access-gcqnx\") pod \"e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb\" (UID: \"827afd0b-acca-4950-b572-af636a6cbbca\") " pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"
Sep 08 11:43:46.441611 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:46.441598    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/827afd0b-acca-4950-b572-af636a6cbbca-istio-token\") pod \"e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb\" (UID: \"827afd0b-acca-4950-b572-af636a6cbbca\") " pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"
Sep 08 11:43:46.558952 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:46.558927    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"
Sep 08 11:43:46.869419 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:43:46.869385    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod827afd0b_acca_4950_b572_af636a6cbbca.slice/crio-4e103fd2454057a6bacbca103a337d4239184a89c0adb81e249a73106e51bc17 WatchSource:0}: Error finding container 4e103fd2454057a6bacbca103a337d4239184a89c0adb81e249a73106e51bc17: Status 404 returned error can't find the container with id 4e103fd2454057a6bacbca103a337d4239184a89c0adb81e249a73106e51bc17
Sep 08 11:43:46.871933 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:46.871895    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:43:46.872006 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:46.871968    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:43:46.872051 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:46.872004    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:43:46.872298 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:46.872276    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"]
Sep 08 11:43:47.707227 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:47.707190    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb" event={"ID":"827afd0b-acca-4950-b572-af636a6cbbca","Type":"ContainerStarted","Data":"6f8565559c1c54afa6499f11bc0521df1098d2ca48f56c6d40f171030de3a2c1"}
Sep 08 11:43:47.707402 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:47.707244    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb" event={"ID":"827afd0b-acca-4950-b572-af636a6cbbca","Type":"ContainerStarted","Data":"4e103fd2454057a6bacbca103a337d4239184a89c0adb81e249a73106e51bc17"}
Sep 08 11:43:47.738917 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:47.738869    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb" podStartSLOduration=1.738848053 podStartE2EDuration="1.738848053s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:43:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:43:47.736869694 +0000 UTC m=+802.388576498" watchObservedRunningTime="2026-09-08 11:43:47.738848053 +0000 UTC m=+802.390554846"
Sep 08 11:43:48.559937 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:48.559908    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"
Sep 08 11:43:48.565119 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:48.565092    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"
Sep 08 11:43:48.712462 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:48.712433    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"
Sep 08 11:43:48.713394 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:48.713372    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"
Sep 08 11:43:50.479799 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:50.479775    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"
Sep 08 11:43:50.576816 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:50.576789    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-workload-certs\") pod \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\" (UID: \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\") "
Sep 08 11:43:50.576962 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:50.576848    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-istio-podinfo\") pod \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\" (UID: \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\") "
Sep 08 11:43:50.576962 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:50.576883    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-istio-token\") pod \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\" (UID: \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\") "
Sep 08 11:43:50.576962 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:50.576918    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-istiod-ca-cert\") pod \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\" (UID: \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\") "
Sep 08 11:43:50.576962 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:50.576953    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4644m\" (UniqueName: \"kubernetes.io/projected/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-kube-api-access-4644m\") pod \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\" (UID: \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\") "
Sep 08 11:43:50.577115 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:50.576981    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-istio-envoy\") pod \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\" (UID: \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\") "
Sep 08 11:43:50.577115 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:50.577031    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-workload-socket\") pod \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\" (UID: \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\") "
Sep 08 11:43:50.577115 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:50.577068    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cc2c1f5d-cdae-4f76-b7d8-e1087a617b04" (UID: "cc2c1f5d-cdae-4f76-b7d8-e1087a617b04"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:43:50.577115 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:50.577095    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-credential-socket\") pod \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\" (UID: \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\") "
Sep 08 11:43:50.577263 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:50.577129    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-istio-data\") pod \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\" (UID: \"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04\") "
Sep 08 11:43:50.577388 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:50.577362    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cc2c1f5d-cdae-4f76-b7d8-e1087a617b04" (UID: "cc2c1f5d-cdae-4f76-b7d8-e1087a617b04"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:43:50.577479 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:50.577454    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cc2c1f5d-cdae-4f76-b7d8-e1087a617b04" (UID: "cc2c1f5d-cdae-4f76-b7d8-e1087a617b04"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:43:50.577479 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:50.577470    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cc2c1f5d-cdae-4f76-b7d8-e1087a617b04" (UID: "cc2c1f5d-cdae-4f76-b7d8-e1087a617b04"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:43:50.577655 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:50.577531    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-istio-data" (OuterVolumeSpecName: "istio-data") pod "cc2c1f5d-cdae-4f76-b7d8-e1087a617b04" (UID: "cc2c1f5d-cdae-4f76-b7d8-e1087a617b04"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:43:50.577807 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:50.577782    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-istiod-ca-cert\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:43:50.577862 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:50.577812    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-workload-socket\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:43:50.577862 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:50.577824    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-credential-socket\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:43:50.577862 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:50.577838    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-istio-data\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:43:50.577862 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:50.577851    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-workload-certs\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:43:50.579391 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:50.579364    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cc2c1f5d-cdae-4f76-b7d8-e1087a617b04" (UID: "cc2c1f5d-cdae-4f76-b7d8-e1087a617b04"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 11:43:50.579513 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:50.579424    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-kube-api-access-4644m" (OuterVolumeSpecName: "kube-api-access-4644m") pod "cc2c1f5d-cdae-4f76-b7d8-e1087a617b04" (UID: "cc2c1f5d-cdae-4f76-b7d8-e1087a617b04"). InnerVolumeSpecName "kube-api-access-4644m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:43:50.579614 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:50.579599    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cc2c1f5d-cdae-4f76-b7d8-e1087a617b04" (UID: "cc2c1f5d-cdae-4f76-b7d8-e1087a617b04"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:43:50.579657 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:50.579622    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-istio-token" (OuterVolumeSpecName: "istio-token") pod "cc2c1f5d-cdae-4f76-b7d8-e1087a617b04" (UID: "cc2c1f5d-cdae-4f76-b7d8-e1087a617b04"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:43:50.679322 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:50.679289    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-istio-podinfo\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:43:50.679322 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:50.679316    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-istio-token\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:43:50.679510 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:50.679368    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4644m\" (UniqueName: \"kubernetes.io/projected/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-kube-api-access-4644m\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:43:50.679510 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:50.679379    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04-istio-envoy\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:43:50.724970 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:50.724930    2575 generic.go:356] "Generic (PLEG): container finished" podID="cc2c1f5d-cdae-4f76-b7d8-e1087a617b04" containerID="1e9d07715fb7d440aaa93c178a63d848173ea3cf1f2c971a12b0c978f52eae08" exitCode=0
Sep 08 11:43:50.725168 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:50.725031    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"
Sep 08 11:43:50.725168 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:50.725069    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d" event={"ID":"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04","Type":"ContainerDied","Data":"1e9d07715fb7d440aaa93c178a63d848173ea3cf1f2c971a12b0c978f52eae08"}
Sep 08 11:43:50.725168 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:50.725148    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d" event={"ID":"cc2c1f5d-cdae-4f76-b7d8-e1087a617b04","Type":"ContainerDied","Data":"0eca746d6c33c8d6a732941994b9cb44bd41414a210f2ae3cc40b9c1c46c96ed"}
Sep 08 11:43:50.725408 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:50.725178    2575 scope.go:117] "RemoveContainer" containerID="1e9d07715fb7d440aaa93c178a63d848173ea3cf1f2c971a12b0c978f52eae08"
Sep 08 11:43:50.738848 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:50.738823    2575 scope.go:117] "RemoveContainer" containerID="8a8f7e6e4e1cc0c600eeb176609f99a07a7af808b665c72a6b446089c6a54ad8"
Sep 08 11:43:50.749962 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:50.749936    2575 scope.go:117] "RemoveContainer" containerID="1e9d07715fb7d440aaa93c178a63d848173ea3cf1f2c971a12b0c978f52eae08"
Sep 08 11:43:50.750290 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:43:50.750269    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e9d07715fb7d440aaa93c178a63d848173ea3cf1f2c971a12b0c978f52eae08\": container with ID starting with 1e9d07715fb7d440aaa93c178a63d848173ea3cf1f2c971a12b0c978f52eae08 not found: ID does not exist" containerID="1e9d07715fb7d440aaa93c178a63d848173ea3cf1f2c971a12b0c978f52eae08"
Sep 08 11:43:50.750384 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:50.750302    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e9d07715fb7d440aaa93c178a63d848173ea3cf1f2c971a12b0c978f52eae08"} err="failed to get container status \"1e9d07715fb7d440aaa93c178a63d848173ea3cf1f2c971a12b0c978f52eae08\": rpc error: code = NotFound desc = could not find container \"1e9d07715fb7d440aaa93c178a63d848173ea3cf1f2c971a12b0c978f52eae08\": container with ID starting with 1e9d07715fb7d440aaa93c178a63d848173ea3cf1f2c971a12b0c978f52eae08 not found: ID does not exist"
Sep 08 11:43:50.750384 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:50.750319    2575 scope.go:117] "RemoveContainer" containerID="8a8f7e6e4e1cc0c600eeb176609f99a07a7af808b665c72a6b446089c6a54ad8"
Sep 08 11:43:50.750629 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:43:50.750610    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a8f7e6e4e1cc0c600eeb176609f99a07a7af808b665c72a6b446089c6a54ad8\": container with ID starting with 8a8f7e6e4e1cc0c600eeb176609f99a07a7af808b665c72a6b446089c6a54ad8 not found: ID does not exist" containerID="8a8f7e6e4e1cc0c600eeb176609f99a07a7af808b665c72a6b446089c6a54ad8"
Sep 08 11:43:50.750670 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:50.750635    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a8f7e6e4e1cc0c600eeb176609f99a07a7af808b665c72a6b446089c6a54ad8"} err="failed to get container status \"8a8f7e6e4e1cc0c600eeb176609f99a07a7af808b665c72a6b446089c6a54ad8\": rpc error: code = NotFound desc = could not find container \"8a8f7e6e4e1cc0c600eeb176609f99a07a7af808b665c72a6b446089c6a54ad8\": container with ID starting with 8a8f7e6e4e1cc0c600eeb176609f99a07a7af808b665c72a6b446089c6a54ad8 not found: ID does not exist"
Sep 08 11:43:50.754688 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:50.754668    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"]
Sep 08 11:43:50.762813 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:50.762790    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d"]
Sep 08 11:43:51.841570 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:43:51.841540    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc2c1f5d-cdae-4f76-b7d8-e1087a617b04" path="/var/lib/kubelet/pods/cc2c1f5d-cdae-4f76-b7d8-e1087a617b04/volumes"
Sep 08 11:44:04.753506 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:04.753459    2575 patch_prober.go:28] interesting pod/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 11:44:04.754034 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:04.753546    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb" podUID="827afd0b-acca-4950-b572-af636a6cbbca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 11:44:06.820503 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:06.820472    2575 generic.go:356] "Generic (PLEG): container finished" podID="827afd0b-acca-4950-b572-af636a6cbbca" containerID="6f8565559c1c54afa6499f11bc0521df1098d2ca48f56c6d40f171030de3a2c1" exitCode=0
Sep 08 11:44:06.820982 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:06.820550    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb" event={"ID":"827afd0b-acca-4950-b572-af636a6cbbca","Type":"ContainerDied","Data":"6f8565559c1c54afa6499f11bc0521df1098d2ca48f56c6d40f171030de3a2c1"}
Sep 08 11:44:06.821075 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:06.821058    2575 scope.go:117] "RemoveContainer" containerID="6f8565559c1c54afa6499f11bc0521df1098d2ca48f56c6d40f171030de3a2c1"
Sep 08 11:44:06.822125 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:06.822097    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:44:06.822219 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:06.822179    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:44:06.822281 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:06.822225    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:44:07.827662 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:07.827631    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb" event={"ID":"827afd0b-acca-4950-b572-af636a6cbbca","Type":"ContainerStarted","Data":"63d8aaa3cd72a1c2bf2dda5597085332a50e9ea95d8782bdf0ef0403c7f52ddb"}
Sep 08 11:44:08.559540 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:08.559510    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"
Sep 08 11:44:08.559714 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:08.559686    2575 patch_prober.go:28] interesting pod/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 08 11:44:08.559777 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:08.559758    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb" podUID="827afd0b-acca-4950-b572-af636a6cbbca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 08 11:44:09.559805 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:09.559770    2575 patch_prober.go:28] interesting pod/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 08 11:44:09.560173 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:09.559851    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb" podUID="827afd0b-acca-4950-b572-af636a6cbbca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 08 11:44:10.559655 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:10.559620    2575 patch_prober.go:28] interesting pod/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 08 11:44:10.559839 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:10.559688    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb" podUID="827afd0b-acca-4950-b572-af636a6cbbca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 08 11:44:11.559439 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:11.559405    2575 patch_prober.go:28] interesting pod/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 08 11:44:11.559612 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:11.559471    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb" podUID="827afd0b-acca-4950-b572-af636a6cbbca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 08 11:44:12.559827 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:12.559792    2575 patch_prober.go:28] interesting pod/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 08 11:44:12.560323 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:12.559891    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb" podUID="827afd0b-acca-4950-b572-af636a6cbbca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 08 11:44:13.562757 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:13.562723    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"
Sep 08 11:44:13.563204 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:13.562974    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"
Sep 08 11:44:13.563762 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:13.563745    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"
Sep 08 11:44:15.811167 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:15.811131    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-a1721d/autores-model-a1721d-kserve-74c9765755-hc9zk"]
Sep 08 11:44:15.811847 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:15.811826    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc2c1f5d-cdae-4f76-b7d8-e1087a617b04" containerName="istio-proxy"
Sep 08 11:44:15.811900 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:15.811852    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc2c1f5d-cdae-4f76-b7d8-e1087a617b04" containerName="istio-proxy"
Sep 08 11:44:15.811900 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:15.811885    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc2c1f5d-cdae-4f76-b7d8-e1087a617b04" containerName="istio-proxy"
Sep 08 11:44:15.811900 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:15.811894    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc2c1f5d-cdae-4f76-b7d8-e1087a617b04" containerName="istio-proxy"
Sep 08 11:44:15.812024 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:15.812011    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc2c1f5d-cdae-4f76-b7d8-e1087a617b04" containerName="istio-proxy"
Sep 08 11:44:15.812059 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:15.812029    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc2c1f5d-cdae-4f76-b7d8-e1087a617b04" containerName="istio-proxy"
Sep 08 11:44:15.814890 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:15.814872    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-a1721d/autores-model-a1721d-kserve-74c9765755-hc9zk"
Sep 08 11:44:15.819241 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:15.819214    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-a1721d\"/\"openshift-service-ca.crt\""
Sep 08 11:44:15.820299 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:15.819390    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-a1721d\"/\"kube-root-ca.crt\""
Sep 08 11:44:15.820299 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:15.819481    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-a1721d\"/\"default-dockercfg-5nfb5\""
Sep 08 11:44:15.820299 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:15.819620    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-a1721d\"/\"autores-model-a1721d-kserve-self-signed-certs\""
Sep 08 11:44:15.823516 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:15.823138    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-a1721d/autores-model-a1721d-kserve-74c9765755-hc9zk"]
Sep 08 11:44:15.939955 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:15.939929    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a011eb22-4067-46a0-941d-c4f5213a3faf-tmp-dir\") pod \"autores-model-a1721d-kserve-74c9765755-hc9zk\" (UID: \"a011eb22-4067-46a0-941d-c4f5213a3faf\") " pod="ai-tenant-e2e-autores-a1721d/autores-model-a1721d-kserve-74c9765755-hc9zk"
Sep 08 11:44:15.940124 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:15.939973    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a011eb22-4067-46a0-941d-c4f5213a3faf-home\") pod \"autores-model-a1721d-kserve-74c9765755-hc9zk\" (UID: \"a011eb22-4067-46a0-941d-c4f5213a3faf\") " pod="ai-tenant-e2e-autores-a1721d/autores-model-a1721d-kserve-74c9765755-hc9zk"
Sep 08 11:44:15.940124 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:15.939990    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a011eb22-4067-46a0-941d-c4f5213a3faf-model-cache\") pod \"autores-model-a1721d-kserve-74c9765755-hc9zk\" (UID: \"a011eb22-4067-46a0-941d-c4f5213a3faf\") " pod="ai-tenant-e2e-autores-a1721d/autores-model-a1721d-kserve-74c9765755-hc9zk"
Sep 08 11:44:15.940124 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:15.940069    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a011eb22-4067-46a0-941d-c4f5213a3faf-tls-certs\") pod \"autores-model-a1721d-kserve-74c9765755-hc9zk\" (UID: \"a011eb22-4067-46a0-941d-c4f5213a3faf\") " pod="ai-tenant-e2e-autores-a1721d/autores-model-a1721d-kserve-74c9765755-hc9zk"
Sep 08 11:44:15.940124 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:15.940096    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a011eb22-4067-46a0-941d-c4f5213a3faf-dshm\") pod \"autores-model-a1721d-kserve-74c9765755-hc9zk\" (UID: \"a011eb22-4067-46a0-941d-c4f5213a3faf\") " pod="ai-tenant-e2e-autores-a1721d/autores-model-a1721d-kserve-74c9765755-hc9zk"
Sep 08 11:44:15.940124 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:15.940122    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd7rs\" (UniqueName: \"kubernetes.io/projected/a011eb22-4067-46a0-941d-c4f5213a3faf-kube-api-access-vd7rs\") pod \"autores-model-a1721d-kserve-74c9765755-hc9zk\" (UID: \"a011eb22-4067-46a0-941d-c4f5213a3faf\") " pod="ai-tenant-e2e-autores-a1721d/autores-model-a1721d-kserve-74c9765755-hc9zk"
Sep 08 11:44:16.040706 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:16.040667    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a011eb22-4067-46a0-941d-c4f5213a3faf-tmp-dir\") pod \"autores-model-a1721d-kserve-74c9765755-hc9zk\" (UID: \"a011eb22-4067-46a0-941d-c4f5213a3faf\") " pod="ai-tenant-e2e-autores-a1721d/autores-model-a1721d-kserve-74c9765755-hc9zk"
Sep 08 11:44:16.040893 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:16.040750    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a011eb22-4067-46a0-941d-c4f5213a3faf-home\") pod \"autores-model-a1721d-kserve-74c9765755-hc9zk\" (UID: \"a011eb22-4067-46a0-941d-c4f5213a3faf\") " pod="ai-tenant-e2e-autores-a1721d/autores-model-a1721d-kserve-74c9765755-hc9zk"
Sep 08 11:44:16.040893 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:16.040777    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a011eb22-4067-46a0-941d-c4f5213a3faf-model-cache\") pod \"autores-model-a1721d-kserve-74c9765755-hc9zk\" (UID: \"a011eb22-4067-46a0-941d-c4f5213a3faf\") " pod="ai-tenant-e2e-autores-a1721d/autores-model-a1721d-kserve-74c9765755-hc9zk"
Sep 08 11:44:16.040893 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:16.040887    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a011eb22-4067-46a0-941d-c4f5213a3faf-tls-certs\") pod \"autores-model-a1721d-kserve-74c9765755-hc9zk\" (UID: \"a011eb22-4067-46a0-941d-c4f5213a3faf\") " pod="ai-tenant-e2e-autores-a1721d/autores-model-a1721d-kserve-74c9765755-hc9zk"
Sep 08 11:44:16.041135 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:16.040930    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a011eb22-4067-46a0-941d-c4f5213a3faf-dshm\") pod \"autores-model-a1721d-kserve-74c9765755-hc9zk\" (UID: \"a011eb22-4067-46a0-941d-c4f5213a3faf\") " pod="ai-tenant-e2e-autores-a1721d/autores-model-a1721d-kserve-74c9765755-hc9zk"
Sep 08 11:44:16.041135 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:16.041041    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a011eb22-4067-46a0-941d-c4f5213a3faf-tmp-dir\") pod \"autores-model-a1721d-kserve-74c9765755-hc9zk\" (UID: \"a011eb22-4067-46a0-941d-c4f5213a3faf\") " pod="ai-tenant-e2e-autores-a1721d/autores-model-a1721d-kserve-74c9765755-hc9zk"
Sep 08 11:44:16.041135 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:16.041061    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vd7rs\" (UniqueName: \"kubernetes.io/projected/a011eb22-4067-46a0-941d-c4f5213a3faf-kube-api-access-vd7rs\") pod \"autores-model-a1721d-kserve-74c9765755-hc9zk\" (UID: \"a011eb22-4067-46a0-941d-c4f5213a3faf\") " pod="ai-tenant-e2e-autores-a1721d/autores-model-a1721d-kserve-74c9765755-hc9zk"
Sep 08 11:44:16.041135 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:16.041113    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a011eb22-4067-46a0-941d-c4f5213a3faf-home\") pod \"autores-model-a1721d-kserve-74c9765755-hc9zk\" (UID: \"a011eb22-4067-46a0-941d-c4f5213a3faf\") " pod="ai-tenant-e2e-autores-a1721d/autores-model-a1721d-kserve-74c9765755-hc9zk"
Sep 08 11:44:16.041301 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:16.041144    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a011eb22-4067-46a0-941d-c4f5213a3faf-model-cache\") pod \"autores-model-a1721d-kserve-74c9765755-hc9zk\" (UID: \"a011eb22-4067-46a0-941d-c4f5213a3faf\") " pod="ai-tenant-e2e-autores-a1721d/autores-model-a1721d-kserve-74c9765755-hc9zk"
Sep 08 11:44:16.043541 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:16.043517    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a011eb22-4067-46a0-941d-c4f5213a3faf-dshm\") pod \"autores-model-a1721d-kserve-74c9765755-hc9zk\" (UID: \"a011eb22-4067-46a0-941d-c4f5213a3faf\") " pod="ai-tenant-e2e-autores-a1721d/autores-model-a1721d-kserve-74c9765755-hc9zk"
Sep 08 11:44:16.043732 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:16.043711    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a011eb22-4067-46a0-941d-c4f5213a3faf-tls-certs\") pod \"autores-model-a1721d-kserve-74c9765755-hc9zk\" (UID: \"a011eb22-4067-46a0-941d-c4f5213a3faf\") " pod="ai-tenant-e2e-autores-a1721d/autores-model-a1721d-kserve-74c9765755-hc9zk"
Sep 08 11:44:16.050361 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:16.050323    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd7rs\" (UniqueName: \"kubernetes.io/projected/a011eb22-4067-46a0-941d-c4f5213a3faf-kube-api-access-vd7rs\") pod \"autores-model-a1721d-kserve-74c9765755-hc9zk\" (UID: \"a011eb22-4067-46a0-941d-c4f5213a3faf\") " pod="ai-tenant-e2e-autores-a1721d/autores-model-a1721d-kserve-74c9765755-hc9zk"
Sep 08 11:44:16.136222 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:16.136145    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-a1721d/autores-model-a1721d-kserve-74c9765755-hc9zk"
Sep 08 11:44:16.410452 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:16.408902    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-a1721d/autores-model-a1721d-kserve-74c9765755-hc9zk"]
Sep 08 11:44:16.877829 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:16.877791    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-a1721d/autores-model-a1721d-kserve-74c9765755-hc9zk" event={"ID":"a011eb22-4067-46a0-941d-c4f5213a3faf","Type":"ContainerStarted","Data":"e40ec1176ec50ccc1b015d6b350fe1085655980fc34c9ee6266f80dfddb521e6"}
Sep 08 11:44:16.878204 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:16.877840    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-a1721d/autores-model-a1721d-kserve-74c9765755-hc9zk" event={"ID":"a011eb22-4067-46a0-941d-c4f5213a3faf","Type":"ContainerStarted","Data":"e3e0606c84177b496e8f2e4ff19100ff159221aa0d6a65f6af1216cc6828bbd6"}
Sep 08 11:44:16.896006 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:16.895960    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-a1721d/autores-model-a1721d-kserve-74c9765755-hc9zk" podStartSLOduration=1.895945341 podStartE2EDuration="1.895945341s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:44:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:44:16.89488822 +0000 UTC m=+831.546595016" watchObservedRunningTime="2026-09-08 11:44:16.895945341 +0000 UTC m=+831.547652155"
Sep 08 11:44:20.627264 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:20.627229    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"]
Sep 08 11:44:20.627644 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:20.627509    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb" podUID="827afd0b-acca-4950-b572-af636a6cbbca" containerName="istio-proxy" containerID="cri-o://63d8aaa3cd72a1c2bf2dda5597085332a50e9ea95d8782bdf0ef0403c7f52ddb" gracePeriod=30
Sep 08 11:44:25.484032 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:25.484000    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b16466d7-56464cd675-fjgt8"]
Sep 08 11:44:25.487875 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:25.487853    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b16466d7-56464cd675-fjgt8"
Sep 08 11:44:25.490385 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:25.490332    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-b16466d7-serving-cert\""
Sep 08 11:44:25.498259 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:25.498228    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b16466d7-56464cd675-fjgt8"]
Sep 08 11:44:25.632868 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:25.632836    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f31d84c7-684d-4f80-82d7-957421703c99-maas-api-tls\") pod \"maas-api-e2e-ait-b16466d7-56464cd675-fjgt8\" (UID: \"f31d84c7-684d-4f80-82d7-957421703c99\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b16466d7-56464cd675-fjgt8"
Sep 08 11:44:25.633030 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:25.632887    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqjcw\" (UniqueName: \"kubernetes.io/projected/f31d84c7-684d-4f80-82d7-957421703c99-kube-api-access-zqjcw\") pod \"maas-api-e2e-ait-b16466d7-56464cd675-fjgt8\" (UID: \"f31d84c7-684d-4f80-82d7-957421703c99\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b16466d7-56464cd675-fjgt8"
Sep 08 11:44:25.633030 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:25.632923    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f31d84c7-684d-4f80-82d7-957421703c99-metrics-certs\") pod \"maas-api-e2e-ait-b16466d7-56464cd675-fjgt8\" (UID: \"f31d84c7-684d-4f80-82d7-957421703c99\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b16466d7-56464cd675-fjgt8"
Sep 08 11:44:25.633030 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:25.632961    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f31d84c7-684d-4f80-82d7-957421703c99-openshift-service-ca\") pod \"maas-api-e2e-ait-b16466d7-56464cd675-fjgt8\" (UID: \"f31d84c7-684d-4f80-82d7-957421703c99\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b16466d7-56464cd675-fjgt8"
Sep 08 11:44:25.734327 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:25.734245    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f31d84c7-684d-4f80-82d7-957421703c99-maas-api-tls\") pod \"maas-api-e2e-ait-b16466d7-56464cd675-fjgt8\" (UID: \"f31d84c7-684d-4f80-82d7-957421703c99\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b16466d7-56464cd675-fjgt8"
Sep 08 11:44:25.734327 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:25.734315    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqjcw\" (UniqueName: \"kubernetes.io/projected/f31d84c7-684d-4f80-82d7-957421703c99-kube-api-access-zqjcw\") pod \"maas-api-e2e-ait-b16466d7-56464cd675-fjgt8\" (UID: \"f31d84c7-684d-4f80-82d7-957421703c99\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b16466d7-56464cd675-fjgt8"
Sep 08 11:44:25.734556 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:25.734388    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f31d84c7-684d-4f80-82d7-957421703c99-metrics-certs\") pod \"maas-api-e2e-ait-b16466d7-56464cd675-fjgt8\" (UID: \"f31d84c7-684d-4f80-82d7-957421703c99\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b16466d7-56464cd675-fjgt8"
Sep 08 11:44:25.734556 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:25.734432    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f31d84c7-684d-4f80-82d7-957421703c99-openshift-service-ca\") pod \"maas-api-e2e-ait-b16466d7-56464cd675-fjgt8\" (UID: \"f31d84c7-684d-4f80-82d7-957421703c99\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b16466d7-56464cd675-fjgt8"
Sep 08 11:44:25.735093 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:25.735069    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f31d84c7-684d-4f80-82d7-957421703c99-openshift-service-ca\") pod \"maas-api-e2e-ait-b16466d7-56464cd675-fjgt8\" (UID: \"f31d84c7-684d-4f80-82d7-957421703c99\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b16466d7-56464cd675-fjgt8"
Sep 08 11:44:25.737010 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:25.736985    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f31d84c7-684d-4f80-82d7-957421703c99-metrics-certs\") pod \"maas-api-e2e-ait-b16466d7-56464cd675-fjgt8\" (UID: \"f31d84c7-684d-4f80-82d7-957421703c99\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b16466d7-56464cd675-fjgt8"
Sep 08 11:44:25.737222 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:25.737206    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-b16466d7-serving-cert\""
Sep 08 11:44:25.743702 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:25.743678    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqjcw\" (UniqueName: \"kubernetes.io/projected/f31d84c7-684d-4f80-82d7-957421703c99-kube-api-access-zqjcw\") pod \"maas-api-e2e-ait-b16466d7-56464cd675-fjgt8\" (UID: \"f31d84c7-684d-4f80-82d7-957421703c99\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b16466d7-56464cd675-fjgt8"
Sep 08 11:44:25.745487 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:44:25.745468    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-b16466d7-serving-cert: secret "maas-api-e2e-ait-b16466d7-serving-cert" not found
Sep 08 11:44:25.745567 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:44:25.745547    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f31d84c7-684d-4f80-82d7-957421703c99-maas-api-tls podName:f31d84c7-684d-4f80-82d7-957421703c99 nodeName:}" failed. No retries permitted until 2026-09-08 11:44:26.245526974 +0000 UTC m=+840.897233760 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f31d84c7-684d-4f80-82d7-957421703c99-maas-api-tls") pod "maas-api-e2e-ait-b16466d7-56464cd675-fjgt8" (UID: "f31d84c7-684d-4f80-82d7-957421703c99") : secret "maas-api-e2e-ait-b16466d7-serving-cert" not found
Sep 08 11:44:25.896163 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:25.896134    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"
Sep 08 11:44:25.926884 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:25.926854    2575 generic.go:356] "Generic (PLEG): container finished" podID="827afd0b-acca-4950-b572-af636a6cbbca" containerID="63d8aaa3cd72a1c2bf2dda5597085332a50e9ea95d8782bdf0ef0403c7f52ddb" exitCode=0
Sep 08 11:44:25.927036 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:25.926941    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb" event={"ID":"827afd0b-acca-4950-b572-af636a6cbbca","Type":"ContainerDied","Data":"63d8aaa3cd72a1c2bf2dda5597085332a50e9ea95d8782bdf0ef0403c7f52ddb"}
Sep 08 11:44:25.927036 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:25.926953    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"
Sep 08 11:44:25.927036 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:25.926996    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb" event={"ID":"827afd0b-acca-4950-b572-af636a6cbbca","Type":"ContainerDied","Data":"4e103fd2454057a6bacbca103a337d4239184a89c0adb81e249a73106e51bc17"}
Sep 08 11:44:25.927036 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:25.927030    2575 scope.go:117] "RemoveContainer" containerID="63d8aaa3cd72a1c2bf2dda5597085332a50e9ea95d8782bdf0ef0403c7f52ddb"
Sep 08 11:44:25.936467 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:25.936432    2575 scope.go:117] "RemoveContainer" containerID="6f8565559c1c54afa6499f11bc0521df1098d2ca48f56c6d40f171030de3a2c1"
Sep 08 11:44:25.944913 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:25.944888    2575 scope.go:117] "RemoveContainer" containerID="63d8aaa3cd72a1c2bf2dda5597085332a50e9ea95d8782bdf0ef0403c7f52ddb"
Sep 08 11:44:25.945210 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:44:25.945191    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63d8aaa3cd72a1c2bf2dda5597085332a50e9ea95d8782bdf0ef0403c7f52ddb\": container with ID starting with 63d8aaa3cd72a1c2bf2dda5597085332a50e9ea95d8782bdf0ef0403c7f52ddb not found: ID does not exist" containerID="63d8aaa3cd72a1c2bf2dda5597085332a50e9ea95d8782bdf0ef0403c7f52ddb"
Sep 08 11:44:25.945294 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:25.945219    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63d8aaa3cd72a1c2bf2dda5597085332a50e9ea95d8782bdf0ef0403c7f52ddb"} err="failed to get container status \"63d8aaa3cd72a1c2bf2dda5597085332a50e9ea95d8782bdf0ef0403c7f52ddb\": rpc error: code = NotFound desc = could not find container \"63d8aaa3cd72a1c2bf2dda5597085332a50e9ea95d8782bdf0ef0403c7f52ddb\": container with ID starting with 63d8aaa3cd72a1c2bf2dda5597085332a50e9ea95d8782bdf0ef0403c7f52ddb not found: ID does not exist"
Sep 08 11:44:25.945294 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:25.945242    2575 scope.go:117] "RemoveContainer" containerID="6f8565559c1c54afa6499f11bc0521df1098d2ca48f56c6d40f171030de3a2c1"
Sep 08 11:44:25.945505 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:44:25.945489    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f8565559c1c54afa6499f11bc0521df1098d2ca48f56c6d40f171030de3a2c1\": container with ID starting with 6f8565559c1c54afa6499f11bc0521df1098d2ca48f56c6d40f171030de3a2c1 not found: ID does not exist" containerID="6f8565559c1c54afa6499f11bc0521df1098d2ca48f56c6d40f171030de3a2c1"
Sep 08 11:44:25.945546 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:25.945509    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f8565559c1c54afa6499f11bc0521df1098d2ca48f56c6d40f171030de3a2c1"} err="failed to get container status \"6f8565559c1c54afa6499f11bc0521df1098d2ca48f56c6d40f171030de3a2c1\": rpc error: code = NotFound desc = could not find container \"6f8565559c1c54afa6499f11bc0521df1098d2ca48f56c6d40f171030de3a2c1\": container with ID starting with 6f8565559c1c54afa6499f11bc0521df1098d2ca48f56c6d40f171030de3a2c1 not found: ID does not exist"
Sep 08 11:44:26.037560 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.037527    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/827afd0b-acca-4950-b572-af636a6cbbca-workload-socket\") pod \"827afd0b-acca-4950-b572-af636a6cbbca\" (UID: \"827afd0b-acca-4950-b572-af636a6cbbca\") "
Sep 08 11:44:26.037716 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.037563    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/827afd0b-acca-4950-b572-af636a6cbbca-credential-socket\") pod \"827afd0b-acca-4950-b572-af636a6cbbca\" (UID: \"827afd0b-acca-4950-b572-af636a6cbbca\") "
Sep 08 11:44:26.037716 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.037647    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/827afd0b-acca-4950-b572-af636a6cbbca-istio-token\") pod \"827afd0b-acca-4950-b572-af636a6cbbca\" (UID: \"827afd0b-acca-4950-b572-af636a6cbbca\") "
Sep 08 11:44:26.037716 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.037673    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/827afd0b-acca-4950-b572-af636a6cbbca-istio-podinfo\") pod \"827afd0b-acca-4950-b572-af636a6cbbca\" (UID: \"827afd0b-acca-4950-b572-af636a6cbbca\") "
Sep 08 11:44:26.037716 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.037707    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/827afd0b-acca-4950-b572-af636a6cbbca-workload-certs\") pod \"827afd0b-acca-4950-b572-af636a6cbbca\" (UID: \"827afd0b-acca-4950-b572-af636a6cbbca\") "
Sep 08 11:44:26.037946 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.037757    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/827afd0b-acca-4950-b572-af636a6cbbca-istiod-ca-cert\") pod \"827afd0b-acca-4950-b572-af636a6cbbca\" (UID: \"827afd0b-acca-4950-b572-af636a6cbbca\") "
Sep 08 11:44:26.037946 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.037748    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/827afd0b-acca-4950-b572-af636a6cbbca-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "827afd0b-acca-4950-b572-af636a6cbbca" (UID: "827afd0b-acca-4950-b572-af636a6cbbca"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:44:26.037946 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.037835    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gcqnx\" (UniqueName: \"kubernetes.io/projected/827afd0b-acca-4950-b572-af636a6cbbca-kube-api-access-gcqnx\") pod \"827afd0b-acca-4950-b572-af636a6cbbca\" (UID: \"827afd0b-acca-4950-b572-af636a6cbbca\") "
Sep 08 11:44:26.037946 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.037917    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/827afd0b-acca-4950-b572-af636a6cbbca-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "827afd0b-acca-4950-b572-af636a6cbbca" (UID: "827afd0b-acca-4950-b572-af636a6cbbca"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:44:26.037946 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.037928    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/827afd0b-acca-4950-b572-af636a6cbbca-istio-envoy\") pod \"827afd0b-acca-4950-b572-af636a6cbbca\" (UID: \"827afd0b-acca-4950-b572-af636a6cbbca\") "
Sep 08 11:44:26.038198 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.037986    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/827afd0b-acca-4950-b572-af636a6cbbca-istio-data\") pod \"827afd0b-acca-4950-b572-af636a6cbbca\" (UID: \"827afd0b-acca-4950-b572-af636a6cbbca\") "
Sep 08 11:44:26.038198 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.038174    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/827afd0b-acca-4950-b572-af636a6cbbca-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "827afd0b-acca-4950-b572-af636a6cbbca" (UID: "827afd0b-acca-4950-b572-af636a6cbbca"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:44:26.038306 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.038284    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/827afd0b-acca-4950-b572-af636a6cbbca-istio-data" (OuterVolumeSpecName: "istio-data") pod "827afd0b-acca-4950-b572-af636a6cbbca" (UID: "827afd0b-acca-4950-b572-af636a6cbbca"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:44:26.038400 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.038327    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/827afd0b-acca-4950-b572-af636a6cbbca-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "827afd0b-acca-4950-b572-af636a6cbbca" (UID: "827afd0b-acca-4950-b572-af636a6cbbca"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:44:26.038639 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.038579    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/827afd0b-acca-4950-b572-af636a6cbbca-workload-socket\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:44:26.038639 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.038600    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/827afd0b-acca-4950-b572-af636a6cbbca-credential-socket\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:44:26.038639 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.038614    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/827afd0b-acca-4950-b572-af636a6cbbca-workload-certs\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:44:26.038639 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.038628    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/827afd0b-acca-4950-b572-af636a6cbbca-istiod-ca-cert\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:44:26.038639 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.038639    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/827afd0b-acca-4950-b572-af636a6cbbca-istio-data\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:44:26.040303 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.040280    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/827afd0b-acca-4950-b572-af636a6cbbca-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "827afd0b-acca-4950-b572-af636a6cbbca" (UID: "827afd0b-acca-4950-b572-af636a6cbbca"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:44:26.040460 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.040441    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/827afd0b-acca-4950-b572-af636a6cbbca-istio-token" (OuterVolumeSpecName: "istio-token") pod "827afd0b-acca-4950-b572-af636a6cbbca" (UID: "827afd0b-acca-4950-b572-af636a6cbbca"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:44:26.040545 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.040462    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/827afd0b-acca-4950-b572-af636a6cbbca-kube-api-access-gcqnx" (OuterVolumeSpecName: "kube-api-access-gcqnx") pod "827afd0b-acca-4950-b572-af636a6cbbca" (UID: "827afd0b-acca-4950-b572-af636a6cbbca"). InnerVolumeSpecName "kube-api-access-gcqnx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:44:26.040588 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.040543    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/827afd0b-acca-4950-b572-af636a6cbbca-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "827afd0b-acca-4950-b572-af636a6cbbca" (UID: "827afd0b-acca-4950-b572-af636a6cbbca"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 11:44:26.136654 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.136622    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-a1721d/autores-model-a1721d-kserve-74c9765755-hc9zk"
Sep 08 11:44:26.136810 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.136666    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-autores-a1721d/autores-model-a1721d-kserve-74c9765755-hc9zk"
Sep 08 11:44:26.139459 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.139439    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcqnx\" (UniqueName: \"kubernetes.io/projected/827afd0b-acca-4950-b572-af636a6cbbca-kube-api-access-gcqnx\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:44:26.139459 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.139458    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/827afd0b-acca-4950-b572-af636a6cbbca-istio-envoy\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:44:26.139586 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.139467    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/827afd0b-acca-4950-b572-af636a6cbbca-istio-token\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:44:26.139586 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.139475    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/827afd0b-acca-4950-b572-af636a6cbbca-istio-podinfo\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:44:26.149025 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.149004    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-autores-a1721d/autores-model-a1721d-kserve-74c9765755-hc9zk"
Sep 08 11:44:26.172539 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.172519    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d-jdw6x"]
Sep 08 11:44:26.177129 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.173846    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="827afd0b-acca-4950-b572-af636a6cbbca" containerName="istio-proxy"
Sep 08 11:44:26.177129 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.173872    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="827afd0b-acca-4950-b572-af636a6cbbca" containerName="istio-proxy"
Sep 08 11:44:26.177129 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.174144    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="827afd0b-acca-4950-b572-af636a6cbbca" containerName="istio-proxy"
Sep 08 11:44:26.183652 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.183626    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d-jdw6x"
Sep 08 11:44:26.186401 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.186381    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-b16466d7\""
Sep 08 11:44:26.187255 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.187233    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d-jdw6x"]
Sep 08 11:44:26.251848 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.251826    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"]
Sep 08 11:44:26.257392 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.257371    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb"]
Sep 08 11:44:26.341274 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.341189    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r46t2\" (UniqueName: \"kubernetes.io/projected/84ad0928-2ca5-4653-ad00-14ca7148a500-kube-api-access-r46t2\") pod \"payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d-jdw6x\" (UID: \"84ad0928-2ca5-4653-ad00-14ca7148a500\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d-jdw6x"
Sep 08 11:44:26.341274 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.341261    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84ad0928-2ca5-4653-ad00-14ca7148a500-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d-jdw6x\" (UID: \"84ad0928-2ca5-4653-ad00-14ca7148a500\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d-jdw6x"
Sep 08 11:44:26.341466 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.341329    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f31d84c7-684d-4f80-82d7-957421703c99-maas-api-tls\") pod \"maas-api-e2e-ait-b16466d7-56464cd675-fjgt8\" (UID: \"f31d84c7-684d-4f80-82d7-957421703c99\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b16466d7-56464cd675-fjgt8"
Sep 08 11:44:26.343834 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.343818    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f31d84c7-684d-4f80-82d7-957421703c99-maas-api-tls\") pod \"maas-api-e2e-ait-b16466d7-56464cd675-fjgt8\" (UID: \"f31d84c7-684d-4f80-82d7-957421703c99\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b16466d7-56464cd675-fjgt8"
Sep 08 11:44:26.400243 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.400216    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b16466d7-56464cd675-fjgt8"
Sep 08 11:44:26.442111 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.442077    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r46t2\" (UniqueName: \"kubernetes.io/projected/84ad0928-2ca5-4653-ad00-14ca7148a500-kube-api-access-r46t2\") pod \"payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d-jdw6x\" (UID: \"84ad0928-2ca5-4653-ad00-14ca7148a500\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d-jdw6x"
Sep 08 11:44:26.442262 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.442198    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84ad0928-2ca5-4653-ad00-14ca7148a500-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d-jdw6x\" (UID: \"84ad0928-2ca5-4653-ad00-14ca7148a500\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d-jdw6x"
Sep 08 11:44:26.443140 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.443116    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84ad0928-2ca5-4653-ad00-14ca7148a500-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d-jdw6x\" (UID: \"84ad0928-2ca5-4653-ad00-14ca7148a500\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d-jdw6x"
Sep 08 11:44:26.453216 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.453194    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r46t2\" (UniqueName: \"kubernetes.io/projected/84ad0928-2ca5-4653-ad00-14ca7148a500-kube-api-access-r46t2\") pod \"payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d-jdw6x\" (UID: \"84ad0928-2ca5-4653-ad00-14ca7148a500\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d-jdw6x"
Sep 08 11:44:26.496724 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.496692    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d-jdw6x"
Sep 08 11:44:26.681628 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.681603    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b16466d7-56464cd675-fjgt8"]
Sep 08 11:44:26.683128 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:44:26.683101    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf31d84c7_684d_4f80_82d7_957421703c99.slice/crio-e718d071e9fd6173e846b3a559954ded72705212bda2398449df2d33657da16a WatchSource:0}: Error finding container e718d071e9fd6173e846b3a559954ded72705212bda2398449df2d33657da16a: Status 404 returned error can't find the container with id e718d071e9fd6173e846b3a559954ded72705212bda2398449df2d33657da16a
Sep 08 11:44:26.771008 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.770976    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d-jdw6x"]
Sep 08 11:44:26.774523 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:44:26.774500    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84ad0928_2ca5_4653_ad00_14ca7148a500.slice/crio-4d1ab1fdb27593a24f52c55608dcf858e850c7199e9ee5e676371ac267ba4a79 WatchSource:0}: Error finding container 4d1ab1fdb27593a24f52c55608dcf858e850c7199e9ee5e676371ac267ba4a79: Status 404 returned error can't find the container with id 4d1ab1fdb27593a24f52c55608dcf858e850c7199e9ee5e676371ac267ba4a79
Sep 08 11:44:26.933005 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.932912    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b16466d7-56464cd675-fjgt8" event={"ID":"f31d84c7-684d-4f80-82d7-957421703c99","Type":"ContainerStarted","Data":"e718d071e9fd6173e846b3a559954ded72705212bda2398449df2d33657da16a"}
Sep 08 11:44:26.934624 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.934594    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d-jdw6x" event={"ID":"84ad0928-2ca5-4653-ad00-14ca7148a500","Type":"ContainerStarted","Data":"bdd74909b901c8f7b4e23da24a31cb34a06228688c87bdb945f6a76cfab7401f"}
Sep 08 11:44:26.934764 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.934642    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d-jdw6x" event={"ID":"84ad0928-2ca5-4653-ad00-14ca7148a500","Type":"ContainerStarted","Data":"4d1ab1fdb27593a24f52c55608dcf858e850c7199e9ee5e676371ac267ba4a79"}
Sep 08 11:44:26.934824 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.934793    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d-jdw6x"
Sep 08 11:44:26.947031 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.947007    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-autores-a1721d/autores-model-a1721d-kserve-74c9765755-hc9zk"
Sep 08 11:44:26.957725 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:26.957690    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d-jdw6x" podStartSLOduration=0.9576771 podStartE2EDuration="957.6771ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:44:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:44:26.955220974 +0000 UTC m=+841.606927792" watchObservedRunningTime="2026-09-08 11:44:26.9576771 +0000 UTC m=+841.609383894"
Sep 08 11:44:27.841447 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:27.841375    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="827afd0b-acca-4950-b572-af636a6cbbca" path="/var/lib/kubelet/pods/827afd0b-acca-4950-b572-af636a6cbbca/volumes"
Sep 08 11:44:27.941877 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:27.941833    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b16466d7-56464cd675-fjgt8" event={"ID":"f31d84c7-684d-4f80-82d7-957421703c99","Type":"ContainerStarted","Data":"8aaf635ff5773f14eccd7048cce2b51bd59d85b40330d6c4a6eb8a5f191036f6"}
Sep 08 11:44:27.942070 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:27.941980    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b16466d7-56464cd675-fjgt8"
Sep 08 11:44:27.964058 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:27.964004    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b16466d7-56464cd675-fjgt8" podStartSLOduration=2.113759831 podStartE2EDuration="2.963988973s" totalImagesPullingTime="850.229142ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:44:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:44:27.963540855 +0000 UTC m=+842.615247649" watchObservedRunningTime="2026-09-08 11:44:27.963988973 +0000 UTC m=+842.615695767"
Sep 08 11:44:33.953358 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:33.953311    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b16466d7-56464cd675-fjgt8"
Sep 08 11:44:37.944353 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:37.944319    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d-jdw6x"
Sep 08 11:44:43.107459 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:43.107404    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-a1721d/autores-model-a1721d-kserve-74c9765755-hc9zk"]
Sep 08 11:44:56.529456 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:56.529423    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b16466d7-56464cd675-fjgt8"]
Sep 08 11:44:56.529918 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:56.529725    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b16466d7-56464cd675-fjgt8" podUID="f31d84c7-684d-4f80-82d7-957421703c99" containerName="maas-api" containerID="cri-o://8aaf635ff5773f14eccd7048cce2b51bd59d85b40330d6c4a6eb8a5f191036f6" gracePeriod=30
Sep 08 11:44:56.617030 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:56.616994    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d-jdw6x"]
Sep 08 11:44:56.617261 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:56.617224    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d-jdw6x" podUID="84ad0928-2ca5-4653-ad00-14ca7148a500" containerName="payload-pre-processing" containerID="cri-o://bdd74909b901c8f7b4e23da24a31cb34a06228688c87bdb945f6a76cfab7401f" gracePeriod=30
Sep 08 11:44:56.879161 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:56.879135    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b16466d7-56464cd675-fjgt8"
Sep 08 11:44:56.907546 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:56.907499    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d-jdw6x"
Sep 08 11:44:57.060556 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:57.060526    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r46t2\" (UniqueName: \"kubernetes.io/projected/84ad0928-2ca5-4653-ad00-14ca7148a500-kube-api-access-r46t2\") pod \"84ad0928-2ca5-4653-ad00-14ca7148a500\" (UID: \"84ad0928-2ca5-4653-ad00-14ca7148a500\") "
Sep 08 11:44:57.060742 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:57.060632    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f31d84c7-684d-4f80-82d7-957421703c99-maas-api-tls\") pod \"f31d84c7-684d-4f80-82d7-957421703c99\" (UID: \"f31d84c7-684d-4f80-82d7-957421703c99\") "
Sep 08 11:44:57.060742 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:57.060672    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqjcw\" (UniqueName: \"kubernetes.io/projected/f31d84c7-684d-4f80-82d7-957421703c99-kube-api-access-zqjcw\") pod \"f31d84c7-684d-4f80-82d7-957421703c99\" (UID: \"f31d84c7-684d-4f80-82d7-957421703c99\") "
Sep 08 11:44:57.060742 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:57.060726    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f31d84c7-684d-4f80-82d7-957421703c99-metrics-certs\") pod \"f31d84c7-684d-4f80-82d7-957421703c99\" (UID: \"f31d84c7-684d-4f80-82d7-957421703c99\") "
Sep 08 11:44:57.060897 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:57.060791    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f31d84c7-684d-4f80-82d7-957421703c99-openshift-service-ca\") pod \"f31d84c7-684d-4f80-82d7-957421703c99\" (UID: \"f31d84c7-684d-4f80-82d7-957421703c99\") "
Sep 08 11:44:57.060897 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:57.060842    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84ad0928-2ca5-4653-ad00-14ca7148a500-plugins-config-volume\") pod \"84ad0928-2ca5-4653-ad00-14ca7148a500\" (UID: \"84ad0928-2ca5-4653-ad00-14ca7148a500\") "
Sep 08 11:44:57.061440 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:57.061407    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f31d84c7-684d-4f80-82d7-957421703c99-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f31d84c7-684d-4f80-82d7-957421703c99" (UID: "f31d84c7-684d-4f80-82d7-957421703c99"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:44:57.061591 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:57.061512    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84ad0928-2ca5-4653-ad00-14ca7148a500-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "84ad0928-2ca5-4653-ad00-14ca7148a500" (UID: "84ad0928-2ca5-4653-ad00-14ca7148a500"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:44:57.063478 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:57.063437    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f31d84c7-684d-4f80-82d7-957421703c99-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f31d84c7-684d-4f80-82d7-957421703c99" (UID: "f31d84c7-684d-4f80-82d7-957421703c99"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:44:57.063478 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:57.063456    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f31d84c7-684d-4f80-82d7-957421703c99-kube-api-access-zqjcw" (OuterVolumeSpecName: "kube-api-access-zqjcw") pod "f31d84c7-684d-4f80-82d7-957421703c99" (UID: "f31d84c7-684d-4f80-82d7-957421703c99"). InnerVolumeSpecName "kube-api-access-zqjcw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:44:57.063478 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:57.063465    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84ad0928-2ca5-4653-ad00-14ca7148a500-kube-api-access-r46t2" (OuterVolumeSpecName: "kube-api-access-r46t2") pod "84ad0928-2ca5-4653-ad00-14ca7148a500" (UID: "84ad0928-2ca5-4653-ad00-14ca7148a500"). InnerVolumeSpecName "kube-api-access-r46t2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:44:57.063650 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:57.063522    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f31d84c7-684d-4f80-82d7-957421703c99-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f31d84c7-684d-4f80-82d7-957421703c99" (UID: "f31d84c7-684d-4f80-82d7-957421703c99"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:44:57.105542 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:57.105482    2575 generic.go:356] "Generic (PLEG): container finished" podID="84ad0928-2ca5-4653-ad00-14ca7148a500" containerID="bdd74909b901c8f7b4e23da24a31cb34a06228688c87bdb945f6a76cfab7401f" exitCode=0
Sep 08 11:44:57.105542 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:57.105525    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d-jdw6x"
Sep 08 11:44:57.105709 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:57.105564    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d-jdw6x" event={"ID":"84ad0928-2ca5-4653-ad00-14ca7148a500","Type":"ContainerDied","Data":"bdd74909b901c8f7b4e23da24a31cb34a06228688c87bdb945f6a76cfab7401f"}
Sep 08 11:44:57.105709 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:57.105615    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d-jdw6x" event={"ID":"84ad0928-2ca5-4653-ad00-14ca7148a500","Type":"ContainerDied","Data":"4d1ab1fdb27593a24f52c55608dcf858e850c7199e9ee5e676371ac267ba4a79"}
Sep 08 11:44:57.105709 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:57.105637    2575 scope.go:117] "RemoveContainer" containerID="bdd74909b901c8f7b4e23da24a31cb34a06228688c87bdb945f6a76cfab7401f"
Sep 08 11:44:57.107074 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:57.107026    2575 generic.go:356] "Generic (PLEG): container finished" podID="f31d84c7-684d-4f80-82d7-957421703c99" containerID="8aaf635ff5773f14eccd7048cce2b51bd59d85b40330d6c4a6eb8a5f191036f6" exitCode=0
Sep 08 11:44:57.107074 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:57.107069    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b16466d7-56464cd675-fjgt8"
Sep 08 11:44:57.107195 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:57.107079    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b16466d7-56464cd675-fjgt8" event={"ID":"f31d84c7-684d-4f80-82d7-957421703c99","Type":"ContainerDied","Data":"8aaf635ff5773f14eccd7048cce2b51bd59d85b40330d6c4a6eb8a5f191036f6"}
Sep 08 11:44:57.107195 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:57.107130    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b16466d7-56464cd675-fjgt8" event={"ID":"f31d84c7-684d-4f80-82d7-957421703c99","Type":"ContainerDied","Data":"e718d071e9fd6173e846b3a559954ded72705212bda2398449df2d33657da16a"}
Sep 08 11:44:57.114823 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:57.114806    2575 scope.go:117] "RemoveContainer" containerID="bdd74909b901c8f7b4e23da24a31cb34a06228688c87bdb945f6a76cfab7401f"
Sep 08 11:44:57.115128 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:44:57.115104    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdd74909b901c8f7b4e23da24a31cb34a06228688c87bdb945f6a76cfab7401f\": container with ID starting with bdd74909b901c8f7b4e23da24a31cb34a06228688c87bdb945f6a76cfab7401f not found: ID does not exist" containerID="bdd74909b901c8f7b4e23da24a31cb34a06228688c87bdb945f6a76cfab7401f"
Sep 08 11:44:57.115182 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:57.115145    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdd74909b901c8f7b4e23da24a31cb34a06228688c87bdb945f6a76cfab7401f"} err="failed to get container status \"bdd74909b901c8f7b4e23da24a31cb34a06228688c87bdb945f6a76cfab7401f\": rpc error: code = NotFound desc = could not find container \"bdd74909b901c8f7b4e23da24a31cb34a06228688c87bdb945f6a76cfab7401f\": container with ID starting with bdd74909b901c8f7b4e23da24a31cb34a06228688c87bdb945f6a76cfab7401f not found: ID does not exist"
Sep 08 11:44:57.115182 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:57.115170    2575 scope.go:117] "RemoveContainer" containerID="8aaf635ff5773f14eccd7048cce2b51bd59d85b40330d6c4a6eb8a5f191036f6"
Sep 08 11:44:57.123923 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:57.123907    2575 scope.go:117] "RemoveContainer" containerID="8aaf635ff5773f14eccd7048cce2b51bd59d85b40330d6c4a6eb8a5f191036f6"
Sep 08 11:44:57.124200 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:44:57.124183    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8aaf635ff5773f14eccd7048cce2b51bd59d85b40330d6c4a6eb8a5f191036f6\": container with ID starting with 8aaf635ff5773f14eccd7048cce2b51bd59d85b40330d6c4a6eb8a5f191036f6 not found: ID does not exist" containerID="8aaf635ff5773f14eccd7048cce2b51bd59d85b40330d6c4a6eb8a5f191036f6"
Sep 08 11:44:57.124259 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:57.124210    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8aaf635ff5773f14eccd7048cce2b51bd59d85b40330d6c4a6eb8a5f191036f6"} err="failed to get container status \"8aaf635ff5773f14eccd7048cce2b51bd59d85b40330d6c4a6eb8a5f191036f6\": rpc error: code = NotFound desc = could not find container \"8aaf635ff5773f14eccd7048cce2b51bd59d85b40330d6c4a6eb8a5f191036f6\": container with ID starting with 8aaf635ff5773f14eccd7048cce2b51bd59d85b40330d6c4a6eb8a5f191036f6 not found: ID does not exist"
Sep 08 11:44:57.129473 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:57.129451    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d-jdw6x"]
Sep 08 11:44:57.134553 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:57.134523    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d-jdw6x"]
Sep 08 11:44:57.146952 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:57.146929    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b16466d7-56464cd675-fjgt8"]
Sep 08 11:44:57.151524 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:57.151500    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b16466d7-56464cd675-fjgt8"]
Sep 08 11:44:57.161727 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:57.161708    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqjcw\" (UniqueName: \"kubernetes.io/projected/f31d84c7-684d-4f80-82d7-957421703c99-kube-api-access-zqjcw\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:44:57.161811 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:57.161729    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f31d84c7-684d-4f80-82d7-957421703c99-metrics-certs\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:44:57.161811 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:57.161740    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f31d84c7-684d-4f80-82d7-957421703c99-openshift-service-ca\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:44:57.161811 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:57.161748    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84ad0928-2ca5-4653-ad00-14ca7148a500-plugins-config-volume\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:44:57.161811 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:57.161756    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r46t2\" (UniqueName: \"kubernetes.io/projected/84ad0928-2ca5-4653-ad00-14ca7148a500-kube-api-access-r46t2\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:44:57.161811 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:57.161764    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f31d84c7-684d-4f80-82d7-957421703c99-maas-api-tls\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:44:57.850083 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:57.845872    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84ad0928-2ca5-4653-ad00-14ca7148a500" path="/var/lib/kubelet/pods/84ad0928-2ca5-4653-ad00-14ca7148a500/volumes"
Sep 08 11:44:57.850083 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:57.846563    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f31d84c7-684d-4f80-82d7-957421703c99" path="/var/lib/kubelet/pods/f31d84c7-684d-4f80-82d7-957421703c99/volumes"
Sep 08 11:44:58.128060 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.127977    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-a1721d/autores-model-a1721d-kserve-74c9765755-hc9zk" podUID="a011eb22-4067-46a0-941d-c4f5213a3faf" containerName="main" containerID="cri-o://e40ec1176ec50ccc1b015d6b350fe1085655980fc34c9ee6266f80dfddb521e6" gracePeriod=45
Sep 08 11:44:58.393943 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.393889    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-a1721d/autores-model-a1721d-kserve-74c9765755-hc9zk"
Sep 08 11:44:58.575403 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.575375    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a011eb22-4067-46a0-941d-c4f5213a3faf-home\") pod \"a011eb22-4067-46a0-941d-c4f5213a3faf\" (UID: \"a011eb22-4067-46a0-941d-c4f5213a3faf\") "
Sep 08 11:44:58.575590 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.575423    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a011eb22-4067-46a0-941d-c4f5213a3faf-tls-certs\") pod \"a011eb22-4067-46a0-941d-c4f5213a3faf\" (UID: \"a011eb22-4067-46a0-941d-c4f5213a3faf\") "
Sep 08 11:44:58.575590 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.575472    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a011eb22-4067-46a0-941d-c4f5213a3faf-tmp-dir\") pod \"a011eb22-4067-46a0-941d-c4f5213a3faf\" (UID: \"a011eb22-4067-46a0-941d-c4f5213a3faf\") "
Sep 08 11:44:58.575590 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.575532    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vd7rs\" (UniqueName: \"kubernetes.io/projected/a011eb22-4067-46a0-941d-c4f5213a3faf-kube-api-access-vd7rs\") pod \"a011eb22-4067-46a0-941d-c4f5213a3faf\" (UID: \"a011eb22-4067-46a0-941d-c4f5213a3faf\") "
Sep 08 11:44:58.575768 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.575620    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a011eb22-4067-46a0-941d-c4f5213a3faf-home" (OuterVolumeSpecName: "home") pod "a011eb22-4067-46a0-941d-c4f5213a3faf" (UID: "a011eb22-4067-46a0-941d-c4f5213a3faf"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:44:58.575768 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.575647    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a011eb22-4067-46a0-941d-c4f5213a3faf-dshm\") pod \"a011eb22-4067-46a0-941d-c4f5213a3faf\" (UID: \"a011eb22-4067-46a0-941d-c4f5213a3faf\") "
Sep 08 11:44:58.575768 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.575690    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a011eb22-4067-46a0-941d-c4f5213a3faf-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a011eb22-4067-46a0-941d-c4f5213a3faf" (UID: "a011eb22-4067-46a0-941d-c4f5213a3faf"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:44:58.575768 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.575710    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a011eb22-4067-46a0-941d-c4f5213a3faf-model-cache\") pod \"a011eb22-4067-46a0-941d-c4f5213a3faf\" (UID: \"a011eb22-4067-46a0-941d-c4f5213a3faf\") "
Sep 08 11:44:58.575941 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.575828    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a011eb22-4067-46a0-941d-c4f5213a3faf-model-cache" (OuterVolumeSpecName: "model-cache") pod "a011eb22-4067-46a0-941d-c4f5213a3faf" (UID: "a011eb22-4067-46a0-941d-c4f5213a3faf"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:44:58.576022 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.576007    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a011eb22-4067-46a0-941d-c4f5213a3faf-model-cache\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:44:58.576077 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.576023    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a011eb22-4067-46a0-941d-c4f5213a3faf-home\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:44:58.576077 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.576032    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a011eb22-4067-46a0-941d-c4f5213a3faf-tmp-dir\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:44:58.577852 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.577826    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a011eb22-4067-46a0-941d-c4f5213a3faf-dshm" (OuterVolumeSpecName: "dshm") pod "a011eb22-4067-46a0-941d-c4f5213a3faf" (UID: "a011eb22-4067-46a0-941d-c4f5213a3faf"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:44:58.577970 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.577924    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a011eb22-4067-46a0-941d-c4f5213a3faf-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a011eb22-4067-46a0-941d-c4f5213a3faf" (UID: "a011eb22-4067-46a0-941d-c4f5213a3faf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:44:58.577970 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.577953    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a011eb22-4067-46a0-941d-c4f5213a3faf-kube-api-access-vd7rs" (OuterVolumeSpecName: "kube-api-access-vd7rs") pod "a011eb22-4067-46a0-941d-c4f5213a3faf" (UID: "a011eb22-4067-46a0-941d-c4f5213a3faf"). InnerVolumeSpecName "kube-api-access-vd7rs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:44:58.626775 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.626742    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"]
Sep 08 11:44:58.627488 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.627463    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84ad0928-2ca5-4653-ad00-14ca7148a500" containerName="payload-pre-processing"
Sep 08 11:44:58.627488 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.627488    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="84ad0928-2ca5-4653-ad00-14ca7148a500" containerName="payload-pre-processing"
Sep 08 11:44:58.627638 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.627511    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="827afd0b-acca-4950-b572-af636a6cbbca" containerName="istio-proxy"
Sep 08 11:44:58.627638 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.627520    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="827afd0b-acca-4950-b572-af636a6cbbca" containerName="istio-proxy"
Sep 08 11:44:58.627638 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.627542    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a011eb22-4067-46a0-941d-c4f5213a3faf" containerName="main"
Sep 08 11:44:58.627638 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.627551    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a011eb22-4067-46a0-941d-c4f5213a3faf" containerName="main"
Sep 08 11:44:58.627638 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.627562    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f31d84c7-684d-4f80-82d7-957421703c99" containerName="maas-api"
Sep 08 11:44:58.627638 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.627570    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f31d84c7-684d-4f80-82d7-957421703c99" containerName="maas-api"
Sep 08 11:44:58.627840 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.627675    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f31d84c7-684d-4f80-82d7-957421703c99" containerName="maas-api"
Sep 08 11:44:58.627840 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.627690    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="827afd0b-acca-4950-b572-af636a6cbbca" containerName="istio-proxy"
Sep 08 11:44:58.627840 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.627699    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a011eb22-4067-46a0-941d-c4f5213a3faf" containerName="main"
Sep 08 11:44:58.627840 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.627713    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="84ad0928-2ca5-4653-ad00-14ca7148a500" containerName="payload-pre-processing"
Sep 08 11:44:58.631302 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.631287    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"
Sep 08 11:44:58.634373 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.634325    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-46564b9d-openshift-default-dockercfg-gmq5h\""
Sep 08 11:44:58.643728 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.643545    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"]
Sep 08 11:44:58.676765 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.676737    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vd7rs\" (UniqueName: \"kubernetes.io/projected/a011eb22-4067-46a0-941d-c4f5213a3faf-kube-api-access-vd7rs\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:44:58.676765 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.676763    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a011eb22-4067-46a0-941d-c4f5213a3faf-dshm\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:44:58.676927 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.676774    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a011eb22-4067-46a0-941d-c4f5213a3faf-tls-certs\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:44:58.777771 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.777730    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkfl9\" (UniqueName: \"kubernetes.io/projected/e6ab4d59-781d-419b-9f1c-7b986491b9a0-kube-api-access-qkfl9\") pod \"e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf\" (UID: \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\") " pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"
Sep 08 11:44:58.777962 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.777781    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6ab4d59-781d-419b-9f1c-7b986491b9a0-workload-certs\") pod \"e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf\" (UID: \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\") " pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"
Sep 08 11:44:58.777962 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.777880    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6ab4d59-781d-419b-9f1c-7b986491b9a0-istio-data\") pod \"e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf\" (UID: \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\") " pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"
Sep 08 11:44:58.777962 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.777915    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6ab4d59-781d-419b-9f1c-7b986491b9a0-istio-envoy\") pod \"e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf\" (UID: \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\") " pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"
Sep 08 11:44:58.778144 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.777963    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6ab4d59-781d-419b-9f1c-7b986491b9a0-istio-podinfo\") pod \"e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf\" (UID: \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\") " pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"
Sep 08 11:44:58.778144 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.778002    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6ab4d59-781d-419b-9f1c-7b986491b9a0-credential-socket\") pod \"e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf\" (UID: \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\") " pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"
Sep 08 11:44:58.778144 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.778100    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6ab4d59-781d-419b-9f1c-7b986491b9a0-istiod-ca-cert\") pod \"e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf\" (UID: \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\") " pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"
Sep 08 11:44:58.778289 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.778145    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6ab4d59-781d-419b-9f1c-7b986491b9a0-istio-token\") pod \"e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf\" (UID: \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\") " pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"
Sep 08 11:44:58.778289 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.778172    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6ab4d59-781d-419b-9f1c-7b986491b9a0-workload-socket\") pod \"e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf\" (UID: \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\") " pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"
Sep 08 11:44:58.879303 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.879268    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkfl9\" (UniqueName: \"kubernetes.io/projected/e6ab4d59-781d-419b-9f1c-7b986491b9a0-kube-api-access-qkfl9\") pod \"e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf\" (UID: \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\") " pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"
Sep 08 11:44:58.879303 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.879310    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6ab4d59-781d-419b-9f1c-7b986491b9a0-workload-certs\") pod \"e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf\" (UID: \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\") " pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"
Sep 08 11:44:58.879846 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.879375    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6ab4d59-781d-419b-9f1c-7b986491b9a0-istio-data\") pod \"e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf\" (UID: \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\") " pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"
Sep 08 11:44:58.879846 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.879401    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6ab4d59-781d-419b-9f1c-7b986491b9a0-istio-envoy\") pod \"e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf\" (UID: \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\") " pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"
Sep 08 11:44:58.879846 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.879419    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6ab4d59-781d-419b-9f1c-7b986491b9a0-istio-podinfo\") pod \"e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf\" (UID: \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\") " pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"
Sep 08 11:44:58.879846 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.879442    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6ab4d59-781d-419b-9f1c-7b986491b9a0-credential-socket\") pod \"e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf\" (UID: \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\") " pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"
Sep 08 11:44:58.879846 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.879499    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6ab4d59-781d-419b-9f1c-7b986491b9a0-istiod-ca-cert\") pod \"e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf\" (UID: \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\") " pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"
Sep 08 11:44:58.879846 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.879540    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6ab4d59-781d-419b-9f1c-7b986491b9a0-istio-token\") pod \"e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf\" (UID: \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\") " pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"
Sep 08 11:44:58.879846 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.879566    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6ab4d59-781d-419b-9f1c-7b986491b9a0-workload-socket\") pod \"e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf\" (UID: \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\") " pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"
Sep 08 11:44:58.879846 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.879835    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6ab4d59-781d-419b-9f1c-7b986491b9a0-istio-data\") pod \"e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf\" (UID: \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\") " pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"
Sep 08 11:44:58.880224 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.879921    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6ab4d59-781d-419b-9f1c-7b986491b9a0-workload-certs\") pod \"e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf\" (UID: \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\") " pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"
Sep 08 11:44:58.880224 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.880122    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6ab4d59-781d-419b-9f1c-7b986491b9a0-workload-socket\") pod \"e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf\" (UID: \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\") " pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"
Sep 08 11:44:58.880224 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.880144    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6ab4d59-781d-419b-9f1c-7b986491b9a0-credential-socket\") pod \"e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf\" (UID: \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\") " pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"
Sep 08 11:44:58.880224 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.880202    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6ab4d59-781d-419b-9f1c-7b986491b9a0-istiod-ca-cert\") pod \"e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf\" (UID: \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\") " pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"
Sep 08 11:44:58.882009 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.881986    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6ab4d59-781d-419b-9f1c-7b986491b9a0-istio-envoy\") pod \"e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf\" (UID: \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\") " pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"
Sep 08 11:44:58.882142 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.882104    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6ab4d59-781d-419b-9f1c-7b986491b9a0-istio-podinfo\") pod \"e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf\" (UID: \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\") " pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"
Sep 08 11:44:58.890736 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.890712    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkfl9\" (UniqueName: \"kubernetes.io/projected/e6ab4d59-781d-419b-9f1c-7b986491b9a0-kube-api-access-qkfl9\") pod \"e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf\" (UID: \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\") " pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"
Sep 08 11:44:58.890846 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.890748    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6ab4d59-781d-419b-9f1c-7b986491b9a0-istio-token\") pod \"e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf\" (UID: \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\") " pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"
Sep 08 11:44:58.950827 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:58.950767    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"
Sep 08 11:44:59.120983 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:59.120949    2575 generic.go:356] "Generic (PLEG): container finished" podID="a011eb22-4067-46a0-941d-c4f5213a3faf" containerID="e40ec1176ec50ccc1b015d6b350fe1085655980fc34c9ee6266f80dfddb521e6" exitCode=0
Sep 08 11:44:59.121194 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:59.121028    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-a1721d/autores-model-a1721d-kserve-74c9765755-hc9zk"
Sep 08 11:44:59.121194 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:59.121041    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-a1721d/autores-model-a1721d-kserve-74c9765755-hc9zk" event={"ID":"a011eb22-4067-46a0-941d-c4f5213a3faf","Type":"ContainerDied","Data":"e40ec1176ec50ccc1b015d6b350fe1085655980fc34c9ee6266f80dfddb521e6"}
Sep 08 11:44:59.121194 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:59.121088    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-a1721d/autores-model-a1721d-kserve-74c9765755-hc9zk" event={"ID":"a011eb22-4067-46a0-941d-c4f5213a3faf","Type":"ContainerDied","Data":"e3e0606c84177b496e8f2e4ff19100ff159221aa0d6a65f6af1216cc6828bbd6"}
Sep 08 11:44:59.121194 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:59.121107    2575 scope.go:117] "RemoveContainer" containerID="e40ec1176ec50ccc1b015d6b350fe1085655980fc34c9ee6266f80dfddb521e6"
Sep 08 11:44:59.130287 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:59.130141    2575 scope.go:117] "RemoveContainer" containerID="e40ec1176ec50ccc1b015d6b350fe1085655980fc34c9ee6266f80dfddb521e6"
Sep 08 11:44:59.130489 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:44:59.130472    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e40ec1176ec50ccc1b015d6b350fe1085655980fc34c9ee6266f80dfddb521e6\": container with ID starting with e40ec1176ec50ccc1b015d6b350fe1085655980fc34c9ee6266f80dfddb521e6 not found: ID does not exist" containerID="e40ec1176ec50ccc1b015d6b350fe1085655980fc34c9ee6266f80dfddb521e6"
Sep 08 11:44:59.130541 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:59.130499    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e40ec1176ec50ccc1b015d6b350fe1085655980fc34c9ee6266f80dfddb521e6"} err="failed to get container status \"e40ec1176ec50ccc1b015d6b350fe1085655980fc34c9ee6266f80dfddb521e6\": rpc error: code = NotFound desc = could not find container \"e40ec1176ec50ccc1b015d6b350fe1085655980fc34c9ee6266f80dfddb521e6\": container with ID starting with e40ec1176ec50ccc1b015d6b350fe1085655980fc34c9ee6266f80dfddb521e6 not found: ID does not exist"
Sep 08 11:44:59.147636 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:59.147610    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-a1721d/autores-model-a1721d-kserve-74c9765755-hc9zk"]
Sep 08 11:44:59.150441 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:59.150421    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-a1721d/autores-model-a1721d-kserve-74c9765755-hc9zk"]
Sep 08 11:44:59.230621 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:59.230596    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"]
Sep 08 11:44:59.231756 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:44:59.231734    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6ab4d59_781d_419b_9f1c_7b986491b9a0.slice/crio-b8c43b96c4452702887fe5096b4974c4aa1eb65bb73e6dca1ee8868b2703a60e WatchSource:0}: Error finding container b8c43b96c4452702887fe5096b4974c4aa1eb65bb73e6dca1ee8868b2703a60e: Status 404 returned error can't find the container with id b8c43b96c4452702887fe5096b4974c4aa1eb65bb73e6dca1ee8868b2703a60e
Sep 08 11:44:59.234054 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:59.234017    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:44:59.234101 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:59.234086    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:44:59.234154 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:59.234115    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:44:59.841833 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:44:59.841798    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a011eb22-4067-46a0-941d-c4f5213a3faf" path="/var/lib/kubelet/pods/a011eb22-4067-46a0-941d-c4f5213a3faf/volumes"
Sep 08 11:45:00.128474 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:00.128373    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf" event={"ID":"e6ab4d59-781d-419b-9f1c-7b986491b9a0","Type":"ContainerStarted","Data":"011938f5bad36f1e9ba90164f00dc7df848579e6064dc3bdfd9c5524b3f18c3e"}
Sep 08 11:45:00.128474 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:00.128432    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf" event={"ID":"e6ab4d59-781d-419b-9f1c-7b986491b9a0","Type":"ContainerStarted","Data":"b8c43b96c4452702887fe5096b4974c4aa1eb65bb73e6dca1ee8868b2703a60e"}
Sep 08 11:45:00.153875 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:00.153820    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf" podStartSLOduration=2.153800414 podStartE2EDuration="2.153800414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:44:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:45:00.152227644 +0000 UTC m=+874.803934465" watchObservedRunningTime="2026-09-08 11:45:00.153800414 +0000 UTC m=+874.805507231"
Sep 08 11:45:00.951277 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:00.951245    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"
Sep 08 11:45:00.955708 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:00.955686    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"
Sep 08 11:45:01.134939 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:01.134908    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"
Sep 08 11:45:01.135762 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:01.135744    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"
Sep 08 11:45:02.715617 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:02.715576    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk"]
Sep 08 11:45:02.719579 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:02.719560    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk"
Sep 08 11:45:02.722361 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:02.722327    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-46564b9d-serving-cert\""
Sep 08 11:45:02.731317 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:02.731293    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk"]
Sep 08 11:45:02.819215 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:02.819182    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8d072db-8a1a-42c8-b3d3-b1f4611c9133-metrics-certs\") pod \"maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk\" (UID: \"d8d072db-8a1a-42c8-b3d3-b1f4611c9133\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk"
Sep 08 11:45:02.819399 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:02.819225    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8d072db-8a1a-42c8-b3d3-b1f4611c9133-maas-api-tls\") pod \"maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk\" (UID: \"d8d072db-8a1a-42c8-b3d3-b1f4611c9133\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk"
Sep 08 11:45:02.819480 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:02.819390    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khnsx\" (UniqueName: \"kubernetes.io/projected/d8d072db-8a1a-42c8-b3d3-b1f4611c9133-kube-api-access-khnsx\") pod \"maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk\" (UID: \"d8d072db-8a1a-42c8-b3d3-b1f4611c9133\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk"
Sep 08 11:45:02.819480 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:02.819444    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8d072db-8a1a-42c8-b3d3-b1f4611c9133-openshift-service-ca\") pod \"maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk\" (UID: \"d8d072db-8a1a-42c8-b3d3-b1f4611c9133\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk"
Sep 08 11:45:02.920103 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:02.920073    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khnsx\" (UniqueName: \"kubernetes.io/projected/d8d072db-8a1a-42c8-b3d3-b1f4611c9133-kube-api-access-khnsx\") pod \"maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk\" (UID: \"d8d072db-8a1a-42c8-b3d3-b1f4611c9133\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk"
Sep 08 11:45:02.920304 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:02.920146    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8d072db-8a1a-42c8-b3d3-b1f4611c9133-openshift-service-ca\") pod \"maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk\" (UID: \"d8d072db-8a1a-42c8-b3d3-b1f4611c9133\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk"
Sep 08 11:45:02.920304 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:02.920184    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8d072db-8a1a-42c8-b3d3-b1f4611c9133-metrics-certs\") pod \"maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk\" (UID: \"d8d072db-8a1a-42c8-b3d3-b1f4611c9133\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk"
Sep 08 11:45:02.920304 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:02.920211    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8d072db-8a1a-42c8-b3d3-b1f4611c9133-maas-api-tls\") pod \"maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk\" (UID: \"d8d072db-8a1a-42c8-b3d3-b1f4611c9133\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk"
Sep 08 11:45:02.920514 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:45:02.920369    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-46564b9d-serving-cert: secret "maas-api-e2e-derive-46564b9d-serving-cert" not found
Sep 08 11:45:02.920514 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:45:02.920449    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8d072db-8a1a-42c8-b3d3-b1f4611c9133-maas-api-tls podName:d8d072db-8a1a-42c8-b3d3-b1f4611c9133 nodeName:}" failed. No retries permitted until 2026-09-08 11:45:03.420417893 +0000 UTC m=+878.072124684 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d8d072db-8a1a-42c8-b3d3-b1f4611c9133-maas-api-tls") pod "maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk" (UID: "d8d072db-8a1a-42c8-b3d3-b1f4611c9133") : secret "maas-api-e2e-derive-46564b9d-serving-cert" not found
Sep 08 11:45:02.920932 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:02.920905    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8d072db-8a1a-42c8-b3d3-b1f4611c9133-openshift-service-ca\") pod \"maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk\" (UID: \"d8d072db-8a1a-42c8-b3d3-b1f4611c9133\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk"
Sep 08 11:45:02.923247 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:02.923225    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8d072db-8a1a-42c8-b3d3-b1f4611c9133-metrics-certs\") pod \"maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk\" (UID: \"d8d072db-8a1a-42c8-b3d3-b1f4611c9133\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk"
Sep 08 11:45:02.931298 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:02.931278    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khnsx\" (UniqueName: \"kubernetes.io/projected/d8d072db-8a1a-42c8-b3d3-b1f4611c9133-kube-api-access-khnsx\") pod \"maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk\" (UID: \"d8d072db-8a1a-42c8-b3d3-b1f4611c9133\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk"
Sep 08 11:45:03.427443 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:03.427409    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8d072db-8a1a-42c8-b3d3-b1f4611c9133-maas-api-tls\") pod \"maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk\" (UID: \"d8d072db-8a1a-42c8-b3d3-b1f4611c9133\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk"
Sep 08 11:45:03.429960 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:03.429938    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8d072db-8a1a-42c8-b3d3-b1f4611c9133-maas-api-tls\") pod \"maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk\" (UID: \"d8d072db-8a1a-42c8-b3d3-b1f4611c9133\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk"
Sep 08 11:45:03.631100 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:03.631068    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk"
Sep 08 11:45:03.946961 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:03.946925    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk"]
Sep 08 11:45:03.947484 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:45:03.947459    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8d072db_8a1a_42c8_b3d3_b1f4611c9133.slice/crio-ca42a9d10f5255b9803d56430aa2284461b07a65608214c78e2e960d13966f7e WatchSource:0}: Error finding container ca42a9d10f5255b9803d56430aa2284461b07a65608214c78e2e960d13966f7e: Status 404 returned error can't find the container with id ca42a9d10f5255b9803d56430aa2284461b07a65608214c78e2e960d13966f7e
Sep 08 11:45:04.153526 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:04.153488    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk" event={"ID":"d8d072db-8a1a-42c8-b3d3-b1f4611c9133","Type":"ContainerStarted","Data":"ca42a9d10f5255b9803d56430aa2284461b07a65608214c78e2e960d13966f7e"}
Sep 08 11:45:05.161233 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:05.161198    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk" event={"ID":"d8d072db-8a1a-42c8-b3d3-b1f4611c9133","Type":"ContainerStarted","Data":"4b62a8047dd43608c982e9a37feb6da51fb6a8e5b7c2e048478ca0b42f228041"}
Sep 08 11:45:05.161745 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:05.161305    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk"
Sep 08 11:45:05.182291 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:05.182246    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk" podStartSLOduration=2.648521863 podStartE2EDuration="3.182232253s" totalImagesPullingTime="533.71039ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:45:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:45:05.180541042 +0000 UTC m=+879.832247856" watchObservedRunningTime="2026-09-08 11:45:05.182232253 +0000 UTC m=+879.833939046"
Sep 08 11:45:09.277733 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:09.277700    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-20cf96-6958956bd5-nkfr7"]
Sep 08 11:45:09.282315 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:09.282293    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-20cf96-6958956bd5-nkfr7"
Sep 08 11:45:09.285129 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:09.285098    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-20cf96\""
Sep 08 11:45:09.285273 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:09.285133    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-20cf96-dockercfg-m6qwf\""
Sep 08 11:45:09.290713 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:09.290679    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-20cf96-6958956bd5-nkfr7"]
Sep 08 11:45:09.389420 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:09.389378    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da8caaba-57da-46bf-b77a-dab2ba4dd4d1-plugins-config-volume\") pod \"payload-processing-e2e-explicit-20cf96-6958956bd5-nkfr7\" (UID: \"da8caaba-57da-46bf-b77a-dab2ba4dd4d1\") " pod="openshift-ingress/payload-processing-e2e-explicit-20cf96-6958956bd5-nkfr7"
Sep 08 11:45:09.389600 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:09.389461    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlknl\" (UniqueName: \"kubernetes.io/projected/da8caaba-57da-46bf-b77a-dab2ba4dd4d1-kube-api-access-mlknl\") pod \"payload-processing-e2e-explicit-20cf96-6958956bd5-nkfr7\" (UID: \"da8caaba-57da-46bf-b77a-dab2ba4dd4d1\") " pod="openshift-ingress/payload-processing-e2e-explicit-20cf96-6958956bd5-nkfr7"
Sep 08 11:45:09.490922 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:09.490888    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da8caaba-57da-46bf-b77a-dab2ba4dd4d1-plugins-config-volume\") pod \"payload-processing-e2e-explicit-20cf96-6958956bd5-nkfr7\" (UID: \"da8caaba-57da-46bf-b77a-dab2ba4dd4d1\") " pod="openshift-ingress/payload-processing-e2e-explicit-20cf96-6958956bd5-nkfr7"
Sep 08 11:45:09.491115 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:09.490940    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlknl\" (UniqueName: \"kubernetes.io/projected/da8caaba-57da-46bf-b77a-dab2ba4dd4d1-kube-api-access-mlknl\") pod \"payload-processing-e2e-explicit-20cf96-6958956bd5-nkfr7\" (UID: \"da8caaba-57da-46bf-b77a-dab2ba4dd4d1\") " pod="openshift-ingress/payload-processing-e2e-explicit-20cf96-6958956bd5-nkfr7"
Sep 08 11:45:09.491652 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:09.491628    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da8caaba-57da-46bf-b77a-dab2ba4dd4d1-plugins-config-volume\") pod \"payload-processing-e2e-explicit-20cf96-6958956bd5-nkfr7\" (UID: \"da8caaba-57da-46bf-b77a-dab2ba4dd4d1\") " pod="openshift-ingress/payload-processing-e2e-explicit-20cf96-6958956bd5-nkfr7"
Sep 08 11:45:09.501432 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:09.501411    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlknl\" (UniqueName: \"kubernetes.io/projected/da8caaba-57da-46bf-b77a-dab2ba4dd4d1-kube-api-access-mlknl\") pod \"payload-processing-e2e-explicit-20cf96-6958956bd5-nkfr7\" (UID: \"da8caaba-57da-46bf-b77a-dab2ba4dd4d1\") " pod="openshift-ingress/payload-processing-e2e-explicit-20cf96-6958956bd5-nkfr7"
Sep 08 11:45:09.595383 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:09.595295    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-20cf96-6958956bd5-nkfr7"
Sep 08 11:45:09.868896 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:09.868875    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-20cf96-6958956bd5-nkfr7"]
Sep 08 11:45:09.870442 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:45:09.870409    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda8caaba_57da_46bf_b77a_dab2ba4dd4d1.slice/crio-0af652e10d862d4be60079698ec5b135da4c59e966b0101ffebadbfb49223ddc WatchSource:0}: Error finding container 0af652e10d862d4be60079698ec5b135da4c59e966b0101ffebadbfb49223ddc: Status 404 returned error can't find the container with id 0af652e10d862d4be60079698ec5b135da4c59e966b0101ffebadbfb49223ddc
Sep 08 11:45:10.188638 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:10.188530    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-20cf96-6958956bd5-nkfr7" event={"ID":"da8caaba-57da-46bf-b77a-dab2ba4dd4d1","Type":"ContainerStarted","Data":"2d00d4700325cd3e926da358fb50067116b4e8d86b982e8b394cd6cef873f1d4"}
Sep 08 11:45:10.188872 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:10.188641    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-20cf96-6958956bd5-nkfr7" event={"ID":"da8caaba-57da-46bf-b77a-dab2ba4dd4d1","Type":"ContainerStarted","Data":"0af652e10d862d4be60079698ec5b135da4c59e966b0101ffebadbfb49223ddc"}
Sep 08 11:45:10.188872 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:10.188674    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-20cf96-6958956bd5-nkfr7"
Sep 08 11:45:10.212155 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:10.212094    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-20cf96-6958956bd5-nkfr7" podStartSLOduration=1.212075773 podStartE2EDuration="1.212075773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:45:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:45:10.208024699 +0000 UTC m=+884.859731514" watchObservedRunningTime="2026-09-08 11:45:10.212075773 +0000 UTC m=+884.863782567"
Sep 08 11:45:11.171792 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:11.171765    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk"
Sep 08 11:45:21.196511 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:21.196478    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-20cf96-6958956bd5-nkfr7"
Sep 08 11:45:22.255902 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:22.255818    2575 generic.go:356] "Generic (PLEG): container finished" podID="e6ab4d59-781d-419b-9f1c-7b986491b9a0" containerID="011938f5bad36f1e9ba90164f00dc7df848579e6064dc3bdfd9c5524b3f18c3e" exitCode=0
Sep 08 11:45:22.256277 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:22.255896    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf" event={"ID":"e6ab4d59-781d-419b-9f1c-7b986491b9a0","Type":"ContainerDied","Data":"011938f5bad36f1e9ba90164f00dc7df848579e6064dc3bdfd9c5524b3f18c3e"}
Sep 08 11:45:22.256277 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:22.256261    2575 scope.go:117] "RemoveContainer" containerID="011938f5bad36f1e9ba90164f00dc7df848579e6064dc3bdfd9c5524b3f18c3e"
Sep 08 11:45:22.257259 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:22.257236    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:45:22.257319 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:22.257296    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:45:22.257374 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:22.257356    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:45:23.263631 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:23.263596    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf" event={"ID":"e6ab4d59-781d-419b-9f1c-7b986491b9a0","Type":"ContainerStarted","Data":"bf6156563cb2b9d738f0de241c87cc0f95f694e808959137affc6bfc82c871aa"}
Sep 08 11:45:23.951361 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:23.951315    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"
Sep 08 11:45:23.951575 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:23.951543    2575 patch_prober.go:28] interesting pod/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 08 11:45:23.951654 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:23.951609    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf" podUID="e6ab4d59-781d-419b-9f1c-7b986491b9a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 08 11:45:24.951333 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:24.951296    2575 patch_prober.go:28] interesting pod/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 08 11:45:24.951822 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:24.951390    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf" podUID="e6ab4d59-781d-419b-9f1c-7b986491b9a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 08 11:45:25.897428 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:25.897398    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m57jb_63788019-f061-44d6-89a3-50c4a62e9fbf/ovn-acl-logging/0.log"
Sep 08 11:45:25.898105 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:25.898088    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m57jb_63788019-f061-44d6-89a3-50c4a62e9fbf/ovn-acl-logging/0.log"
Sep 08 11:45:25.951433 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:25.951401    2575 patch_prober.go:28] interesting pod/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 08 11:45:25.951767 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:25.951453    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf" podUID="e6ab4d59-781d-419b-9f1c-7b986491b9a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 08 11:45:26.952062 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:26.952024    2575 patch_prober.go:28] interesting pod/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 08 11:45:26.952470 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:26.952082    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf" podUID="e6ab4d59-781d-419b-9f1c-7b986491b9a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 08 11:45:27.951546 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:27.951511    2575 patch_prober.go:28] interesting pod/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 08 11:45:27.951719 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:27.951565    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf" podUID="e6ab4d59-781d-419b-9f1c-7b986491b9a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 08 11:45:28.951366 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:28.951306    2575 patch_prober.go:28] interesting pod/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 08 11:45:28.951828 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:28.951393    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf" podUID="e6ab4d59-781d-419b-9f1c-7b986491b9a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 08 11:45:29.956119 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:29.956088    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"
Sep 08 11:45:29.956541 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:29.956381    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"
Sep 08 11:45:29.957044 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:29.957027    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"
Sep 08 11:45:33.638389 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:33.638358    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk"]
Sep 08 11:45:33.638947 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:33.638590    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk" podUID="d8d072db-8a1a-42c8-b3d3-b1f4611c9133" containerName="maas-api" containerID="cri-o://4b62a8047dd43608c982e9a37feb6da51fb6a8e5b7c2e048478ca0b42f228041" gracePeriod=30
Sep 08 11:45:33.886594 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:33.886571    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk"
Sep 08 11:45:34.024806 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:34.024774    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"]
Sep 08 11:45:34.025045 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:34.025015    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf" podUID="e6ab4d59-781d-419b-9f1c-7b986491b9a0" containerName="istio-proxy" containerID="cri-o://bf6156563cb2b9d738f0de241c87cc0f95f694e808959137affc6bfc82c871aa" gracePeriod=30
Sep 08 11:45:34.054114 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:34.054085    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8d072db-8a1a-42c8-b3d3-b1f4611c9133-maas-api-tls\") pod \"d8d072db-8a1a-42c8-b3d3-b1f4611c9133\" (UID: \"d8d072db-8a1a-42c8-b3d3-b1f4611c9133\") "
Sep 08 11:45:34.054263 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:34.054137    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8d072db-8a1a-42c8-b3d3-b1f4611c9133-metrics-certs\") pod \"d8d072db-8a1a-42c8-b3d3-b1f4611c9133\" (UID: \"d8d072db-8a1a-42c8-b3d3-b1f4611c9133\") "
Sep 08 11:45:34.054263 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:34.054174    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khnsx\" (UniqueName: \"kubernetes.io/projected/d8d072db-8a1a-42c8-b3d3-b1f4611c9133-kube-api-access-khnsx\") pod \"d8d072db-8a1a-42c8-b3d3-b1f4611c9133\" (UID: \"d8d072db-8a1a-42c8-b3d3-b1f4611c9133\") "
Sep 08 11:45:34.054263 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:34.054237    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8d072db-8a1a-42c8-b3d3-b1f4611c9133-openshift-service-ca\") pod \"d8d072db-8a1a-42c8-b3d3-b1f4611c9133\" (UID: \"d8d072db-8a1a-42c8-b3d3-b1f4611c9133\") "
Sep 08 11:45:34.054629 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:34.054603    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8d072db-8a1a-42c8-b3d3-b1f4611c9133-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d8d072db-8a1a-42c8-b3d3-b1f4611c9133" (UID: "d8d072db-8a1a-42c8-b3d3-b1f4611c9133"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:45:34.056252 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:34.056227    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8d072db-8a1a-42c8-b3d3-b1f4611c9133-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d8d072db-8a1a-42c8-b3d3-b1f4611c9133" (UID: "d8d072db-8a1a-42c8-b3d3-b1f4611c9133"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:45:34.056812 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:34.056791    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8d072db-8a1a-42c8-b3d3-b1f4611c9133-kube-api-access-khnsx" (OuterVolumeSpecName: "kube-api-access-khnsx") pod "d8d072db-8a1a-42c8-b3d3-b1f4611c9133" (UID: "d8d072db-8a1a-42c8-b3d3-b1f4611c9133"). InnerVolumeSpecName "kube-api-access-khnsx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:45:34.056812 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:34.056793    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8d072db-8a1a-42c8-b3d3-b1f4611c9133-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d8d072db-8a1a-42c8-b3d3-b1f4611c9133" (UID: "d8d072db-8a1a-42c8-b3d3-b1f4611c9133"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:45:34.155946 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:34.155908    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8d072db-8a1a-42c8-b3d3-b1f4611c9133-openshift-service-ca\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:45:34.155946 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:34.155940    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8d072db-8a1a-42c8-b3d3-b1f4611c9133-maas-api-tls\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:45:34.155946 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:34.155950    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8d072db-8a1a-42c8-b3d3-b1f4611c9133-metrics-certs\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:45:34.156217 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:34.155958    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khnsx\" (UniqueName: \"kubernetes.io/projected/d8d072db-8a1a-42c8-b3d3-b1f4611c9133-kube-api-access-khnsx\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:45:34.336648 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:34.336566    2575 generic.go:356] "Generic (PLEG): container finished" podID="d8d072db-8a1a-42c8-b3d3-b1f4611c9133" containerID="4b62a8047dd43608c982e9a37feb6da51fb6a8e5b7c2e048478ca0b42f228041" exitCode=0
Sep 08 11:45:34.336648 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:34.336611    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk"
Sep 08 11:45:34.336648 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:34.336633    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk" event={"ID":"d8d072db-8a1a-42c8-b3d3-b1f4611c9133","Type":"ContainerDied","Data":"4b62a8047dd43608c982e9a37feb6da51fb6a8e5b7c2e048478ca0b42f228041"}
Sep 08 11:45:34.336848 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:34.336683    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk" event={"ID":"d8d072db-8a1a-42c8-b3d3-b1f4611c9133","Type":"ContainerDied","Data":"ca42a9d10f5255b9803d56430aa2284461b07a65608214c78e2e960d13966f7e"}
Sep 08 11:45:34.336848 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:34.336713    2575 scope.go:117] "RemoveContainer" containerID="4b62a8047dd43608c982e9a37feb6da51fb6a8e5b7c2e048478ca0b42f228041"
Sep 08 11:45:34.346266 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:34.346247    2575 scope.go:117] "RemoveContainer" containerID="4b62a8047dd43608c982e9a37feb6da51fb6a8e5b7c2e048478ca0b42f228041"
Sep 08 11:45:34.346553 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:45:34.346533    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b62a8047dd43608c982e9a37feb6da51fb6a8e5b7c2e048478ca0b42f228041\": container with ID starting with 4b62a8047dd43608c982e9a37feb6da51fb6a8e5b7c2e048478ca0b42f228041 not found: ID does not exist" containerID="4b62a8047dd43608c982e9a37feb6da51fb6a8e5b7c2e048478ca0b42f228041"
Sep 08 11:45:34.346604 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:34.346564    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b62a8047dd43608c982e9a37feb6da51fb6a8e5b7c2e048478ca0b42f228041"} err="failed to get container status \"4b62a8047dd43608c982e9a37feb6da51fb6a8e5b7c2e048478ca0b42f228041\": rpc error: code = NotFound desc = could not find container \"4b62a8047dd43608c982e9a37feb6da51fb6a8e5b7c2e048478ca0b42f228041\": container with ID starting with 4b62a8047dd43608c982e9a37feb6da51fb6a8e5b7c2e048478ca0b42f228041 not found: ID does not exist"
Sep 08 11:45:34.360601 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:34.360575    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk"]
Sep 08 11:45:34.364323 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:34.364304    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-46564b9d-6d75d544f8-n64vk"]
Sep 08 11:45:35.842093 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:35.842062    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8d072db-8a1a-42c8-b3d3-b1f4611c9133" path="/var/lib/kubelet/pods/d8d072db-8a1a-42c8-b3d3-b1f4611c9133/volumes"
Sep 08 11:45:39.288295 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:39.288232    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"
Sep 08 11:45:39.303542 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:39.303520    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6ab4d59-781d-419b-9f1c-7b986491b9a0-workload-certs\") pod \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\" (UID: \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\") "
Sep 08 11:45:39.303654 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:39.303550    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6ab4d59-781d-419b-9f1c-7b986491b9a0-istio-token\") pod \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\" (UID: \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\") "
Sep 08 11:45:39.303654 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:39.303572    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6ab4d59-781d-419b-9f1c-7b986491b9a0-istio-envoy\") pod \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\" (UID: \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\") "
Sep 08 11:45:39.303654 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:39.303594    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6ab4d59-781d-419b-9f1c-7b986491b9a0-istiod-ca-cert\") pod \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\" (UID: \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\") "
Sep 08 11:45:39.303654 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:39.303642    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkfl9\" (UniqueName: \"kubernetes.io/projected/e6ab4d59-781d-419b-9f1c-7b986491b9a0-kube-api-access-qkfl9\") pod \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\" (UID: \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\") "
Sep 08 11:45:39.303872 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:39.303670    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6ab4d59-781d-419b-9f1c-7b986491b9a0-istio-data\") pod \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\" (UID: \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\") "
Sep 08 11:45:39.303872 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:39.303724    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6ab4d59-781d-419b-9f1c-7b986491b9a0-istio-podinfo\") pod \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\" (UID: \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\") "
Sep 08 11:45:39.303872 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:39.303772    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6ab4d59-781d-419b-9f1c-7b986491b9a0-credential-socket\") pod \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\" (UID: \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\") "
Sep 08 11:45:39.303872 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:39.303789    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6ab4d59-781d-419b-9f1c-7b986491b9a0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e6ab4d59-781d-419b-9f1c-7b986491b9a0" (UID: "e6ab4d59-781d-419b-9f1c-7b986491b9a0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:45:39.303872 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:39.303825    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6ab4d59-781d-419b-9f1c-7b986491b9a0-workload-socket\") pod \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\" (UID: \"e6ab4d59-781d-419b-9f1c-7b986491b9a0\") "
Sep 08 11:45:39.304106 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:39.303966    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6ab4d59-781d-419b-9f1c-7b986491b9a0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e6ab4d59-781d-419b-9f1c-7b986491b9a0" (UID: "e6ab4d59-781d-419b-9f1c-7b986491b9a0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:45:39.304106 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:39.304050    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6ab4d59-781d-419b-9f1c-7b986491b9a0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e6ab4d59-781d-419b-9f1c-7b986491b9a0" (UID: "e6ab4d59-781d-419b-9f1c-7b986491b9a0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:45:39.304214 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:39.304192    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6ab4d59-781d-419b-9f1c-7b986491b9a0-credential-socket\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:45:39.304214 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:39.304210    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6ab4d59-781d-419b-9f1c-7b986491b9a0-workload-certs\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:45:39.304502 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:39.304223    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6ab4d59-781d-419b-9f1c-7b986491b9a0-istiod-ca-cert\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:45:39.304502 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:39.304212    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6ab4d59-781d-419b-9f1c-7b986491b9a0-istio-data" (OuterVolumeSpecName: "istio-data") pod "e6ab4d59-781d-419b-9f1c-7b986491b9a0" (UID: "e6ab4d59-781d-419b-9f1c-7b986491b9a0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:45:39.304502 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:39.304255    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6ab4d59-781d-419b-9f1c-7b986491b9a0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e6ab4d59-781d-419b-9f1c-7b986491b9a0" (UID: "e6ab4d59-781d-419b-9f1c-7b986491b9a0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:45:39.305968 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:39.305945    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6ab4d59-781d-419b-9f1c-7b986491b9a0-istio-token" (OuterVolumeSpecName: "istio-token") pod "e6ab4d59-781d-419b-9f1c-7b986491b9a0" (UID: "e6ab4d59-781d-419b-9f1c-7b986491b9a0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:45:39.306068 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:39.305960    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6ab4d59-781d-419b-9f1c-7b986491b9a0-kube-api-access-qkfl9" (OuterVolumeSpecName: "kube-api-access-qkfl9") pod "e6ab4d59-781d-419b-9f1c-7b986491b9a0" (UID: "e6ab4d59-781d-419b-9f1c-7b986491b9a0"). InnerVolumeSpecName "kube-api-access-qkfl9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:45:39.306068 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:39.305997    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e6ab4d59-781d-419b-9f1c-7b986491b9a0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e6ab4d59-781d-419b-9f1c-7b986491b9a0" (UID: "e6ab4d59-781d-419b-9f1c-7b986491b9a0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 11:45:39.306174 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:39.306158    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6ab4d59-781d-419b-9f1c-7b986491b9a0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e6ab4d59-781d-419b-9f1c-7b986491b9a0" (UID: "e6ab4d59-781d-419b-9f1c-7b986491b9a0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:45:39.364527 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:39.364492    2575 generic.go:356] "Generic (PLEG): container finished" podID="e6ab4d59-781d-419b-9f1c-7b986491b9a0" containerID="bf6156563cb2b9d738f0de241c87cc0f95f694e808959137affc6bfc82c871aa" exitCode=0
Sep 08 11:45:39.364700 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:39.364538    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"
Sep 08 11:45:39.364700 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:39.364576    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf" event={"ID":"e6ab4d59-781d-419b-9f1c-7b986491b9a0","Type":"ContainerDied","Data":"bf6156563cb2b9d738f0de241c87cc0f95f694e808959137affc6bfc82c871aa"}
Sep 08 11:45:39.364700 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:39.364633    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf" event={"ID":"e6ab4d59-781d-419b-9f1c-7b986491b9a0","Type":"ContainerDied","Data":"b8c43b96c4452702887fe5096b4974c4aa1eb65bb73e6dca1ee8868b2703a60e"}
Sep 08 11:45:39.364700 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:39.364656    2575 scope.go:117] "RemoveContainer" containerID="bf6156563cb2b9d738f0de241c87cc0f95f694e808959137affc6bfc82c871aa"
Sep 08 11:45:39.374565 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:39.374548    2575 scope.go:117] "RemoveContainer" containerID="011938f5bad36f1e9ba90164f00dc7df848579e6064dc3bdfd9c5524b3f18c3e"
Sep 08 11:45:39.382471 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:39.382458    2575 scope.go:117] "RemoveContainer" containerID="bf6156563cb2b9d738f0de241c87cc0f95f694e808959137affc6bfc82c871aa"
Sep 08 11:45:39.382721 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:45:39.382705    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf6156563cb2b9d738f0de241c87cc0f95f694e808959137affc6bfc82c871aa\": container with ID starting with bf6156563cb2b9d738f0de241c87cc0f95f694e808959137affc6bfc82c871aa not found: ID does not exist" containerID="bf6156563cb2b9d738f0de241c87cc0f95f694e808959137affc6bfc82c871aa"
Sep 08 11:45:39.382772 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:39.382728    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf6156563cb2b9d738f0de241c87cc0f95f694e808959137affc6bfc82c871aa"} err="failed to get container status \"bf6156563cb2b9d738f0de241c87cc0f95f694e808959137affc6bfc82c871aa\": rpc error: code = NotFound desc = could not find container \"bf6156563cb2b9d738f0de241c87cc0f95f694e808959137affc6bfc82c871aa\": container with ID starting with bf6156563cb2b9d738f0de241c87cc0f95f694e808959137affc6bfc82c871aa not found: ID does not exist"
Sep 08 11:45:39.382772 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:39.382742    2575 scope.go:117] "RemoveContainer" containerID="011938f5bad36f1e9ba90164f00dc7df848579e6064dc3bdfd9c5524b3f18c3e"
Sep 08 11:45:39.382995 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:45:39.382982    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"011938f5bad36f1e9ba90164f00dc7df848579e6064dc3bdfd9c5524b3f18c3e\": container with ID starting with 011938f5bad36f1e9ba90164f00dc7df848579e6064dc3bdfd9c5524b3f18c3e not found: ID does not exist" containerID="011938f5bad36f1e9ba90164f00dc7df848579e6064dc3bdfd9c5524b3f18c3e"
Sep 08 11:45:39.383034 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:39.382999    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"011938f5bad36f1e9ba90164f00dc7df848579e6064dc3bdfd9c5524b3f18c3e"} err="failed to get container status \"011938f5bad36f1e9ba90164f00dc7df848579e6064dc3bdfd9c5524b3f18c3e\": rpc error: code = NotFound desc = could not find container \"011938f5bad36f1e9ba90164f00dc7df848579e6064dc3bdfd9c5524b3f18c3e\": container with ID starting with 011938f5bad36f1e9ba90164f00dc7df848579e6064dc3bdfd9c5524b3f18c3e not found: ID does not exist"
Sep 08 11:45:39.393618 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:39.393596    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"]
Sep 08 11:45:39.400864 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:39.400839    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf"]
Sep 08 11:45:39.405020 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:39.405000    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6ab4d59-781d-419b-9f1c-7b986491b9a0-workload-socket\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:45:39.405084 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:39.405022    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6ab4d59-781d-419b-9f1c-7b986491b9a0-istio-token\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:45:39.405084 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:39.405032    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6ab4d59-781d-419b-9f1c-7b986491b9a0-istio-envoy\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:45:39.405084 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:39.405040    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkfl9\" (UniqueName: \"kubernetes.io/projected/e6ab4d59-781d-419b-9f1c-7b986491b9a0-kube-api-access-qkfl9\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:45:39.405084 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:39.405048    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6ab4d59-781d-419b-9f1c-7b986491b9a0-istio-data\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:45:39.405084 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:39.405056    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6ab4d59-781d-419b-9f1c-7b986491b9a0-istio-podinfo\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:45:39.842357 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:45:39.842303    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6ab4d59-781d-419b-9f1c-7b986491b9a0" path="/var/lib/kubelet/pods/e6ab4d59-781d-419b-9f1c-7b986491b9a0/volumes"
Sep 08 11:46:19.106240 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:19.106199    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-20cf96-6958956bd5-nkfr7"]
Sep 08 11:46:19.107108 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:19.106941    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-20cf96-6958956bd5-nkfr7" podUID="da8caaba-57da-46bf-b77a-dab2ba4dd4d1" containerName="payload-processing" containerID="cri-o://2d00d4700325cd3e926da358fb50067116b4e8d86b982e8b394cd6cef873f1d4" gracePeriod=30
Sep 08 11:46:19.357686 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:19.357624    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-20cf96-6958956bd5-nkfr7"
Sep 08 11:46:19.406893 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:19.406862    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlknl\" (UniqueName: \"kubernetes.io/projected/da8caaba-57da-46bf-b77a-dab2ba4dd4d1-kube-api-access-mlknl\") pod \"da8caaba-57da-46bf-b77a-dab2ba4dd4d1\" (UID: \"da8caaba-57da-46bf-b77a-dab2ba4dd4d1\") "
Sep 08 11:46:19.406893 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:19.406900    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da8caaba-57da-46bf-b77a-dab2ba4dd4d1-plugins-config-volume\") pod \"da8caaba-57da-46bf-b77a-dab2ba4dd4d1\" (UID: \"da8caaba-57da-46bf-b77a-dab2ba4dd4d1\") "
Sep 08 11:46:19.407389 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:19.407354    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da8caaba-57da-46bf-b77a-dab2ba4dd4d1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "da8caaba-57da-46bf-b77a-dab2ba4dd4d1" (UID: "da8caaba-57da-46bf-b77a-dab2ba4dd4d1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:46:19.409167 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:19.409137    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da8caaba-57da-46bf-b77a-dab2ba4dd4d1-kube-api-access-mlknl" (OuterVolumeSpecName: "kube-api-access-mlknl") pod "da8caaba-57da-46bf-b77a-dab2ba4dd4d1" (UID: "da8caaba-57da-46bf-b77a-dab2ba4dd4d1"). InnerVolumeSpecName "kube-api-access-mlknl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:46:19.507709 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:19.507678    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlknl\" (UniqueName: \"kubernetes.io/projected/da8caaba-57da-46bf-b77a-dab2ba4dd4d1-kube-api-access-mlknl\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:46:19.507709 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:19.507704    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da8caaba-57da-46bf-b77a-dab2ba4dd4d1-plugins-config-volume\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:46:19.580530 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:19.580498    2575 generic.go:356] "Generic (PLEG): container finished" podID="da8caaba-57da-46bf-b77a-dab2ba4dd4d1" containerID="2d00d4700325cd3e926da358fb50067116b4e8d86b982e8b394cd6cef873f1d4" exitCode=0
Sep 08 11:46:19.580721 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:19.580549    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-20cf96-6958956bd5-nkfr7"
Sep 08 11:46:19.580721 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:19.580582    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-20cf96-6958956bd5-nkfr7" event={"ID":"da8caaba-57da-46bf-b77a-dab2ba4dd4d1","Type":"ContainerDied","Data":"2d00d4700325cd3e926da358fb50067116b4e8d86b982e8b394cd6cef873f1d4"}
Sep 08 11:46:19.580721 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:19.580634    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-20cf96-6958956bd5-nkfr7" event={"ID":"da8caaba-57da-46bf-b77a-dab2ba4dd4d1","Type":"ContainerDied","Data":"0af652e10d862d4be60079698ec5b135da4c59e966b0101ffebadbfb49223ddc"}
Sep 08 11:46:19.580721 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:19.580656    2575 scope.go:117] "RemoveContainer" containerID="2d00d4700325cd3e926da358fb50067116b4e8d86b982e8b394cd6cef873f1d4"
Sep 08 11:46:19.590644 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:19.590629    2575 scope.go:117] "RemoveContainer" containerID="2d00d4700325cd3e926da358fb50067116b4e8d86b982e8b394cd6cef873f1d4"
Sep 08 11:46:19.590930 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:46:19.590912    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d00d4700325cd3e926da358fb50067116b4e8d86b982e8b394cd6cef873f1d4\": container with ID starting with 2d00d4700325cd3e926da358fb50067116b4e8d86b982e8b394cd6cef873f1d4 not found: ID does not exist" containerID="2d00d4700325cd3e926da358fb50067116b4e8d86b982e8b394cd6cef873f1d4"
Sep 08 11:46:19.590968 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:19.590940    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d00d4700325cd3e926da358fb50067116b4e8d86b982e8b394cd6cef873f1d4"} err="failed to get container status \"2d00d4700325cd3e926da358fb50067116b4e8d86b982e8b394cd6cef873f1d4\": rpc error: code = NotFound desc = could not find container \"2d00d4700325cd3e926da358fb50067116b4e8d86b982e8b394cd6cef873f1d4\": container with ID starting with 2d00d4700325cd3e926da358fb50067116b4e8d86b982e8b394cd6cef873f1d4 not found: ID does not exist"
Sep 08 11:46:19.604428 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:19.604405    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-20cf96-6958956bd5-nkfr7"]
Sep 08 11:46:19.609124 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:19.609062    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-20cf96-6958956bd5-nkfr7"]
Sep 08 11:46:19.841634 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:19.841601    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da8caaba-57da-46bf-b77a-dab2ba4dd4d1" path="/var/lib/kubelet/pods/da8caaba-57da-46bf-b77a-dab2ba4dd4d1/volumes"
Sep 08 11:46:28.367849 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.367813    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh"]
Sep 08 11:46:28.368545 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.368524    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6ab4d59-781d-419b-9f1c-7b986491b9a0" containerName="istio-proxy"
Sep 08 11:46:28.368599 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.368549    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6ab4d59-781d-419b-9f1c-7b986491b9a0" containerName="istio-proxy"
Sep 08 11:46:28.368599 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.368575    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da8caaba-57da-46bf-b77a-dab2ba4dd4d1" containerName="payload-processing"
Sep 08 11:46:28.368599 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.368583    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="da8caaba-57da-46bf-b77a-dab2ba4dd4d1" containerName="payload-processing"
Sep 08 11:46:28.368599 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.368595    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8d072db-8a1a-42c8-b3d3-b1f4611c9133" containerName="maas-api"
Sep 08 11:46:28.368728 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.368606    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8d072db-8a1a-42c8-b3d3-b1f4611c9133" containerName="maas-api"
Sep 08 11:46:28.368728 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.368712    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6ab4d59-781d-419b-9f1c-7b986491b9a0" containerName="istio-proxy"
Sep 08 11:46:28.368728 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.368722    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8d072db-8a1a-42c8-b3d3-b1f4611c9133" containerName="maas-api"
Sep 08 11:46:28.368820 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.368731    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="da8caaba-57da-46bf-b77a-dab2ba4dd4d1" containerName="payload-processing"
Sep 08 11:46:28.372357 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.372318    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh"
Sep 08 11:46:28.375152 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.375132    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-536240-openshift-default-dockercfg-55rsf\""
Sep 08 11:46:28.385425 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.385401    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh"]
Sep 08 11:46:28.493275 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.493241    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/455ce385-bb43-48ed-8290-b2351535810b-istiod-ca-cert\") pod \"e2e-noten-536240-openshift-default-5b558f7c56-t9hlh\" (UID: \"455ce385-bb43-48ed-8290-b2351535810b\") " pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh"
Sep 08 11:46:28.493275 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.493276    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/455ce385-bb43-48ed-8290-b2351535810b-istio-envoy\") pod \"e2e-noten-536240-openshift-default-5b558f7c56-t9hlh\" (UID: \"455ce385-bb43-48ed-8290-b2351535810b\") " pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh"
Sep 08 11:46:28.493514 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.493314    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/455ce385-bb43-48ed-8290-b2351535810b-workload-socket\") pod \"e2e-noten-536240-openshift-default-5b558f7c56-t9hlh\" (UID: \"455ce385-bb43-48ed-8290-b2351535810b\") " pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh"
Sep 08 11:46:28.493514 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.493429    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/455ce385-bb43-48ed-8290-b2351535810b-istio-podinfo\") pod \"e2e-noten-536240-openshift-default-5b558f7c56-t9hlh\" (UID: \"455ce385-bb43-48ed-8290-b2351535810b\") " pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh"
Sep 08 11:46:28.493514 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.493471    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/455ce385-bb43-48ed-8290-b2351535810b-istio-data\") pod \"e2e-noten-536240-openshift-default-5b558f7c56-t9hlh\" (UID: \"455ce385-bb43-48ed-8290-b2351535810b\") " pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh"
Sep 08 11:46:28.493514 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.493495    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/455ce385-bb43-48ed-8290-b2351535810b-istio-token\") pod \"e2e-noten-536240-openshift-default-5b558f7c56-t9hlh\" (UID: \"455ce385-bb43-48ed-8290-b2351535810b\") " pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh"
Sep 08 11:46:28.493514 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.493511    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtbhb\" (UniqueName: \"kubernetes.io/projected/455ce385-bb43-48ed-8290-b2351535810b-kube-api-access-jtbhb\") pod \"e2e-noten-536240-openshift-default-5b558f7c56-t9hlh\" (UID: \"455ce385-bb43-48ed-8290-b2351535810b\") " pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh"
Sep 08 11:46:28.493680 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.493542    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/455ce385-bb43-48ed-8290-b2351535810b-credential-socket\") pod \"e2e-noten-536240-openshift-default-5b558f7c56-t9hlh\" (UID: \"455ce385-bb43-48ed-8290-b2351535810b\") " pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh"
Sep 08 11:46:28.493680 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.493595    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/455ce385-bb43-48ed-8290-b2351535810b-workload-certs\") pod \"e2e-noten-536240-openshift-default-5b558f7c56-t9hlh\" (UID: \"455ce385-bb43-48ed-8290-b2351535810b\") " pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh"
Sep 08 11:46:28.594801 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.594746    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/455ce385-bb43-48ed-8290-b2351535810b-istio-token\") pod \"e2e-noten-536240-openshift-default-5b558f7c56-t9hlh\" (UID: \"455ce385-bb43-48ed-8290-b2351535810b\") " pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh"
Sep 08 11:46:28.594801 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.594805    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtbhb\" (UniqueName: \"kubernetes.io/projected/455ce385-bb43-48ed-8290-b2351535810b-kube-api-access-jtbhb\") pod \"e2e-noten-536240-openshift-default-5b558f7c56-t9hlh\" (UID: \"455ce385-bb43-48ed-8290-b2351535810b\") " pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh"
Sep 08 11:46:28.595048 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.594842    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/455ce385-bb43-48ed-8290-b2351535810b-credential-socket\") pod \"e2e-noten-536240-openshift-default-5b558f7c56-t9hlh\" (UID: \"455ce385-bb43-48ed-8290-b2351535810b\") " pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh"
Sep 08 11:46:28.595048 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.594878    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/455ce385-bb43-48ed-8290-b2351535810b-workload-certs\") pod \"e2e-noten-536240-openshift-default-5b558f7c56-t9hlh\" (UID: \"455ce385-bb43-48ed-8290-b2351535810b\") " pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh"
Sep 08 11:46:28.595048 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.595016    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/455ce385-bb43-48ed-8290-b2351535810b-istiod-ca-cert\") pod \"e2e-noten-536240-openshift-default-5b558f7c56-t9hlh\" (UID: \"455ce385-bb43-48ed-8290-b2351535810b\") " pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh"
Sep 08 11:46:28.595194 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.595055    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/455ce385-bb43-48ed-8290-b2351535810b-istio-envoy\") pod \"e2e-noten-536240-openshift-default-5b558f7c56-t9hlh\" (UID: \"455ce385-bb43-48ed-8290-b2351535810b\") " pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh"
Sep 08 11:46:28.595194 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.595090    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/455ce385-bb43-48ed-8290-b2351535810b-workload-socket\") pod \"e2e-noten-536240-openshift-default-5b558f7c56-t9hlh\" (UID: \"455ce385-bb43-48ed-8290-b2351535810b\") " pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh"
Sep 08 11:46:28.595194 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.595189    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/455ce385-bb43-48ed-8290-b2351535810b-istio-podinfo\") pod \"e2e-noten-536240-openshift-default-5b558f7c56-t9hlh\" (UID: \"455ce385-bb43-48ed-8290-b2351535810b\") " pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh"
Sep 08 11:46:28.595385 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.595231    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/455ce385-bb43-48ed-8290-b2351535810b-istio-data\") pod \"e2e-noten-536240-openshift-default-5b558f7c56-t9hlh\" (UID: \"455ce385-bb43-48ed-8290-b2351535810b\") " pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh"
Sep 08 11:46:28.595457 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.595397    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/455ce385-bb43-48ed-8290-b2351535810b-credential-socket\") pod \"e2e-noten-536240-openshift-default-5b558f7c56-t9hlh\" (UID: \"455ce385-bb43-48ed-8290-b2351535810b\") " pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh"
Sep 08 11:46:28.595516 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.595501    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/455ce385-bb43-48ed-8290-b2351535810b-workload-certs\") pod \"e2e-noten-536240-openshift-default-5b558f7c56-t9hlh\" (UID: \"455ce385-bb43-48ed-8290-b2351535810b\") " pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh"
Sep 08 11:46:28.595560 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.595542    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/455ce385-bb43-48ed-8290-b2351535810b-workload-socket\") pod \"e2e-noten-536240-openshift-default-5b558f7c56-t9hlh\" (UID: \"455ce385-bb43-48ed-8290-b2351535810b\") " pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh"
Sep 08 11:46:28.595601 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.595565    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/455ce385-bb43-48ed-8290-b2351535810b-istio-data\") pod \"e2e-noten-536240-openshift-default-5b558f7c56-t9hlh\" (UID: \"455ce385-bb43-48ed-8290-b2351535810b\") " pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh"
Sep 08 11:46:28.595692 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.595675    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/455ce385-bb43-48ed-8290-b2351535810b-istiod-ca-cert\") pod \"e2e-noten-536240-openshift-default-5b558f7c56-t9hlh\" (UID: \"455ce385-bb43-48ed-8290-b2351535810b\") " pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh"
Sep 08 11:46:28.597594 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.597571    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/455ce385-bb43-48ed-8290-b2351535810b-istio-envoy\") pod \"e2e-noten-536240-openshift-default-5b558f7c56-t9hlh\" (UID: \"455ce385-bb43-48ed-8290-b2351535810b\") " pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh"
Sep 08 11:46:28.597722 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.597705    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/455ce385-bb43-48ed-8290-b2351535810b-istio-podinfo\") pod \"e2e-noten-536240-openshift-default-5b558f7c56-t9hlh\" (UID: \"455ce385-bb43-48ed-8290-b2351535810b\") " pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh"
Sep 08 11:46:28.604642 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.604609    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/455ce385-bb43-48ed-8290-b2351535810b-istio-token\") pod \"e2e-noten-536240-openshift-default-5b558f7c56-t9hlh\" (UID: \"455ce385-bb43-48ed-8290-b2351535810b\") " pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh"
Sep 08 11:46:28.604752 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.604654    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtbhb\" (UniqueName: \"kubernetes.io/projected/455ce385-bb43-48ed-8290-b2351535810b-kube-api-access-jtbhb\") pod \"e2e-noten-536240-openshift-default-5b558f7c56-t9hlh\" (UID: \"455ce385-bb43-48ed-8290-b2351535810b\") " pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh"
Sep 08 11:46:28.683660 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.683576    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh"
Sep 08 11:46:28.996195 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:28.996166    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh"]
Sep 08 11:46:28.998369 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:46:28.998326    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod455ce385_bb43_48ed_8290_b2351535810b.slice/crio-abd50511fcb56ccb548371846b59994b34f4d7351aba59d568719d48556cac33 WatchSource:0}: Error finding container abd50511fcb56ccb548371846b59994b34f4d7351aba59d568719d48556cac33: Status 404 returned error can't find the container with id abd50511fcb56ccb548371846b59994b34f4d7351aba59d568719d48556cac33
Sep 08 11:46:29.001018 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:29.000989    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:46:29.001090 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:29.001056    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:46:29.001090 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:29.001082    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:46:29.646739 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:29.646698    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh" event={"ID":"455ce385-bb43-48ed-8290-b2351535810b","Type":"ContainerStarted","Data":"416cda6ad2d5ee68d957c8917d106c544de8ca27013d7784b3e51deddd59cbed"}
Sep 08 11:46:29.647124 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:29.646780    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh" event={"ID":"455ce385-bb43-48ed-8290-b2351535810b","Type":"ContainerStarted","Data":"abd50511fcb56ccb548371846b59994b34f4d7351aba59d568719d48556cac33"}
Sep 08 11:46:29.673917 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:29.673859    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh" podStartSLOduration=1.673844329 podStartE2EDuration="1.673844329s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:46:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:46:29.672806169 +0000 UTC m=+964.324512974" watchObservedRunningTime="2026-09-08 11:46:29.673844329 +0000 UTC m=+964.325551122"
Sep 08 11:46:29.684324 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:29.684290    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh"
Sep 08 11:46:30.689812 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:30.689777    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh"
Sep 08 11:46:31.657470 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:31.657440    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh"
Sep 08 11:46:31.658441 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:31.658420    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh"
Sep 08 11:46:36.936505 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:36.936467    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs"]
Sep 08 11:46:36.936941 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:36.936668    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs" podUID="088f99a1-9124-48de-9d7e-d18743e2a9ee" containerName="maas-api" containerID="cri-o://3834c61efa7e4d905f67f6277fce684e30c1b61f06cf5403617583a1a0ebd76a" gracePeriod=30
Sep 08 11:46:37.195022 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:37.194967    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs"
Sep 08 11:46:37.283533 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:37.283506    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hb64\" (UniqueName: \"kubernetes.io/projected/088f99a1-9124-48de-9d7e-d18743e2a9ee-kube-api-access-9hb64\") pod \"088f99a1-9124-48de-9d7e-d18743e2a9ee\" (UID: \"088f99a1-9124-48de-9d7e-d18743e2a9ee\") "
Sep 08 11:46:37.283734 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:37.283557    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/088f99a1-9124-48de-9d7e-d18743e2a9ee-maas-api-tls\") pod \"088f99a1-9124-48de-9d7e-d18743e2a9ee\" (UID: \"088f99a1-9124-48de-9d7e-d18743e2a9ee\") "
Sep 08 11:46:37.283734 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:37.283602    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/088f99a1-9124-48de-9d7e-d18743e2a9ee-openshift-service-ca\") pod \"088f99a1-9124-48de-9d7e-d18743e2a9ee\" (UID: \"088f99a1-9124-48de-9d7e-d18743e2a9ee\") "
Sep 08 11:46:37.283734 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:37.283698    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/088f99a1-9124-48de-9d7e-d18743e2a9ee-metrics-certs\") pod \"088f99a1-9124-48de-9d7e-d18743e2a9ee\" (UID: \"088f99a1-9124-48de-9d7e-d18743e2a9ee\") "
Sep 08 11:46:37.284068 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:37.284044    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/088f99a1-9124-48de-9d7e-d18743e2a9ee-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "088f99a1-9124-48de-9d7e-d18743e2a9ee" (UID: "088f99a1-9124-48de-9d7e-d18743e2a9ee"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:46:37.285909 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:37.285873    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/088f99a1-9124-48de-9d7e-d18743e2a9ee-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "088f99a1-9124-48de-9d7e-d18743e2a9ee" (UID: "088f99a1-9124-48de-9d7e-d18743e2a9ee"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:46:37.286011 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:37.285931    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/088f99a1-9124-48de-9d7e-d18743e2a9ee-kube-api-access-9hb64" (OuterVolumeSpecName: "kube-api-access-9hb64") pod "088f99a1-9124-48de-9d7e-d18743e2a9ee" (UID: "088f99a1-9124-48de-9d7e-d18743e2a9ee"). InnerVolumeSpecName "kube-api-access-9hb64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:46:37.286011 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:37.285953    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/088f99a1-9124-48de-9d7e-d18743e2a9ee-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "088f99a1-9124-48de-9d7e-d18743e2a9ee" (UID: "088f99a1-9124-48de-9d7e-d18743e2a9ee"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:46:37.385448 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:37.385414    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/088f99a1-9124-48de-9d7e-d18743e2a9ee-metrics-certs\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:46:37.385448 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:37.385443    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hb64\" (UniqueName: \"kubernetes.io/projected/088f99a1-9124-48de-9d7e-d18743e2a9ee-kube-api-access-9hb64\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:46:37.385448 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:37.385452    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/088f99a1-9124-48de-9d7e-d18743e2a9ee-maas-api-tls\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:46:37.385663 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:37.385461    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/088f99a1-9124-48de-9d7e-d18743e2a9ee-openshift-service-ca\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:46:37.689624 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:37.689587    2575 generic.go:356] "Generic (PLEG): container finished" podID="088f99a1-9124-48de-9d7e-d18743e2a9ee" containerID="3834c61efa7e4d905f67f6277fce684e30c1b61f06cf5403617583a1a0ebd76a" exitCode=0
Sep 08 11:46:37.689833 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:37.689632    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs" event={"ID":"088f99a1-9124-48de-9d7e-d18743e2a9ee","Type":"ContainerDied","Data":"3834c61efa7e4d905f67f6277fce684e30c1b61f06cf5403617583a1a0ebd76a"}
Sep 08 11:46:37.689833 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:37.689681    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs" event={"ID":"088f99a1-9124-48de-9d7e-d18743e2a9ee","Type":"ContainerDied","Data":"57353c078454095a2b2b59c565b5c24ada581fda81cc7b96424f1c0f6fa6cc49"}
Sep 08 11:46:37.689833 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:37.689637    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs"
Sep 08 11:46:37.689833 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:37.689712    2575 scope.go:117] "RemoveContainer" containerID="3834c61efa7e4d905f67f6277fce684e30c1b61f06cf5403617583a1a0ebd76a"
Sep 08 11:46:37.699139 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:37.699117    2575 scope.go:117] "RemoveContainer" containerID="3834c61efa7e4d905f67f6277fce684e30c1b61f06cf5403617583a1a0ebd76a"
Sep 08 11:46:37.699422 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:46:37.699400    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3834c61efa7e4d905f67f6277fce684e30c1b61f06cf5403617583a1a0ebd76a\": container with ID starting with 3834c61efa7e4d905f67f6277fce684e30c1b61f06cf5403617583a1a0ebd76a not found: ID does not exist" containerID="3834c61efa7e4d905f67f6277fce684e30c1b61f06cf5403617583a1a0ebd76a"
Sep 08 11:46:37.699512 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:37.699429    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3834c61efa7e4d905f67f6277fce684e30c1b61f06cf5403617583a1a0ebd76a"} err="failed to get container status \"3834c61efa7e4d905f67f6277fce684e30c1b61f06cf5403617583a1a0ebd76a\": rpc error: code = NotFound desc = could not find container \"3834c61efa7e4d905f67f6277fce684e30c1b61f06cf5403617583a1a0ebd76a\": container with ID starting with 3834c61efa7e4d905f67f6277fce684e30c1b61f06cf5403617583a1a0ebd76a not found: ID does not exist"
Sep 08 11:46:37.715081 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:37.715055    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs"]
Sep 08 11:46:37.717133 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:37.717113    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-95669b-84549d6d57-wnmqs"]
Sep 08 11:46:37.842327 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:37.842295    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="088f99a1-9124-48de-9d7e-d18743e2a9ee" path="/var/lib/kubelet/pods/088f99a1-9124-48de-9d7e-d18743e2a9ee/volumes"
Sep 08 11:46:44.975844 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:44.975811    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"]
Sep 08 11:46:44.976247 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:44.976053    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8" podUID="a7cca131-5a8c-41e2-860b-fc2277495a2c" containerName="istio-proxy" containerID="cri-o://709700c393848c7f32efcee8efff112bcb76260f9899cb3b544b59aa5ce623b5" gracePeriod=30
Sep 08 11:46:45.911084 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:45.911040    2575 patch_prober.go:28] interesting pod/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 11:46:45.911251 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:45.911100    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8" podUID="a7cca131-5a8c-41e2-860b-fc2277495a2c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 11:46:50.230422 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:50.230390    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"
Sep 08 11:46:50.416977 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:50.416948    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7cca131-5a8c-41e2-860b-fc2277495a2c-credential-socket\") pod \"a7cca131-5a8c-41e2-860b-fc2277495a2c\" (UID: \"a7cca131-5a8c-41e2-860b-fc2277495a2c\") "
Sep 08 11:46:50.417154 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:50.416991    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7cca131-5a8c-41e2-860b-fc2277495a2c-istio-token\") pod \"a7cca131-5a8c-41e2-860b-fc2277495a2c\" (UID: \"a7cca131-5a8c-41e2-860b-fc2277495a2c\") "
Sep 08 11:46:50.417154 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:50.417057    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f2zfq\" (UniqueName: \"kubernetes.io/projected/a7cca131-5a8c-41e2-860b-fc2277495a2c-kube-api-access-f2zfq\") pod \"a7cca131-5a8c-41e2-860b-fc2277495a2c\" (UID: \"a7cca131-5a8c-41e2-860b-fc2277495a2c\") "
Sep 08 11:46:50.417154 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:50.417085    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7cca131-5a8c-41e2-860b-fc2277495a2c-istio-data\") pod \"a7cca131-5a8c-41e2-860b-fc2277495a2c\" (UID: \"a7cca131-5a8c-41e2-860b-fc2277495a2c\") "
Sep 08 11:46:50.417154 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:50.417115    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7cca131-5a8c-41e2-860b-fc2277495a2c-workload-certs\") pod \"a7cca131-5a8c-41e2-860b-fc2277495a2c\" (UID: \"a7cca131-5a8c-41e2-860b-fc2277495a2c\") "
Sep 08 11:46:50.417391 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:50.417192    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7cca131-5a8c-41e2-860b-fc2277495a2c-istio-podinfo\") pod \"a7cca131-5a8c-41e2-860b-fc2277495a2c\" (UID: \"a7cca131-5a8c-41e2-860b-fc2277495a2c\") "
Sep 08 11:46:50.417391 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:50.417224    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7cca131-5a8c-41e2-860b-fc2277495a2c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a7cca131-5a8c-41e2-860b-fc2277495a2c" (UID: "a7cca131-5a8c-41e2-860b-fc2277495a2c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:46:50.417391 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:50.417243    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7cca131-5a8c-41e2-860b-fc2277495a2c-workload-socket\") pod \"a7cca131-5a8c-41e2-860b-fc2277495a2c\" (UID: \"a7cca131-5a8c-41e2-860b-fc2277495a2c\") "
Sep 08 11:46:50.417391 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:50.417306    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7cca131-5a8c-41e2-860b-fc2277495a2c-istio-envoy\") pod \"a7cca131-5a8c-41e2-860b-fc2277495a2c\" (UID: \"a7cca131-5a8c-41e2-860b-fc2277495a2c\") "
Sep 08 11:46:50.417391 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:50.417363    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7cca131-5a8c-41e2-860b-fc2277495a2c-istiod-ca-cert\") pod \"a7cca131-5a8c-41e2-860b-fc2277495a2c\" (UID: \"a7cca131-5a8c-41e2-860b-fc2277495a2c\") "
Sep 08 11:46:50.417644 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:50.417432    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7cca131-5a8c-41e2-860b-fc2277495a2c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a7cca131-5a8c-41e2-860b-fc2277495a2c" (UID: "a7cca131-5a8c-41e2-860b-fc2277495a2c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:46:50.417644 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:50.417448    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7cca131-5a8c-41e2-860b-fc2277495a2c-istio-data" (OuterVolumeSpecName: "istio-data") pod "a7cca131-5a8c-41e2-860b-fc2277495a2c" (UID: "a7cca131-5a8c-41e2-860b-fc2277495a2c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:46:50.417644 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:50.417609    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7cca131-5a8c-41e2-860b-fc2277495a2c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a7cca131-5a8c-41e2-860b-fc2277495a2c" (UID: "a7cca131-5a8c-41e2-860b-fc2277495a2c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:46:50.417770 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:50.417748    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7cca131-5a8c-41e2-860b-fc2277495a2c-credential-socket\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:46:50.417770 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:50.417769    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7cca131-5a8c-41e2-860b-fc2277495a2c-istio-data\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:46:50.417850 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:50.417782    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7cca131-5a8c-41e2-860b-fc2277495a2c-workload-certs\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:46:50.417850 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:50.417794    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7cca131-5a8c-41e2-860b-fc2277495a2c-workload-socket\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:46:50.417850 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:50.417830    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7cca131-5a8c-41e2-860b-fc2277495a2c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a7cca131-5a8c-41e2-860b-fc2277495a2c" (UID: "a7cca131-5a8c-41e2-860b-fc2277495a2c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:46:50.419626 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:50.419601    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7cca131-5a8c-41e2-860b-fc2277495a2c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a7cca131-5a8c-41e2-860b-fc2277495a2c" (UID: "a7cca131-5a8c-41e2-860b-fc2277495a2c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:46:50.419626 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:50.419619    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7cca131-5a8c-41e2-860b-fc2277495a2c-istio-token" (OuterVolumeSpecName: "istio-token") pod "a7cca131-5a8c-41e2-860b-fc2277495a2c" (UID: "a7cca131-5a8c-41e2-860b-fc2277495a2c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:46:50.419898 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:50.419879    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a7cca131-5a8c-41e2-860b-fc2277495a2c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a7cca131-5a8c-41e2-860b-fc2277495a2c" (UID: "a7cca131-5a8c-41e2-860b-fc2277495a2c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 11:46:50.419957 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:50.419892    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7cca131-5a8c-41e2-860b-fc2277495a2c-kube-api-access-f2zfq" (OuterVolumeSpecName: "kube-api-access-f2zfq") pod "a7cca131-5a8c-41e2-860b-fc2277495a2c" (UID: "a7cca131-5a8c-41e2-860b-fc2277495a2c"). InnerVolumeSpecName "kube-api-access-f2zfq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:46:50.518485 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:50.518452    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2zfq\" (UniqueName: \"kubernetes.io/projected/a7cca131-5a8c-41e2-860b-fc2277495a2c-kube-api-access-f2zfq\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:46:50.518485 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:50.518482    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7cca131-5a8c-41e2-860b-fc2277495a2c-istio-podinfo\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:46:50.518485 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:50.518492    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7cca131-5a8c-41e2-860b-fc2277495a2c-istio-envoy\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:46:50.518729 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:50.518501    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7cca131-5a8c-41e2-860b-fc2277495a2c-istiod-ca-cert\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:46:50.518729 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:50.518508    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7cca131-5a8c-41e2-860b-fc2277495a2c-istio-token\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:46:50.759461 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:50.759373    2575 generic.go:356] "Generic (PLEG): container finished" podID="a7cca131-5a8c-41e2-860b-fc2277495a2c" containerID="709700c393848c7f32efcee8efff112bcb76260f9899cb3b544b59aa5ce623b5" exitCode=0
Sep 08 11:46:50.759461 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:50.759421    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"
Sep 08 11:46:50.759461 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:50.759432    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8" event={"ID":"a7cca131-5a8c-41e2-860b-fc2277495a2c","Type":"ContainerDied","Data":"709700c393848c7f32efcee8efff112bcb76260f9899cb3b544b59aa5ce623b5"}
Sep 08 11:46:50.759731 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:50.759484    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8" event={"ID":"a7cca131-5a8c-41e2-860b-fc2277495a2c","Type":"ContainerDied","Data":"2ecf0748064a31dea5065cb520cb3660e36c06da7c229a48e2d622e9fb8282be"}
Sep 08 11:46:50.759731 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:50.759506    2575 scope.go:117] "RemoveContainer" containerID="709700c393848c7f32efcee8efff112bcb76260f9899cb3b544b59aa5ce623b5"
Sep 08 11:46:50.769427 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:50.769405    2575 scope.go:117] "RemoveContainer" containerID="bfea41053a147c4fe160d52392271b45017ec9a51c7496788c647abd6c7cdac7"
Sep 08 11:46:50.778558 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:50.778532    2575 scope.go:117] "RemoveContainer" containerID="709700c393848c7f32efcee8efff112bcb76260f9899cb3b544b59aa5ce623b5"
Sep 08 11:46:50.778855 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:46:50.778837    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"709700c393848c7f32efcee8efff112bcb76260f9899cb3b544b59aa5ce623b5\": container with ID starting with 709700c393848c7f32efcee8efff112bcb76260f9899cb3b544b59aa5ce623b5 not found: ID does not exist" containerID="709700c393848c7f32efcee8efff112bcb76260f9899cb3b544b59aa5ce623b5"
Sep 08 11:46:50.778910 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:50.778865    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"709700c393848c7f32efcee8efff112bcb76260f9899cb3b544b59aa5ce623b5"} err="failed to get container status \"709700c393848c7f32efcee8efff112bcb76260f9899cb3b544b59aa5ce623b5\": rpc error: code = NotFound desc = could not find container \"709700c393848c7f32efcee8efff112bcb76260f9899cb3b544b59aa5ce623b5\": container with ID starting with 709700c393848c7f32efcee8efff112bcb76260f9899cb3b544b59aa5ce623b5 not found: ID does not exist"
Sep 08 11:46:50.778910 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:50.778881    2575 scope.go:117] "RemoveContainer" containerID="bfea41053a147c4fe160d52392271b45017ec9a51c7496788c647abd6c7cdac7"
Sep 08 11:46:50.779111 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:46:50.779095    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfea41053a147c4fe160d52392271b45017ec9a51c7496788c647abd6c7cdac7\": container with ID starting with bfea41053a147c4fe160d52392271b45017ec9a51c7496788c647abd6c7cdac7 not found: ID does not exist" containerID="bfea41053a147c4fe160d52392271b45017ec9a51c7496788c647abd6c7cdac7"
Sep 08 11:46:50.779156 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:50.779117    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfea41053a147c4fe160d52392271b45017ec9a51c7496788c647abd6c7cdac7"} err="failed to get container status \"bfea41053a147c4fe160d52392271b45017ec9a51c7496788c647abd6c7cdac7\": rpc error: code = NotFound desc = could not find container \"bfea41053a147c4fe160d52392271b45017ec9a51c7496788c647abd6c7cdac7\": container with ID starting with bfea41053a147c4fe160d52392271b45017ec9a51c7496788c647abd6c7cdac7 not found: ID does not exist"
Sep 08 11:46:50.783915 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:50.783892    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"]
Sep 08 11:46:50.789194 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:50.789170    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8"]
Sep 08 11:46:51.841783 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:51.841753    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7cca131-5a8c-41e2-860b-fc2277495a2c" path="/var/lib/kubelet/pods/a7cca131-5a8c-41e2-860b-fc2277495a2c/volumes"
Sep 08 11:46:55.897283 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:55.897243    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-425b2c-854978865d-mksn4"]
Sep 08 11:46:55.897700 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:55.897543    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-425b2c-854978865d-mksn4" podUID="b2e2eebe-dd6e-44ec-8c02-badbc022f774" containerName="payload-pre-processing" containerID="cri-o://35d0a041254e106c29d5598c0f0c5b6455e454d8f0c1d5c0cd882254b1798ff0" gracePeriod=30
Sep 08 11:46:56.150563 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:56.150510    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-425b2c-854978865d-mksn4"
Sep 08 11:46:56.173733 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:56.173705    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9vdl\" (UniqueName: \"kubernetes.io/projected/b2e2eebe-dd6e-44ec-8c02-badbc022f774-kube-api-access-v9vdl\") pod \"b2e2eebe-dd6e-44ec-8c02-badbc022f774\" (UID: \"b2e2eebe-dd6e-44ec-8c02-badbc022f774\") "
Sep 08 11:46:56.173861 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:56.173816    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2e2eebe-dd6e-44ec-8c02-badbc022f774-plugins-config-volume\") pod \"b2e2eebe-dd6e-44ec-8c02-badbc022f774\" (UID: \"b2e2eebe-dd6e-44ec-8c02-badbc022f774\") "
Sep 08 11:46:56.174248 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:56.174217    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2e2eebe-dd6e-44ec-8c02-badbc022f774-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b2e2eebe-dd6e-44ec-8c02-badbc022f774" (UID: "b2e2eebe-dd6e-44ec-8c02-badbc022f774"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:46:56.175961 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:56.175933    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2e2eebe-dd6e-44ec-8c02-badbc022f774-kube-api-access-v9vdl" (OuterVolumeSpecName: "kube-api-access-v9vdl") pod "b2e2eebe-dd6e-44ec-8c02-badbc022f774" (UID: "b2e2eebe-dd6e-44ec-8c02-badbc022f774"). InnerVolumeSpecName "kube-api-access-v9vdl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:46:56.275452 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:56.275416    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9vdl\" (UniqueName: \"kubernetes.io/projected/b2e2eebe-dd6e-44ec-8c02-badbc022f774-kube-api-access-v9vdl\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:46:56.275452 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:56.275444    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2e2eebe-dd6e-44ec-8c02-badbc022f774-plugins-config-volume\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:46:56.792553 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:56.792518    2575 generic.go:356] "Generic (PLEG): container finished" podID="b2e2eebe-dd6e-44ec-8c02-badbc022f774" containerID="35d0a041254e106c29d5598c0f0c5b6455e454d8f0c1d5c0cd882254b1798ff0" exitCode=0
Sep 08 11:46:56.792724 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:56.792566    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-425b2c-854978865d-mksn4" event={"ID":"b2e2eebe-dd6e-44ec-8c02-badbc022f774","Type":"ContainerDied","Data":"35d0a041254e106c29d5598c0f0c5b6455e454d8f0c1d5c0cd882254b1798ff0"}
Sep 08 11:46:56.792724 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:56.792568    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-425b2c-854978865d-mksn4"
Sep 08 11:46:56.792724 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:56.792605    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-425b2c-854978865d-mksn4" event={"ID":"b2e2eebe-dd6e-44ec-8c02-badbc022f774","Type":"ContainerDied","Data":"bce4fca459c4fa36d9ea80a62d4d4dca0744f112f5c613d6ab59280de8bf1ac6"}
Sep 08 11:46:56.792724 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:56.792628    2575 scope.go:117] "RemoveContainer" containerID="35d0a041254e106c29d5598c0f0c5b6455e454d8f0c1d5c0cd882254b1798ff0"
Sep 08 11:46:56.801673 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:56.801655    2575 scope.go:117] "RemoveContainer" containerID="35d0a041254e106c29d5598c0f0c5b6455e454d8f0c1d5c0cd882254b1798ff0"
Sep 08 11:46:56.801933 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:46:56.801916    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35d0a041254e106c29d5598c0f0c5b6455e454d8f0c1d5c0cd882254b1798ff0\": container with ID starting with 35d0a041254e106c29d5598c0f0c5b6455e454d8f0c1d5c0cd882254b1798ff0 not found: ID does not exist" containerID="35d0a041254e106c29d5598c0f0c5b6455e454d8f0c1d5c0cd882254b1798ff0"
Sep 08 11:46:56.801976 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:56.801940    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35d0a041254e106c29d5598c0f0c5b6455e454d8f0c1d5c0cd882254b1798ff0"} err="failed to get container status \"35d0a041254e106c29d5598c0f0c5b6455e454d8f0c1d5c0cd882254b1798ff0\": rpc error: code = NotFound desc = could not find container \"35d0a041254e106c29d5598c0f0c5b6455e454d8f0c1d5c0cd882254b1798ff0\": container with ID starting with 35d0a041254e106c29d5598c0f0c5b6455e454d8f0c1d5c0cd882254b1798ff0 not found: ID does not exist"
Sep 08 11:46:56.815593 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:56.815567    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-425b2c-854978865d-mksn4"]
Sep 08 11:46:56.821770 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:56.821746    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-425b2c-854978865d-mksn4"]
Sep 08 11:46:57.841516 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:46:57.841486    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2e2eebe-dd6e-44ec-8c02-badbc022f774" path="/var/lib/kubelet/pods/b2e2eebe-dd6e-44ec-8c02-badbc022f774/volumes"
Sep 08 11:47:09.133641 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:09.133600    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk"]
Sep 08 11:47:09.134304 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:09.134285    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7cca131-5a8c-41e2-860b-fc2277495a2c" containerName="istio-proxy"
Sep 08 11:47:09.134395 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:09.134309    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7cca131-5a8c-41e2-860b-fc2277495a2c" containerName="istio-proxy"
Sep 08 11:47:09.134395 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:09.134323    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7cca131-5a8c-41e2-860b-fc2277495a2c" containerName="istio-proxy"
Sep 08 11:47:09.134395 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:09.134331    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7cca131-5a8c-41e2-860b-fc2277495a2c" containerName="istio-proxy"
Sep 08 11:47:09.134395 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:09.134366    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2e2eebe-dd6e-44ec-8c02-badbc022f774" containerName="payload-pre-processing"
Sep 08 11:47:09.134395 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:09.134377    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2e2eebe-dd6e-44ec-8c02-badbc022f774" containerName="payload-pre-processing"
Sep 08 11:47:09.134395 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:09.134393    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6ab4d59-781d-419b-9f1c-7b986491b9a0" containerName="istio-proxy"
Sep 08 11:47:09.134638 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:09.134401    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6ab4d59-781d-419b-9f1c-7b986491b9a0" containerName="istio-proxy"
Sep 08 11:47:09.134638 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:09.134424    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="088f99a1-9124-48de-9d7e-d18743e2a9ee" containerName="maas-api"
Sep 08 11:47:09.134638 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:09.134432    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="088f99a1-9124-48de-9d7e-d18743e2a9ee" containerName="maas-api"
Sep 08 11:47:09.134638 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:09.134539    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7cca131-5a8c-41e2-860b-fc2277495a2c" containerName="istio-proxy"
Sep 08 11:47:09.134638 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:09.134559    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2e2eebe-dd6e-44ec-8c02-badbc022f774" containerName="payload-pre-processing"
Sep 08 11:47:09.134638 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:09.134568    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="088f99a1-9124-48de-9d7e-d18743e2a9ee" containerName="maas-api"
Sep 08 11:47:09.134638 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:09.134577    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6ab4d59-781d-419b-9f1c-7b986491b9a0" containerName="istio-proxy"
Sep 08 11:47:09.139575 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:09.139558    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk"
Sep 08 11:47:09.142134 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:09.142114    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-838a68-serving-cert\""
Sep 08 11:47:09.151590 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:09.151564    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk"]
Sep 08 11:47:09.203994 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:09.203953    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ebac4c1-9786-410c-9465-44c658a3d627-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk\" (UID: \"9ebac4c1-9786-410c-9465-44c658a3d627\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk"
Sep 08 11:47:09.204164 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:09.204083    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjkxx\" (UniqueName: \"kubernetes.io/projected/9ebac4c1-9786-410c-9465-44c658a3d627-kube-api-access-mjkxx\") pod \"maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk\" (UID: \"9ebac4c1-9786-410c-9465-44c658a3d627\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk"
Sep 08 11:47:09.204164 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:09.204122    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ebac4c1-9786-410c-9465-44c658a3d627-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk\" (UID: \"9ebac4c1-9786-410c-9465-44c658a3d627\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk"
Sep 08 11:47:09.204269 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:09.204177    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ebac4c1-9786-410c-9465-44c658a3d627-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk\" (UID: \"9ebac4c1-9786-410c-9465-44c658a3d627\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk"
Sep 08 11:47:09.304953 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:09.304920    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ebac4c1-9786-410c-9465-44c658a3d627-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk\" (UID: \"9ebac4c1-9786-410c-9465-44c658a3d627\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk"
Sep 08 11:47:09.305136 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:09.304997    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjkxx\" (UniqueName: \"kubernetes.io/projected/9ebac4c1-9786-410c-9465-44c658a3d627-kube-api-access-mjkxx\") pod \"maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk\" (UID: \"9ebac4c1-9786-410c-9465-44c658a3d627\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk"
Sep 08 11:47:09.305136 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:09.305024    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ebac4c1-9786-410c-9465-44c658a3d627-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk\" (UID: \"9ebac4c1-9786-410c-9465-44c658a3d627\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk"
Sep 08 11:47:09.305136 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:09.305054    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ebac4c1-9786-410c-9465-44c658a3d627-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk\" (UID: \"9ebac4c1-9786-410c-9465-44c658a3d627\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk"
Sep 08 11:47:09.305307 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:47:09.305151    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-838a68-serving-cert: secret "maas-api-e2e-shared-a-w3-838a68-serving-cert" not found
Sep 08 11:47:09.305307 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:47:09.305217    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ebac4c1-9786-410c-9465-44c658a3d627-maas-api-tls podName:9ebac4c1-9786-410c-9465-44c658a3d627 nodeName:}" failed. No retries permitted until 2026-09-08 11:47:09.805201333 +0000 UTC m=+1004.456908109 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9ebac4c1-9786-410c-9465-44c658a3d627-maas-api-tls") pod "maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk" (UID: "9ebac4c1-9786-410c-9465-44c658a3d627") : secret "maas-api-e2e-shared-a-w3-838a68-serving-cert" not found
Sep 08 11:47:09.305586 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:09.305565    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ebac4c1-9786-410c-9465-44c658a3d627-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk\" (UID: \"9ebac4c1-9786-410c-9465-44c658a3d627\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk"
Sep 08 11:47:09.307568 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:09.307539    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ebac4c1-9786-410c-9465-44c658a3d627-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk\" (UID: \"9ebac4c1-9786-410c-9465-44c658a3d627\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk"
Sep 08 11:47:09.315793 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:09.315768    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjkxx\" (UniqueName: \"kubernetes.io/projected/9ebac4c1-9786-410c-9465-44c658a3d627-kube-api-access-mjkxx\") pod \"maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk\" (UID: \"9ebac4c1-9786-410c-9465-44c658a3d627\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk"
Sep 08 11:47:09.809664 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:09.809622    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ebac4c1-9786-410c-9465-44c658a3d627-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk\" (UID: \"9ebac4c1-9786-410c-9465-44c658a3d627\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk"
Sep 08 11:47:09.812224 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:09.812196    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ebac4c1-9786-410c-9465-44c658a3d627-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk\" (UID: \"9ebac4c1-9786-410c-9465-44c658a3d627\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk"
Sep 08 11:47:10.050897 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:10.050862    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk"
Sep 08 11:47:10.348452 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:10.348422    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk"]
Sep 08 11:47:10.349602 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:47:10.349575    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ebac4c1_9786_410c_9465_44c658a3d627.slice/crio-b5488b7a91ca57624b191f55fb5e61d7f465d77339a9459ac5160b6a25ed196d WatchSource:0}: Error finding container b5488b7a91ca57624b191f55fb5e61d7f465d77339a9459ac5160b6a25ed196d: Status 404 returned error can't find the container with id b5488b7a91ca57624b191f55fb5e61d7f465d77339a9459ac5160b6a25ed196d
Sep 08 11:47:10.350970 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:10.350955    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 11:47:10.878355 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:10.878301    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk" event={"ID":"9ebac4c1-9786-410c-9465-44c658a3d627","Type":"ContainerStarted","Data":"b5488b7a91ca57624b191f55fb5e61d7f465d77339a9459ac5160b6a25ed196d"}
Sep 08 11:47:11.884604 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:11.884569    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk" event={"ID":"9ebac4c1-9786-410c-9465-44c658a3d627","Type":"ContainerStarted","Data":"df34ab146245c5fb83c92b55475f76eed50fc9690ee688ccdfcce91b1c06f36e"}
Sep 08 11:47:11.885007 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:11.884644    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk"
Sep 08 11:47:11.923353 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:11.923285    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk" podStartSLOduration=2.414435022 podStartE2EDuration="2.923269967s" totalImagesPullingTime="508.834945ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:47:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:47:11.921875414 +0000 UTC m=+1006.573582227" watchObservedRunningTime="2026-09-08 11:47:11.923269967 +0000 UTC m=+1006.574976761"
Sep 08 11:47:17.895776 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:17.895749    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk"
Sep 08 11:47:22.191427 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:22.191400    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2fe44c90-6c8d7765c-fskb7"]
Sep 08 11:47:22.191901 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:22.191887    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7cca131-5a8c-41e2-860b-fc2277495a2c" containerName="istio-proxy"
Sep 08 11:47:22.194953 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:22.194937    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2fe44c90-6c8d7765c-fskb7"
Sep 08 11:47:22.197702 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:22.197676    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-2fe44c90\""
Sep 08 11:47:22.197814 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:22.197734    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-2fe44c90-dockercfg-wp85h\""
Sep 08 11:47:22.210121 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:22.210097    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2fe44c90-6c8d7765c-fskb7"]
Sep 08 11:47:22.332656 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:22.332618    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6fxl\" (UniqueName: \"kubernetes.io/projected/15d5e7c5-7dc0-4446-be95-71696d04be0c-kube-api-access-b6fxl\") pod \"payload-processing-e2e-mt-2fe44c90-6c8d7765c-fskb7\" (UID: \"15d5e7c5-7dc0-4446-be95-71696d04be0c\") " pod="openshift-ingress/payload-processing-e2e-mt-2fe44c90-6c8d7765c-fskb7"
Sep 08 11:47:22.332854 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:22.332826    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15d5e7c5-7dc0-4446-be95-71696d04be0c-plugins-config-volume\") pod \"payload-processing-e2e-mt-2fe44c90-6c8d7765c-fskb7\" (UID: \"15d5e7c5-7dc0-4446-be95-71696d04be0c\") " pod="openshift-ingress/payload-processing-e2e-mt-2fe44c90-6c8d7765c-fskb7"
Sep 08 11:47:22.433773 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:22.433748    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15d5e7c5-7dc0-4446-be95-71696d04be0c-plugins-config-volume\") pod \"payload-processing-e2e-mt-2fe44c90-6c8d7765c-fskb7\" (UID: \"15d5e7c5-7dc0-4446-be95-71696d04be0c\") " pod="openshift-ingress/payload-processing-e2e-mt-2fe44c90-6c8d7765c-fskb7"
Sep 08 11:47:22.433934 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:22.433787    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6fxl\" (UniqueName: \"kubernetes.io/projected/15d5e7c5-7dc0-4446-be95-71696d04be0c-kube-api-access-b6fxl\") pod \"payload-processing-e2e-mt-2fe44c90-6c8d7765c-fskb7\" (UID: \"15d5e7c5-7dc0-4446-be95-71696d04be0c\") " pod="openshift-ingress/payload-processing-e2e-mt-2fe44c90-6c8d7765c-fskb7"
Sep 08 11:47:22.434460 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:22.434441    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15d5e7c5-7dc0-4446-be95-71696d04be0c-plugins-config-volume\") pod \"payload-processing-e2e-mt-2fe44c90-6c8d7765c-fskb7\" (UID: \"15d5e7c5-7dc0-4446-be95-71696d04be0c\") " pod="openshift-ingress/payload-processing-e2e-mt-2fe44c90-6c8d7765c-fskb7"
Sep 08 11:47:22.443152 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:22.443094    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6fxl\" (UniqueName: \"kubernetes.io/projected/15d5e7c5-7dc0-4446-be95-71696d04be0c-kube-api-access-b6fxl\") pod \"payload-processing-e2e-mt-2fe44c90-6c8d7765c-fskb7\" (UID: \"15d5e7c5-7dc0-4446-be95-71696d04be0c\") " pod="openshift-ingress/payload-processing-e2e-mt-2fe44c90-6c8d7765c-fskb7"
Sep 08 11:47:22.506302 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:22.506279    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2fe44c90-6c8d7765c-fskb7"
Sep 08 11:47:22.782885 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:22.782859    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2fe44c90-6c8d7765c-fskb7"]
Sep 08 11:47:22.784603 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:47:22.784571    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15d5e7c5_7dc0_4446_be95_71696d04be0c.slice/crio-70230e3f27deac60d9f7a04df61a1376ac9d83172442754b440a94172dca35e6 WatchSource:0}: Error finding container 70230e3f27deac60d9f7a04df61a1376ac9d83172442754b440a94172dca35e6: Status 404 returned error can't find the container with id 70230e3f27deac60d9f7a04df61a1376ac9d83172442754b440a94172dca35e6
Sep 08 11:47:22.940751 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:22.940711    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2fe44c90-6c8d7765c-fskb7" event={"ID":"15d5e7c5-7dc0-4446-be95-71696d04be0c","Type":"ContainerStarted","Data":"5a412ea0eea1cb1c63f3fbb5b022b0c4223a197f439b7405b0ca50f3234f4fe0"}
Sep 08 11:47:22.940899 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:22.940771    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2fe44c90-6c8d7765c-fskb7" event={"ID":"15d5e7c5-7dc0-4446-be95-71696d04be0c","Type":"ContainerStarted","Data":"70230e3f27deac60d9f7a04df61a1376ac9d83172442754b440a94172dca35e6"}
Sep 08 11:47:22.940899 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:22.940824    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-2fe44c90-6c8d7765c-fskb7"
Sep 08 11:47:22.961401 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:22.961329    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-2fe44c90-6c8d7765c-fskb7" podStartSLOduration=0.961312375 podStartE2EDuration="961.312375ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:47:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:47:22.959400393 +0000 UTC m=+1017.611107205" watchObservedRunningTime="2026-09-08 11:47:22.961312375 +0000 UTC m=+1017.613019171"
Sep 08 11:47:31.118664 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:31.118627    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh"]
Sep 08 11:47:31.119060 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:31.118835    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh" podUID="455ce385-bb43-48ed-8290-b2351535810b" containerName="istio-proxy" containerID="cri-o://416cda6ad2d5ee68d957c8917d106c544de8ca27013d7784b3e51deddd59cbed" gracePeriod=30
Sep 08 11:47:31.659560 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:31.659518    2575 patch_prober.go:28] interesting pod/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 11:47:31.659740 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:31.659595    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh" podUID="455ce385-bb43-48ed-8290-b2351535810b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 11:47:33.948633 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:33.948599    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-2fe44c90-6c8d7765c-fskb7"
Sep 08 11:47:36.374081 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:36.374049    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh"
Sep 08 11:47:36.460784 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:36.460682    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/455ce385-bb43-48ed-8290-b2351535810b-workload-certs\") pod \"455ce385-bb43-48ed-8290-b2351535810b\" (UID: \"455ce385-bb43-48ed-8290-b2351535810b\") "
Sep 08 11:47:36.460784 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:36.460725    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/455ce385-bb43-48ed-8290-b2351535810b-istio-data\") pod \"455ce385-bb43-48ed-8290-b2351535810b\" (UID: \"455ce385-bb43-48ed-8290-b2351535810b\") "
Sep 08 11:47:36.461037 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:36.460803    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtbhb\" (UniqueName: \"kubernetes.io/projected/455ce385-bb43-48ed-8290-b2351535810b-kube-api-access-jtbhb\") pod \"455ce385-bb43-48ed-8290-b2351535810b\" (UID: \"455ce385-bb43-48ed-8290-b2351535810b\") "
Sep 08 11:47:36.461037 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:36.460849    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/455ce385-bb43-48ed-8290-b2351535810b-istio-podinfo\") pod \"455ce385-bb43-48ed-8290-b2351535810b\" (UID: \"455ce385-bb43-48ed-8290-b2351535810b\") "
Sep 08 11:47:36.461037 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:36.460875    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/455ce385-bb43-48ed-8290-b2351535810b-istiod-ca-cert\") pod \"455ce385-bb43-48ed-8290-b2351535810b\" (UID: \"455ce385-bb43-48ed-8290-b2351535810b\") "
Sep 08 11:47:36.461037 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:36.460909    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/455ce385-bb43-48ed-8290-b2351535810b-istio-envoy\") pod \"455ce385-bb43-48ed-8290-b2351535810b\" (UID: \"455ce385-bb43-48ed-8290-b2351535810b\") "
Sep 08 11:47:36.461037 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:36.460961    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/455ce385-bb43-48ed-8290-b2351535810b-istio-token\") pod \"455ce385-bb43-48ed-8290-b2351535810b\" (UID: \"455ce385-bb43-48ed-8290-b2351535810b\") "
Sep 08 11:47:36.461037 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:36.460989    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/455ce385-bb43-48ed-8290-b2351535810b-workload-socket\") pod \"455ce385-bb43-48ed-8290-b2351535810b\" (UID: \"455ce385-bb43-48ed-8290-b2351535810b\") "
Sep 08 11:47:36.461037 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:36.461029    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/455ce385-bb43-48ed-8290-b2351535810b-credential-socket\") pod \"455ce385-bb43-48ed-8290-b2351535810b\" (UID: \"455ce385-bb43-48ed-8290-b2351535810b\") "
Sep 08 11:47:36.461438 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:36.461089    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/455ce385-bb43-48ed-8290-b2351535810b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "455ce385-bb43-48ed-8290-b2351535810b" (UID: "455ce385-bb43-48ed-8290-b2351535810b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:47:36.461438 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:36.461222    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/455ce385-bb43-48ed-8290-b2351535810b-istio-data" (OuterVolumeSpecName: "istio-data") pod "455ce385-bb43-48ed-8290-b2351535810b" (UID: "455ce385-bb43-48ed-8290-b2351535810b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:47:36.461438 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:36.461407    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/455ce385-bb43-48ed-8290-b2351535810b-workload-certs\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:47:36.461438 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:36.461425    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/455ce385-bb43-48ed-8290-b2351535810b-istio-data\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:47:36.461967 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:36.461817    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/455ce385-bb43-48ed-8290-b2351535810b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "455ce385-bb43-48ed-8290-b2351535810b" (UID: "455ce385-bb43-48ed-8290-b2351535810b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:47:36.462176 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:36.462127    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/455ce385-bb43-48ed-8290-b2351535810b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "455ce385-bb43-48ed-8290-b2351535810b" (UID: "455ce385-bb43-48ed-8290-b2351535810b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:47:36.462409 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:36.462378    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/455ce385-bb43-48ed-8290-b2351535810b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "455ce385-bb43-48ed-8290-b2351535810b" (UID: "455ce385-bb43-48ed-8290-b2351535810b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:47:36.464269 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:36.464004    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/455ce385-bb43-48ed-8290-b2351535810b-kube-api-access-jtbhb" (OuterVolumeSpecName: "kube-api-access-jtbhb") pod "455ce385-bb43-48ed-8290-b2351535810b" (UID: "455ce385-bb43-48ed-8290-b2351535810b"). InnerVolumeSpecName "kube-api-access-jtbhb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:47:36.464395 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:36.464376    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/455ce385-bb43-48ed-8290-b2351535810b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "455ce385-bb43-48ed-8290-b2351535810b" (UID: "455ce385-bb43-48ed-8290-b2351535810b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:47:36.464619 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:36.464596    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/455ce385-bb43-48ed-8290-b2351535810b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "455ce385-bb43-48ed-8290-b2351535810b" (UID: "455ce385-bb43-48ed-8290-b2351535810b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 11:47:36.464699 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:36.464685    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/455ce385-bb43-48ed-8290-b2351535810b-istio-token" (OuterVolumeSpecName: "istio-token") pod "455ce385-bb43-48ed-8290-b2351535810b" (UID: "455ce385-bb43-48ed-8290-b2351535810b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:47:36.569494 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:36.569461    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtbhb\" (UniqueName: \"kubernetes.io/projected/455ce385-bb43-48ed-8290-b2351535810b-kube-api-access-jtbhb\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:47:36.569494 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:36.569489    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/455ce385-bb43-48ed-8290-b2351535810b-istio-podinfo\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:47:36.569494 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:36.569499    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/455ce385-bb43-48ed-8290-b2351535810b-istiod-ca-cert\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:47:36.569722 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:36.569508    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/455ce385-bb43-48ed-8290-b2351535810b-istio-envoy\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:47:36.569722 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:36.569516    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/455ce385-bb43-48ed-8290-b2351535810b-istio-token\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:47:36.569722 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:36.569523    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/455ce385-bb43-48ed-8290-b2351535810b-workload-socket\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:47:36.569722 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:36.569691    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/455ce385-bb43-48ed-8290-b2351535810b-credential-socket\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:47:37.018563 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:37.018532    2575 generic.go:356] "Generic (PLEG): container finished" podID="455ce385-bb43-48ed-8290-b2351535810b" containerID="416cda6ad2d5ee68d957c8917d106c544de8ca27013d7784b3e51deddd59cbed" exitCode=0
Sep 08 11:47:37.018752 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:37.018584    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh" event={"ID":"455ce385-bb43-48ed-8290-b2351535810b","Type":"ContainerDied","Data":"416cda6ad2d5ee68d957c8917d106c544de8ca27013d7784b3e51deddd59cbed"}
Sep 08 11:47:37.018752 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:37.018590    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh"
Sep 08 11:47:37.018752 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:37.018626    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh" event={"ID":"455ce385-bb43-48ed-8290-b2351535810b","Type":"ContainerDied","Data":"abd50511fcb56ccb548371846b59994b34f4d7351aba59d568719d48556cac33"}
Sep 08 11:47:37.018752 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:37.018648    2575 scope.go:117] "RemoveContainer" containerID="416cda6ad2d5ee68d957c8917d106c544de8ca27013d7784b3e51deddd59cbed"
Sep 08 11:47:37.028747 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:37.028728    2575 scope.go:117] "RemoveContainer" containerID="416cda6ad2d5ee68d957c8917d106c544de8ca27013d7784b3e51deddd59cbed"
Sep 08 11:47:37.029088 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:47:37.029066    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"416cda6ad2d5ee68d957c8917d106c544de8ca27013d7784b3e51deddd59cbed\": container with ID starting with 416cda6ad2d5ee68d957c8917d106c544de8ca27013d7784b3e51deddd59cbed not found: ID does not exist" containerID="416cda6ad2d5ee68d957c8917d106c544de8ca27013d7784b3e51deddd59cbed"
Sep 08 11:47:37.029144 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:37.029097    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"416cda6ad2d5ee68d957c8917d106c544de8ca27013d7784b3e51deddd59cbed"} err="failed to get container status \"416cda6ad2d5ee68d957c8917d106c544de8ca27013d7784b3e51deddd59cbed\": rpc error: code = NotFound desc = could not find container \"416cda6ad2d5ee68d957c8917d106c544de8ca27013d7784b3e51deddd59cbed\": container with ID starting with 416cda6ad2d5ee68d957c8917d106c544de8ca27013d7784b3e51deddd59cbed not found: ID does not exist"
Sep 08 11:47:37.043230 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:37.043207    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh"]
Sep 08 11:47:37.048538 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:37.048517    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh"]
Sep 08 11:47:37.318127 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:37.318096    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv"]
Sep 08 11:47:37.318611 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:37.318597    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="455ce385-bb43-48ed-8290-b2351535810b" containerName="istio-proxy"
Sep 08 11:47:37.318671 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:37.318614    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="455ce385-bb43-48ed-8290-b2351535810b" containerName="istio-proxy"
Sep 08 11:47:37.318708 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:37.318681    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="455ce385-bb43-48ed-8290-b2351535810b" containerName="istio-proxy"
Sep 08 11:47:37.323069 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:37.323052    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv"
Sep 08 11:47:37.325852 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:37.325835    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-bb9b64-serving-cert\""
Sep 08 11:47:37.334594 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:37.334573    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv"]
Sep 08 11:47:37.377331 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:37.377299    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c3c90b7-f66f-4b19-ae7e-cbf367afee3e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv\" (UID: \"0c3c90b7-f66f-4b19-ae7e-cbf367afee3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv"
Sep 08 11:47:37.377722 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:37.377416    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c3c90b7-f66f-4b19-ae7e-cbf367afee3e-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv\" (UID: \"0c3c90b7-f66f-4b19-ae7e-cbf367afee3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv"
Sep 08 11:47:37.377722 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:37.377526    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7qbq\" (UniqueName: \"kubernetes.io/projected/0c3c90b7-f66f-4b19-ae7e-cbf367afee3e-kube-api-access-q7qbq\") pod \"maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv\" (UID: \"0c3c90b7-f66f-4b19-ae7e-cbf367afee3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv"
Sep 08 11:47:37.377722 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:37.377601    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c3c90b7-f66f-4b19-ae7e-cbf367afee3e-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv\" (UID: \"0c3c90b7-f66f-4b19-ae7e-cbf367afee3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv"
Sep 08 11:47:37.478295 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:37.478262    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c3c90b7-f66f-4b19-ae7e-cbf367afee3e-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv\" (UID: \"0c3c90b7-f66f-4b19-ae7e-cbf367afee3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv"
Sep 08 11:47:37.478500 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:37.478320    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c3c90b7-f66f-4b19-ae7e-cbf367afee3e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv\" (UID: \"0c3c90b7-f66f-4b19-ae7e-cbf367afee3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv"
Sep 08 11:47:37.478500 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:37.478382    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c3c90b7-f66f-4b19-ae7e-cbf367afee3e-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv\" (UID: \"0c3c90b7-f66f-4b19-ae7e-cbf367afee3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv"
Sep 08 11:47:37.478500 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:37.478435    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7qbq\" (UniqueName: \"kubernetes.io/projected/0c3c90b7-f66f-4b19-ae7e-cbf367afee3e-kube-api-access-q7qbq\") pod \"maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv\" (UID: \"0c3c90b7-f66f-4b19-ae7e-cbf367afee3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv"
Sep 08 11:47:37.478500 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:47:37.478457    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-bb9b64-serving-cert: secret "maas-api-e2e-shared-b-w3-bb9b64-serving-cert" not found
Sep 08 11:47:37.478728 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:47:37.478533    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c3c90b7-f66f-4b19-ae7e-cbf367afee3e-maas-api-tls podName:0c3c90b7-f66f-4b19-ae7e-cbf367afee3e nodeName:}" failed. No retries permitted until 2026-09-08 11:47:37.97851167 +0000 UTC m=+1032.630218455 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0c3c90b7-f66f-4b19-ae7e-cbf367afee3e-maas-api-tls") pod "maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv" (UID: "0c3c90b7-f66f-4b19-ae7e-cbf367afee3e") : secret "maas-api-e2e-shared-b-w3-bb9b64-serving-cert" not found
Sep 08 11:47:37.479092 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:37.479070    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c3c90b7-f66f-4b19-ae7e-cbf367afee3e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv\" (UID: \"0c3c90b7-f66f-4b19-ae7e-cbf367afee3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv"
Sep 08 11:47:37.481068 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:37.481048    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c3c90b7-f66f-4b19-ae7e-cbf367afee3e-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv\" (UID: \"0c3c90b7-f66f-4b19-ae7e-cbf367afee3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv"
Sep 08 11:47:37.488386 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:37.488365    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7qbq\" (UniqueName: \"kubernetes.io/projected/0c3c90b7-f66f-4b19-ae7e-cbf367afee3e-kube-api-access-q7qbq\") pod \"maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv\" (UID: \"0c3c90b7-f66f-4b19-ae7e-cbf367afee3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv"
Sep 08 11:47:37.841211 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:37.841182    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="455ce385-bb43-48ed-8290-b2351535810b" path="/var/lib/kubelet/pods/455ce385-bb43-48ed-8290-b2351535810b/volumes"
Sep 08 11:47:37.982441 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:37.982406    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c3c90b7-f66f-4b19-ae7e-cbf367afee3e-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv\" (UID: \"0c3c90b7-f66f-4b19-ae7e-cbf367afee3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv"
Sep 08 11:47:37.984798 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:37.984771    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c3c90b7-f66f-4b19-ae7e-cbf367afee3e-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv\" (UID: \"0c3c90b7-f66f-4b19-ae7e-cbf367afee3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv"
Sep 08 11:47:38.085578 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:38.085542    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858-ql5mn"]
Sep 08 11:47:38.089275 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:38.089257    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858-ql5mn"
Sep 08 11:47:38.092200 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:38.092149    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-bb9b64-dockercfg-lbpmh\""
Sep 08 11:47:38.092200 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:38.092173    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-bb9b64\""
Sep 08 11:47:38.101246 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:38.101226    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858-ql5mn"]
Sep 08 11:47:38.183936 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:38.183903    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlhbm\" (UniqueName: \"kubernetes.io/projected/1f653452-d608-40f7-84cb-1f5c6992fb58-kube-api-access-hlhbm\") pod \"payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858-ql5mn\" (UID: \"1f653452-d608-40f7-84cb-1f5c6992fb58\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858-ql5mn"
Sep 08 11:47:38.184093 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:38.183959    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f653452-d608-40f7-84cb-1f5c6992fb58-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858-ql5mn\" (UID: \"1f653452-d608-40f7-84cb-1f5c6992fb58\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858-ql5mn"
Sep 08 11:47:38.237013 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:38.236987    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv"
Sep 08 11:47:38.285648 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:38.285616    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlhbm\" (UniqueName: \"kubernetes.io/projected/1f653452-d608-40f7-84cb-1f5c6992fb58-kube-api-access-hlhbm\") pod \"payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858-ql5mn\" (UID: \"1f653452-d608-40f7-84cb-1f5c6992fb58\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858-ql5mn"
Sep 08 11:47:38.285838 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:38.285708    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f653452-d608-40f7-84cb-1f5c6992fb58-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858-ql5mn\" (UID: \"1f653452-d608-40f7-84cb-1f5c6992fb58\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858-ql5mn"
Sep 08 11:47:38.286511 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:38.286458    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f653452-d608-40f7-84cb-1f5c6992fb58-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858-ql5mn\" (UID: \"1f653452-d608-40f7-84cb-1f5c6992fb58\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858-ql5mn"
Sep 08 11:47:38.297003 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:38.296932    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlhbm\" (UniqueName: \"kubernetes.io/projected/1f653452-d608-40f7-84cb-1f5c6992fb58-kube-api-access-hlhbm\") pod \"payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858-ql5mn\" (UID: \"1f653452-d608-40f7-84cb-1f5c6992fb58\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858-ql5mn"
Sep 08 11:47:38.401185 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:38.401106    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858-ql5mn"
Sep 08 11:47:38.514484 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:38.514460    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv"]
Sep 08 11:47:38.516185 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:47:38.516151    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c3c90b7_f66f_4b19_ae7e_cbf367afee3e.slice/crio-5548038a1b7278c72d2e319e659c1aa6b25b5e7cd53dff830d106a1968404213 WatchSource:0}: Error finding container 5548038a1b7278c72d2e319e659c1aa6b25b5e7cd53dff830d106a1968404213: Status 404 returned error can't find the container with id 5548038a1b7278c72d2e319e659c1aa6b25b5e7cd53dff830d106a1968404213
Sep 08 11:47:38.681919 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:38.681888    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858-ql5mn"]
Sep 08 11:47:38.682436 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:47:38.682415    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f653452_d608_40f7_84cb_1f5c6992fb58.slice/crio-74d6288046092f5694433f779a4176932291d9ac26bbb44e41efe6cad361052d WatchSource:0}: Error finding container 74d6288046092f5694433f779a4176932291d9ac26bbb44e41efe6cad361052d: Status 404 returned error can't find the container with id 74d6288046092f5694433f779a4176932291d9ac26bbb44e41efe6cad361052d
Sep 08 11:47:39.031654 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:39.031626    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858-ql5mn" event={"ID":"1f653452-d608-40f7-84cb-1f5c6992fb58","Type":"ContainerStarted","Data":"eaa195245eb994e1f3eed546b6b8eff7bef4ec3a103795764eec29fd1f1c0722"}
Sep 08 11:47:39.031842 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:39.031683    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858-ql5mn" event={"ID":"1f653452-d608-40f7-84cb-1f5c6992fb58","Type":"ContainerStarted","Data":"74d6288046092f5694433f779a4176932291d9ac26bbb44e41efe6cad361052d"}
Sep 08 11:47:39.031842 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:39.031712    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858-ql5mn"
Sep 08 11:47:39.032883 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:39.032862    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv" event={"ID":"0c3c90b7-f66f-4b19-ae7e-cbf367afee3e","Type":"ContainerStarted","Data":"5548038a1b7278c72d2e319e659c1aa6b25b5e7cd53dff830d106a1968404213"}
Sep 08 11:47:39.054962 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:39.054921    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858-ql5mn" podStartSLOduration=1.054906347 podStartE2EDuration="1.054906347s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:47:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:47:39.053668213 +0000 UTC m=+1033.705375031" watchObservedRunningTime="2026-09-08 11:47:39.054906347 +0000 UTC m=+1033.706613140"
Sep 08 11:47:40.039329 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:40.039291    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv" event={"ID":"0c3c90b7-f66f-4b19-ae7e-cbf367afee3e","Type":"ContainerStarted","Data":"4ce4f84fd51f89fd128240e1c903acb7d704ebe8c8fea2abc6dfa023f4d80580"}
Sep 08 11:47:40.039727 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:40.039501    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv"
Sep 08 11:47:40.060308 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:40.060266    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv" podStartSLOduration=2.482947826 podStartE2EDuration="3.060251433s" totalImagesPullingTime="577.303607ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:47:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:47:40.059162921 +0000 UTC m=+1034.710869728" watchObservedRunningTime="2026-09-08 11:47:40.060251433 +0000 UTC m=+1034.711958226"
Sep 08 11:47:46.050084 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:46.050054    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv"
Sep 08 11:47:50.041522 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:47:50.041489    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858-ql5mn"
Sep 08 11:48:03.870995 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:03.870959    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2fe44c90-6c8d7765c-fskb7"]
Sep 08 11:48:03.871524 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:03.871228    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-2fe44c90-6c8d7765c-fskb7" podUID="15d5e7c5-7dc0-4446-be95-71696d04be0c" containerName="payload-processing" containerID="cri-o://5a412ea0eea1cb1c63f3fbb5b022b0c4223a197f439b7405b0ca50f3234f4fe0" gracePeriod=30
Sep 08 11:48:03.947049 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:03.947003    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-mt-2fe44c90-6c8d7765c-fskb7" podUID="15d5e7c5-7dc0-4446-be95-71696d04be0c" containerName="payload-processing" probeResult="failure" output="dial tcp 10.134.0.52:9004: connect: connection refused"
Sep 08 11:48:04.124135 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:04.124112    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2fe44c90-6c8d7765c-fskb7"
Sep 08 11:48:04.138242 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:04.138220    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6fxl\" (UniqueName: \"kubernetes.io/projected/15d5e7c5-7dc0-4446-be95-71696d04be0c-kube-api-access-b6fxl\") pod \"15d5e7c5-7dc0-4446-be95-71696d04be0c\" (UID: \"15d5e7c5-7dc0-4446-be95-71696d04be0c\") "
Sep 08 11:48:04.138378 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:04.138298    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15d5e7c5-7dc0-4446-be95-71696d04be0c-plugins-config-volume\") pod \"15d5e7c5-7dc0-4446-be95-71696d04be0c\" (UID: \"15d5e7c5-7dc0-4446-be95-71696d04be0c\") "
Sep 08 11:48:04.138633 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:04.138609    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15d5e7c5-7dc0-4446-be95-71696d04be0c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "15d5e7c5-7dc0-4446-be95-71696d04be0c" (UID: "15d5e7c5-7dc0-4446-be95-71696d04be0c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:48:04.140812 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:04.140782    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15d5e7c5-7dc0-4446-be95-71696d04be0c-kube-api-access-b6fxl" (OuterVolumeSpecName: "kube-api-access-b6fxl") pod "15d5e7c5-7dc0-4446-be95-71696d04be0c" (UID: "15d5e7c5-7dc0-4446-be95-71696d04be0c"). InnerVolumeSpecName "kube-api-access-b6fxl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:48:04.162974 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:04.162941    2575 generic.go:356] "Generic (PLEG): container finished" podID="15d5e7c5-7dc0-4446-be95-71696d04be0c" containerID="5a412ea0eea1cb1c63f3fbb5b022b0c4223a197f439b7405b0ca50f3234f4fe0" exitCode=0
Sep 08 11:48:04.163095 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:04.162996    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2fe44c90-6c8d7765c-fskb7"
Sep 08 11:48:04.163095 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:04.163008    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2fe44c90-6c8d7765c-fskb7" event={"ID":"15d5e7c5-7dc0-4446-be95-71696d04be0c","Type":"ContainerDied","Data":"5a412ea0eea1cb1c63f3fbb5b022b0c4223a197f439b7405b0ca50f3234f4fe0"}
Sep 08 11:48:04.163095 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:04.163070    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2fe44c90-6c8d7765c-fskb7" event={"ID":"15d5e7c5-7dc0-4446-be95-71696d04be0c","Type":"ContainerDied","Data":"70230e3f27deac60d9f7a04df61a1376ac9d83172442754b440a94172dca35e6"}
Sep 08 11:48:04.163247 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:04.163102    2575 scope.go:117] "RemoveContainer" containerID="5a412ea0eea1cb1c63f3fbb5b022b0c4223a197f439b7405b0ca50f3234f4fe0"
Sep 08 11:48:04.172169 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:04.172137    2575 scope.go:117] "RemoveContainer" containerID="5a412ea0eea1cb1c63f3fbb5b022b0c4223a197f439b7405b0ca50f3234f4fe0"
Sep 08 11:48:04.172528 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:48:04.172505    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a412ea0eea1cb1c63f3fbb5b022b0c4223a197f439b7405b0ca50f3234f4fe0\": container with ID starting with 5a412ea0eea1cb1c63f3fbb5b022b0c4223a197f439b7405b0ca50f3234f4fe0 not found: ID does not exist" containerID="5a412ea0eea1cb1c63f3fbb5b022b0c4223a197f439b7405b0ca50f3234f4fe0"
Sep 08 11:48:04.172599 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:04.172539    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a412ea0eea1cb1c63f3fbb5b022b0c4223a197f439b7405b0ca50f3234f4fe0"} err="failed to get container status \"5a412ea0eea1cb1c63f3fbb5b022b0c4223a197f439b7405b0ca50f3234f4fe0\": rpc error: code = NotFound desc = could not find container \"5a412ea0eea1cb1c63f3fbb5b022b0c4223a197f439b7405b0ca50f3234f4fe0\": container with ID starting with 5a412ea0eea1cb1c63f3fbb5b022b0c4223a197f439b7405b0ca50f3234f4fe0 not found: ID does not exist"
Sep 08 11:48:04.190820 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:04.190797    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2fe44c90-6c8d7765c-fskb7"]
Sep 08 11:48:04.195074 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:04.195050    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2fe44c90-6c8d7765c-fskb7"]
Sep 08 11:48:04.239358 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:04.239310    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6fxl\" (UniqueName: \"kubernetes.io/projected/15d5e7c5-7dc0-4446-be95-71696d04be0c-kube-api-access-b6fxl\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:48:04.239358 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:04.239333    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15d5e7c5-7dc0-4446-be95-71696d04be0c-plugins-config-volume\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:48:05.841819 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:05.841788    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15d5e7c5-7dc0-4446-be95-71696d04be0c" path="/var/lib/kubelet/pods/15d5e7c5-7dc0-4446-be95-71696d04be0c/volumes"
Sep 08 11:48:30.700441 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:30.700233    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs"]
Sep 08 11:48:30.701223 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:30.700818    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15d5e7c5-7dc0-4446-be95-71696d04be0c" containerName="payload-processing"
Sep 08 11:48:30.701223 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:30.700838    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="15d5e7c5-7dc0-4446-be95-71696d04be0c" containerName="payload-processing"
Sep 08 11:48:30.701223 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:30.700960    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="15d5e7c5-7dc0-4446-be95-71696d04be0c" containerName="payload-processing"
Sep 08 11:48:30.705563 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:30.705544    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs"
Sep 08 11:48:30.708367 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:30.708326    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-69606d-serving-cert\""
Sep 08 11:48:30.717790 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:30.717765    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs"]
Sep 08 11:48:30.788683 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:30.788653    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49084489-5b0b-45b9-b9f0-24de320fecd2-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs\" (UID: \"49084489-5b0b-45b9-b9f0-24de320fecd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs"
Sep 08 11:48:30.788683 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:30.788683    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49084489-5b0b-45b9-b9f0-24de320fecd2-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs\" (UID: \"49084489-5b0b-45b9-b9f0-24de320fecd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs"
Sep 08 11:48:30.788864 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:30.788709    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/49084489-5b0b-45b9-b9f0-24de320fecd2-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs\" (UID: \"49084489-5b0b-45b9-b9f0-24de320fecd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs"
Sep 08 11:48:30.788864 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:30.788811    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj2b9\" (UniqueName: \"kubernetes.io/projected/49084489-5b0b-45b9-b9f0-24de320fecd2-kube-api-access-wj2b9\") pod \"maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs\" (UID: \"49084489-5b0b-45b9-b9f0-24de320fecd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs"
Sep 08 11:48:30.890230 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:30.890202    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/49084489-5b0b-45b9-b9f0-24de320fecd2-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs\" (UID: \"49084489-5b0b-45b9-b9f0-24de320fecd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs"
Sep 08 11:48:30.890445 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:30.890247    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj2b9\" (UniqueName: \"kubernetes.io/projected/49084489-5b0b-45b9-b9f0-24de320fecd2-kube-api-access-wj2b9\") pod \"maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs\" (UID: \"49084489-5b0b-45b9-b9f0-24de320fecd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs"
Sep 08 11:48:30.890445 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:30.890405    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49084489-5b0b-45b9-b9f0-24de320fecd2-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs\" (UID: \"49084489-5b0b-45b9-b9f0-24de320fecd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs"
Sep 08 11:48:30.890445 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:30.890435    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49084489-5b0b-45b9-b9f0-24de320fecd2-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs\" (UID: \"49084489-5b0b-45b9-b9f0-24de320fecd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs"
Sep 08 11:48:30.890887 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:30.890865    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/49084489-5b0b-45b9-b9f0-24de320fecd2-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs\" (UID: \"49084489-5b0b-45b9-b9f0-24de320fecd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs"
Sep 08 11:48:30.892916 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:30.892895    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49084489-5b0b-45b9-b9f0-24de320fecd2-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs\" (UID: \"49084489-5b0b-45b9-b9f0-24de320fecd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs"
Sep 08 11:48:30.893038 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:30.893021    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49084489-5b0b-45b9-b9f0-24de320fecd2-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs\" (UID: \"49084489-5b0b-45b9-b9f0-24de320fecd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs"
Sep 08 11:48:30.899311 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:30.899289    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj2b9\" (UniqueName: \"kubernetes.io/projected/49084489-5b0b-45b9-b9f0-24de320fecd2-kube-api-access-wj2b9\") pod \"maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs\" (UID: \"49084489-5b0b-45b9-b9f0-24de320fecd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs"
Sep 08 11:48:31.017673 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:31.017606    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs"
Sep 08 11:48:31.296941 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:48:31.296907    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49084489_5b0b_45b9_b9f0_24de320fecd2.slice/crio-a266846e07cf1647c77234805fe3eda804f1e5605d51eaf97f6401da163aaa73 WatchSource:0}: Error finding container a266846e07cf1647c77234805fe3eda804f1e5605d51eaf97f6401da163aaa73: Status 404 returned error can't find the container with id a266846e07cf1647c77234805fe3eda804f1e5605d51eaf97f6401da163aaa73
Sep 08 11:48:31.297561 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:31.297541    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs"]
Sep 08 11:48:31.312971 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:31.312929    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs" event={"ID":"49084489-5b0b-45b9-b9f0-24de320fecd2","Type":"ContainerStarted","Data":"a266846e07cf1647c77234805fe3eda804f1e5605d51eaf97f6401da163aaa73"}
Sep 08 11:48:32.321263 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:32.321223    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs" event={"ID":"49084489-5b0b-45b9-b9f0-24de320fecd2","Type":"ContainerStarted","Data":"802327b320cef51f38897266d7d8458a36438dd1575072f9d1f674961c8b2ebc"}
Sep 08 11:48:32.321687 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:32.321333    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs"
Sep 08 11:48:32.343115 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:32.343060    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs" podStartSLOduration=1.500246385 podStartE2EDuration="2.343039273s" totalImagesPullingTime="842.792888ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:48:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:48:32.341499135 +0000 UTC m=+1086.993206145" watchObservedRunningTime="2026-09-08 11:48:32.343039273 +0000 UTC m=+1086.994746066"
Sep 08 11:48:38.331812 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:38.331784    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs"
Sep 08 11:48:55.126253 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:55.126222    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"]
Sep 08 11:48:55.130255 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:55.130239    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"
Sep 08 11:48:55.132947 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:55.132924    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-489cdd-openshift-default-dockercfg-bmqcl\""
Sep 08 11:48:55.145522 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:55.145494    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"]
Sep 08 11:48:55.220234 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:55.220200    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-istio-data\") pod \"e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq\" (UID: \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\") " pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"
Sep 08 11:48:55.220395 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:55.220250    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cddvw\" (UniqueName: \"kubernetes.io/projected/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-kube-api-access-cddvw\") pod \"e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq\" (UID: \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\") " pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"
Sep 08 11:48:55.220395 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:55.220300    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-workload-socket\") pod \"e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq\" (UID: \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\") " pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"
Sep 08 11:48:55.220395 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:55.220318    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-credential-socket\") pod \"e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq\" (UID: \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\") " pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"
Sep 08 11:48:55.220395 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:55.220381    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-istiod-ca-cert\") pod \"e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq\" (UID: \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\") " pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"
Sep 08 11:48:55.220533 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:55.220418    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-istio-envoy\") pod \"e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq\" (UID: \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\") " pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"
Sep 08 11:48:55.220533 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:55.220435    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-istio-token\") pod \"e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq\" (UID: \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\") " pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"
Sep 08 11:48:55.220533 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:55.220491    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-workload-certs\") pod \"e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq\" (UID: \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\") " pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"
Sep 08 11:48:55.220533 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:55.220509    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-istio-podinfo\") pod \"e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq\" (UID: \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\") " pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"
Sep 08 11:48:55.321793 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:55.321761    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-workload-certs\") pod \"e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq\" (UID: \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\") " pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"
Sep 08 11:48:55.321793 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:55.321794    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-istio-podinfo\") pod \"e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq\" (UID: \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\") " pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"
Sep 08 11:48:55.322033 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:55.321846    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-istio-data\") pod \"e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq\" (UID: \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\") " pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"
Sep 08 11:48:55.322033 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:55.321875    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cddvw\" (UniqueName: \"kubernetes.io/projected/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-kube-api-access-cddvw\") pod \"e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq\" (UID: \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\") " pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"
Sep 08 11:48:55.322033 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:55.321909    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-workload-socket\") pod \"e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq\" (UID: \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\") " pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"
Sep 08 11:48:55.322033 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:55.321936    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-credential-socket\") pod \"e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq\" (UID: \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\") " pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"
Sep 08 11:48:55.322033 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:55.321966    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-istiod-ca-cert\") pod \"e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq\" (UID: \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\") " pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"
Sep 08 11:48:55.322033 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:55.322003    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-istio-envoy\") pod \"e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq\" (UID: \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\") " pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"
Sep 08 11:48:55.322033 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:55.322034    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-istio-token\") pod \"e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq\" (UID: \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\") " pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"
Sep 08 11:48:55.322423 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:55.322236    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-workload-certs\") pod \"e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq\" (UID: \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\") " pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"
Sep 08 11:48:55.322423 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:55.322313    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-istio-data\") pod \"e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq\" (UID: \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\") " pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"
Sep 08 11:48:55.322423 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:55.322415    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-credential-socket\") pod \"e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq\" (UID: \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\") " pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"
Sep 08 11:48:55.322541 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:55.322438    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-workload-socket\") pod \"e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq\" (UID: \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\") " pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"
Sep 08 11:48:55.322745 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:55.322722    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-istiod-ca-cert\") pod \"e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq\" (UID: \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\") " pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"
Sep 08 11:48:55.324362 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:55.324328    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-istio-podinfo\") pod \"e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq\" (UID: \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\") " pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"
Sep 08 11:48:55.324414 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:55.324364    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-istio-envoy\") pod \"e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq\" (UID: \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\") " pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"
Sep 08 11:48:55.338431 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:55.338405    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-istio-token\") pod \"e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq\" (UID: \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\") " pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"
Sep 08 11:48:55.338750 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:55.338730    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cddvw\" (UniqueName: \"kubernetes.io/projected/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-kube-api-access-cddvw\") pod \"e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq\" (UID: \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\") " pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"
Sep 08 11:48:55.448899 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:55.448818    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"
Sep 08 11:48:55.735423 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:55.735394    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"]
Sep 08 11:48:55.737576 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:48:55.737550    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58206bfc_9a1f_46fa_b55e_66f6f6eec2d3.slice/crio-af0fde2b6264a85fc24e67d4266a3a14730412d52094546959d521899e20fff1 WatchSource:0}: Error finding container af0fde2b6264a85fc24e67d4266a3a14730412d52094546959d521899e20fff1: Status 404 returned error can't find the container with id af0fde2b6264a85fc24e67d4266a3a14730412d52094546959d521899e20fff1
Sep 08 11:48:55.739789 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:55.739758    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:48:55.739847 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:55.739825    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:48:55.739885 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:55.739853    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:48:56.450285 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:56.450248    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq" event={"ID":"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3","Type":"ContainerStarted","Data":"eaff1c3fc7b673e462ef7176c5e33760a7267d2bc2b5f0c820149f7103cda63d"}
Sep 08 11:48:56.450718 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:56.450301    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq" event={"ID":"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3","Type":"ContainerStarted","Data":"af0fde2b6264a85fc24e67d4266a3a14730412d52094546959d521899e20fff1"}
Sep 08 11:48:57.449906 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:57.449870    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"
Sep 08 11:48:57.455643 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:57.455617    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"
Sep 08 11:48:57.456761 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:57.456745    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"
Sep 08 11:48:57.457582 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:57.457564    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"
Sep 08 11:48:57.479913 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:48:57.479871    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq" podStartSLOduration=2.479856731 podStartE2EDuration="2.479856731s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:48:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:48:56.474500951 +0000 UTC m=+1111.126207762" watchObservedRunningTime="2026-09-08 11:48:57.479856731 +0000 UTC m=+1112.131563557"
Sep 08 11:49:00.267244 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:00.267205    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f-8rzdn"]
Sep 08 11:49:00.271333 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:00.271312    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f-8rzdn"
Sep 08 11:49:00.275903 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:00.275880    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-489cdd\""
Sep 08 11:49:00.284630 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:00.284600    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f-8rzdn"]
Sep 08 11:49:00.368508 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:00.368472    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c960dc8-99df-4ac8-ae5f-f75f51a964e7-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f-8rzdn\" (UID: \"5c960dc8-99df-4ac8-ae5f-f75f51a964e7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f-8rzdn"
Sep 08 11:49:00.368673 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:00.368641    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wc8l\" (UniqueName: \"kubernetes.io/projected/5c960dc8-99df-4ac8-ae5f-f75f51a964e7-kube-api-access-5wc8l\") pod \"payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f-8rzdn\" (UID: \"5c960dc8-99df-4ac8-ae5f-f75f51a964e7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f-8rzdn"
Sep 08 11:49:00.470112 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:00.470048    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c960dc8-99df-4ac8-ae5f-f75f51a964e7-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f-8rzdn\" (UID: \"5c960dc8-99df-4ac8-ae5f-f75f51a964e7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f-8rzdn"
Sep 08 11:49:00.470303 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:00.470185    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wc8l\" (UniqueName: \"kubernetes.io/projected/5c960dc8-99df-4ac8-ae5f-f75f51a964e7-kube-api-access-5wc8l\") pod \"payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f-8rzdn\" (UID: \"5c960dc8-99df-4ac8-ae5f-f75f51a964e7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f-8rzdn"
Sep 08 11:49:00.471001 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:00.470976    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c960dc8-99df-4ac8-ae5f-f75f51a964e7-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f-8rzdn\" (UID: \"5c960dc8-99df-4ac8-ae5f-f75f51a964e7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f-8rzdn"
Sep 08 11:49:00.481600 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:00.481580    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wc8l\" (UniqueName: \"kubernetes.io/projected/5c960dc8-99df-4ac8-ae5f-f75f51a964e7-kube-api-access-5wc8l\") pod \"payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f-8rzdn\" (UID: \"5c960dc8-99df-4ac8-ae5f-f75f51a964e7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f-8rzdn"
Sep 08 11:49:00.582504 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:00.582480    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f-8rzdn"
Sep 08 11:49:00.859727 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:00.859706    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f-8rzdn"]
Sep 08 11:49:00.862128 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:49:00.862102    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c960dc8_99df_4ac8_ae5f_f75f51a964e7.slice/crio-c9dedc522d089cfec31cfcd4e3c599b9e21befc5eee83a4cf19e2579ac30ca88 WatchSource:0}: Error finding container c9dedc522d089cfec31cfcd4e3c599b9e21befc5eee83a4cf19e2579ac30ca88: Status 404 returned error can't find the container with id c9dedc522d089cfec31cfcd4e3c599b9e21befc5eee83a4cf19e2579ac30ca88
Sep 08 11:49:01.485829 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:01.485798    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f-8rzdn" event={"ID":"5c960dc8-99df-4ac8-ae5f-f75f51a964e7","Type":"ContainerStarted","Data":"44a56d285dc536c8060b4b2860ec734a4ba0ebfd67c6e57c3ceddc28f7b92b6a"}
Sep 08 11:49:01.486276 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:01.485849    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f-8rzdn" event={"ID":"5c960dc8-99df-4ac8-ae5f-f75f51a964e7","Type":"ContainerStarted","Data":"c9dedc522d089cfec31cfcd4e3c599b9e21befc5eee83a4cf19e2579ac30ca88"}
Sep 08 11:49:01.486276 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:01.485956    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f-8rzdn"
Sep 08 11:49:01.508629 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:01.508575    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f-8rzdn" podStartSLOduration=1.5085585 podStartE2EDuration="1.5085585s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:49:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:49:01.505759557 +0000 UTC m=+1116.157466372" watchObservedRunningTime="2026-09-08 11:49:01.5085585 +0000 UTC m=+1116.160265292"
Sep 08 11:49:12.494997 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:12.494962    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f-8rzdn"
Sep 08 11:49:20.597941 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:20.597904    2575 generic.go:356] "Generic (PLEG): container finished" podID="58206bfc-9a1f-46fa-b55e-66f6f6eec2d3" containerID="eaff1c3fc7b673e462ef7176c5e33760a7267d2bc2b5f0c820149f7103cda63d" exitCode=0
Sep 08 11:49:20.598399 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:20.597973    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq" event={"ID":"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3","Type":"ContainerDied","Data":"eaff1c3fc7b673e462ef7176c5e33760a7267d2bc2b5f0c820149f7103cda63d"}
Sep 08 11:49:20.598399 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:20.598395    2575 scope.go:117] "RemoveContainer" containerID="eaff1c3fc7b673e462ef7176c5e33760a7267d2bc2b5f0c820149f7103cda63d"
Sep 08 11:49:20.599487 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:20.599462    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:49:20.599548 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:20.599537    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:49:20.599584 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:20.599568    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:49:21.605558 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:21.605527    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq" event={"ID":"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3","Type":"ContainerStarted","Data":"1a1205c7edf5df5e6ed7bd9338c78245d4414ca4637045f259d8570774909f08"}
Sep 08 11:49:22.449686 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:22.449650    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"
Sep 08 11:49:22.449860 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:22.449840    2575 patch_prober.go:28] interesting pod/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 08 11:49:22.449921 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:22.449901    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq" podUID="58206bfc-9a1f-46fa-b55e-66f6f6eec2d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 08 11:49:23.449856 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:23.449822    2575 patch_prober.go:28] interesting pod/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 08 11:49:23.450258 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:23.449887    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq" podUID="58206bfc-9a1f-46fa-b55e-66f6f6eec2d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 08 11:49:24.449592 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:24.449559    2575 patch_prober.go:28] interesting pod/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 08 11:49:24.449760 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:24.449626    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq" podUID="58206bfc-9a1f-46fa-b55e-66f6f6eec2d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 08 11:49:25.449692 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:25.449660    2575 patch_prober.go:28] interesting pod/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 08 11:49:25.450090 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:25.449714    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq" podUID="58206bfc-9a1f-46fa-b55e-66f6f6eec2d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 08 11:49:26.449855 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:26.449819    2575 patch_prober.go:28] interesting pod/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 08 11:49:26.450258 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:26.449883    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq" podUID="58206bfc-9a1f-46fa-b55e-66f6f6eec2d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 08 11:49:27.453252 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:27.453221    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"
Sep 08 11:49:27.453658 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:27.453592    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"
Sep 08 11:49:27.454189 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:27.454169    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"
Sep 08 11:49:44.238761 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:44.238724    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb"]
Sep 08 11:49:44.242846 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:44.242828    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb"
Sep 08 11:49:44.245482 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:44.245462    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-63d6ac92-serving-cert\""
Sep 08 11:49:44.251526 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:44.251486    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb"]
Sep 08 11:49:44.298468 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:44.298437    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c32e7d5b-a32e-4560-8564-8dc6fa90fa93-maas-api-tls\") pod \"maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb\" (UID: \"c32e7d5b-a32e-4560-8564-8dc6fa90fa93\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb"
Sep 08 11:49:44.298612 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:44.298506    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxq7c\" (UniqueName: \"kubernetes.io/projected/c32e7d5b-a32e-4560-8564-8dc6fa90fa93-kube-api-access-kxq7c\") pod \"maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb\" (UID: \"c32e7d5b-a32e-4560-8564-8dc6fa90fa93\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb"
Sep 08 11:49:44.298612 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:44.298537    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c32e7d5b-a32e-4560-8564-8dc6fa90fa93-metrics-certs\") pod \"maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb\" (UID: \"c32e7d5b-a32e-4560-8564-8dc6fa90fa93\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb"
Sep 08 11:49:44.298612 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:44.298564    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c32e7d5b-a32e-4560-8564-8dc6fa90fa93-openshift-service-ca\") pod \"maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb\" (UID: \"c32e7d5b-a32e-4560-8564-8dc6fa90fa93\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb"
Sep 08 11:49:44.399600 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:44.399569    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxq7c\" (UniqueName: \"kubernetes.io/projected/c32e7d5b-a32e-4560-8564-8dc6fa90fa93-kube-api-access-kxq7c\") pod \"maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb\" (UID: \"c32e7d5b-a32e-4560-8564-8dc6fa90fa93\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb"
Sep 08 11:49:44.399783 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:44.399616    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c32e7d5b-a32e-4560-8564-8dc6fa90fa93-metrics-certs\") pod \"maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb\" (UID: \"c32e7d5b-a32e-4560-8564-8dc6fa90fa93\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb"
Sep 08 11:49:44.399783 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:44.399744    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c32e7d5b-a32e-4560-8564-8dc6fa90fa93-openshift-service-ca\") pod \"maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb\" (UID: \"c32e7d5b-a32e-4560-8564-8dc6fa90fa93\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb"
Sep 08 11:49:44.399900 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:44.399831    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c32e7d5b-a32e-4560-8564-8dc6fa90fa93-maas-api-tls\") pod \"maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb\" (UID: \"c32e7d5b-a32e-4560-8564-8dc6fa90fa93\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb"
Sep 08 11:49:44.399982 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:49:44.399962    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-63d6ac92-serving-cert: secret "maas-api-e2e-mt-63d6ac92-serving-cert" not found
Sep 08 11:49:44.400065 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:49:44.400054    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c32e7d5b-a32e-4560-8564-8dc6fa90fa93-maas-api-tls podName:c32e7d5b-a32e-4560-8564-8dc6fa90fa93 nodeName:}" failed. No retries permitted until 2026-09-08 11:49:44.900030297 +0000 UTC m=+1159.551737070 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c32e7d5b-a32e-4560-8564-8dc6fa90fa93-maas-api-tls") pod "maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb" (UID: "c32e7d5b-a32e-4560-8564-8dc6fa90fa93") : secret "maas-api-e2e-mt-63d6ac92-serving-cert" not found
Sep 08 11:49:44.400432 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:44.400417    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c32e7d5b-a32e-4560-8564-8dc6fa90fa93-openshift-service-ca\") pod \"maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb\" (UID: \"c32e7d5b-a32e-4560-8564-8dc6fa90fa93\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb"
Sep 08 11:49:44.402084 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:44.402041    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c32e7d5b-a32e-4560-8564-8dc6fa90fa93-metrics-certs\") pod \"maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb\" (UID: \"c32e7d5b-a32e-4560-8564-8dc6fa90fa93\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb"
Sep 08 11:49:44.408805 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:44.408782    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxq7c\" (UniqueName: \"kubernetes.io/projected/c32e7d5b-a32e-4560-8564-8dc6fa90fa93-kube-api-access-kxq7c\") pod \"maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb\" (UID: \"c32e7d5b-a32e-4560-8564-8dc6fa90fa93\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb"
Sep 08 11:49:44.903766 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:44.903731    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c32e7d5b-a32e-4560-8564-8dc6fa90fa93-maas-api-tls\") pod \"maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb\" (UID: \"c32e7d5b-a32e-4560-8564-8dc6fa90fa93\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb"
Sep 08 11:49:44.906213 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:44.906187    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c32e7d5b-a32e-4560-8564-8dc6fa90fa93-maas-api-tls\") pod \"maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb\" (UID: \"c32e7d5b-a32e-4560-8564-8dc6fa90fa93\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb"
Sep 08 11:49:45.155199 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:45.155106    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb"
Sep 08 11:49:45.431394 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:45.431368    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb"]
Sep 08 11:49:45.433324 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:49:45.433298    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc32e7d5b_a32e_4560_8564_8dc6fa90fa93.slice/crio-92e32aa56a5f742cc93ad2f7fd2d829cd30a7ea08c56b0e49cef88e7d1f75103 WatchSource:0}: Error finding container 92e32aa56a5f742cc93ad2f7fd2d829cd30a7ea08c56b0e49cef88e7d1f75103: Status 404 returned error can't find the container with id 92e32aa56a5f742cc93ad2f7fd2d829cd30a7ea08c56b0e49cef88e7d1f75103
Sep 08 11:49:45.736036 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:45.735959    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb" event={"ID":"c32e7d5b-a32e-4560-8564-8dc6fa90fa93","Type":"ContainerStarted","Data":"92e32aa56a5f742cc93ad2f7fd2d829cd30a7ea08c56b0e49cef88e7d1f75103"}
Sep 08 11:49:46.743107 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:46.743025    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb" event={"ID":"c32e7d5b-a32e-4560-8564-8dc6fa90fa93","Type":"ContainerStarted","Data":"86a8a2495307fd54f7f8e93f57c34f04eef5eca6f02d3cdca9a33898c77a36a8"}
Sep 08 11:49:46.743479 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:46.743155    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb"
Sep 08 11:49:46.762569 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:46.762524    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb" podStartSLOduration=2.325145431 podStartE2EDuration="2.762510586s" totalImagesPullingTime="437.365155ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:49:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:49:46.761542536 +0000 UTC m=+1161.413249360" watchObservedRunningTime="2026-09-08 11:49:46.762510586 +0000 UTC m=+1161.414217379"
Sep 08 11:49:52.752923 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:49:52.752890    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb"
Sep 08 11:50:25.936201 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:50:25.936175    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m57jb_63788019-f061-44d6-89a3-50c4a62e9fbf/ovn-acl-logging/0.log"
Sep 08 11:50:25.937208 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:50:25.937195    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m57jb_63788019-f061-44d6-89a3-50c4a62e9fbf/ovn-acl-logging/0.log"
Sep 08 11:51:23.450396 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:51:23.450308    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb"]
Sep 08 11:51:23.450951 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:51:23.450570    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb" podUID="c32e7d5b-a32e-4560-8564-8dc6fa90fa93" containerName="maas-api" containerID="cri-o://86a8a2495307fd54f7f8e93f57c34f04eef5eca6f02d3cdca9a33898c77a36a8" gracePeriod=30
Sep 08 11:51:23.711062 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:51:23.711007    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb"
Sep 08 11:51:23.774789 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:51:23.774762    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c32e7d5b-a32e-4560-8564-8dc6fa90fa93-openshift-service-ca\") pod \"c32e7d5b-a32e-4560-8564-8dc6fa90fa93\" (UID: \"c32e7d5b-a32e-4560-8564-8dc6fa90fa93\") "
Sep 08 11:51:23.774960 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:51:23.774823    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxq7c\" (UniqueName: \"kubernetes.io/projected/c32e7d5b-a32e-4560-8564-8dc6fa90fa93-kube-api-access-kxq7c\") pod \"c32e7d5b-a32e-4560-8564-8dc6fa90fa93\" (UID: \"c32e7d5b-a32e-4560-8564-8dc6fa90fa93\") "
Sep 08 11:51:23.774960 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:51:23.774855    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c32e7d5b-a32e-4560-8564-8dc6fa90fa93-metrics-certs\") pod \"c32e7d5b-a32e-4560-8564-8dc6fa90fa93\" (UID: \"c32e7d5b-a32e-4560-8564-8dc6fa90fa93\") "
Sep 08 11:51:23.774960 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:51:23.774901    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c32e7d5b-a32e-4560-8564-8dc6fa90fa93-maas-api-tls\") pod \"c32e7d5b-a32e-4560-8564-8dc6fa90fa93\" (UID: \"c32e7d5b-a32e-4560-8564-8dc6fa90fa93\") "
Sep 08 11:51:23.775207 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:51:23.775177    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c32e7d5b-a32e-4560-8564-8dc6fa90fa93-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c32e7d5b-a32e-4560-8564-8dc6fa90fa93" (UID: "c32e7d5b-a32e-4560-8564-8dc6fa90fa93"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:51:23.777148 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:51:23.777121    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c32e7d5b-a32e-4560-8564-8dc6fa90fa93-kube-api-access-kxq7c" (OuterVolumeSpecName: "kube-api-access-kxq7c") pod "c32e7d5b-a32e-4560-8564-8dc6fa90fa93" (UID: "c32e7d5b-a32e-4560-8564-8dc6fa90fa93"). InnerVolumeSpecName "kube-api-access-kxq7c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:51:23.777148 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:51:23.777135    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c32e7d5b-a32e-4560-8564-8dc6fa90fa93-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c32e7d5b-a32e-4560-8564-8dc6fa90fa93" (UID: "c32e7d5b-a32e-4560-8564-8dc6fa90fa93"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:51:23.777284 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:51:23.777162    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c32e7d5b-a32e-4560-8564-8dc6fa90fa93-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c32e7d5b-a32e-4560-8564-8dc6fa90fa93" (UID: "c32e7d5b-a32e-4560-8564-8dc6fa90fa93"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:51:23.875920 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:51:23.875885    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c32e7d5b-a32e-4560-8564-8dc6fa90fa93-maas-api-tls\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:51:23.875920 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:51:23.875919    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c32e7d5b-a32e-4560-8564-8dc6fa90fa93-openshift-service-ca\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:51:23.876119 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:51:23.875930    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxq7c\" (UniqueName: \"kubernetes.io/projected/c32e7d5b-a32e-4560-8564-8dc6fa90fa93-kube-api-access-kxq7c\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:51:23.876119 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:51:23.875938    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c32e7d5b-a32e-4560-8564-8dc6fa90fa93-metrics-certs\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:51:24.272428 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:51:24.272396    2575 generic.go:356] "Generic (PLEG): container finished" podID="c32e7d5b-a32e-4560-8564-8dc6fa90fa93" containerID="86a8a2495307fd54f7f8e93f57c34f04eef5eca6f02d3cdca9a33898c77a36a8" exitCode=0
Sep 08 11:51:24.272602 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:51:24.272437    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb"
Sep 08 11:51:24.272602 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:51:24.272458    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb" event={"ID":"c32e7d5b-a32e-4560-8564-8dc6fa90fa93","Type":"ContainerDied","Data":"86a8a2495307fd54f7f8e93f57c34f04eef5eca6f02d3cdca9a33898c77a36a8"}
Sep 08 11:51:24.272602 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:51:24.272505    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb" event={"ID":"c32e7d5b-a32e-4560-8564-8dc6fa90fa93","Type":"ContainerDied","Data":"92e32aa56a5f742cc93ad2f7fd2d829cd30a7ea08c56b0e49cef88e7d1f75103"}
Sep 08 11:51:24.272602 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:51:24.272526    2575 scope.go:117] "RemoveContainer" containerID="86a8a2495307fd54f7f8e93f57c34f04eef5eca6f02d3cdca9a33898c77a36a8"
Sep 08 11:51:24.283936 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:51:24.283916    2575 scope.go:117] "RemoveContainer" containerID="86a8a2495307fd54f7f8e93f57c34f04eef5eca6f02d3cdca9a33898c77a36a8"
Sep 08 11:51:24.284203 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:51:24.284184    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86a8a2495307fd54f7f8e93f57c34f04eef5eca6f02d3cdca9a33898c77a36a8\": container with ID starting with 86a8a2495307fd54f7f8e93f57c34f04eef5eca6f02d3cdca9a33898c77a36a8 not found: ID does not exist" containerID="86a8a2495307fd54f7f8e93f57c34f04eef5eca6f02d3cdca9a33898c77a36a8"
Sep 08 11:51:24.284257 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:51:24.284213    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86a8a2495307fd54f7f8e93f57c34f04eef5eca6f02d3cdca9a33898c77a36a8"} err="failed to get container status \"86a8a2495307fd54f7f8e93f57c34f04eef5eca6f02d3cdca9a33898c77a36a8\": rpc error: code = NotFound desc = could not find container \"86a8a2495307fd54f7f8e93f57c34f04eef5eca6f02d3cdca9a33898c77a36a8\": container with ID starting with 86a8a2495307fd54f7f8e93f57c34f04eef5eca6f02d3cdca9a33898c77a36a8 not found: ID does not exist"
Sep 08 11:51:24.293165 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:51:24.293145    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb"]
Sep 08 11:51:24.298034 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:51:24.298007    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-63d6ac92-7d886cfb8d-nvmvb"]
Sep 08 11:51:25.842851 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:51:25.842817    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c32e7d5b-a32e-4560-8564-8dc6fa90fa93" path="/var/lib/kubelet/pods/c32e7d5b-a32e-4560-8564-8dc6fa90fa93/volumes"
Sep 08 11:53:51.978442 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:51.978412    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"]
Sep 08 11:53:51.978918 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:51.978884    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c32e7d5b-a32e-4560-8564-8dc6fa90fa93" containerName="maas-api"
Sep 08 11:53:51.978918 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:51.978896    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c32e7d5b-a32e-4560-8564-8dc6fa90fa93" containerName="maas-api"
Sep 08 11:53:51.978995 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:51.978969    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c32e7d5b-a32e-4560-8564-8dc6fa90fa93" containerName="maas-api"
Sep 08 11:53:51.982229 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:51.982207    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"
Sep 08 11:53:51.985365 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:51.985327    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-3f9288-openshift-default-dockercfg-qk7rq\""
Sep 08 11:53:51.997020 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:51.996995    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"]
Sep 08 11:53:52.026307 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:52.026274    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8720989c-68c4-47f5-88b9-01c994e9e411-istio-podinfo\") pod \"e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49\" (UID: \"8720989c-68c4-47f5-88b9-01c994e9e411\") " pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"
Sep 08 11:53:52.026307 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:52.026309    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8720989c-68c4-47f5-88b9-01c994e9e411-istio-envoy\") pod \"e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49\" (UID: \"8720989c-68c4-47f5-88b9-01c994e9e411\") " pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"
Sep 08 11:53:52.026563 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:52.026334    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwzhj\" (UniqueName: \"kubernetes.io/projected/8720989c-68c4-47f5-88b9-01c994e9e411-kube-api-access-vwzhj\") pod \"e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49\" (UID: \"8720989c-68c4-47f5-88b9-01c994e9e411\") " pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"
Sep 08 11:53:52.026563 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:52.026399    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8720989c-68c4-47f5-88b9-01c994e9e411-istiod-ca-cert\") pod \"e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49\" (UID: \"8720989c-68c4-47f5-88b9-01c994e9e411\") " pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"
Sep 08 11:53:52.026563 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:52.026460    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8720989c-68c4-47f5-88b9-01c994e9e411-istio-token\") pod \"e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49\" (UID: \"8720989c-68c4-47f5-88b9-01c994e9e411\") " pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"
Sep 08 11:53:52.026563 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:52.026480    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8720989c-68c4-47f5-88b9-01c994e9e411-workload-certs\") pod \"e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49\" (UID: \"8720989c-68c4-47f5-88b9-01c994e9e411\") " pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"
Sep 08 11:53:52.026761 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:52.026573    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8720989c-68c4-47f5-88b9-01c994e9e411-credential-socket\") pod \"e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49\" (UID: \"8720989c-68c4-47f5-88b9-01c994e9e411\") " pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"
Sep 08 11:53:52.026761 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:52.026657    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8720989c-68c4-47f5-88b9-01c994e9e411-istio-data\") pod \"e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49\" (UID: \"8720989c-68c4-47f5-88b9-01c994e9e411\") " pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"
Sep 08 11:53:52.026761 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:52.026729    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8720989c-68c4-47f5-88b9-01c994e9e411-workload-socket\") pod \"e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49\" (UID: \"8720989c-68c4-47f5-88b9-01c994e9e411\") " pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"
Sep 08 11:53:52.128241 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:52.128206    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8720989c-68c4-47f5-88b9-01c994e9e411-istio-podinfo\") pod \"e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49\" (UID: \"8720989c-68c4-47f5-88b9-01c994e9e411\") " pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"
Sep 08 11:53:52.128241 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:52.128247    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8720989c-68c4-47f5-88b9-01c994e9e411-istio-envoy\") pod \"e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49\" (UID: \"8720989c-68c4-47f5-88b9-01c994e9e411\") " pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"
Sep 08 11:53:52.128502 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:52.128267    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwzhj\" (UniqueName: \"kubernetes.io/projected/8720989c-68c4-47f5-88b9-01c994e9e411-kube-api-access-vwzhj\") pod \"e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49\" (UID: \"8720989c-68c4-47f5-88b9-01c994e9e411\") " pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"
Sep 08 11:53:52.128502 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:52.128290    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8720989c-68c4-47f5-88b9-01c994e9e411-istiod-ca-cert\") pod \"e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49\" (UID: \"8720989c-68c4-47f5-88b9-01c994e9e411\") " pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"
Sep 08 11:53:52.128502 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:52.128362    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8720989c-68c4-47f5-88b9-01c994e9e411-istio-token\") pod \"e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49\" (UID: \"8720989c-68c4-47f5-88b9-01c994e9e411\") " pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"
Sep 08 11:53:52.128667 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:52.128511    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8720989c-68c4-47f5-88b9-01c994e9e411-workload-certs\") pod \"e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49\" (UID: \"8720989c-68c4-47f5-88b9-01c994e9e411\") " pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"
Sep 08 11:53:52.128667 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:52.128602    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8720989c-68c4-47f5-88b9-01c994e9e411-credential-socket\") pod \"e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49\" (UID: \"8720989c-68c4-47f5-88b9-01c994e9e411\") " pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"
Sep 08 11:53:52.128769 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:52.128677    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8720989c-68c4-47f5-88b9-01c994e9e411-istio-data\") pod \"e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49\" (UID: \"8720989c-68c4-47f5-88b9-01c994e9e411\") " pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"
Sep 08 11:53:52.128769 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:52.128736    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8720989c-68c4-47f5-88b9-01c994e9e411-workload-socket\") pod \"e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49\" (UID: \"8720989c-68c4-47f5-88b9-01c994e9e411\") " pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"
Sep 08 11:53:52.128896 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:52.128874    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8720989c-68c4-47f5-88b9-01c994e9e411-workload-certs\") pod \"e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49\" (UID: \"8720989c-68c4-47f5-88b9-01c994e9e411\") " pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"
Sep 08 11:53:52.128998 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:52.128976    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8720989c-68c4-47f5-88b9-01c994e9e411-istio-data\") pod \"e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49\" (UID: \"8720989c-68c4-47f5-88b9-01c994e9e411\") " pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"
Sep 08 11:53:52.129226 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:52.129203    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8720989c-68c4-47f5-88b9-01c994e9e411-istiod-ca-cert\") pod \"e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49\" (UID: \"8720989c-68c4-47f5-88b9-01c994e9e411\") " pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"
Sep 08 11:53:52.129278 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:52.129237    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8720989c-68c4-47f5-88b9-01c994e9e411-credential-socket\") pod \"e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49\" (UID: \"8720989c-68c4-47f5-88b9-01c994e9e411\") " pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"
Sep 08 11:53:52.129278 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:52.129241    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8720989c-68c4-47f5-88b9-01c994e9e411-workload-socket\") pod \"e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49\" (UID: \"8720989c-68c4-47f5-88b9-01c994e9e411\") " pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"
Sep 08 11:53:52.130752 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:52.130728    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8720989c-68c4-47f5-88b9-01c994e9e411-istio-envoy\") pod \"e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49\" (UID: \"8720989c-68c4-47f5-88b9-01c994e9e411\") " pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"
Sep 08 11:53:52.131028 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:52.131010    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8720989c-68c4-47f5-88b9-01c994e9e411-istio-podinfo\") pod \"e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49\" (UID: \"8720989c-68c4-47f5-88b9-01c994e9e411\") " pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"
Sep 08 11:53:52.137683 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:52.137658    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8720989c-68c4-47f5-88b9-01c994e9e411-istio-token\") pod \"e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49\" (UID: \"8720989c-68c4-47f5-88b9-01c994e9e411\") " pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"
Sep 08 11:53:52.137877 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:52.137854    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwzhj\" (UniqueName: \"kubernetes.io/projected/8720989c-68c4-47f5-88b9-01c994e9e411-kube-api-access-vwzhj\") pod \"e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49\" (UID: \"8720989c-68c4-47f5-88b9-01c994e9e411\") " pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"
Sep 08 11:53:52.293973 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:52.293937    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"
Sep 08 11:53:52.575486 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:52.575461    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"]
Sep 08 11:53:52.578077 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:53:52.578049    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8720989c_68c4_47f5_88b9_01c994e9e411.slice/crio-ba2a759e9840ca47335e51702031fa472103f0bc3c3437f1cb585b7887949782 WatchSource:0}: Error finding container ba2a759e9840ca47335e51702031fa472103f0bc3c3437f1cb585b7887949782: Status 404 returned error can't find the container with id ba2a759e9840ca47335e51702031fa472103f0bc3c3437f1cb585b7887949782
Sep 08 11:53:52.580731 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:52.580697    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:53:52.580830 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:52.580764    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:53:52.580830 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:52.580794    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:53:53.057402 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:53.057361    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49" event={"ID":"8720989c-68c4-47f5-88b9-01c994e9e411","Type":"ContainerStarted","Data":"4958a2d5015bf21109060ea4a394bd4a62a689cc6159f728e7a647213da01cb8"}
Sep 08 11:53:53.057799 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:53.057417    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49" event={"ID":"8720989c-68c4-47f5-88b9-01c994e9e411","Type":"ContainerStarted","Data":"ba2a759e9840ca47335e51702031fa472103f0bc3c3437f1cb585b7887949782"}
Sep 08 11:53:53.081218 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:53.081170    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49" podStartSLOduration=2.081154116 podStartE2EDuration="2.081154116s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:53:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:53:53.079317084 +0000 UTC m=+1407.731023897" watchObservedRunningTime="2026-09-08 11:53:53.081154116 +0000 UTC m=+1407.732860909"
Sep 08 11:53:53.294323 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:53.294288    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"
Sep 08 11:53:53.299200 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:53.299176    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"
Sep 08 11:53:54.062985 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:54.062955    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"
Sep 08 11:53:54.064013 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:54.063995    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"
Sep 08 11:53:57.003831 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:57.003802    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-3f9288-fc9c679f7-q7h5c"]
Sep 08 11:53:57.007378 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:57.007362    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-3f9288-fc9c679f7-q7h5c"
Sep 08 11:53:57.010548 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:57.010527    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-3f9288\""
Sep 08 11:53:57.010675 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:57.010556    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-3f9288-dockercfg-rqhbk\""
Sep 08 11:53:57.016863 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:57.016840    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-3f9288-fc9c679f7-q7h5c"]
Sep 08 11:53:57.081505 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:57.081469    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2fw6\" (UniqueName: \"kubernetes.io/projected/1dcf7efe-bf30-4533-9658-4d2d89e40c40-kube-api-access-h2fw6\") pod \"payload-processing-e2e-ipp-a-3f9288-fc9c679f7-q7h5c\" (UID: \"1dcf7efe-bf30-4533-9658-4d2d89e40c40\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-3f9288-fc9c679f7-q7h5c"
Sep 08 11:53:57.081694 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:57.081604    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1dcf7efe-bf30-4533-9658-4d2d89e40c40-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-3f9288-fc9c679f7-q7h5c\" (UID: \"1dcf7efe-bf30-4533-9658-4d2d89e40c40\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-3f9288-fc9c679f7-q7h5c"
Sep 08 11:53:57.182729 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:57.182698    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2fw6\" (UniqueName: \"kubernetes.io/projected/1dcf7efe-bf30-4533-9658-4d2d89e40c40-kube-api-access-h2fw6\") pod \"payload-processing-e2e-ipp-a-3f9288-fc9c679f7-q7h5c\" (UID: \"1dcf7efe-bf30-4533-9658-4d2d89e40c40\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-3f9288-fc9c679f7-q7h5c"
Sep 08 11:53:57.182944 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:57.182793    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1dcf7efe-bf30-4533-9658-4d2d89e40c40-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-3f9288-fc9c679f7-q7h5c\" (UID: \"1dcf7efe-bf30-4533-9658-4d2d89e40c40\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-3f9288-fc9c679f7-q7h5c"
Sep 08 11:53:57.183563 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:57.183541    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1dcf7efe-bf30-4533-9658-4d2d89e40c40-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-3f9288-fc9c679f7-q7h5c\" (UID: \"1dcf7efe-bf30-4533-9658-4d2d89e40c40\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-3f9288-fc9c679f7-q7h5c"
Sep 08 11:53:57.192776 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:57.192749    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2fw6\" (UniqueName: \"kubernetes.io/projected/1dcf7efe-bf30-4533-9658-4d2d89e40c40-kube-api-access-h2fw6\") pod \"payload-processing-e2e-ipp-a-3f9288-fc9c679f7-q7h5c\" (UID: \"1dcf7efe-bf30-4533-9658-4d2d89e40c40\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-3f9288-fc9c679f7-q7h5c"
Sep 08 11:53:57.319307 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:57.319270    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-3f9288-fc9c679f7-q7h5c"
Sep 08 11:53:57.599549 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:57.599520    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-3f9288-fc9c679f7-q7h5c"]
Sep 08 11:53:57.601270 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:53:57.601240    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dcf7efe_bf30_4533_9658_4d2d89e40c40.slice/crio-3680df02255ad252334c9216c926926ab01659a14101356e35f7d5cb0c9c6bbf WatchSource:0}: Error finding container 3680df02255ad252334c9216c926926ab01659a14101356e35f7d5cb0c9c6bbf: Status 404 returned error can't find the container with id 3680df02255ad252334c9216c926926ab01659a14101356e35f7d5cb0c9c6bbf
Sep 08 11:53:58.087722 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:58.087687    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-3f9288-fc9c679f7-q7h5c" event={"ID":"1dcf7efe-bf30-4533-9658-4d2d89e40c40","Type":"ContainerStarted","Data":"6196c56e23bdaadd5921830938c3beb03948d6c35a52c367fecd532ee06bf83f"}
Sep 08 11:53:58.088140 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:58.087748    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-3f9288-fc9c679f7-q7h5c" event={"ID":"1dcf7efe-bf30-4533-9658-4d2d89e40c40","Type":"ContainerStarted","Data":"3680df02255ad252334c9216c926926ab01659a14101356e35f7d5cb0c9c6bbf"}
Sep 08 11:53:58.088140 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:58.087781    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-3f9288-fc9c679f7-q7h5c"
Sep 08 11:53:58.110070 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:53:58.109997    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-3f9288-fc9c679f7-q7h5c" podStartSLOduration=2.1099799360000002 podStartE2EDuration="2.109979936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:53:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:53:58.107653702 +0000 UTC m=+1412.759360515" watchObservedRunningTime="2026-09-08 11:53:58.109979936 +0000 UTC m=+1412.761686773"
Sep 08 11:54:09.095762 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:09.095732    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-3f9288-fc9c679f7-q7h5c"
Sep 08 11:54:13.169161 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:13.169128    2575 generic.go:356] "Generic (PLEG): container finished" podID="8720989c-68c4-47f5-88b9-01c994e9e411" containerID="4958a2d5015bf21109060ea4a394bd4a62a689cc6159f728e7a647213da01cb8" exitCode=0
Sep 08 11:54:13.169599 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:13.169217    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49" event={"ID":"8720989c-68c4-47f5-88b9-01c994e9e411","Type":"ContainerDied","Data":"4958a2d5015bf21109060ea4a394bd4a62a689cc6159f728e7a647213da01cb8"}
Sep 08 11:54:13.169800 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:13.169782    2575 scope.go:117] "RemoveContainer" containerID="4958a2d5015bf21109060ea4a394bd4a62a689cc6159f728e7a647213da01cb8"
Sep 08 11:54:13.170992 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:13.170962    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:54:13.171099 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:13.171026    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:54:13.171099 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:13.171060    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:54:14.183007 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:14.182203    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49" event={"ID":"8720989c-68c4-47f5-88b9-01c994e9e411","Type":"ContainerStarted","Data":"c0399a34738df45a5ad42cb1276961d296fe60fd56db348810180b39c4ba18ae"}
Sep 08 11:54:14.295176 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:14.295139    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"
Sep 08 11:54:14.295384 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:14.295370    2575 patch_prober.go:28] interesting pod/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 08 11:54:14.295429 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:14.295411    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49" podUID="8720989c-68c4-47f5-88b9-01c994e9e411" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 08 11:54:15.294431 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:15.294400    2575 patch_prober.go:28] interesting pod/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 08 11:54:15.294832 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:15.294448    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49" podUID="8720989c-68c4-47f5-88b9-01c994e9e411" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 08 11:54:16.294508 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:16.294475    2575 patch_prober.go:28] interesting pod/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 08 11:54:16.294880 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:16.294543    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49" podUID="8720989c-68c4-47f5-88b9-01c994e9e411" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 08 11:54:17.295035 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:17.294996    2575 patch_prober.go:28] interesting pod/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 08 11:54:17.295478 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:17.295065    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49" podUID="8720989c-68c4-47f5-88b9-01c994e9e411" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 08 11:54:18.295406 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:18.295331    2575 patch_prober.go:28] interesting pod/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 08 11:54:18.295815 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:18.295451    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49" podUID="8720989c-68c4-47f5-88b9-01c994e9e411" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 08 11:54:19.294249 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:19.294210    2575 patch_prober.go:28] interesting pod/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 08 11:54:19.294458 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:19.294271    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49" podUID="8720989c-68c4-47f5-88b9-01c994e9e411" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 08 11:54:20.299625 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:20.299599    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"
Sep 08 11:54:20.300023 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:20.299882    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"
Sep 08 11:54:20.300534 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:20.300516    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"
Sep 08 11:54:20.945937 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:20.945908    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"]
Sep 08 11:54:20.950849 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:20.950824    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"
Sep 08 11:54:20.954143 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:20.954124    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-2ebeba-openshift-default-dockercfg-jztg6\""
Sep 08 11:54:20.963579 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:20.963557    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"]
Sep 08 11:54:21.043926 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:21.043897    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-istio-envoy\") pod \"e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl\" (UID: \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\") " pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"
Sep 08 11:54:21.044074 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:21.043950    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-istio-token\") pod \"e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl\" (UID: \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\") " pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"
Sep 08 11:54:21.044074 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:21.043973    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-istio-data\") pod \"e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl\" (UID: \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\") " pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"
Sep 08 11:54:21.044074 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:21.043990    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-credential-socket\") pod \"e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl\" (UID: \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\") " pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"
Sep 08 11:54:21.044074 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:21.044014    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-istiod-ca-cert\") pod \"e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl\" (UID: \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\") " pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"
Sep 08 11:54:21.044074 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:21.044055    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmn4g\" (UniqueName: \"kubernetes.io/projected/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-kube-api-access-hmn4g\") pod \"e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl\" (UID: \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\") " pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"
Sep 08 11:54:21.044272 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:21.044084    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-istio-podinfo\") pod \"e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl\" (UID: \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\") " pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"
Sep 08 11:54:21.044272 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:21.044140    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-workload-certs\") pod \"e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl\" (UID: \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\") " pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"
Sep 08 11:54:21.044272 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:21.044159    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-workload-socket\") pod \"e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl\" (UID: \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\") " pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"
Sep 08 11:54:21.145410 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:21.145376    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-workload-certs\") pod \"e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl\" (UID: \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\") " pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"
Sep 08 11:54:21.145592 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:21.145416    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-workload-socket\") pod \"e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl\" (UID: \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\") " pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"
Sep 08 11:54:21.145592 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:21.145472    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-istio-envoy\") pod \"e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl\" (UID: \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\") " pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"
Sep 08 11:54:21.145592 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:21.145557    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-istio-token\") pod \"e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl\" (UID: \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\") " pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"
Sep 08 11:54:21.145727 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:21.145590    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-istio-data\") pod \"e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl\" (UID: \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\") " pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"
Sep 08 11:54:21.145727 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:21.145618    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-credential-socket\") pod \"e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl\" (UID: \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\") " pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"
Sep 08 11:54:21.145727 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:21.145661    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-istiod-ca-cert\") pod \"e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl\" (UID: \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\") " pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"
Sep 08 11:54:21.145727 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:21.145694    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmn4g\" (UniqueName: \"kubernetes.io/projected/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-kube-api-access-hmn4g\") pod \"e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl\" (UID: \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\") " pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"
Sep 08 11:54:21.145958 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:21.145936    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-istio-podinfo\") pod \"e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl\" (UID: \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\") " pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"
Sep 08 11:54:21.146038 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:21.145788    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-workload-certs\") pod \"e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl\" (UID: \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\") " pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"
Sep 08 11:54:21.146038 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:21.145979    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-istio-data\") pod \"e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl\" (UID: \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\") " pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"
Sep 08 11:54:21.146038 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:21.145878    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-workload-socket\") pod \"e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl\" (UID: \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\") " pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"
Sep 08 11:54:21.146185 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:21.146112    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-credential-socket\") pod \"e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl\" (UID: \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\") " pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"
Sep 08 11:54:21.146430 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:21.146411    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-istiod-ca-cert\") pod \"e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl\" (UID: \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\") " pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"
Sep 08 11:54:21.148012 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:21.147989    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-istio-envoy\") pod \"e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl\" (UID: \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\") " pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"
Sep 08 11:54:21.148477 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:21.148459    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-istio-podinfo\") pod \"e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl\" (UID: \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\") " pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"
Sep 08 11:54:21.154973 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:21.154948    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmn4g\" (UniqueName: \"kubernetes.io/projected/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-kube-api-access-hmn4g\") pod \"e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl\" (UID: \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\") " pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"
Sep 08 11:54:21.155134 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:21.155118    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-istio-token\") pod \"e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl\" (UID: \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\") " pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"
Sep 08 11:54:21.261955 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:21.261863    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"
Sep 08 11:54:21.544380 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:21.544355    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"]
Sep 08 11:54:21.546391 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:54:21.546361    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d3a4505_aaf2_4b3f_9342_e7ffb67f2cde.slice/crio-0b43a0b79dbd0e3ff16d5c24a08024e48605102e0a783cf9c5fb942bb4dd50e1 WatchSource:0}: Error finding container 0b43a0b79dbd0e3ff16d5c24a08024e48605102e0a783cf9c5fb942bb4dd50e1: Status 404 returned error can't find the container with id 0b43a0b79dbd0e3ff16d5c24a08024e48605102e0a783cf9c5fb942bb4dd50e1
Sep 08 11:54:21.548861 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:21.548828    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:54:21.548939 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:21.548891    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:54:21.548939 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:21.548918    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:54:22.229085 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:22.229049    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl" event={"ID":"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde","Type":"ContainerStarted","Data":"8261c4d9a2ed871194133607336b4f948cbe0bab9e4da55e09d40b63edbc18f2"}
Sep 08 11:54:22.229314 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:22.229109    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl" event={"ID":"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde","Type":"ContainerStarted","Data":"0b43a0b79dbd0e3ff16d5c24a08024e48605102e0a783cf9c5fb942bb4dd50e1"}
Sep 08 11:54:22.255995 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:22.255927    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl" podStartSLOduration=2.25591157 podStartE2EDuration="2.25591157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:54:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:54:22.254203816 +0000 UTC m=+1436.905910637" watchObservedRunningTime="2026-09-08 11:54:22.25591157 +0000 UTC m=+1436.907618364"
Sep 08 11:54:22.263089 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:22.263065    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"
Sep 08 11:54:22.268577 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:22.268557    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"
Sep 08 11:54:23.235127 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:23.235102    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"
Sep 08 11:54:23.235981 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:23.235964    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"
Sep 08 11:54:26.208909 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:26.208881    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b-n5xnn"]
Sep 08 11:54:26.213157 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:26.213131    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b-n5xnn"
Sep 08 11:54:26.216651 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:26.216627    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-2ebeba-dockercfg-qw56b\""
Sep 08 11:54:26.216781 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:26.216636    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-2ebeba\""
Sep 08 11:54:26.227388 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:26.227365    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b-n5xnn"]
Sep 08 11:54:26.295371 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:26.295301    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsqbm\" (UniqueName: \"kubernetes.io/projected/c933e6cd-a0e9-4974-840c-72f187af1ad6-kube-api-access-wsqbm\") pod \"payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b-n5xnn\" (UID: \"c933e6cd-a0e9-4974-840c-72f187af1ad6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b-n5xnn"
Sep 08 11:54:26.295541 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:26.295443    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c933e6cd-a0e9-4974-840c-72f187af1ad6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b-n5xnn\" (UID: \"c933e6cd-a0e9-4974-840c-72f187af1ad6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b-n5xnn"
Sep 08 11:54:26.396533 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:26.396500    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsqbm\" (UniqueName: \"kubernetes.io/projected/c933e6cd-a0e9-4974-840c-72f187af1ad6-kube-api-access-wsqbm\") pod \"payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b-n5xnn\" (UID: \"c933e6cd-a0e9-4974-840c-72f187af1ad6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b-n5xnn"
Sep 08 11:54:26.396696 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:26.396549    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c933e6cd-a0e9-4974-840c-72f187af1ad6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b-n5xnn\" (UID: \"c933e6cd-a0e9-4974-840c-72f187af1ad6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b-n5xnn"
Sep 08 11:54:26.397189 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:26.397171    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c933e6cd-a0e9-4974-840c-72f187af1ad6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b-n5xnn\" (UID: \"c933e6cd-a0e9-4974-840c-72f187af1ad6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b-n5xnn"
Sep 08 11:54:26.410629 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:26.410599    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsqbm\" (UniqueName: \"kubernetes.io/projected/c933e6cd-a0e9-4974-840c-72f187af1ad6-kube-api-access-wsqbm\") pod \"payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b-n5xnn\" (UID: \"c933e6cd-a0e9-4974-840c-72f187af1ad6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b-n5xnn"
Sep 08 11:54:26.526054 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:26.526023    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b-n5xnn"
Sep 08 11:54:26.804597 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:26.804564    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b-n5xnn"]
Sep 08 11:54:26.806203 ip-10-0-136-127 kubenswrapper[2575]: W0908 11:54:26.806168    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc933e6cd_a0e9_4974_840c_72f187af1ad6.slice/crio-bca3a5bd4183e4bc469bae29c9715657e10991f8057f787e56cb0da9e2f89ea7 WatchSource:0}: Error finding container bca3a5bd4183e4bc469bae29c9715657e10991f8057f787e56cb0da9e2f89ea7: Status 404 returned error can't find the container with id bca3a5bd4183e4bc469bae29c9715657e10991f8057f787e56cb0da9e2f89ea7
Sep 08 11:54:27.260262 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:27.260175    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b-n5xnn" event={"ID":"c933e6cd-a0e9-4974-840c-72f187af1ad6","Type":"ContainerStarted","Data":"7dbfa9d8d6549d19cb68a58e70104a111ba95696cb0a4c25ff0f5e7176f98c25"}
Sep 08 11:54:27.260262 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:27.260239    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b-n5xnn" event={"ID":"c933e6cd-a0e9-4974-840c-72f187af1ad6","Type":"ContainerStarted","Data":"bca3a5bd4183e4bc469bae29c9715657e10991f8057f787e56cb0da9e2f89ea7"}
Sep 08 11:54:27.260715 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:27.260285    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b-n5xnn"
Sep 08 11:54:27.280814 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:27.280768    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b-n5xnn" podStartSLOduration=1.280752642 podStartE2EDuration="1.280752642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:54:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:54:27.279941936 +0000 UTC m=+1441.931648753" watchObservedRunningTime="2026-09-08 11:54:27.280752642 +0000 UTC m=+1441.932459436"
Sep 08 11:54:38.268259 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:38.268227    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b-n5xnn"
Sep 08 11:54:42.357071 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:42.357035    2575 generic.go:356] "Generic (PLEG): container finished" podID="6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde" containerID="8261c4d9a2ed871194133607336b4f948cbe0bab9e4da55e09d40b63edbc18f2" exitCode=0
Sep 08 11:54:42.357504 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:42.357104    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl" event={"ID":"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde","Type":"ContainerDied","Data":"8261c4d9a2ed871194133607336b4f948cbe0bab9e4da55e09d40b63edbc18f2"}
Sep 08 11:54:42.357602 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:42.357587    2575 scope.go:117] "RemoveContainer" containerID="8261c4d9a2ed871194133607336b4f948cbe0bab9e4da55e09d40b63edbc18f2"
Sep 08 11:54:42.358918 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:42.358894    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:54:42.358979 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:42.358962    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:54:42.359016 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:42.358995    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 08 11:54:43.365498 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:43.365465    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl" event={"ID":"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde","Type":"ContainerStarted","Data":"9ff9df2ed1bcb9eeb1d47264cbb0eb95a8e7aab6cb5ea481a44700a4876548e9"}
Sep 08 11:54:44.262705 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:44.262619    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"
Sep 08 11:54:44.262705 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:44.262645    2575 patch_prober.go:28] interesting pod/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 08 11:54:44.262705 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:44.262686    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl" podUID="6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 08 11:54:45.263422 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:45.262910    2575 patch_prober.go:28] interesting pod/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 08 11:54:45.263422 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:45.262990    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl" podUID="6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 08 11:54:46.271363 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:46.262698    2575 patch_prober.go:28] interesting pod/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 08 11:54:46.271363 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:46.262759    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl" podUID="6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 08 11:54:47.262324 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:47.262277    2575 patch_prober.go:28] interesting pod/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 08 11:54:47.262546 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:47.262378    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl" podUID="6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 08 11:54:48.262855 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:48.262818    2575 patch_prober.go:28] interesting pod/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 08 11:54:48.263517 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:48.263486    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl" podUID="6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 08 11:54:49.262773 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:49.262737    2575 patch_prober.go:28] interesting pod/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 08 11:54:49.262957 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:49.262794    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl" podUID="6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 08 11:54:50.266662 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:50.266631    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"
Sep 08 11:54:50.267023 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:50.266901    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"
Sep 08 11:54:50.267531 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:50.267513    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"
Sep 08 11:54:54.110072 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:54:54.110037    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-5mkwm_e4e40b15-6a61-41d4-8f31-3477f98974a3/payload-processing/0.log"
Sep 08 11:55:25.974167 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:25.974141    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m57jb_63788019-f061-44d6-89a3-50c4a62e9fbf/ovn-acl-logging/0.log"
Sep 08 11:55:25.976289 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:25.976271    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m57jb_63788019-f061-44d6-89a3-50c4a62e9fbf/ovn-acl-logging/0.log"
Sep 08 11:55:34.684753 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:34.684721    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs"]
Sep 08 11:55:34.685526 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:34.685467    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs" podUID="49084489-5b0b-45b9-b9f0-24de320fecd2" containerName="maas-api" containerID="cri-o://802327b320cef51f38897266d7d8458a36438dd1575072f9d1f674961c8b2ebc" gracePeriod=30
Sep 08 11:55:34.931581 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:34.931455    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs"
Sep 08 11:55:35.022639 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:35.022611    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wj2b9\" (UniqueName: \"kubernetes.io/projected/49084489-5b0b-45b9-b9f0-24de320fecd2-kube-api-access-wj2b9\") pod \"49084489-5b0b-45b9-b9f0-24de320fecd2\" (UID: \"49084489-5b0b-45b9-b9f0-24de320fecd2\") "
Sep 08 11:55:35.022828 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:35.022650    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/49084489-5b0b-45b9-b9f0-24de320fecd2-openshift-service-ca\") pod \"49084489-5b0b-45b9-b9f0-24de320fecd2\" (UID: \"49084489-5b0b-45b9-b9f0-24de320fecd2\") "
Sep 08 11:55:35.022828 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:35.022685    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49084489-5b0b-45b9-b9f0-24de320fecd2-metrics-certs\") pod \"49084489-5b0b-45b9-b9f0-24de320fecd2\" (UID: \"49084489-5b0b-45b9-b9f0-24de320fecd2\") "
Sep 08 11:55:35.022828 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:35.022752    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49084489-5b0b-45b9-b9f0-24de320fecd2-maas-api-tls\") pod \"49084489-5b0b-45b9-b9f0-24de320fecd2\" (UID: \"49084489-5b0b-45b9-b9f0-24de320fecd2\") "
Sep 08 11:55:35.023094 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:35.023042    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49084489-5b0b-45b9-b9f0-24de320fecd2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "49084489-5b0b-45b9-b9f0-24de320fecd2" (UID: "49084489-5b0b-45b9-b9f0-24de320fecd2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:55:35.023230 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:35.023161    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/49084489-5b0b-45b9-b9f0-24de320fecd2-openshift-service-ca\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:55:35.025106 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:35.025079    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49084489-5b0b-45b9-b9f0-24de320fecd2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "49084489-5b0b-45b9-b9f0-24de320fecd2" (UID: "49084489-5b0b-45b9-b9f0-24de320fecd2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:55:35.025452 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:35.025431    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49084489-5b0b-45b9-b9f0-24de320fecd2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "49084489-5b0b-45b9-b9f0-24de320fecd2" (UID: "49084489-5b0b-45b9-b9f0-24de320fecd2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:55:35.025452 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:35.025437    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49084489-5b0b-45b9-b9f0-24de320fecd2-kube-api-access-wj2b9" (OuterVolumeSpecName: "kube-api-access-wj2b9") pod "49084489-5b0b-45b9-b9f0-24de320fecd2" (UID: "49084489-5b0b-45b9-b9f0-24de320fecd2"). InnerVolumeSpecName "kube-api-access-wj2b9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:55:35.124221 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:35.124186    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49084489-5b0b-45b9-b9f0-24de320fecd2-maas-api-tls\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:55:35.124221 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:35.124216    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wj2b9\" (UniqueName: \"kubernetes.io/projected/49084489-5b0b-45b9-b9f0-24de320fecd2-kube-api-access-wj2b9\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:55:35.124221 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:35.124225    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49084489-5b0b-45b9-b9f0-24de320fecd2-metrics-certs\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:55:35.660374 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:35.660314    2575 generic.go:356] "Generic (PLEG): container finished" podID="49084489-5b0b-45b9-b9f0-24de320fecd2" containerID="802327b320cef51f38897266d7d8458a36438dd1575072f9d1f674961c8b2ebc" exitCode=0
Sep 08 11:55:35.660542 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:35.660386    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs" event={"ID":"49084489-5b0b-45b9-b9f0-24de320fecd2","Type":"ContainerDied","Data":"802327b320cef51f38897266d7d8458a36438dd1575072f9d1f674961c8b2ebc"}
Sep 08 11:55:35.660542 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:35.660428    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs" event={"ID":"49084489-5b0b-45b9-b9f0-24de320fecd2","Type":"ContainerDied","Data":"a266846e07cf1647c77234805fe3eda804f1e5605d51eaf97f6401da163aaa73"}
Sep 08 11:55:35.660542 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:35.660448    2575 scope.go:117] "RemoveContainer" containerID="802327b320cef51f38897266d7d8458a36438dd1575072f9d1f674961c8b2ebc"
Sep 08 11:55:35.660542 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:35.660393    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs"
Sep 08 11:55:35.670753 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:35.670734    2575 scope.go:117] "RemoveContainer" containerID="802327b320cef51f38897266d7d8458a36438dd1575072f9d1f674961c8b2ebc"
Sep 08 11:55:35.671019 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:55:35.671003    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"802327b320cef51f38897266d7d8458a36438dd1575072f9d1f674961c8b2ebc\": container with ID starting with 802327b320cef51f38897266d7d8458a36438dd1575072f9d1f674961c8b2ebc not found: ID does not exist" containerID="802327b320cef51f38897266d7d8458a36438dd1575072f9d1f674961c8b2ebc"
Sep 08 11:55:35.671098 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:35.671026    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"802327b320cef51f38897266d7d8458a36438dd1575072f9d1f674961c8b2ebc"} err="failed to get container status \"802327b320cef51f38897266d7d8458a36438dd1575072f9d1f674961c8b2ebc\": rpc error: code = NotFound desc = could not find container \"802327b320cef51f38897266d7d8458a36438dd1575072f9d1f674961c8b2ebc\": container with ID starting with 802327b320cef51f38897266d7d8458a36438dd1575072f9d1f674961c8b2ebc not found: ID does not exist"
Sep 08 11:55:35.685485 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:35.685462    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs"]
Sep 08 11:55:35.689938 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:35.689914    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-69606d-66b59b877f-nz5cs"]
Sep 08 11:55:35.842128 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:35.842094    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49084489-5b0b-45b9-b9f0-24de320fecd2" path="/var/lib/kubelet/pods/49084489-5b0b-45b9-b9f0-24de320fecd2/volumes"
Sep 08 11:55:46.279702 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:46.279667    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-3f9288-fc9c679f7-q7h5c_1dcf7efe-bf30-4533-9658-4d2d89e40c40/payload-processing/0.log"
Sep 08 11:55:46.406174 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:46.406146    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-5mkwm_e4e40b15-6a61-41d4-8f31-3477f98974a3/payload-processing/0.log"
Sep 08 11:55:52.550180 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:52.550146    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f-8rzdn"]
Sep 08 11:55:52.550661 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:52.550421    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f-8rzdn" podUID="5c960dc8-99df-4ac8-ae5f-f75f51a964e7" containerName="payload-processing" containerID="cri-o://44a56d285dc536c8060b4b2860ec734a4ba0ebfd67c6e57c3ceddc28f7b92b6a" gracePeriod=30
Sep 08 11:55:52.764672 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:52.764641    2575 generic.go:356] "Generic (PLEG): container finished" podID="5c960dc8-99df-4ac8-ae5f-f75f51a964e7" containerID="44a56d285dc536c8060b4b2860ec734a4ba0ebfd67c6e57c3ceddc28f7b92b6a" exitCode=0
Sep 08 11:55:52.764843 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:52.764722    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f-8rzdn" event={"ID":"5c960dc8-99df-4ac8-ae5f-f75f51a964e7","Type":"ContainerDied","Data":"44a56d285dc536c8060b4b2860ec734a4ba0ebfd67c6e57c3ceddc28f7b92b6a"}
Sep 08 11:55:52.808856 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:52.808806    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f-8rzdn"
Sep 08 11:55:52.907590 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:52.907554    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c960dc8-99df-4ac8-ae5f-f75f51a964e7-plugins-config-volume\") pod \"5c960dc8-99df-4ac8-ae5f-f75f51a964e7\" (UID: \"5c960dc8-99df-4ac8-ae5f-f75f51a964e7\") "
Sep 08 11:55:52.907771 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:52.907620    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wc8l\" (UniqueName: \"kubernetes.io/projected/5c960dc8-99df-4ac8-ae5f-f75f51a964e7-kube-api-access-5wc8l\") pod \"5c960dc8-99df-4ac8-ae5f-f75f51a964e7\" (UID: \"5c960dc8-99df-4ac8-ae5f-f75f51a964e7\") "
Sep 08 11:55:52.907886 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:52.907864    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c960dc8-99df-4ac8-ae5f-f75f51a964e7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5c960dc8-99df-4ac8-ae5f-f75f51a964e7" (UID: "5c960dc8-99df-4ac8-ae5f-f75f51a964e7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:55:52.909919 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:52.909896    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c960dc8-99df-4ac8-ae5f-f75f51a964e7-kube-api-access-5wc8l" (OuterVolumeSpecName: "kube-api-access-5wc8l") pod "5c960dc8-99df-4ac8-ae5f-f75f51a964e7" (UID: "5c960dc8-99df-4ac8-ae5f-f75f51a964e7"). InnerVolumeSpecName "kube-api-access-5wc8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:55:53.009280 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:53.009248    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c960dc8-99df-4ac8-ae5f-f75f51a964e7-plugins-config-volume\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:55:53.009280 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:53.009277    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wc8l\" (UniqueName: \"kubernetes.io/projected/5c960dc8-99df-4ac8-ae5f-f75f51a964e7-kube-api-access-5wc8l\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:55:53.771732 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:53.771702    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f-8rzdn"
Sep 08 11:55:53.772184 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:53.771698    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f-8rzdn" event={"ID":"5c960dc8-99df-4ac8-ae5f-f75f51a964e7","Type":"ContainerDied","Data":"c9dedc522d089cfec31cfcd4e3c599b9e21befc5eee83a4cf19e2579ac30ca88"}
Sep 08 11:55:53.772184 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:53.771834    2575 scope.go:117] "RemoveContainer" containerID="44a56d285dc536c8060b4b2860ec734a4ba0ebfd67c6e57c3ceddc28f7b92b6a"
Sep 08 11:55:53.797791 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:53.797759    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f-8rzdn"]
Sep 08 11:55:53.802045 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:53.802023    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f-8rzdn"]
Sep 08 11:55:53.841791 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:53.841764    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c960dc8-99df-4ac8-ae5f-f75f51a964e7" path="/var/lib/kubelet/pods/5c960dc8-99df-4ac8-ae5f-f75f51a964e7/volumes"
Sep 08 11:55:59.712757 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:59.712716    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"]
Sep 08 11:55:59.713366 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:55:59.713096    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq" podUID="58206bfc-9a1f-46fa-b55e-66f6f6eec2d3" containerName="istio-proxy" containerID="cri-o://1a1205c7edf5df5e6ed7bd9338c78245d4414ca4637045f259d8570774909f08" gracePeriod=30
Sep 08 11:56:04.849405 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:04.849369    2575 generic.go:356] "Generic (PLEG): container finished" podID="58206bfc-9a1f-46fa-b55e-66f6f6eec2d3" containerID="1a1205c7edf5df5e6ed7bd9338c78245d4414ca4637045f259d8570774909f08" exitCode=0
Sep 08 11:56:04.849807 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:04.849452    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq" event={"ID":"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3","Type":"ContainerDied","Data":"1a1205c7edf5df5e6ed7bd9338c78245d4414ca4637045f259d8570774909f08"}
Sep 08 11:56:04.849807 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:04.849516    2575 scope.go:117] "RemoveContainer" containerID="eaff1c3fc7b673e462ef7176c5e33760a7267d2bc2b5f0c820149f7103cda63d"
Sep 08 11:56:04.982004 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:04.981947    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"
Sep 08 11:56:05.024901 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:05.024866    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-istio-token\") pod \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\" (UID: \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\") "
Sep 08 11:56:05.025099 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:05.024923    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-istiod-ca-cert\") pod \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\" (UID: \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\") "
Sep 08 11:56:05.025099 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:05.025023    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cddvw\" (UniqueName: \"kubernetes.io/projected/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-kube-api-access-cddvw\") pod \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\" (UID: \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\") "
Sep 08 11:56:05.025099 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:05.025082    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-istio-podinfo\") pod \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\" (UID: \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\") "
Sep 08 11:56:05.025282 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:05.025147    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-workload-certs\") pod \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\" (UID: \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\") "
Sep 08 11:56:05.025282 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:05.025176    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-istio-envoy\") pod \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\" (UID: \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\") "
Sep 08 11:56:05.025282 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:05.025207    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-credential-socket\") pod \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\" (UID: \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\") "
Sep 08 11:56:05.025282 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:05.025235    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-workload-socket\") pod \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\" (UID: \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\") "
Sep 08 11:56:05.025514 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:05.025305    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-istio-data\") pod \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\" (UID: \"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3\") "
Sep 08 11:56:05.025514 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:05.025314    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "58206bfc-9a1f-46fa-b55e-66f6f6eec2d3" (UID: "58206bfc-9a1f-46fa-b55e-66f6f6eec2d3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:56:05.025514 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:05.025467    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "58206bfc-9a1f-46fa-b55e-66f6f6eec2d3" (UID: "58206bfc-9a1f-46fa-b55e-66f6f6eec2d3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:56:05.025677 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:05.025617    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "58206bfc-9a1f-46fa-b55e-66f6f6eec2d3" (UID: "58206bfc-9a1f-46fa-b55e-66f6f6eec2d3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:56:05.025810 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:05.025787    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-istiod-ca-cert\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:56:05.025890 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:05.025814    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-credential-socket\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:56:05.025890 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:05.025831    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-workload-socket\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:56:05.025890 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:05.025774    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-istio-data" (OuterVolumeSpecName: "istio-data") pod "58206bfc-9a1f-46fa-b55e-66f6f6eec2d3" (UID: "58206bfc-9a1f-46fa-b55e-66f6f6eec2d3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:56:05.026139 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:05.026102    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "58206bfc-9a1f-46fa-b55e-66f6f6eec2d3" (UID: "58206bfc-9a1f-46fa-b55e-66f6f6eec2d3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:56:05.028084 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:05.028047    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "58206bfc-9a1f-46fa-b55e-66f6f6eec2d3" (UID: "58206bfc-9a1f-46fa-b55e-66f6f6eec2d3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:56:05.028223 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:05.028114    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-kube-api-access-cddvw" (OuterVolumeSpecName: "kube-api-access-cddvw") pod "58206bfc-9a1f-46fa-b55e-66f6f6eec2d3" (UID: "58206bfc-9a1f-46fa-b55e-66f6f6eec2d3"). InnerVolumeSpecName "kube-api-access-cddvw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:56:05.028539 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:05.028517    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "58206bfc-9a1f-46fa-b55e-66f6f6eec2d3" (UID: "58206bfc-9a1f-46fa-b55e-66f6f6eec2d3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 11:56:05.028774 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:05.028756    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-istio-token" (OuterVolumeSpecName: "istio-token") pod "58206bfc-9a1f-46fa-b55e-66f6f6eec2d3" (UID: "58206bfc-9a1f-46fa-b55e-66f6f6eec2d3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:56:05.126638 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:05.126603    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-istio-data\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:56:05.126638 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:05.126633    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-istio-token\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:56:05.126638 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:05.126642    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cddvw\" (UniqueName: \"kubernetes.io/projected/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-kube-api-access-cddvw\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:56:05.126881 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:05.126652    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-istio-podinfo\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:56:05.126881 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:05.126661    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-workload-certs\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:56:05.126881 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:05.126668    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3-istio-envoy\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:56:05.855650 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:05.855626    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"
Sep 08 11:56:05.856027 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:05.855678    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq" event={"ID":"58206bfc-9a1f-46fa-b55e-66f6f6eec2d3","Type":"ContainerDied","Data":"af0fde2b6264a85fc24e67d4266a3a14730412d52094546959d521899e20fff1"}
Sep 08 11:56:05.856027 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:05.855740    2575 scope.go:117] "RemoveContainer" containerID="1a1205c7edf5df5e6ed7bd9338c78245d4414ca4637045f259d8570774909f08"
Sep 08 11:56:05.877150 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:05.877122    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"]
Sep 08 11:56:05.881461 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:05.881439    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq"]
Sep 08 11:56:07.843773 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:07.843739    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58206bfc-9a1f-46fa-b55e-66f6f6eec2d3" path="/var/lib/kubelet/pods/58206bfc-9a1f-46fa-b55e-66f6f6eec2d3/volumes"
Sep 08 11:56:48.923680 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:48.923640    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-3f9288-fc9c679f7-q7h5c"]
Sep 08 11:56:48.924246 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:48.923886    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-3f9288-fc9c679f7-q7h5c" podUID="1dcf7efe-bf30-4533-9658-4d2d89e40c40" containerName="payload-processing" containerID="cri-o://6196c56e23bdaadd5921830938c3beb03948d6c35a52c367fecd532ee06bf83f" gracePeriod=30
Sep 08 11:56:49.090545 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:49.090229    2575 generic.go:356] "Generic (PLEG): container finished" podID="1dcf7efe-bf30-4533-9658-4d2d89e40c40" containerID="6196c56e23bdaadd5921830938c3beb03948d6c35a52c367fecd532ee06bf83f" exitCode=0
Sep 08 11:56:49.090836 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:49.090503    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-3f9288-fc9c679f7-q7h5c" event={"ID":"1dcf7efe-bf30-4533-9658-4d2d89e40c40","Type":"ContainerDied","Data":"6196c56e23bdaadd5921830938c3beb03948d6c35a52c367fecd532ee06bf83f"}
Sep 08 11:56:49.180008 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:49.179953    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-3f9288-fc9c679f7-q7h5c"
Sep 08 11:56:49.261572 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:49.261532    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1dcf7efe-bf30-4533-9658-4d2d89e40c40-plugins-config-volume\") pod \"1dcf7efe-bf30-4533-9658-4d2d89e40c40\" (UID: \"1dcf7efe-bf30-4533-9658-4d2d89e40c40\") "
Sep 08 11:56:49.261782 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:49.261629    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2fw6\" (UniqueName: \"kubernetes.io/projected/1dcf7efe-bf30-4533-9658-4d2d89e40c40-kube-api-access-h2fw6\") pod \"1dcf7efe-bf30-4533-9658-4d2d89e40c40\" (UID: \"1dcf7efe-bf30-4533-9658-4d2d89e40c40\") "
Sep 08 11:56:49.262318 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:49.262287    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dcf7efe-bf30-4533-9658-4d2d89e40c40-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1dcf7efe-bf30-4533-9658-4d2d89e40c40" (UID: "1dcf7efe-bf30-4533-9658-4d2d89e40c40"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:56:49.270476 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:49.269528    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dcf7efe-bf30-4533-9658-4d2d89e40c40-kube-api-access-h2fw6" (OuterVolumeSpecName: "kube-api-access-h2fw6") pod "1dcf7efe-bf30-4533-9658-4d2d89e40c40" (UID: "1dcf7efe-bf30-4533-9658-4d2d89e40c40"). InnerVolumeSpecName "kube-api-access-h2fw6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:56:49.363278 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:49.363247    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1dcf7efe-bf30-4533-9658-4d2d89e40c40-plugins-config-volume\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:56:49.363278 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:49.363275    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2fw6\" (UniqueName: \"kubernetes.io/projected/1dcf7efe-bf30-4533-9658-4d2d89e40c40-kube-api-access-h2fw6\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:56:50.093537 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:50.093496    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-ipp-a-3f9288-fc9c679f7-q7h5c" podUID="1dcf7efe-bf30-4533-9658-4d2d89e40c40" containerName="payload-processing" probeResult="failure" output="dial tcp 10.134.0.60:9004: i/o timeout"
Sep 08 11:56:50.097304 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:50.097280    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-3f9288-fc9c679f7-q7h5c"
Sep 08 11:56:50.097424 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:50.097299    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-3f9288-fc9c679f7-q7h5c" event={"ID":"1dcf7efe-bf30-4533-9658-4d2d89e40c40","Type":"ContainerDied","Data":"3680df02255ad252334c9216c926926ab01659a14101356e35f7d5cb0c9c6bbf"}
Sep 08 11:56:50.097424 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:50.097382    2575 scope.go:117] "RemoveContainer" containerID="6196c56e23bdaadd5921830938c3beb03948d6c35a52c367fecd532ee06bf83f"
Sep 08 11:56:50.117248 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:50.117217    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-3f9288-fc9c679f7-q7h5c"]
Sep 08 11:56:50.121173 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:50.121144    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-3f9288-fc9c679f7-q7h5c"]
Sep 08 11:56:51.841520 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:56:51.841486    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1dcf7efe-bf30-4533-9658-4d2d89e40c40" path="/var/lib/kubelet/pods/1dcf7efe-bf30-4533-9658-4d2d89e40c40/volumes"
Sep 08 11:57:29.292264 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:29.292228    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"]
Sep 08 11:57:29.292775 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:29.292472    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49" podUID="8720989c-68c4-47f5-88b9-01c994e9e411" containerName="istio-proxy" containerID="cri-o://c0399a34738df45a5ad42cb1276961d296fe60fd56db348810180b39c4ba18ae" gracePeriod=30
Sep 08 11:57:34.545589 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:34.545564    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"
Sep 08 11:57:34.703187 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:34.703099    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8720989c-68c4-47f5-88b9-01c994e9e411-istio-data\") pod \"8720989c-68c4-47f5-88b9-01c994e9e411\" (UID: \"8720989c-68c4-47f5-88b9-01c994e9e411\") "
Sep 08 11:57:34.703187 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:34.703139    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8720989c-68c4-47f5-88b9-01c994e9e411-workload-certs\") pod \"8720989c-68c4-47f5-88b9-01c994e9e411\" (UID: \"8720989c-68c4-47f5-88b9-01c994e9e411\") "
Sep 08 11:57:34.703187 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:34.703177    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwzhj\" (UniqueName: \"kubernetes.io/projected/8720989c-68c4-47f5-88b9-01c994e9e411-kube-api-access-vwzhj\") pod \"8720989c-68c4-47f5-88b9-01c994e9e411\" (UID: \"8720989c-68c4-47f5-88b9-01c994e9e411\") "
Sep 08 11:57:34.703514 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:34.703199    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8720989c-68c4-47f5-88b9-01c994e9e411-istiod-ca-cert\") pod \"8720989c-68c4-47f5-88b9-01c994e9e411\" (UID: \"8720989c-68c4-47f5-88b9-01c994e9e411\") "
Sep 08 11:57:34.703514 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:34.703225    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8720989c-68c4-47f5-88b9-01c994e9e411-istio-envoy\") pod \"8720989c-68c4-47f5-88b9-01c994e9e411\" (UID: \"8720989c-68c4-47f5-88b9-01c994e9e411\") "
Sep 08 11:57:34.703514 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:34.703294    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8720989c-68c4-47f5-88b9-01c994e9e411-istio-podinfo\") pod \"8720989c-68c4-47f5-88b9-01c994e9e411\" (UID: \"8720989c-68c4-47f5-88b9-01c994e9e411\") "
Sep 08 11:57:34.703514 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:34.703399    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8720989c-68c4-47f5-88b9-01c994e9e411-istio-token\") pod \"8720989c-68c4-47f5-88b9-01c994e9e411\" (UID: \"8720989c-68c4-47f5-88b9-01c994e9e411\") "
Sep 08 11:57:34.703514 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:34.703435    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8720989c-68c4-47f5-88b9-01c994e9e411-istio-data" (OuterVolumeSpecName: "istio-data") pod "8720989c-68c4-47f5-88b9-01c994e9e411" (UID: "8720989c-68c4-47f5-88b9-01c994e9e411"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:57:34.703514 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:34.703457    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8720989c-68c4-47f5-88b9-01c994e9e411-credential-socket\") pod \"8720989c-68c4-47f5-88b9-01c994e9e411\" (UID: \"8720989c-68c4-47f5-88b9-01c994e9e411\") "
Sep 08 11:57:34.703514 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:34.703473    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8720989c-68c4-47f5-88b9-01c994e9e411-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8720989c-68c4-47f5-88b9-01c994e9e411" (UID: "8720989c-68c4-47f5-88b9-01c994e9e411"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:57:34.703514 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:34.703500    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8720989c-68c4-47f5-88b9-01c994e9e411-workload-socket\") pod \"8720989c-68c4-47f5-88b9-01c994e9e411\" (UID: \"8720989c-68c4-47f5-88b9-01c994e9e411\") "
Sep 08 11:57:34.703917 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:34.703704    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8720989c-68c4-47f5-88b9-01c994e9e411-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8720989c-68c4-47f5-88b9-01c994e9e411" (UID: "8720989c-68c4-47f5-88b9-01c994e9e411"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:57:34.703917 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:34.703730    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8720989c-68c4-47f5-88b9-01c994e9e411-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8720989c-68c4-47f5-88b9-01c994e9e411" (UID: "8720989c-68c4-47f5-88b9-01c994e9e411"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:57:34.703917 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:34.703910    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8720989c-68c4-47f5-88b9-01c994e9e411-credential-socket\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:57:34.704048 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:34.703927    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8720989c-68c4-47f5-88b9-01c994e9e411-istio-data\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:57:34.704048 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:34.703939    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8720989c-68c4-47f5-88b9-01c994e9e411-workload-certs\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:57:34.704048 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:34.703953    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8720989c-68c4-47f5-88b9-01c994e9e411-istiod-ca-cert\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:57:34.704048 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:34.703909    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8720989c-68c4-47f5-88b9-01c994e9e411-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8720989c-68c4-47f5-88b9-01c994e9e411" (UID: "8720989c-68c4-47f5-88b9-01c994e9e411"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:57:34.705990 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:34.705971    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8720989c-68c4-47f5-88b9-01c994e9e411-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8720989c-68c4-47f5-88b9-01c994e9e411" (UID: "8720989c-68c4-47f5-88b9-01c994e9e411"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 11:57:34.706096 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:34.706070    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8720989c-68c4-47f5-88b9-01c994e9e411-kube-api-access-vwzhj" (OuterVolumeSpecName: "kube-api-access-vwzhj") pod "8720989c-68c4-47f5-88b9-01c994e9e411" (UID: "8720989c-68c4-47f5-88b9-01c994e9e411"). InnerVolumeSpecName "kube-api-access-vwzhj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:57:34.706217 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:34.706200    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8720989c-68c4-47f5-88b9-01c994e9e411-istio-token" (OuterVolumeSpecName: "istio-token") pod "8720989c-68c4-47f5-88b9-01c994e9e411" (UID: "8720989c-68c4-47f5-88b9-01c994e9e411"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:57:34.706273 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:34.706227    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8720989c-68c4-47f5-88b9-01c994e9e411-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8720989c-68c4-47f5-88b9-01c994e9e411" (UID: "8720989c-68c4-47f5-88b9-01c994e9e411"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:57:34.804969 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:34.804943    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8720989c-68c4-47f5-88b9-01c994e9e411-workload-socket\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:57:34.804969 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:34.804970    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwzhj\" (UniqueName: \"kubernetes.io/projected/8720989c-68c4-47f5-88b9-01c994e9e411-kube-api-access-vwzhj\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:57:34.805122 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:34.804982    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8720989c-68c4-47f5-88b9-01c994e9e411-istio-envoy\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:57:34.805122 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:34.804990    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8720989c-68c4-47f5-88b9-01c994e9e411-istio-podinfo\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:57:34.805122 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:34.804998    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8720989c-68c4-47f5-88b9-01c994e9e411-istio-token\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:57:35.337123 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:35.337095    2575 generic.go:356] "Generic (PLEG): container finished" podID="8720989c-68c4-47f5-88b9-01c994e9e411" containerID="c0399a34738df45a5ad42cb1276961d296fe60fd56db348810180b39c4ba18ae" exitCode=0
Sep 08 11:57:35.337410 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:35.337128    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49" event={"ID":"8720989c-68c4-47f5-88b9-01c994e9e411","Type":"ContainerDied","Data":"c0399a34738df45a5ad42cb1276961d296fe60fd56db348810180b39c4ba18ae"}
Sep 08 11:57:35.337410 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:35.337141    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"
Sep 08 11:57:35.337410 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:35.337166    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49" event={"ID":"8720989c-68c4-47f5-88b9-01c994e9e411","Type":"ContainerDied","Data":"ba2a759e9840ca47335e51702031fa472103f0bc3c3437f1cb585b7887949782"}
Sep 08 11:57:35.337410 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:35.337187    2575 scope.go:117] "RemoveContainer" containerID="c0399a34738df45a5ad42cb1276961d296fe60fd56db348810180b39c4ba18ae"
Sep 08 11:57:35.346793 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:35.346772    2575 scope.go:117] "RemoveContainer" containerID="4958a2d5015bf21109060ea4a394bd4a62a689cc6159f728e7a647213da01cb8"
Sep 08 11:57:35.354623 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:35.354605    2575 scope.go:117] "RemoveContainer" containerID="c0399a34738df45a5ad42cb1276961d296fe60fd56db348810180b39c4ba18ae"
Sep 08 11:57:35.354852 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:57:35.354837    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0399a34738df45a5ad42cb1276961d296fe60fd56db348810180b39c4ba18ae\": container with ID starting with c0399a34738df45a5ad42cb1276961d296fe60fd56db348810180b39c4ba18ae not found: ID does not exist" containerID="c0399a34738df45a5ad42cb1276961d296fe60fd56db348810180b39c4ba18ae"
Sep 08 11:57:35.354902 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:35.354858    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0399a34738df45a5ad42cb1276961d296fe60fd56db348810180b39c4ba18ae"} err="failed to get container status \"c0399a34738df45a5ad42cb1276961d296fe60fd56db348810180b39c4ba18ae\": rpc error: code = NotFound desc = could not find container \"c0399a34738df45a5ad42cb1276961d296fe60fd56db348810180b39c4ba18ae\": container with ID starting with c0399a34738df45a5ad42cb1276961d296fe60fd56db348810180b39c4ba18ae not found: ID does not exist"
Sep 08 11:57:35.354902 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:35.354871    2575 scope.go:117] "RemoveContainer" containerID="4958a2d5015bf21109060ea4a394bd4a62a689cc6159f728e7a647213da01cb8"
Sep 08 11:57:35.355089 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:57:35.355072    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4958a2d5015bf21109060ea4a394bd4a62a689cc6159f728e7a647213da01cb8\": container with ID starting with 4958a2d5015bf21109060ea4a394bd4a62a689cc6159f728e7a647213da01cb8 not found: ID does not exist" containerID="4958a2d5015bf21109060ea4a394bd4a62a689cc6159f728e7a647213da01cb8"
Sep 08 11:57:35.355187 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:35.355089    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4958a2d5015bf21109060ea4a394bd4a62a689cc6159f728e7a647213da01cb8"} err="failed to get container status \"4958a2d5015bf21109060ea4a394bd4a62a689cc6159f728e7a647213da01cb8\": rpc error: code = NotFound desc = could not find container \"4958a2d5015bf21109060ea4a394bd4a62a689cc6159f728e7a647213da01cb8\": container with ID starting with 4958a2d5015bf21109060ea4a394bd4a62a689cc6159f728e7a647213da01cb8 not found: ID does not exist"
Sep 08 11:57:35.362639 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:35.362614    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"]
Sep 08 11:57:35.368631 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:35.368612    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49"]
Sep 08 11:57:35.841321 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:35.841290    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8720989c-68c4-47f5-88b9-01c994e9e411" path="/var/lib/kubelet/pods/8720989c-68c4-47f5-88b9-01c994e9e411/volumes"
Sep 08 11:57:40.744836 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:40.744797    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b-n5xnn"]
Sep 08 11:57:40.745668 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:40.745605    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b-n5xnn" podUID="c933e6cd-a0e9-4974-840c-72f187af1ad6" containerName="payload-pre-processing" containerID="cri-o://7dbfa9d8d6549d19cb68a58e70104a111ba95696cb0a4c25ff0f5e7176f98c25" gracePeriod=30
Sep 08 11:57:41.016882 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:41.016857    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b-n5xnn"
Sep 08 11:57:41.064794 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:41.064753    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wsqbm\" (UniqueName: \"kubernetes.io/projected/c933e6cd-a0e9-4974-840c-72f187af1ad6-kube-api-access-wsqbm\") pod \"c933e6cd-a0e9-4974-840c-72f187af1ad6\" (UID: \"c933e6cd-a0e9-4974-840c-72f187af1ad6\") "
Sep 08 11:57:41.065031 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:41.064929    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c933e6cd-a0e9-4974-840c-72f187af1ad6-plugins-config-volume\") pod \"c933e6cd-a0e9-4974-840c-72f187af1ad6\" (UID: \"c933e6cd-a0e9-4974-840c-72f187af1ad6\") "
Sep 08 11:57:41.065598 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:41.065563    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c933e6cd-a0e9-4974-840c-72f187af1ad6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c933e6cd-a0e9-4974-840c-72f187af1ad6" (UID: "c933e6cd-a0e9-4974-840c-72f187af1ad6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:57:41.067157 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:41.067123    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c933e6cd-a0e9-4974-840c-72f187af1ad6-kube-api-access-wsqbm" (OuterVolumeSpecName: "kube-api-access-wsqbm") pod "c933e6cd-a0e9-4974-840c-72f187af1ad6" (UID: "c933e6cd-a0e9-4974-840c-72f187af1ad6"). InnerVolumeSpecName "kube-api-access-wsqbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:57:41.166762 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:41.166720    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsqbm\" (UniqueName: \"kubernetes.io/projected/c933e6cd-a0e9-4974-840c-72f187af1ad6-kube-api-access-wsqbm\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:57:41.166762 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:41.166754    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c933e6cd-a0e9-4974-840c-72f187af1ad6-plugins-config-volume\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:57:41.369405 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:41.369371    2575 generic.go:356] "Generic (PLEG): container finished" podID="c933e6cd-a0e9-4974-840c-72f187af1ad6" containerID="7dbfa9d8d6549d19cb68a58e70104a111ba95696cb0a4c25ff0f5e7176f98c25" exitCode=0
Sep 08 11:57:41.369562 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:41.369417    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b-n5xnn"
Sep 08 11:57:41.369562 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:41.369457    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b-n5xnn" event={"ID":"c933e6cd-a0e9-4974-840c-72f187af1ad6","Type":"ContainerDied","Data":"7dbfa9d8d6549d19cb68a58e70104a111ba95696cb0a4c25ff0f5e7176f98c25"}
Sep 08 11:57:41.369562 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:41.369511    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b-n5xnn" event={"ID":"c933e6cd-a0e9-4974-840c-72f187af1ad6","Type":"ContainerDied","Data":"bca3a5bd4183e4bc469bae29c9715657e10991f8057f787e56cb0da9e2f89ea7"}
Sep 08 11:57:41.369562 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:41.369534    2575 scope.go:117] "RemoveContainer" containerID="7dbfa9d8d6549d19cb68a58e70104a111ba95696cb0a4c25ff0f5e7176f98c25"
Sep 08 11:57:41.378689 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:41.378672    2575 scope.go:117] "RemoveContainer" containerID="7dbfa9d8d6549d19cb68a58e70104a111ba95696cb0a4c25ff0f5e7176f98c25"
Sep 08 11:57:41.378935 ip-10-0-136-127 kubenswrapper[2575]: E0908 11:57:41.378917    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7dbfa9d8d6549d19cb68a58e70104a111ba95696cb0a4c25ff0f5e7176f98c25\": container with ID starting with 7dbfa9d8d6549d19cb68a58e70104a111ba95696cb0a4c25ff0f5e7176f98c25 not found: ID does not exist" containerID="7dbfa9d8d6549d19cb68a58e70104a111ba95696cb0a4c25ff0f5e7176f98c25"
Sep 08 11:57:41.378990 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:41.378944    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dbfa9d8d6549d19cb68a58e70104a111ba95696cb0a4c25ff0f5e7176f98c25"} err="failed to get container status \"7dbfa9d8d6549d19cb68a58e70104a111ba95696cb0a4c25ff0f5e7176f98c25\": rpc error: code = NotFound desc = could not find container \"7dbfa9d8d6549d19cb68a58e70104a111ba95696cb0a4c25ff0f5e7176f98c25\": container with ID starting with 7dbfa9d8d6549d19cb68a58e70104a111ba95696cb0a4c25ff0f5e7176f98c25 not found: ID does not exist"
Sep 08 11:57:41.393446 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:41.393427    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b-n5xnn"]
Sep 08 11:57:41.398815 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:41.398795    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b-n5xnn"]
Sep 08 11:57:41.841920 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:41.841886    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c933e6cd-a0e9-4974-840c-72f187af1ad6" path="/var/lib/kubelet/pods/c933e6cd-a0e9-4974-840c-72f187af1ad6/volumes"
Sep 08 11:57:48.305639 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:48.305608    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"]
Sep 08 11:57:48.306091 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:48.305808    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl" podUID="6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde" containerName="istio-proxy" containerID="cri-o://9ff9df2ed1bcb9eeb1d47264cbb0eb95a8e7aab6cb5ea481a44700a4876548e9" gracePeriod=30
Sep 08 11:57:50.269159 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:50.269125    2575 patch_prober.go:28] interesting pod/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 11:57:50.269550 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:50.269193    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl" podUID="6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 11:57:53.434601 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:53.434564    2575 generic.go:356] "Generic (PLEG): container finished" podID="6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde" containerID="9ff9df2ed1bcb9eeb1d47264cbb0eb95a8e7aab6cb5ea481a44700a4876548e9" exitCode=0
Sep 08 11:57:53.434981 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:53.434597    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl" event={"ID":"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde","Type":"ContainerDied","Data":"9ff9df2ed1bcb9eeb1d47264cbb0eb95a8e7aab6cb5ea481a44700a4876548e9"}
Sep 08 11:57:53.434981 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:53.434665    2575 scope.go:117] "RemoveContainer" containerID="8261c4d9a2ed871194133607336b4f948cbe0bab9e4da55e09d40b63edbc18f2"
Sep 08 11:57:53.560238 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:53.560212    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"
Sep 08 11:57:53.683751 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:53.683657    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-istio-envoy\") pod \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\" (UID: \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\") "
Sep 08 11:57:53.683751 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:53.683724    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-istio-token\") pod \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\" (UID: \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\") "
Sep 08 11:57:53.683751 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:53.683745    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-workload-certs\") pod \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\" (UID: \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\") "
Sep 08 11:57:53.684041 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:53.683769    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-credential-socket\") pod \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\" (UID: \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\") "
Sep 08 11:57:53.684041 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:53.683797    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-istio-data\") pod \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\" (UID: \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\") "
Sep 08 11:57:53.684041 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:53.683825    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-workload-socket\") pod \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\" (UID: \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\") "
Sep 08 11:57:53.684041 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:53.683902    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-istio-podinfo\") pod \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\" (UID: \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\") "
Sep 08 11:57:53.684041 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:53.683933    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-istiod-ca-cert\") pod \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\" (UID: \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\") "
Sep 08 11:57:53.684041 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:53.683973    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmn4g\" (UniqueName: \"kubernetes.io/projected/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-kube-api-access-hmn4g\") pod \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\" (UID: \"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde\") "
Sep 08 11:57:53.684374 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:53.684135    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde" (UID: "6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:57:53.684374 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:53.684152    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde" (UID: "6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:57:53.684661 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:53.684400    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-workload-certs\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:57:53.684661 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:53.684421    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-credential-socket\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:57:53.684661 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:53.684453    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde" (UID: "6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:57:53.684661 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:53.684482    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-istio-data" (OuterVolumeSpecName: "istio-data") pod "6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde" (UID: "6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:57:53.684883 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:53.684743    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde" (UID: "6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:57:53.686167 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:53.686137    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-istio-token" (OuterVolumeSpecName: "istio-token") pod "6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde" (UID: "6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:57:53.686278 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:53.686189    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde" (UID: "6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:57:53.686327 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:53.686285    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde" (UID: "6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 11:57:53.686436 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:53.686397    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-kube-api-access-hmn4g" (OuterVolumeSpecName: "kube-api-access-hmn4g") pod "6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde" (UID: "6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde"). InnerVolumeSpecName "kube-api-access-hmn4g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:57:53.785547 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:53.785511    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-istio-data\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:57:53.785547 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:53.785540    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-workload-socket\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:57:53.785547 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:53.785549    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-istio-podinfo\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:57:53.785547 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:53.785558    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-istiod-ca-cert\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:57:53.785814 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:53.785568    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmn4g\" (UniqueName: \"kubernetes.io/projected/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-kube-api-access-hmn4g\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:57:53.785814 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:53.785577    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-istio-envoy\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:57:53.785814 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:53.785587    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde-istio-token\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:57:54.441579 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:54.441547    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"
Sep 08 11:57:54.442042 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:54.441582    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl" event={"ID":"6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde","Type":"ContainerDied","Data":"0b43a0b79dbd0e3ff16d5c24a08024e48605102e0a783cf9c5fb942bb4dd50e1"}
Sep 08 11:57:54.442042 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:54.441658    2575 scope.go:117] "RemoveContainer" containerID="9ff9df2ed1bcb9eeb1d47264cbb0eb95a8e7aab6cb5ea481a44700a4876548e9"
Sep 08 11:57:54.464731 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:54.464707    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"]
Sep 08 11:57:54.469999 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:54.469969    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl"]
Sep 08 11:57:55.841832 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:55.841799    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde" path="/var/lib/kubelet/pods/6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde/volumes"
Sep 08 11:57:59.307473 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:59.307296    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk"]
Sep 08 11:57:59.307944 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:59.307595    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk" podUID="9ebac4c1-9786-410c-9465-44c658a3d627" containerName="maas-api" containerID="cri-o://df34ab146245c5fb83c92b55475f76eed50fc9690ee688ccdfcce91b1c06f36e" gracePeriod=30
Sep 08 11:57:59.470987 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:59.470954    2575 generic.go:356] "Generic (PLEG): container finished" podID="9ebac4c1-9786-410c-9465-44c658a3d627" containerID="df34ab146245c5fb83c92b55475f76eed50fc9690ee688ccdfcce91b1c06f36e" exitCode=0
Sep 08 11:57:59.471171 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:59.471022    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk" event={"ID":"9ebac4c1-9786-410c-9465-44c658a3d627","Type":"ContainerDied","Data":"df34ab146245c5fb83c92b55475f76eed50fc9690ee688ccdfcce91b1c06f36e"}
Sep 08 11:57:59.567703 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:59.567642    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk"
Sep 08 11:57:59.641955 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:59.641920    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ebac4c1-9786-410c-9465-44c658a3d627-openshift-service-ca\") pod \"9ebac4c1-9786-410c-9465-44c658a3d627\" (UID: \"9ebac4c1-9786-410c-9465-44c658a3d627\") "
Sep 08 11:57:59.642144 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:59.641972    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ebac4c1-9786-410c-9465-44c658a3d627-metrics-certs\") pod \"9ebac4c1-9786-410c-9465-44c658a3d627\" (UID: \"9ebac4c1-9786-410c-9465-44c658a3d627\") "
Sep 08 11:57:59.642191 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:59.642160    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ebac4c1-9786-410c-9465-44c658a3d627-maas-api-tls\") pod \"9ebac4c1-9786-410c-9465-44c658a3d627\" (UID: \"9ebac4c1-9786-410c-9465-44c658a3d627\") "
Sep 08 11:57:59.642244 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:59.642207    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjkxx\" (UniqueName: \"kubernetes.io/projected/9ebac4c1-9786-410c-9465-44c658a3d627-kube-api-access-mjkxx\") pod \"9ebac4c1-9786-410c-9465-44c658a3d627\" (UID: \"9ebac4c1-9786-410c-9465-44c658a3d627\") "
Sep 08 11:57:59.642316 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:59.642287    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ebac4c1-9786-410c-9465-44c658a3d627-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9ebac4c1-9786-410c-9465-44c658a3d627" (UID: "9ebac4c1-9786-410c-9465-44c658a3d627"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:57:59.642620 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:59.642601    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ebac4c1-9786-410c-9465-44c658a3d627-openshift-service-ca\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:57:59.644208 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:59.644190    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ebac4c1-9786-410c-9465-44c658a3d627-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9ebac4c1-9786-410c-9465-44c658a3d627" (UID: "9ebac4c1-9786-410c-9465-44c658a3d627"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:57:59.644333 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:59.644318    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ebac4c1-9786-410c-9465-44c658a3d627-kube-api-access-mjkxx" (OuterVolumeSpecName: "kube-api-access-mjkxx") pod "9ebac4c1-9786-410c-9465-44c658a3d627" (UID: "9ebac4c1-9786-410c-9465-44c658a3d627"). InnerVolumeSpecName "kube-api-access-mjkxx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:57:59.644430 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:59.644408    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ebac4c1-9786-410c-9465-44c658a3d627-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9ebac4c1-9786-410c-9465-44c658a3d627" (UID: "9ebac4c1-9786-410c-9465-44c658a3d627"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:57:59.744005 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:59.743973    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ebac4c1-9786-410c-9465-44c658a3d627-metrics-certs\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:57:59.744005 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:59.743998    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ebac4c1-9786-410c-9465-44c658a3d627-maas-api-tls\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:57:59.744005 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:57:59.744007    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjkxx\" (UniqueName: \"kubernetes.io/projected/9ebac4c1-9786-410c-9465-44c658a3d627-kube-api-access-mjkxx\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:58:00.477391 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:00.477361    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk"
Sep 08 11:58:00.477840 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:00.477393    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk" event={"ID":"9ebac4c1-9786-410c-9465-44c658a3d627","Type":"ContainerDied","Data":"b5488b7a91ca57624b191f55fb5e61d7f465d77339a9459ac5160b6a25ed196d"}
Sep 08 11:58:00.477840 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:00.477462    2575 scope.go:117] "RemoveContainer" containerID="df34ab146245c5fb83c92b55475f76eed50fc9690ee688ccdfcce91b1c06f36e"
Sep 08 11:58:00.499968 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:00.499944    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk"]
Sep 08 11:58:00.502113 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:00.502093    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-838a68-7c69c444d7-lwvdk"]
Sep 08 11:58:01.842032 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:01.841984    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ebac4c1-9786-410c-9465-44c658a3d627" path="/var/lib/kubelet/pods/9ebac4c1-9786-410c-9465-44c658a3d627/volumes"
Sep 08 11:58:18.301884 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:18.301850    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv"]
Sep 08 11:58:18.302424 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:18.302069    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv" podUID="0c3c90b7-f66f-4b19-ae7e-cbf367afee3e" containerName="maas-api" containerID="cri-o://4ce4f84fd51f89fd128240e1c903acb7d704ebe8c8fea2abc6dfa023f4d80580" gracePeriod=30
Sep 08 11:58:18.352635 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:18.352591    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858-ql5mn"]
Sep 08 11:58:18.352890 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:18.352855    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858-ql5mn" podUID="1f653452-d608-40f7-84cb-1f5c6992fb58" containerName="payload-pre-processing" containerID="cri-o://eaa195245eb994e1f3eed546b6b8eff7bef4ec3a103795764eec29fd1f1c0722" gracePeriod=30
Sep 08 11:58:18.576759 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:18.576728    2575 generic.go:356] "Generic (PLEG): container finished" podID="0c3c90b7-f66f-4b19-ae7e-cbf367afee3e" containerID="4ce4f84fd51f89fd128240e1c903acb7d704ebe8c8fea2abc6dfa023f4d80580" exitCode=0
Sep 08 11:58:18.576951 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:18.576802    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv" event={"ID":"0c3c90b7-f66f-4b19-ae7e-cbf367afee3e","Type":"ContainerDied","Data":"4ce4f84fd51f89fd128240e1c903acb7d704ebe8c8fea2abc6dfa023f4d80580"}
Sep 08 11:58:18.578910 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:18.578887    2575 generic.go:356] "Generic (PLEG): container finished" podID="1f653452-d608-40f7-84cb-1f5c6992fb58" containerID="eaa195245eb994e1f3eed546b6b8eff7bef4ec3a103795764eec29fd1f1c0722" exitCode=0
Sep 08 11:58:18.579028 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:18.578961    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858-ql5mn" event={"ID":"1f653452-d608-40f7-84cb-1f5c6992fb58","Type":"ContainerDied","Data":"eaa195245eb994e1f3eed546b6b8eff7bef4ec3a103795764eec29fd1f1c0722"}
Sep 08 11:58:18.606813 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:18.606786    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv"
Sep 08 11:58:18.629729 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:18.629666    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c3c90b7-f66f-4b19-ae7e-cbf367afee3e-openshift-service-ca\") pod \"0c3c90b7-f66f-4b19-ae7e-cbf367afee3e\" (UID: \"0c3c90b7-f66f-4b19-ae7e-cbf367afee3e\") "
Sep 08 11:58:18.629922 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:18.629794    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7qbq\" (UniqueName: \"kubernetes.io/projected/0c3c90b7-f66f-4b19-ae7e-cbf367afee3e-kube-api-access-q7qbq\") pod \"0c3c90b7-f66f-4b19-ae7e-cbf367afee3e\" (UID: \"0c3c90b7-f66f-4b19-ae7e-cbf367afee3e\") "
Sep 08 11:58:18.629922 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:18.629866    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c3c90b7-f66f-4b19-ae7e-cbf367afee3e-maas-api-tls\") pod \"0c3c90b7-f66f-4b19-ae7e-cbf367afee3e\" (UID: \"0c3c90b7-f66f-4b19-ae7e-cbf367afee3e\") "
Sep 08 11:58:18.630240 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:18.629969    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c3c90b7-f66f-4b19-ae7e-cbf367afee3e-metrics-certs\") pod \"0c3c90b7-f66f-4b19-ae7e-cbf367afee3e\" (UID: \"0c3c90b7-f66f-4b19-ae7e-cbf367afee3e\") "
Sep 08 11:58:18.630240 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:18.630043    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c3c90b7-f66f-4b19-ae7e-cbf367afee3e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0c3c90b7-f66f-4b19-ae7e-cbf367afee3e" (UID: "0c3c90b7-f66f-4b19-ae7e-cbf367afee3e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:58:18.630376 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:18.630314    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c3c90b7-f66f-4b19-ae7e-cbf367afee3e-openshift-service-ca\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:58:18.633049 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:18.632986    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c3c90b7-f66f-4b19-ae7e-cbf367afee3e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0c3c90b7-f66f-4b19-ae7e-cbf367afee3e" (UID: "0c3c90b7-f66f-4b19-ae7e-cbf367afee3e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:58:18.633049 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:18.632997    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c3c90b7-f66f-4b19-ae7e-cbf367afee3e-kube-api-access-q7qbq" (OuterVolumeSpecName: "kube-api-access-q7qbq") pod "0c3c90b7-f66f-4b19-ae7e-cbf367afee3e" (UID: "0c3c90b7-f66f-4b19-ae7e-cbf367afee3e"). InnerVolumeSpecName "kube-api-access-q7qbq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:58:18.634073 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:18.634050    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c3c90b7-f66f-4b19-ae7e-cbf367afee3e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0c3c90b7-f66f-4b19-ae7e-cbf367afee3e" (UID: "0c3c90b7-f66f-4b19-ae7e-cbf367afee3e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:58:18.637644 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:18.637624    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858-ql5mn"
Sep 08 11:58:18.731642 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:18.731607    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f653452-d608-40f7-84cb-1f5c6992fb58-plugins-config-volume\") pod \"1f653452-d608-40f7-84cb-1f5c6992fb58\" (UID: \"1f653452-d608-40f7-84cb-1f5c6992fb58\") "
Sep 08 11:58:18.731846 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:18.731668    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hlhbm\" (UniqueName: \"kubernetes.io/projected/1f653452-d608-40f7-84cb-1f5c6992fb58-kube-api-access-hlhbm\") pod \"1f653452-d608-40f7-84cb-1f5c6992fb58\" (UID: \"1f653452-d608-40f7-84cb-1f5c6992fb58\") "
Sep 08 11:58:18.731920 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:18.731860    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7qbq\" (UniqueName: \"kubernetes.io/projected/0c3c90b7-f66f-4b19-ae7e-cbf367afee3e-kube-api-access-q7qbq\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:58:18.731920 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:18.731873    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c3c90b7-f66f-4b19-ae7e-cbf367afee3e-maas-api-tls\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:58:18.731920 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:18.731881    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c3c90b7-f66f-4b19-ae7e-cbf367afee3e-metrics-certs\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:58:18.732068 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:18.731984    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f653452-d608-40f7-84cb-1f5c6992fb58-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1f653452-d608-40f7-84cb-1f5c6992fb58" (UID: "1f653452-d608-40f7-84cb-1f5c6992fb58"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:58:18.733980 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:18.733951    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f653452-d608-40f7-84cb-1f5c6992fb58-kube-api-access-hlhbm" (OuterVolumeSpecName: "kube-api-access-hlhbm") pod "1f653452-d608-40f7-84cb-1f5c6992fb58" (UID: "1f653452-d608-40f7-84cb-1f5c6992fb58"). InnerVolumeSpecName "kube-api-access-hlhbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:58:18.832750 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:18.832662    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f653452-d608-40f7-84cb-1f5c6992fb58-plugins-config-volume\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:58:18.832750 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:18.832693    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlhbm\" (UniqueName: \"kubernetes.io/projected/1f653452-d608-40f7-84cb-1f5c6992fb58-kube-api-access-hlhbm\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 11:58:19.585543 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:19.585458    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858-ql5mn"
Sep 08 11:58:19.585543 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:19.585497    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858-ql5mn" event={"ID":"1f653452-d608-40f7-84cb-1f5c6992fb58","Type":"ContainerDied","Data":"74d6288046092f5694433f779a4176932291d9ac26bbb44e41efe6cad361052d"}
Sep 08 11:58:19.586070 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:19.585564    2575 scope.go:117] "RemoveContainer" containerID="eaa195245eb994e1f3eed546b6b8eff7bef4ec3a103795764eec29fd1f1c0722"
Sep 08 11:58:19.587096 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:19.587048    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv"
Sep 08 11:58:19.587163 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:19.587084    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv" event={"ID":"0c3c90b7-f66f-4b19-ae7e-cbf367afee3e","Type":"ContainerDied","Data":"5548038a1b7278c72d2e319e659c1aa6b25b5e7cd53dff830d106a1968404213"}
Sep 08 11:58:19.601109 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:19.601085    2575 scope.go:117] "RemoveContainer" containerID="4ce4f84fd51f89fd128240e1c903acb7d704ebe8c8fea2abc6dfa023f4d80580"
Sep 08 11:58:19.614214 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:19.614190    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858-ql5mn"]
Sep 08 11:58:19.621477 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:19.621455    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858-ql5mn"]
Sep 08 11:58:19.632936 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:19.632910    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv"]
Sep 08 11:58:19.637604 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:19.637582    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-bb9b64-7fd485dd95-dpkfv"]
Sep 08 11:58:19.842152 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:19.842057    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c3c90b7-f66f-4b19-ae7e-cbf367afee3e" path="/var/lib/kubelet/pods/0c3c90b7-f66f-4b19-ae7e-cbf367afee3e/volumes"
Sep 08 11:58:19.842517 ip-10-0-136-127 kubenswrapper[2575]: I0908 11:58:19.842497    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f653452-d608-40f7-84cb-1f5c6992fb58" path="/var/lib/kubelet/pods/1f653452-d608-40f7-84cb-1f5c6992fb58/volumes"
Sep 08 12:00:26.007801 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:00:26.007770    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m57jb_63788019-f061-44d6-89a3-50c4a62e9fbf/ovn-acl-logging/0.log"
Sep 08 12:00:26.009605 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:00:26.009586    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m57jb_63788019-f061-44d6-89a3-50c4a62e9fbf/ovn-acl-logging/0.log"
Sep 08 12:04:10.491070 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.491040    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-cf5b5fd48-swslq"]
Sep 08 12:04:10.491531 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.491485    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c3c90b7-f66f-4b19-ae7e-cbf367afee3e" containerName="maas-api"
Sep 08 12:04:10.491531 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.491497    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c3c90b7-f66f-4b19-ae7e-cbf367afee3e" containerName="maas-api"
Sep 08 12:04:10.491531 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.491507    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ebac4c1-9786-410c-9465-44c658a3d627" containerName="maas-api"
Sep 08 12:04:10.491531 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.491512    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ebac4c1-9786-410c-9465-44c658a3d627" containerName="maas-api"
Sep 08 12:04:10.491531 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.491519    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c960dc8-99df-4ac8-ae5f-f75f51a964e7" containerName="payload-processing"
Sep 08 12:04:10.491531 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.491527    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c960dc8-99df-4ac8-ae5f-f75f51a964e7" containerName="payload-processing"
Sep 08 12:04:10.491752 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.491538    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde" containerName="istio-proxy"
Sep 08 12:04:10.491752 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.491546    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde" containerName="istio-proxy"
Sep 08 12:04:10.491752 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.491554    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde" containerName="istio-proxy"
Sep 08 12:04:10.491752 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.491563    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde" containerName="istio-proxy"
Sep 08 12:04:10.491752 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.491580    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c933e6cd-a0e9-4974-840c-72f187af1ad6" containerName="payload-pre-processing"
Sep 08 12:04:10.491752 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.491589    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c933e6cd-a0e9-4974-840c-72f187af1ad6" containerName="payload-pre-processing"
Sep 08 12:04:10.491752 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.491600    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58206bfc-9a1f-46fa-b55e-66f6f6eec2d3" containerName="istio-proxy"
Sep 08 12:04:10.491752 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.491607    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="58206bfc-9a1f-46fa-b55e-66f6f6eec2d3" containerName="istio-proxy"
Sep 08 12:04:10.491752 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.491623    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49084489-5b0b-45b9-b9f0-24de320fecd2" containerName="maas-api"
Sep 08 12:04:10.491752 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.491628    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="49084489-5b0b-45b9-b9f0-24de320fecd2" containerName="maas-api"
Sep 08 12:04:10.491752 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.491639    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f653452-d608-40f7-84cb-1f5c6992fb58" containerName="payload-pre-processing"
Sep 08 12:04:10.491752 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.491644    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f653452-d608-40f7-84cb-1f5c6992fb58" containerName="payload-pre-processing"
Sep 08 12:04:10.491752 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.491653    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58206bfc-9a1f-46fa-b55e-66f6f6eec2d3" containerName="istio-proxy"
Sep 08 12:04:10.491752 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.491661    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="58206bfc-9a1f-46fa-b55e-66f6f6eec2d3" containerName="istio-proxy"
Sep 08 12:04:10.491752 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.491670    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dcf7efe-bf30-4533-9658-4d2d89e40c40" containerName="payload-processing"
Sep 08 12:04:10.491752 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.491675    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dcf7efe-bf30-4533-9658-4d2d89e40c40" containerName="payload-processing"
Sep 08 12:04:10.491752 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.491686    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8720989c-68c4-47f5-88b9-01c994e9e411" containerName="istio-proxy"
Sep 08 12:04:10.491752 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.491695    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8720989c-68c4-47f5-88b9-01c994e9e411" containerName="istio-proxy"
Sep 08 12:04:10.491752 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.491706    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8720989c-68c4-47f5-88b9-01c994e9e411" containerName="istio-proxy"
Sep 08 12:04:10.491752 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.491715    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8720989c-68c4-47f5-88b9-01c994e9e411" containerName="istio-proxy"
Sep 08 12:04:10.492511 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.491794    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ebac4c1-9786-410c-9465-44c658a3d627" containerName="maas-api"
Sep 08 12:04:10.492511 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.491803    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="58206bfc-9a1f-46fa-b55e-66f6f6eec2d3" containerName="istio-proxy"
Sep 08 12:04:10.492511 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.491820    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c960dc8-99df-4ac8-ae5f-f75f51a964e7" containerName="payload-processing"
Sep 08 12:04:10.492511 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.491830    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8720989c-68c4-47f5-88b9-01c994e9e411" containerName="istio-proxy"
Sep 08 12:04:10.492511 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.491840    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c3c90b7-f66f-4b19-ae7e-cbf367afee3e" containerName="maas-api"
Sep 08 12:04:10.492511 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.491848    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f653452-d608-40f7-84cb-1f5c6992fb58" containerName="payload-pre-processing"
Sep 08 12:04:10.492511 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.491856    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c933e6cd-a0e9-4974-840c-72f187af1ad6" containerName="payload-pre-processing"
Sep 08 12:04:10.492511 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.491865    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="49084489-5b0b-45b9-b9f0-24de320fecd2" containerName="maas-api"
Sep 08 12:04:10.492511 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.491872    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8720989c-68c4-47f5-88b9-01c994e9e411" containerName="istio-proxy"
Sep 08 12:04:10.492511 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.491881    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1dcf7efe-bf30-4533-9658-4d2d89e40c40" containerName="payload-processing"
Sep 08 12:04:10.492511 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.491891    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde" containerName="istio-proxy"
Sep 08 12:04:10.492511 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.491897    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="58206bfc-9a1f-46fa-b55e-66f6f6eec2d3" containerName="istio-proxy"
Sep 08 12:04:10.492511 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.491903    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d3a4505-aaf2-4b3f-9342-e7ffb67f2cde" containerName="istio-proxy"
Sep 08 12:04:10.495447 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.495325    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-cf5b5fd48-swslq"
Sep 08 12:04:10.508152 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.508129    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-cf5b5fd48-swslq"]
Sep 08 12:04:10.592296 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.592266    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a289c7d-4f50-4ee8-a957-976fe8dd2877-maas-api-tls\") pod \"maas-api-cf5b5fd48-swslq\" (UID: \"1a289c7d-4f50-4ee8-a957-976fe8dd2877\") " pod="odh-ai-gateway-infra/maas-api-cf5b5fd48-swslq"
Sep 08 12:04:10.592498 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.592362    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a289c7d-4f50-4ee8-a957-976fe8dd2877-metrics-certs\") pod \"maas-api-cf5b5fd48-swslq\" (UID: \"1a289c7d-4f50-4ee8-a957-976fe8dd2877\") " pod="odh-ai-gateway-infra/maas-api-cf5b5fd48-swslq"
Sep 08 12:04:10.592498 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.592405    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw8mj\" (UniqueName: \"kubernetes.io/projected/1a289c7d-4f50-4ee8-a957-976fe8dd2877-kube-api-access-bw8mj\") pod \"maas-api-cf5b5fd48-swslq\" (UID: \"1a289c7d-4f50-4ee8-a957-976fe8dd2877\") " pod="odh-ai-gateway-infra/maas-api-cf5b5fd48-swslq"
Sep 08 12:04:10.592498 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.592482    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a289c7d-4f50-4ee8-a957-976fe8dd2877-openshift-service-ca\") pod \"maas-api-cf5b5fd48-swslq\" (UID: \"1a289c7d-4f50-4ee8-a957-976fe8dd2877\") " pod="odh-ai-gateway-infra/maas-api-cf5b5fd48-swslq"
Sep 08 12:04:10.693455 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.693416    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a289c7d-4f50-4ee8-a957-976fe8dd2877-maas-api-tls\") pod \"maas-api-cf5b5fd48-swslq\" (UID: \"1a289c7d-4f50-4ee8-a957-976fe8dd2877\") " pod="odh-ai-gateway-infra/maas-api-cf5b5fd48-swslq"
Sep 08 12:04:10.693634 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.693489    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a289c7d-4f50-4ee8-a957-976fe8dd2877-metrics-certs\") pod \"maas-api-cf5b5fd48-swslq\" (UID: \"1a289c7d-4f50-4ee8-a957-976fe8dd2877\") " pod="odh-ai-gateway-infra/maas-api-cf5b5fd48-swslq"
Sep 08 12:04:10.693634 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.693523    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw8mj\" (UniqueName: \"kubernetes.io/projected/1a289c7d-4f50-4ee8-a957-976fe8dd2877-kube-api-access-bw8mj\") pod \"maas-api-cf5b5fd48-swslq\" (UID: \"1a289c7d-4f50-4ee8-a957-976fe8dd2877\") " pod="odh-ai-gateway-infra/maas-api-cf5b5fd48-swslq"
Sep 08 12:04:10.693634 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.693554    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a289c7d-4f50-4ee8-a957-976fe8dd2877-openshift-service-ca\") pod \"maas-api-cf5b5fd48-swslq\" (UID: \"1a289c7d-4f50-4ee8-a957-976fe8dd2877\") " pod="odh-ai-gateway-infra/maas-api-cf5b5fd48-swslq"
Sep 08 12:04:10.694174 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.694154    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a289c7d-4f50-4ee8-a957-976fe8dd2877-openshift-service-ca\") pod \"maas-api-cf5b5fd48-swslq\" (UID: \"1a289c7d-4f50-4ee8-a957-976fe8dd2877\") " pod="odh-ai-gateway-infra/maas-api-cf5b5fd48-swslq"
Sep 08 12:04:10.696040 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.696009    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a289c7d-4f50-4ee8-a957-976fe8dd2877-metrics-certs\") pod \"maas-api-cf5b5fd48-swslq\" (UID: \"1a289c7d-4f50-4ee8-a957-976fe8dd2877\") " pod="odh-ai-gateway-infra/maas-api-cf5b5fd48-swslq"
Sep 08 12:04:10.696171 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.696050    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a289c7d-4f50-4ee8-a957-976fe8dd2877-maas-api-tls\") pod \"maas-api-cf5b5fd48-swslq\" (UID: \"1a289c7d-4f50-4ee8-a957-976fe8dd2877\") " pod="odh-ai-gateway-infra/maas-api-cf5b5fd48-swslq"
Sep 08 12:04:10.705067 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.705039    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw8mj\" (UniqueName: \"kubernetes.io/projected/1a289c7d-4f50-4ee8-a957-976fe8dd2877-kube-api-access-bw8mj\") pod \"maas-api-cf5b5fd48-swslq\" (UID: \"1a289c7d-4f50-4ee8-a957-976fe8dd2877\") " pod="odh-ai-gateway-infra/maas-api-cf5b5fd48-swslq"
Sep 08 12:04:10.806397 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:10.806368    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-cf5b5fd48-swslq"
Sep 08 12:04:11.082080 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:11.082055    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-cf5b5fd48-swslq"]
Sep 08 12:04:11.084117 ip-10-0-136-127 kubenswrapper[2575]: W0908 12:04:11.084091    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a289c7d_4f50_4ee8_a957_976fe8dd2877.slice/crio-c1e8e21a0003f72fe24d6e811bf6cfc670cb68aeb3413b672a6be8daf17b57c7 WatchSource:0}: Error finding container c1e8e21a0003f72fe24d6e811bf6cfc670cb68aeb3413b672a6be8daf17b57c7: Status 404 returned error can't find the container with id c1e8e21a0003f72fe24d6e811bf6cfc670cb68aeb3413b672a6be8daf17b57c7
Sep 08 12:04:11.085568 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:11.085548    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 12:04:11.350837 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:11.350746    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-cf5b5fd48-swslq" event={"ID":"1a289c7d-4f50-4ee8-a957-976fe8dd2877","Type":"ContainerStarted","Data":"c1e8e21a0003f72fe24d6e811bf6cfc670cb68aeb3413b672a6be8daf17b57c7"}
Sep 08 12:04:12.360494 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:12.360457    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-cf5b5fd48-swslq" event={"ID":"1a289c7d-4f50-4ee8-a957-976fe8dd2877","Type":"ContainerStarted","Data":"03c3d43f9a1f939a0accb40d88fef997f84a22b17b59d7755abe6a6a24835767"}
Sep 08 12:04:12.360945 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:12.360532    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-cf5b5fd48-swslq"
Sep 08 12:04:12.386220 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:12.386161    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-cf5b5fd48-swslq" podStartSLOduration=1.754160434 podStartE2EDuration="2.386143625s" totalImagesPullingTime="631.983191ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 12:04:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 12:04:12.383062129 +0000 UTC m=+2027.034768942" watchObservedRunningTime="2026-09-08 12:04:12.386143625 +0000 UTC m=+2027.037850419"
Sep 08 12:04:18.370899 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:18.370871    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-cf5b5fd48-swslq"
Sep 08 12:04:18.433134 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:18.433099    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7df9d55888-fvb5x"]
Sep 08 12:04:18.433363 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:18.433309    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-7df9d55888-fvb5x" podUID="7abaece7-f447-4eb0-9069-55e77403f630" containerName="maas-api" containerID="cri-o://34dad5a776a6e1565729b6b9acb508d9cd6598ce3e5b248634b2205aa6ac8ebf" gracePeriod=30
Sep 08 12:04:19.680951 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:19.680930    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7df9d55888-fvb5x"
Sep 08 12:04:19.782919 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:19.782891    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7qlg\" (UniqueName: \"kubernetes.io/projected/7abaece7-f447-4eb0-9069-55e77403f630-kube-api-access-f7qlg\") pod \"7abaece7-f447-4eb0-9069-55e77403f630\" (UID: \"7abaece7-f447-4eb0-9069-55e77403f630\") "
Sep 08 12:04:19.783085 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:19.782972    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7abaece7-f447-4eb0-9069-55e77403f630-openshift-service-ca\") pod \"7abaece7-f447-4eb0-9069-55e77403f630\" (UID: \"7abaece7-f447-4eb0-9069-55e77403f630\") "
Sep 08 12:04:19.783085 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:19.783003    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7abaece7-f447-4eb0-9069-55e77403f630-metrics-certs\") pod \"7abaece7-f447-4eb0-9069-55e77403f630\" (UID: \"7abaece7-f447-4eb0-9069-55e77403f630\") "
Sep 08 12:04:19.783085 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:19.783055    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7abaece7-f447-4eb0-9069-55e77403f630-maas-api-tls\") pod \"7abaece7-f447-4eb0-9069-55e77403f630\" (UID: \"7abaece7-f447-4eb0-9069-55e77403f630\") "
Sep 08 12:04:19.783385 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:19.783322    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7abaece7-f447-4eb0-9069-55e77403f630-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7abaece7-f447-4eb0-9069-55e77403f630" (UID: "7abaece7-f447-4eb0-9069-55e77403f630"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 12:04:19.785219 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:19.785197    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7abaece7-f447-4eb0-9069-55e77403f630-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7abaece7-f447-4eb0-9069-55e77403f630" (UID: "7abaece7-f447-4eb0-9069-55e77403f630"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 12:04:19.785322 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:19.785290    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7abaece7-f447-4eb0-9069-55e77403f630-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7abaece7-f447-4eb0-9069-55e77403f630" (UID: "7abaece7-f447-4eb0-9069-55e77403f630"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 12:04:19.785395 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:19.785321    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7abaece7-f447-4eb0-9069-55e77403f630-kube-api-access-f7qlg" (OuterVolumeSpecName: "kube-api-access-f7qlg") pod "7abaece7-f447-4eb0-9069-55e77403f630" (UID: "7abaece7-f447-4eb0-9069-55e77403f630"). InnerVolumeSpecName "kube-api-access-f7qlg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 12:04:19.884468 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:19.884438    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7qlg\" (UniqueName: \"kubernetes.io/projected/7abaece7-f447-4eb0-9069-55e77403f630-kube-api-access-f7qlg\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 12:04:19.884468 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:19.884465    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7abaece7-f447-4eb0-9069-55e77403f630-openshift-service-ca\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 12:04:19.884468 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:19.884476    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7abaece7-f447-4eb0-9069-55e77403f630-metrics-certs\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 12:04:19.884685 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:19.884485    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7abaece7-f447-4eb0-9069-55e77403f630-maas-api-tls\") on node \"ip-10-0-136-127.ec2.internal\" DevicePath \"\""
Sep 08 12:04:20.403945 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:20.403909    2575 generic.go:356] "Generic (PLEG): container finished" podID="7abaece7-f447-4eb0-9069-55e77403f630" containerID="34dad5a776a6e1565729b6b9acb508d9cd6598ce3e5b248634b2205aa6ac8ebf" exitCode=0
Sep 08 12:04:20.404122 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:20.403952    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7df9d55888-fvb5x" event={"ID":"7abaece7-f447-4eb0-9069-55e77403f630","Type":"ContainerDied","Data":"34dad5a776a6e1565729b6b9acb508d9cd6598ce3e5b248634b2205aa6ac8ebf"}
Sep 08 12:04:20.404122 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:20.403959    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7df9d55888-fvb5x"
Sep 08 12:04:20.404122 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:20.403991    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7df9d55888-fvb5x" event={"ID":"7abaece7-f447-4eb0-9069-55e77403f630","Type":"ContainerDied","Data":"1a1d11a5a22dbce1634897984e6ba519beaf778c3ce8a888f41c91e840e02c60"}
Sep 08 12:04:20.404122 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:20.404013    2575 scope.go:117] "RemoveContainer" containerID="34dad5a776a6e1565729b6b9acb508d9cd6598ce3e5b248634b2205aa6ac8ebf"
Sep 08 12:04:20.413074 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:20.413056    2575 scope.go:117] "RemoveContainer" containerID="34dad5a776a6e1565729b6b9acb508d9cd6598ce3e5b248634b2205aa6ac8ebf"
Sep 08 12:04:20.413423 ip-10-0-136-127 kubenswrapper[2575]: E0908 12:04:20.413404    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34dad5a776a6e1565729b6b9acb508d9cd6598ce3e5b248634b2205aa6ac8ebf\": container with ID starting with 34dad5a776a6e1565729b6b9acb508d9cd6598ce3e5b248634b2205aa6ac8ebf not found: ID does not exist" containerID="34dad5a776a6e1565729b6b9acb508d9cd6598ce3e5b248634b2205aa6ac8ebf"
Sep 08 12:04:20.413481 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:20.413430    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34dad5a776a6e1565729b6b9acb508d9cd6598ce3e5b248634b2205aa6ac8ebf"} err="failed to get container status \"34dad5a776a6e1565729b6b9acb508d9cd6598ce3e5b248634b2205aa6ac8ebf\": rpc error: code = NotFound desc = could not find container \"34dad5a776a6e1565729b6b9acb508d9cd6598ce3e5b248634b2205aa6ac8ebf\": container with ID starting with 34dad5a776a6e1565729b6b9acb508d9cd6598ce3e5b248634b2205aa6ac8ebf not found: ID does not exist"
Sep 08 12:04:20.430406 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:20.430377    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7df9d55888-fvb5x"]
Sep 08 12:04:20.433750 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:20.433727    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-7df9d55888-fvb5x"]
Sep 08 12:04:21.841796 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:21.841761    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7abaece7-f447-4eb0-9069-55e77403f630" path="/var/lib/kubelet/pods/7abaece7-f447-4eb0-9069-55e77403f630/volumes"
Sep 08 12:04:43.914169 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:43.914142    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-smdxl_3385a1d2-4297-4648-8d60-0e44b5532167/manager/0.log"
Sep 08 12:04:44.151756 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:44.151721    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-n5glp_12832668-e866-44f0-946f-64ff21a7f8e5/server/0.log"
Sep 08 12:04:44.275761 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:44.275731    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-kzlrt_25acf891-b23c-418b-8abd-8850ed352df9/manager/0.log"
Sep 08 12:04:44.388591 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:44.388563    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dd45fbd48-4c2x2_f8527972-0b8a-4de0-b888-cab3cba1935b/copy-manifests/0.log"
Sep 08 12:04:44.396625 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:44.396597    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dd45fbd48-4c2x2_f8527972-0b8a-4de0-b888-cab3cba1935b/manager/0.log"
Sep 08 12:04:45.112455 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:45.112419    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-cf5b5fd48-swslq_1a289c7d-4f50-4ee8-a957-976fe8dd2877/maas-api/0.log"
Sep 08 12:04:45.449929 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:45.449854    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-8bnk5_fd57be3c-295c-41dd-a168-de4610c1a596/postgres/0.log"
Sep 08 12:04:46.910589 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:46.910520    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-96fj8_a61f855f-c61a-4cdd-bc0a-c9f9d47b56c9/manager/0.log"
Sep 08 12:04:47.268616 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:47.268542    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb_e09a6b8c-164d-414d-a80e-1bd05d882785/istio-proxy/0.log"
Sep 08 12:04:47.753729 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:47.753700    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4bzvt_2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4/istio-proxy/1.log"
Sep 08 12:04:48.004169 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:48.004088    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-5mkwm_e4e40b15-6a61-41d4-8f31-3477f98974a3/payload-processing/0.log"
Sep 08 12:04:48.114777 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:48.114746    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78d7dd88d4-wjvdt_2713c4e2-3d07-454f-a92f-9f75689d226d/router/0.log"
Sep 08 12:04:48.683010 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:48.682974    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-g7dt9_1853033a-31a1-431d-acf6-a658fc0969d7/main/0.log"
Sep 08 12:04:49.031583 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:49.031558    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-q2hk9_fde1f76d-2dfc-447b-a4ad-8e8f09f5f92d/main/0.log"
Sep 08 12:04:57.639054 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:57.639022    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2tmp9_1df1b9eb-b388-4e05-af5d-9da7cfd4ce10/global-pull-secret-syncer/0.log"
Sep 08 12:04:57.817558 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:57.817531    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-62v7t_e520e24a-82d2-4d15-9257-b6bf3df4bb16/konnectivity-agent/0.log"
Sep 08 12:04:57.912013 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:04:57.911923    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-127.ec2.internal_50ad488f94e6200f7b23fbffec7fd91a/haproxy/0.log"
Sep 08 12:05:02.445938 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:02.445899    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-96fj8_a61f855f-c61a-4cdd-bc0a-c9f9d47b56c9/manager/0.log"
Sep 08 12:05:04.045575 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:04.045548    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0e0fb083-5f0a-4c4f-9789-004020617190/alertmanager/0.log"
Sep 08 12:05:04.085927 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:04.085899    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0e0fb083-5f0a-4c4f-9789-004020617190/config-reloader/0.log"
Sep 08 12:05:04.127852 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:04.127823    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0e0fb083-5f0a-4c4f-9789-004020617190/kube-rbac-proxy-web/0.log"
Sep 08 12:05:04.158170 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:04.158079    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0e0fb083-5f0a-4c4f-9789-004020617190/kube-rbac-proxy/0.log"
Sep 08 12:05:04.185446 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:04.185422    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0e0fb083-5f0a-4c4f-9789-004020617190/kube-rbac-proxy-metric/0.log"
Sep 08 12:05:04.216082 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:04.216057    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0e0fb083-5f0a-4c4f-9789-004020617190/prom-label-proxy/0.log"
Sep 08 12:05:04.244010 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:04.243966    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0e0fb083-5f0a-4c4f-9789-004020617190/init-config-reloader/0.log"
Sep 08 12:05:04.292085 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:04.292054    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-fphh6_e106802e-8a43-4870-92a4-08741f4e05d2/cluster-monitoring-operator/0.log"
Sep 08 12:05:04.326506 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:04.326441    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-lgsft_6b125984-2429-429c-b144-efbca9df53ac/kube-state-metrics/0.log"
Sep 08 12:05:04.352265 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:04.352240    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-lgsft_6b125984-2429-429c-b144-efbca9df53ac/kube-rbac-proxy-main/0.log"
Sep 08 12:05:04.386238 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:04.386220    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-lgsft_6b125984-2429-429c-b144-efbca9df53ac/kube-rbac-proxy-self/0.log"
Sep 08 12:05:04.492211 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:04.492179    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4rc2t_c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf/node-exporter/0.log"
Sep 08 12:05:04.523991 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:04.523963    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4rc2t_c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf/kube-rbac-proxy/0.log"
Sep 08 12:05:04.552437 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:04.552412    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4rc2t_c2961c91-e5e1-4cb7-87f7-cbd254a7cbcf/init-textfile/0.log"
Sep 08 12:05:04.832536 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:04.832509    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-s52j9_6ca4be75-c128-468b-8926-416c1a1b9f01/kube-rbac-proxy-main/0.log"
Sep 08 12:05:04.864835 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:04.864802    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-s52j9_6ca4be75-c128-468b-8926-416c1a1b9f01/kube-rbac-proxy-self/0.log"
Sep 08 12:05:04.896663 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:04.896641    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-s52j9_6ca4be75-c128-468b-8926-416c1a1b9f01/openshift-state-metrics/0.log"
Sep 08 12:05:04.964407 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:04.964366    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e6b1732e-6dcd-4234-8a47-a39ca47f866c/prometheus/0.log"
Sep 08 12:05:05.006045 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:05.005961    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e6b1732e-6dcd-4234-8a47-a39ca47f866c/config-reloader/0.log"
Sep 08 12:05:05.052464 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:05.052434    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e6b1732e-6dcd-4234-8a47-a39ca47f866c/thanos-sidecar/0.log"
Sep 08 12:05:05.091577 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:05.091547    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e6b1732e-6dcd-4234-8a47-a39ca47f866c/kube-rbac-proxy-web/0.log"
Sep 08 12:05:05.134144 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:05.134104    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e6b1732e-6dcd-4234-8a47-a39ca47f866c/kube-rbac-proxy/0.log"
Sep 08 12:05:05.168918 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:05.168886    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e6b1732e-6dcd-4234-8a47-a39ca47f866c/kube-rbac-proxy-thanos/0.log"
Sep 08 12:05:05.201251 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:05.201214    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e6b1732e-6dcd-4234-8a47-a39ca47f866c/init-config-reloader/0.log"
Sep 08 12:05:05.376764 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:05.376733    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75cdf8555c-zg72s_5e929af8-ea39-4034-a0dc-0fc17b565598/telemeter-client/0.log"
Sep 08 12:05:05.408564 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:05.408542    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75cdf8555c-zg72s_5e929af8-ea39-4034-a0dc-0fc17b565598/reload/0.log"
Sep 08 12:05:05.436845 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:05.436820    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75cdf8555c-zg72s_5e929af8-ea39-4034-a0dc-0fc17b565598/kube-rbac-proxy/0.log"
Sep 08 12:05:07.418064 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:07.418025    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ghzlp/perf-node-gather-daemonset-l4g76"]
Sep 08 12:05:07.418522 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:07.418507    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7abaece7-f447-4eb0-9069-55e77403f630" containerName="maas-api"
Sep 08 12:05:07.418522 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:07.418523    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7abaece7-f447-4eb0-9069-55e77403f630" containerName="maas-api"
Sep 08 12:05:07.418604 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:07.418598    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7abaece7-f447-4eb0-9069-55e77403f630" containerName="maas-api"
Sep 08 12:05:07.421770 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:07.421747    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ghzlp/perf-node-gather-daemonset-l4g76"
Sep 08 12:05:07.428685 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:07.428567    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ghzlp\"/\"default-dockercfg-xv459\""
Sep 08 12:05:07.429518 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:07.429499    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ghzlp\"/\"kube-root-ca.crt\""
Sep 08 12:05:07.429584 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:07.429529    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ghzlp\"/\"openshift-service-ca.crt\""
Sep 08 12:05:07.443975 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:07.443951    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ghzlp/perf-node-gather-daemonset-l4g76"]
Sep 08 12:05:07.556569 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:07.556530    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/082f3fa7-b2a1-4da0-afc2-cfd9b19d7ece-proc\") pod \"perf-node-gather-daemonset-l4g76\" (UID: \"082f3fa7-b2a1-4da0-afc2-cfd9b19d7ece\") " pod="openshift-must-gather-ghzlp/perf-node-gather-daemonset-l4g76"
Sep 08 12:05:07.556750 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:07.556580    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/082f3fa7-b2a1-4da0-afc2-cfd9b19d7ece-sys\") pod \"perf-node-gather-daemonset-l4g76\" (UID: \"082f3fa7-b2a1-4da0-afc2-cfd9b19d7ece\") " pod="openshift-must-gather-ghzlp/perf-node-gather-daemonset-l4g76"
Sep 08 12:05:07.556750 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:07.556646    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/082f3fa7-b2a1-4da0-afc2-cfd9b19d7ece-lib-modules\") pod \"perf-node-gather-daemonset-l4g76\" (UID: \"082f3fa7-b2a1-4da0-afc2-cfd9b19d7ece\") " pod="openshift-must-gather-ghzlp/perf-node-gather-daemonset-l4g76"
Sep 08 12:05:07.556750 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:07.556672    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dqkv\" (UniqueName: \"kubernetes.io/projected/082f3fa7-b2a1-4da0-afc2-cfd9b19d7ece-kube-api-access-4dqkv\") pod \"perf-node-gather-daemonset-l4g76\" (UID: \"082f3fa7-b2a1-4da0-afc2-cfd9b19d7ece\") " pod="openshift-must-gather-ghzlp/perf-node-gather-daemonset-l4g76"
Sep 08 12:05:07.556750 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:07.556719    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/082f3fa7-b2a1-4da0-afc2-cfd9b19d7ece-podres\") pod \"perf-node-gather-daemonset-l4g76\" (UID: \"082f3fa7-b2a1-4da0-afc2-cfd9b19d7ece\") " pod="openshift-must-gather-ghzlp/perf-node-gather-daemonset-l4g76"
Sep 08 12:05:07.657985 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:07.657950    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/082f3fa7-b2a1-4da0-afc2-cfd9b19d7ece-proc\") pod \"perf-node-gather-daemonset-l4g76\" (UID: \"082f3fa7-b2a1-4da0-afc2-cfd9b19d7ece\") " pod="openshift-must-gather-ghzlp/perf-node-gather-daemonset-l4g76"
Sep 08 12:05:07.658158 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:07.657994    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/082f3fa7-b2a1-4da0-afc2-cfd9b19d7ece-sys\") pod \"perf-node-gather-daemonset-l4g76\" (UID: \"082f3fa7-b2a1-4da0-afc2-cfd9b19d7ece\") " pod="openshift-must-gather-ghzlp/perf-node-gather-daemonset-l4g76"
Sep 08 12:05:07.658158 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:07.658033    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/082f3fa7-b2a1-4da0-afc2-cfd9b19d7ece-lib-modules\") pod \"perf-node-gather-daemonset-l4g76\" (UID: \"082f3fa7-b2a1-4da0-afc2-cfd9b19d7ece\") " pod="openshift-must-gather-ghzlp/perf-node-gather-daemonset-l4g76"
Sep 08 12:05:07.658158 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:07.658050    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dqkv\" (UniqueName: \"kubernetes.io/projected/082f3fa7-b2a1-4da0-afc2-cfd9b19d7ece-kube-api-access-4dqkv\") pod \"perf-node-gather-daemonset-l4g76\" (UID: \"082f3fa7-b2a1-4da0-afc2-cfd9b19d7ece\") " pod="openshift-must-gather-ghzlp/perf-node-gather-daemonset-l4g76"
Sep 08 12:05:07.658158 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:07.658083    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/082f3fa7-b2a1-4da0-afc2-cfd9b19d7ece-podres\") pod \"perf-node-gather-daemonset-l4g76\" (UID: \"082f3fa7-b2a1-4da0-afc2-cfd9b19d7ece\") " pod="openshift-must-gather-ghzlp/perf-node-gather-daemonset-l4g76"
Sep 08 12:05:07.658158 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:07.658081    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/082f3fa7-b2a1-4da0-afc2-cfd9b19d7ece-proc\") pod \"perf-node-gather-daemonset-l4g76\" (UID: \"082f3fa7-b2a1-4da0-afc2-cfd9b19d7ece\") " pod="openshift-must-gather-ghzlp/perf-node-gather-daemonset-l4g76"
Sep 08 12:05:07.658326 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:07.658173    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/082f3fa7-b2a1-4da0-afc2-cfd9b19d7ece-sys\") pod \"perf-node-gather-daemonset-l4g76\" (UID: \"082f3fa7-b2a1-4da0-afc2-cfd9b19d7ece\") " pod="openshift-must-gather-ghzlp/perf-node-gather-daemonset-l4g76"
Sep 08 12:05:07.658326 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:07.658192    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/082f3fa7-b2a1-4da0-afc2-cfd9b19d7ece-lib-modules\") pod \"perf-node-gather-daemonset-l4g76\" (UID: \"082f3fa7-b2a1-4da0-afc2-cfd9b19d7ece\") " pod="openshift-must-gather-ghzlp/perf-node-gather-daemonset-l4g76"
Sep 08 12:05:07.658326 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:07.658210    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/082f3fa7-b2a1-4da0-afc2-cfd9b19d7ece-podres\") pod \"perf-node-gather-daemonset-l4g76\" (UID: \"082f3fa7-b2a1-4da0-afc2-cfd9b19d7ece\") " pod="openshift-must-gather-ghzlp/perf-node-gather-daemonset-l4g76"
Sep 08 12:05:07.673876 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:07.673816    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dqkv\" (UniqueName: \"kubernetes.io/projected/082f3fa7-b2a1-4da0-afc2-cfd9b19d7ece-kube-api-access-4dqkv\") pod \"perf-node-gather-daemonset-l4g76\" (UID: \"082f3fa7-b2a1-4da0-afc2-cfd9b19d7ece\") " pod="openshift-must-gather-ghzlp/perf-node-gather-daemonset-l4g76"
Sep 08 12:05:07.731783 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:07.731756    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ghzlp/perf-node-gather-daemonset-l4g76"
Sep 08 12:05:08.016116 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:08.016087    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ghzlp/perf-node-gather-daemonset-l4g76"]
Sep 08 12:05:08.018103 ip-10-0-136-127 kubenswrapper[2575]: W0908 12:05:08.018073    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod082f3fa7_b2a1_4da0_afc2_cfd9b19d7ece.slice/crio-dab236cff7cfc1a96b7ec5b406e045f7d1d0f262177a9cc892a9727ff9e3850e WatchSource:0}: Error finding container dab236cff7cfc1a96b7ec5b406e045f7d1d0f262177a9cc892a9727ff9e3850e: Status 404 returned error can't find the container with id dab236cff7cfc1a96b7ec5b406e045f7d1d0f262177a9cc892a9727ff9e3850e
Sep 08 12:05:08.640465 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:08.640427    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ghzlp/perf-node-gather-daemonset-l4g76" event={"ID":"082f3fa7-b2a1-4da0-afc2-cfd9b19d7ece","Type":"ContainerStarted","Data":"351154ddf3aa0e1951cf36491f576d1844afed6d06bf7506006cd564c0383b35"}
Sep 08 12:05:08.640853 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:08.640479    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ghzlp/perf-node-gather-daemonset-l4g76" event={"ID":"082f3fa7-b2a1-4da0-afc2-cfd9b19d7ece","Type":"ContainerStarted","Data":"dab236cff7cfc1a96b7ec5b406e045f7d1d0f262177a9cc892a9727ff9e3850e"}
Sep 08 12:05:08.640853 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:08.640506    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ghzlp/perf-node-gather-daemonset-l4g76"
Sep 08 12:05:08.661685 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:08.661634    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ghzlp/perf-node-gather-daemonset-l4g76" podStartSLOduration=1.6616163 podStartE2EDuration="1.6616163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 12:05:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 12:05:08.660329325 +0000 UTC m=+2083.312036119" watchObservedRunningTime="2026-09-08 12:05:08.6616163 +0000 UTC m=+2083.313323094"
Sep 08 12:05:10.519984 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:10.519954    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sdbbl_c6fc3823-83c6-4d67-9068-48bff3a5b3ed/dns/0.log"
Sep 08 12:05:10.546908 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:10.546883    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sdbbl_c6fc3823-83c6-4d67-9068-48bff3a5b3ed/kube-rbac-proxy/0.log"
Sep 08 12:05:10.606233 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:10.606209    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cf287_51e41bf2-8be4-48a7-a3e7-6d17b4566f97/dns-node-resolver/0.log"
Sep 08 12:05:11.218308 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:11.218280    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-64f5c77786-bqrll_e57c960d-1c0a-4c27-865b-ccd85df5fdb1/registry/0.log"
Sep 08 12:05:11.277962 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:11.277922    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bhshk_598d45ef-a4d2-4d2a-b318-c3898319833a/node-ca/0.log"
Sep 08 12:05:12.438085 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:12.438057    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb_e09a6b8c-164d-414d-a80e-1bd05d882785/istio-proxy/0.log"
Sep 08 12:05:13.095403 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:13.095361    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4bzvt_2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4/istio-proxy/0.log"
Sep 08 12:05:13.104427 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:13.104401    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4bzvt_2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4/istio-proxy/1.log"
Sep 08 12:05:13.186245 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:13.186223    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-5mkwm_e4e40b15-6a61-41d4-8f31-3477f98974a3/payload-processing/0.log"
Sep 08 12:05:13.213510 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:13.213487    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78d7dd88d4-wjvdt_2713c4e2-3d07-454f-a92f-9f75689d226d/router/0.log"
Sep 08 12:05:14.176255 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:14.176229    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tf7sb_de1e135a-bd8c-4e20-be89-f7a2a2cbf98e/serve-healthcheck-canary/0.log"
Sep 08 12:05:14.656105 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:14.656078    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ghzlp/perf-node-gather-daemonset-l4g76"
Sep 08 12:05:14.950936 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:14.950865    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qlxz4_fdd4c249-fda4-4507-bf19-31eb55553277/kube-rbac-proxy/0.log"
Sep 08 12:05:14.980049 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:14.980025    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qlxz4_fdd4c249-fda4-4507-bf19-31eb55553277/exporter/0.log"
Sep 08 12:05:15.010051 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:15.010029    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qlxz4_fdd4c249-fda4-4507-bf19-31eb55553277/extractor/0.log"
Sep 08 12:05:17.649937 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:17.649910    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-smdxl_3385a1d2-4297-4648-8d60-0e44b5532167/manager/0.log"
Sep 08 12:05:17.742978 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:17.742889    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-n5glp_12832668-e866-44f0-946f-64ff21a7f8e5/server/0.log"
Sep 08 12:05:17.767885 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:17.767858    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb_e09a6b8c-164d-414d-a80e-1bd05d882785/istio-proxy/0.log"
Sep 08 12:05:17.830278 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:17.830251    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-kzlrt_25acf891-b23c-418b-8abd-8850ed352df9/manager/0.log"
Sep 08 12:05:17.877963 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:17.877934    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dd45fbd48-4c2x2_f8527972-0b8a-4de0-b888-cab3cba1935b/manager/0.log"
Sep 08 12:05:17.936479 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:17.936458    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dd45fbd48-4c2x2_f8527972-0b8a-4de0-b888-cab3cba1935b/copy-manifests/0.log"
Sep 08 12:05:18.426388 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:18.426297    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4bzvt_2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4/istio-proxy/0.log"
Sep 08 12:05:18.435392 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:18.435370    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4bzvt_2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4/istio-proxy/1.log"
Sep 08 12:05:18.499333 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:18.499309    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-5mkwm_e4e40b15-6a61-41d4-8f31-3477f98974a3/payload-processing/0.log"
Sep 08 12:05:18.516728 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:18.516705    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78d7dd88d4-wjvdt_2713c4e2-3d07-454f-a92f-9f75689d226d/router/0.log"
Sep 08 12:05:19.665392 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:19.665363    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-b949f5b5c-gckw5_2d7511b1-4d6b-415e-8f40-aecb65224d2e/manager/0.log"
Sep 08 12:05:20.064525 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:20.064495    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb_e09a6b8c-164d-414d-a80e-1bd05d882785/istio-proxy/0.log"
Sep 08 12:05:20.722620 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:20.722589    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4bzvt_2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4/istio-proxy/0.log"
Sep 08 12:05:20.730916 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:20.730885    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4bzvt_2dabf0b5-a85d-4889-9b6c-4230a0f1fbb4/istio-proxy/1.log"
Sep 08 12:05:20.795220 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:20.795183    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-5mkwm_e4e40b15-6a61-41d4-8f31-3477f98974a3/payload-processing/0.log"
Sep 08 12:05:20.819793 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:20.819764    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78d7dd88d4-wjvdt_2713c4e2-3d07-454f-a92f-9f75689d226d/router/0.log"
Sep 08 12:05:25.306332 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:25.306302    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-cbhsg_fa5f78a4-5774-44c5-8e7e-5786eddd5dc8/migrator/0.log"
Sep 08 12:05:25.338217 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:25.338185    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-cbhsg_fa5f78a4-5774-44c5-8e7e-5786eddd5dc8/graceful-termination/0.log"
Sep 08 12:05:25.770466 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:25.770376    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-2hc2h_7b6421d4-66bb-466a-b4fa-0d57d75e6d46/kube-storage-version-migrator-operator/1.log"
Sep 08 12:05:25.771393 ip-10-0-136-127 kubenswrapper[2575]: I0908 12:05:25.771352    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-2hc2h_7b6421d4-66bb-466a-b4fa-0d57d75e6d46/kube-storage-version-migrator-operator/0.log"