Jul 23 00:02:09.981629 ip-10-0-138-182 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 23 00:02:09.981639 ip-10-0-138-182 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 23 00:02:09.981646 ip-10-0-138-182 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 23 00:02:09.981898 ip-10-0-138-182 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 23 00:02:20.005643 ip-10-0-138-182 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 23 00:02:20.005663 ip-10-0-138-182 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 6f2057e26c564130aa3b149949e08d24 --
Jul 23 00:04:17.127705 ip-10-0-138-182 systemd[1]: Starting Kubernetes Kubelet...
Jul 23 00:04:17.572722 ip-10-0-138-182 kubenswrapper[2549]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 00:04:17.572722 ip-10-0-138-182 kubenswrapper[2549]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 23 00:04:17.572722 ip-10-0-138-182 kubenswrapper[2549]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 00:04:17.572722 ip-10-0-138-182 kubenswrapper[2549]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 23 00:04:17.572722 ip-10-0-138-182 kubenswrapper[2549]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 00:04:17.572722 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.514875    2549 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 23 00:04:17.572722 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519752    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 00:04:17.572722 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519766    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 00:04:17.572722 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519770    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 00:04:17.572722 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519773    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 00:04:17.572722 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519776    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 00:04:17.572722 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519779    2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 00:04:17.572722 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519782    2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 00:04:17.572722 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519785    2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 00:04:17.573499 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519787    2549 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 00:04:17.573499 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519790    2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 00:04:17.573499 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519792    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 00:04:17.573499 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519795    2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 00:04:17.573499 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519798    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 00:04:17.573499 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519801    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 00:04:17.573499 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519803    2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 00:04:17.573499 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519806    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 00:04:17.573499 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519808    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 00:04:17.573499 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519811    2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 00:04:17.573499 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519813    2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 00:04:17.573499 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519816    2549 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 00:04:17.573499 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519819    2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 00:04:17.573499 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519821    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 00:04:17.573499 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519824    2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 00:04:17.573499 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519827    2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 00:04:17.573499 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519829    2549 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 00:04:17.573499 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519833    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 00:04:17.573499 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519836    2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 00:04:17.573499 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519840    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 00:04:17.574170 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519843    2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 00:04:17.574170 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519846    2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 00:04:17.574170 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519849    2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 00:04:17.574170 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519851    2549 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 00:04:17.574170 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519854    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 00:04:17.574170 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519856    2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 00:04:17.574170 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519860    2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 00:04:17.574170 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519862    2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 00:04:17.574170 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519865    2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 00:04:17.574170 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519868    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 00:04:17.574170 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519871    2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 00:04:17.574170 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519874    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 00:04:17.574170 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519877    2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 00:04:17.574170 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519881    2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 00:04:17.574170 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519885    2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 00:04:17.574170 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519887    2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 00:04:17.574170 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519890    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 00:04:17.574170 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519893    2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 00:04:17.574170 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519895    2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 00:04:17.574692 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519898    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 00:04:17.574692 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519901    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 00:04:17.574692 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519905    2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 00:04:17.574692 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519909    2549 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 00:04:17.574692 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519912    2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 00:04:17.574692 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519914    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 00:04:17.574692 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519917    2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 00:04:17.574692 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519921    2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 00:04:17.574692 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519923    2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 00:04:17.574692 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519926    2549 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 00:04:17.574692 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519929    2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 00:04:17.574692 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519931    2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 00:04:17.574692 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519933    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 00:04:17.574692 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519936    2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 00:04:17.574692 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519939    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 00:04:17.574692 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519941    2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 00:04:17.574692 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519944    2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 00:04:17.574692 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519947    2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 00:04:17.574692 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519949    2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 00:04:17.574692 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519952    2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 00:04:17.575252 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519955    2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 00:04:17.575252 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519958    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 00:04:17.575252 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519962    2549 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 00:04:17.575252 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519964    2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 00:04:17.575252 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519968    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 00:04:17.575252 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519970    2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 00:04:17.575252 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519973    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 00:04:17.575252 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519977    2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 00:04:17.575252 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519988    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 00:04:17.575252 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519992    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 00:04:17.575252 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519995    2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 00:04:17.575252 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.519997    2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 00:04:17.575252 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.520002    2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 00:04:17.575252 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.520006    2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 00:04:17.575252 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.520010    2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 00:04:17.575252 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.520013    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 00:04:17.575252 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.520017    2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 00:04:17.575252 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.520022    2549 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 00:04:17.575252 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.520026    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 00:04:17.575252 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.520030    2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 00:04:17.575885 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.520035    2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 00:04:17.575885 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.520039    2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 00:04:17.575885 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.520044    2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 00:04:17.575885 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.520048    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 00:04:17.575885 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.520052    2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 00:04:17.575885 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.520056    2549 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 00:04:17.575885 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.520060    2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 00:04:17.575885 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.520064    2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 00:04:17.575885 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.520068    2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 00:04:17.575885 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.520072    2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 00:04:17.575885 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.520075    2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 00:04:17.575885 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.520079    2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 00:04:17.575885 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.521886    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 00:04:17.575885 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.521895    2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 00:04:17.575885 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.521901    2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 00:04:17.575885 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.521907    2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 00:04:17.575885 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.521912    2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 00:04:17.575885 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.521917    2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 00:04:17.575885 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.521921    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 00:04:17.575885 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.521925    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 00:04:17.576482 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.521930    2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 00:04:17.576482 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.521934    2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 00:04:17.576482 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.521939    2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 00:04:17.576482 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.521943    2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 00:04:17.576482 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.521947    2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 00:04:17.576482 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.521951    2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 00:04:17.576482 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.521955    2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 00:04:17.576482 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.521958    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 00:04:17.576482 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.521962    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 00:04:17.576482 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.521966    2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 00:04:17.576482 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.521970    2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 00:04:17.576482 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.521973    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 00:04:17.576482 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.521977    2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 00:04:17.576482 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.521981    2549 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 00:04:17.576482 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.521985    2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 00:04:17.576482 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.521989    2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 00:04:17.576482 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.521994    2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 00:04:17.576482 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.521998    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 00:04:17.576482 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522002    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 00:04:17.576994 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522005    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 00:04:17.576994 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522009    2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 00:04:17.576994 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522013    2549 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 00:04:17.576994 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522017    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 00:04:17.576994 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522021    2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 00:04:17.576994 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522024    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 00:04:17.576994 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522029    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 00:04:17.576994 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522033    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 00:04:17.576994 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522038    2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 00:04:17.576994 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522042    2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 00:04:17.576994 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522045    2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 00:04:17.576994 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522050    2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 00:04:17.576994 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522054    2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 00:04:17.576994 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522058    2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 00:04:17.576994 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522061    2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 00:04:17.576994 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522065    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 00:04:17.576994 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522068    2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 00:04:17.576994 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522072    2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 00:04:17.576994 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522077    2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 00:04:17.576994 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522083    2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 00:04:17.577584 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522086    2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 00:04:17.577584 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522090    2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 00:04:17.577584 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522094    2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 00:04:17.577584 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522097    2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 00:04:17.577584 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522101    2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 00:04:17.577584 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522104    2549 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 00:04:17.577584 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522108    2549 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 00:04:17.577584 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522112    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 00:04:17.577584 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522116    2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 00:04:17.577584 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522120    2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 00:04:17.577584 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522124    2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 00:04:17.577584 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522128    2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 00:04:17.577584 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522132    2549 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 00:04:17.577584 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522136    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 00:04:17.577584 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522140    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 00:04:17.577584 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522144    2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 00:04:17.577584 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522148    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 00:04:17.577584 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522151    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 00:04:17.577584 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522156    2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 00:04:17.577584 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522159    2549 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 00:04:17.578101 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522163    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 00:04:17.578101 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522168    2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 00:04:17.578101 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522171    2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 00:04:17.578101 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522175    2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 00:04:17.578101 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522180    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 00:04:17.578101 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522184    2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 00:04:17.578101 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522187    2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 00:04:17.578101 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522191    2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 00:04:17.578101 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522195    2549 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 00:04:17.578101 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522199    2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 00:04:17.578101 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522202    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 00:04:17.578101 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522206    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 00:04:17.578101 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522209    2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 00:04:17.578101 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522213    2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 00:04:17.578101 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522217    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 00:04:17.578101 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522221    2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 00:04:17.578101 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522224    2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 00:04:17.578101 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522228    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 00:04:17.578101 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522232    2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 00:04:17.578101 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522236    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 00:04:17.578740 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522239    2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 00:04:17.578740 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522246    2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 00:04:17.578740 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522251    2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 00:04:17.578740 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522255    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 00:04:17.578740 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522258    2549 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 00:04:17.578740 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522264    2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 00:04:17.578740 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522269    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 00:04:17.578740 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522273    2549 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 00:04:17.578740 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522276    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 00:04:17.578740 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522282    2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 00:04:17.578740 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522287    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 00:04:17.578740 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522291    2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 00:04:17.578740 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522842    2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 00:04:17.578740 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522849    2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 00:04:17.578740 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522854    2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 00:04:17.578740 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522858    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 00:04:17.578740 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522864    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 00:04:17.578740 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522868    2549 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 00:04:17.578740 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522872    2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 00:04:17.579246 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522876    2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 00:04:17.579246 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522882    2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 00:04:17.579246 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522887    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 00:04:17.579246 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522892    2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 00:04:17.579246 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522896    2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 00:04:17.579246 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522900    2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 00:04:17.579246 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522904    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 00:04:17.579246 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522908    2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 00:04:17.579246 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522913    2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 00:04:17.579246 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522917    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 00:04:17.579246 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522921    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 00:04:17.579246 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522924    2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 00:04:17.579246 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522929    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 00:04:17.579246 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522932    2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 00:04:17.579246 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522938    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 00:04:17.579246 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522943    2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 00:04:17.579246 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522947    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 00:04:17.579246 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522951    2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 00:04:17.579246 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522955    2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 00:04:17.579804 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522959    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 00:04:17.579804 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522963    2549 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 00:04:17.579804 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522967    2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 00:04:17.579804 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522971    2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 00:04:17.579804 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522974    2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 00:04:17.579804 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522978    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 00:04:17.579804 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522982    2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 00:04:17.579804 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522986    2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 00:04:17.579804 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522990    2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 00:04:17.579804 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.522994    2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 00:04:17.579804 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523000    2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 00:04:17.579804 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523004    2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 00:04:17.579804 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523009    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 00:04:17.579804 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523013    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 00:04:17.579804 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523017    2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 00:04:17.579804 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523020    2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 00:04:17.579804 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523025    2549 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 00:04:17.579804 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523029    2549 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 00:04:17.579804 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523033    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 00:04:17.579804 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523038    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 00:04:17.580331 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523042    2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 00:04:17.580331 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523046    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 00:04:17.580331 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523050    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 00:04:17.580331 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523055    2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 00:04:17.580331 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523061    2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 00:04:17.580331 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523066    2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 00:04:17.580331 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523069    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 00:04:17.580331 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523075    2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 00:04:17.580331 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523081    2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 00:04:17.580331 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523085    2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 00:04:17.580331 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523089    2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 00:04:17.580331 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523092    2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 00:04:17.580331 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523096    2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 00:04:17.580331 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523100    2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 00:04:17.580331 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523103    2549 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 00:04:17.580331 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523107    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 00:04:17.580331 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523111    2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 00:04:17.580331 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523114    2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 00:04:17.580331 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523118    2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 00:04:17.580886 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523121    2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 00:04:17.580886 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523125    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 00:04:17.580886 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523129    2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 00:04:17.580886 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523133    2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 00:04:17.580886 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523136    2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 00:04:17.580886 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523141    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 00:04:17.580886 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523144    2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 00:04:17.580886 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523148    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 00:04:17.580886 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523152    2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 00:04:17.580886 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523155    2549 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 00:04:17.580886 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523159    2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 00:04:17.580886 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523163    2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 00:04:17.580886 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523166    2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 00:04:17.580886 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523170    2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 00:04:17.580886 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523173    2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 00:04:17.580886 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523177    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 00:04:17.580886 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523181    2549 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 00:04:17.580886 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523184    2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 00:04:17.580886 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523188    2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 00:04:17.580886 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523191    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 00:04:17.581434 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523196    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 00:04:17.581434 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523201    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 00:04:17.581434 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523205    2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 00:04:17.581434 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523208    2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 00:04:17.581434 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523212    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 00:04:17.581434 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523216    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 00:04:17.581434 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523219    2549 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 00:04:17.581434 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523223    2549 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 00:04:17.581434 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523226    2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 00:04:17.581434 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523230    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 00:04:17.581434 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523234    2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 00:04:17.581434 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523237    2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 00:04:17.581434 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523241    2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 00:04:17.581434 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.523244    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 00:04:17.581434 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523330    2549 flags.go:64] FLAG: --address="0.0.0.0"
Jul 23 00:04:17.581434 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523339    2549 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 23 00:04:17.581434 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523347    2549 flags.go:64] FLAG: --anonymous-auth="true"
Jul 23 00:04:17.581434 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523353    2549 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 23 00:04:17.581434 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523360    2549 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 23 00:04:17.581434 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523365    2549 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 23 00:04:17.581434 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523371    2549 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 23 00:04:17.582045 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523377    2549 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 23 00:04:17.582045 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523381    2549 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 23 00:04:17.582045 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523386    2549 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 23 00:04:17.582045 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523391    2549 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 23 00:04:17.582045 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523395    2549 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 23 00:04:17.582045 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523400    2549 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 23 00:04:17.582045 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523404    2549 flags.go:64] FLAG: --cgroup-root=""
Jul 23 00:04:17.582045 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523408    2549 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 23 00:04:17.582045 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523413    2549 flags.go:64] FLAG: --client-ca-file=""
Jul 23 00:04:17.582045 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523417    2549 flags.go:64] FLAG: --cloud-provider="external"
Jul 23 00:04:17.582045 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523421    2549 flags.go:64] FLAG: --cluster-dns="[]"
Jul 23 00:04:17.582045 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523430    2549 flags.go:64] FLAG: --cluster-domain=""
Jul 23 00:04:17.582045 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523435    2549 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 23 00:04:17.582045 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523440    2549 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 23 00:04:17.582045 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523444    2549 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 23 00:04:17.582045 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523464    2549 flags.go:64] FLAG: --container-log-max-files="5"
Jul 23 00:04:17.582045 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523470    2549 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 23 00:04:17.582045 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523475    2549 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 23 00:04:17.582045 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523479    2549 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 23 00:04:17.582045 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523484    2549 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 23 00:04:17.582045 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523488    2549 flags.go:64] FLAG: --contention-profiling="false"
Jul 23 00:04:17.582045 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523492    2549 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 23 00:04:17.582045 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523497    2549 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 23 00:04:17.582045 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523501    2549 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 23 00:04:17.582748 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523505    2549 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 23 00:04:17.582748 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523511    2549 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 23 00:04:17.582748 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523515    2549 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 23 00:04:17.582748 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523520    2549 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 23 00:04:17.582748 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523524    2549 flags.go:64] FLAG: --enable-load-reader="false"
Jul 23 00:04:17.582748 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523528    2549 flags.go:64] FLAG: --enable-server="true"
Jul 23 00:04:17.582748 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523533    2549 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 23 00:04:17.582748 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523539    2549 flags.go:64] FLAG: --event-burst="100"
Jul 23 00:04:17.582748 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523544    2549 flags.go:64] FLAG: --event-qps="50"
Jul 23 00:04:17.582748 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523548    2549 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 23 00:04:17.582748 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523552    2549 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 23 00:04:17.582748 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523556    2549 flags.go:64] FLAG: --eviction-hard=""
Jul 23 00:04:17.582748 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523561    2549 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 23 00:04:17.582748 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523566    2549 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 23 00:04:17.582748 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523570    2549 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 23 00:04:17.582748 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523574    2549 flags.go:64] FLAG: --eviction-soft=""
Jul 23 00:04:17.582748 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523579    2549 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 23 00:04:17.582748 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523583    2549 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 23 00:04:17.582748 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523587    2549 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 23 00:04:17.582748 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523594    2549 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 23 00:04:17.582748 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523600    2549 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 23 00:04:17.582748 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523604    2549 flags.go:64] FLAG: --fail-swap-on="true"
Jul 23 00:04:17.582748 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523608    2549 flags.go:64] FLAG: --feature-gates=""
Jul 23 00:04:17.582748 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523613    2549 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 23 00:04:17.582748 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523618    2549 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 23 00:04:17.583736 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523623    2549 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 23 00:04:17.583736 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523627    2549 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 23 00:04:17.583736 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523632    2549 flags.go:64] FLAG: --healthz-port="10248"
Jul 23 00:04:17.583736 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523636    2549 flags.go:64] FLAG: --help="false"
Jul 23 00:04:17.583736 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523640    2549 flags.go:64] FLAG: --hostname-override="ip-10-0-138-182.ec2.internal"
Jul 23 00:04:17.583736 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523645    2549 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 23 00:04:17.583736 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523650    2549 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 23 00:04:17.583736 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523654    2549 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 23 00:04:17.583736 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523659    2549 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 23 00:04:17.583736 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523664    2549 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 23 00:04:17.583736 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523668    2549 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 23 00:04:17.583736 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523672    2549 flags.go:64] FLAG: --image-service-endpoint=""
Jul 23 00:04:17.583736 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523676    2549 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 23 00:04:17.583736 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523680    2549 flags.go:64] FLAG: --kube-api-burst="100"
Jul 23 00:04:17.583736 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523685    2549 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 23 00:04:17.583736 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523689    2549 flags.go:64] FLAG: --kube-api-qps="50"
Jul 23 00:04:17.583736 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523693    2549 flags.go:64] FLAG: --kube-reserved=""
Jul 23 00:04:17.583736 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523698    2549 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 23 00:04:17.583736 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523701    2549 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 23 00:04:17.583736 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523706    2549 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 23 00:04:17.583736 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523711    2549 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 23 00:04:17.583736 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523715    2549 flags.go:64] FLAG: --lock-file=""
Jul 23 00:04:17.583736 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523719    2549 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 23 00:04:17.583736 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523724    2549 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 23 00:04:17.753200 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523728    2549 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 23 00:04:17.753200 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523736    2549 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 23 00:04:17.753200 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523742    2549 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 23 00:04:17.753200 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523747    2549 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 23 00:04:17.753200 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523751    2549 flags.go:64] FLAG: --logging-format="text"
Jul 23 00:04:17.753200 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523755    2549 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 23 00:04:17.753200 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523760    2549 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 23 00:04:17.753200 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523764    2549 flags.go:64] FLAG: --manifest-url=""
Jul 23 00:04:17.753200 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523768    2549 flags.go:64] FLAG: --manifest-url-header=""
Jul 23 00:04:17.753200 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523774    2549 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 23 00:04:17.753200 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523779    2549 flags.go:64] FLAG: --max-open-files="1000000"
Jul 23 00:04:17.753200 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523785    2549 flags.go:64] FLAG: --max-pods="110"
Jul 23 00:04:17.753200 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523789    2549 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 23 00:04:17.753200 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523794    2549 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 23 00:04:17.753200 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523798    2549 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 23 00:04:17.753200 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523802    2549 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 23 00:04:17.753200 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523805    2549 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 23 00:04:17.753200 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523810    2549 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 23 00:04:17.753200 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523814    2549 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 23 00:04:17.753200 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523824    2549 flags.go:64] FLAG: --node-status-max-images="50"
Jul 23 00:04:17.753200 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523828    2549 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 23 00:04:17.753200 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523832    2549 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 23 00:04:17.753200 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523837    2549 flags.go:64] FLAG: --pod-cidr=""
Jul 23 00:04:17.593760 ip-10-0-138-182 systemd[1]: Started Kubernetes Kubelet.
Jul 23 00:04:17.779490 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523841    2549 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 23 00:04:17.779490 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523848    2549 flags.go:64] FLAG: --pod-manifest-path=""
Jul 23 00:04:17.779490 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523852    2549 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 23 00:04:17.779490 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523857    2549 flags.go:64] FLAG: --pods-per-core="0"
Jul 23 00:04:17.779490 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523861    2549 flags.go:64] FLAG: --port="10250"
Jul 23 00:04:17.779490 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523865    2549 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 23 00:04:17.779490 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523870    2549 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0228fdf505011b87e"
Jul 23 00:04:17.779490 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523874    2549 flags.go:64] FLAG: --qos-reserved=""
Jul 23 00:04:17.779490 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523879    2549 flags.go:64] FLAG: --read-only-port="10255"
Jul 23 00:04:17.779490 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523883    2549 flags.go:64] FLAG: --register-node="true"
Jul 23 00:04:17.779490 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523887    2549 flags.go:64] FLAG: --register-with-taints=""
Jul 23 00:04:17.779490 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523894    2549 flags.go:64] FLAG: --registry-burst="10"
Jul 23 00:04:17.779490 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523898    2549 flags.go:64] FLAG: --registry-qps="5"
Jul 23 00:04:17.779490 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523905    2549 flags.go:64] FLAG: --reserved-cpus=""
Jul 23 00:04:17.779490 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523909    2549 flags.go:64] FLAG: --reserved-memory=""
Jul 23 00:04:17.779490 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523914    2549 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 23 00:04:17.779490 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523919    2549 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 23 00:04:17.779490 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523924    2549 flags.go:64] FLAG: --rotate-certificates="false"
Jul 23 00:04:17.779490 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523928    2549 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 23 00:04:17.779490 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523932    2549 flags.go:64] FLAG: --runonce="false"
Jul 23 00:04:17.779490 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523936    2549 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 23 00:04:17.779490 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523941    2549 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 23 00:04:17.779490 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523945    2549 flags.go:64] FLAG: --seccomp-default="false"
Jul 23 00:04:17.779490 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523950    2549 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 23 00:04:17.779490 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523954    2549 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 23 00:04:17.781258 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523958    2549 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 23 00:04:17.781258 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523963    2549 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 23 00:04:17.781258 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523967    2549 flags.go:64] FLAG: --storage-driver-password="root"
Jul 23 00:04:17.781258 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523970    2549 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 23 00:04:17.781258 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523975    2549 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 23 00:04:17.781258 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523986    2549 flags.go:64] FLAG: --storage-driver-user="root"
Jul 23 00:04:17.781258 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523991    2549 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 23 00:04:17.781258 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.523996    2549 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 23 00:04:17.781258 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.524001    2549 flags.go:64] FLAG: --system-cgroups=""
Jul 23 00:04:17.781258 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.524005    2549 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 23 00:04:17.781258 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.524013    2549 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 23 00:04:17.781258 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.524017    2549 flags.go:64] FLAG: --tls-cert-file=""
Jul 23 00:04:17.781258 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.524022    2549 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 23 00:04:17.781258 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.524028    2549 flags.go:64] FLAG: --tls-min-version=""
Jul 23 00:04:17.781258 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.524032    2549 flags.go:64] FLAG: --tls-private-key-file=""
Jul 23 00:04:17.781258 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.524036    2549 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 23 00:04:17.781258 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.524041    2549 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 23 00:04:17.781258 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.524045    2549 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 23 00:04:17.781258 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.524052    2549 flags.go:64] FLAG: --v="2"
Jul 23 00:04:17.781258 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.524058    2549 flags.go:64] FLAG: --version="false"
Jul 23 00:04:17.781258 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.524065    2549 flags.go:64] FLAG: --vmodule=""
Jul 23 00:04:17.781258 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.524070    2549 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 23 00:04:17.781258 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.524075    2549 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 23 00:04:17.781258 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524235    2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 00:04:17.781258 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524240    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 00:04:17.782383 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524244    2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 00:04:17.782383 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524249    2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 00:04:17.782383 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524252    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 00:04:17.782383 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524257    2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 00:04:17.782383 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524261    2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 00:04:17.782383 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524264    2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 00:04:17.782383 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524268    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 00:04:17.782383 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524272    2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 00:04:17.782383 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524276    2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 00:04:17.782383 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524280    2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 00:04:17.782383 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524284    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 00:04:17.782383 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524288    2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 00:04:17.782383 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524292    2549 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 00:04:17.782383 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524296    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 00:04:17.782383 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524299    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 00:04:17.782383 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524303    2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 00:04:17.782383 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524310    2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 00:04:17.782383 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524317    2549 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 00:04:17.782383 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524322    2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 00:04:17.783581 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524326    2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 00:04:17.783581 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524331    2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 00:04:17.783581 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524335    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 00:04:17.783581 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524339    2549 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 00:04:17.783581 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524343    2549 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 00:04:17.783581 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524347    2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 00:04:17.783581 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524353    2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 00:04:17.783581 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524357    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 00:04:17.783581 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524362    2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 00:04:17.783581 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524366    2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 00:04:17.783581 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524370    2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 00:04:17.783581 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524373    2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 00:04:17.783581 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524377    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 00:04:17.783581 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524381    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 00:04:17.783581 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524385    2549 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 00:04:17.783581 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524388    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 00:04:17.783581 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524392    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 00:04:17.783581 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524396    2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 00:04:17.783581 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524399    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 00:04:17.783581 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524403    2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 00:04:17.784437 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524407    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 00:04:17.784437 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524410    2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 00:04:17.784437 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524414    2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 00:04:17.784437 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524419    2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 00:04:17.784437 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524422    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 00:04:17.784437 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524426    2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 00:04:17.784437 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524429    2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 00:04:17.784437 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524433    2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 00:04:17.784437 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524437    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 00:04:17.784437 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524440    2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 00:04:17.784437 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524444    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 00:04:17.784437 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524462    2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 00:04:17.784437 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524466    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 00:04:17.784437 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524469    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 00:04:17.784437 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524473    2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 00:04:17.784437 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524477    2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 00:04:17.784437 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524480    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 00:04:17.784437 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524485    2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 00:04:17.784437 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524490    2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 00:04:17.785615 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524494    2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 00:04:17.785615 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524499    2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 00:04:17.785615 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524503    2549 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 00:04:17.785615 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524507    2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 00:04:17.785615 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524511    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 00:04:17.785615 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524515    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 00:04:17.785615 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524519    2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 00:04:17.785615 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524522    2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 00:04:17.785615 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524526    2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 00:04:17.785615 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524529    2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 00:04:17.785615 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524533    2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 00:04:17.785615 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524537    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 00:04:17.785615 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524541    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 00:04:17.785615 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524544    2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 00:04:17.785615 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524548    2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 00:04:17.785615 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524552    2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 00:04:17.785615 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524557    2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 00:04:17.785615 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524562    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 00:04:17.785615 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524566    2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 00:04:17.785615 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524570    2549 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 00:04:17.786286 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524574    2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 00:04:17.786286 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524577    2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 00:04:17.786286 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524581    2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 00:04:17.786286 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524585    2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 00:04:17.786286 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524589    2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 00:04:17.786286 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524594    2549 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 00:04:17.786286 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524597    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 00:04:17.786286 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524601    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 00:04:17.786286 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524605    2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 00:04:17.786286 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524609    2549 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 00:04:17.786286 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524612    2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 00:04:17.786286 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524617    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 00:04:17.786286 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524621    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 00:04:17.786286 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524626    2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 00:04:17.786286 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524630    2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 00:04:17.786286 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524634    2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 00:04:17.786286 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524638    2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 00:04:17.786286 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524641    2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 00:04:17.786286 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.524645    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 00:04:17.787110 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.525939    2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 00:04:17.787110 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.533072    2549 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 23 00:04:17.787110 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.533091    2549 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 23 00:04:17.787110 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.533104    2549 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 23 00:04:17.787110 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.533111    2549 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 23 00:04:17.787110 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533178    2549 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 00:04:17.787110 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533183    2549 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 00:04:17.787110 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533187    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 00:04:17.787110 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533190    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 00:04:17.787110 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533192    2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 00:04:17.787110 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533195    2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 00:04:17.787110 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533200    2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 00:04:17.787110 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533204    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 00:04:17.787110 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533207    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 00:04:17.787840 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533210    2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 00:04:17.787840 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533213    2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 00:04:17.787840 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533216    2549 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 00:04:17.787840 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533219    2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 00:04:17.787840 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533221    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 00:04:17.787840 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533224    2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 00:04:17.787840 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533227    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 00:04:17.787840 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533230    2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 00:04:17.787840 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533233    2549 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 00:04:17.787840 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533235    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 00:04:17.787840 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533238    2549 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 00:04:17.787840 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533241    2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 00:04:17.787840 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533244    2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 00:04:17.787840 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533247    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 00:04:17.787840 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533250    2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 00:04:17.787840 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533252    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 00:04:17.787840 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533256    2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 00:04:17.787840 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533260    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 00:04:17.787840 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533263    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 00:04:17.787840 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533265    2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 00:04:17.788721 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533274    2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 00:04:17.788721 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533277    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 00:04:17.788721 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533280    2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 00:04:17.788721 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533282    2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 00:04:17.788721 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533287    2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 00:04:17.788721 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533290    2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 00:04:17.788721 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533293    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 00:04:17.788721 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533296    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 00:04:17.788721 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533299    2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 00:04:17.788721 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533302    2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 00:04:17.788721 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533304    2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 00:04:17.788721 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533307    2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 00:04:17.788721 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533310    2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 00:04:17.788721 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533313    2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 00:04:17.788721 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533316    2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 00:04:17.788721 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533323    2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 00:04:17.788721 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533325    2549 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 00:04:17.788721 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533328    2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 00:04:17.788721 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533331    2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 00:04:17.788721 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533333    2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 00:04:17.975945 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533336    2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 00:04:17.975945 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533339    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 00:04:17.975945 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533341    2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 00:04:17.975945 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533344    2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 00:04:17.975945 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533347    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 00:04:17.975945 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533350    2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 00:04:17.975945 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533353    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 00:04:17.975945 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533356    2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 00:04:17.975945 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533358    2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 00:04:17.975945 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533361    2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 00:04:17.975945 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533363    2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 00:04:17.975945 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533366    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 00:04:17.975945 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533375    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 00:04:17.975945 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533385    2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 00:04:17.975945 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533388    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 00:04:17.975945 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533390    2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 00:04:17.975945 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533393    2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 00:04:17.975945 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533396    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 00:04:17.975945 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533398    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 00:04:17.976684 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533401    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 00:04:17.976684 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533403    2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 00:04:17.976684 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533406    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 00:04:17.976684 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533408    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 00:04:17.976684 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533411    2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 00:04:17.976684 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533414    2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 00:04:17.976684 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533416    2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 00:04:17.976684 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533419    2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 00:04:17.976684 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533426    2549 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 00:04:17.976684 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533429    2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 00:04:17.976684 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533432    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 00:04:17.976684 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533435    2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 00:04:17.976684 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533438    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 00:04:17.976684 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533440    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 00:04:17.976684 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533443    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 00:04:17.976684 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533446    2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 00:04:17.976684 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533464    2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 00:04:17.976684 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533467    2549 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 00:04:17.976684 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533470    2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 00:04:17.976684 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533472    2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 00:04:17.977346 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533475    2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 00:04:17.977346 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533477    2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 00:04:17.977346 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533480    2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 00:04:17.977346 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533482    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 00:04:17.977346 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533485    2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 00:04:17.977346 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533487    2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 00:04:17.977346 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533490    2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 00:04:17.977346 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533503    2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 00:04:17.977346 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533506    2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 00:04:17.977346 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533508    2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 00:04:17.977346 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533511    2549 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 00:04:17.977346 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.533517    2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 00:04:17.977346 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533666    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 00:04:17.977346 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533672    2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 00:04:17.977346 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533676    2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 00:04:17.978011 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533680    2549 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 00:04:17.978011 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533683    2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 00:04:17.978011 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533686    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 00:04:17.978011 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533688    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 00:04:17.978011 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533691    2549 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 00:04:17.978011 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533696    2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 00:04:17.978011 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533700    2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 00:04:17.978011 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533703    2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 00:04:17.978011 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533706    2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 00:04:17.978011 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533709    2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 00:04:17.978011 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533711    2549 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 00:04:17.978011 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533714    2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 00:04:17.978011 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533716    2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 00:04:17.978011 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533719    2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 00:04:17.978011 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533722    2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 00:04:17.978011 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533726    2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 00:04:17.978011 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533729    2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 00:04:17.978011 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533732    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 00:04:17.978011 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533735    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 00:04:17.978669 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533737    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 00:04:17.978669 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533740    2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 00:04:17.978669 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533743    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 00:04:17.978669 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533745    2549 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 00:04:17.978669 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533748    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 00:04:17.978669 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533751    2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 00:04:17.978669 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533761    2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 00:04:17.978669 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533764    2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 00:04:17.978669 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533767    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 00:04:17.978669 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533769    2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 00:04:17.978669 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533772    2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 00:04:17.978669 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533775    2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 00:04:17.978669 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533777    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 00:04:17.978669 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533780    2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 00:04:17.978669 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533782    2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 00:04:17.978669 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533785    2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 00:04:17.978669 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533787    2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 00:04:17.978669 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533790    2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 00:04:17.978669 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533794    2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 00:04:17.979260 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533798    2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 00:04:17.979260 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533800    2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 00:04:17.979260 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533803    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 00:04:17.979260 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533807    2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 00:04:17.979260 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533810    2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 00:04:17.979260 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533813    2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 00:04:17.979260 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533815    2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 00:04:17.979260 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533818    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 00:04:17.979260 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533820    2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 00:04:17.979260 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533823    2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 00:04:17.979260 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533826    2549 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 00:04:17.979260 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533828    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 00:04:17.979260 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533831    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 00:04:17.979260 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533834    2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 00:04:17.979260 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533836    2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 00:04:17.979260 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533839    2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 00:04:17.979260 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533841    2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 00:04:17.979260 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533844    2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 00:04:17.979260 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533846    2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 00:04:17.980052 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533849    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 00:04:17.980052 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533857    2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 00:04:17.980052 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533860    2549 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 00:04:17.980052 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533863    2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 00:04:17.980052 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533865    2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 00:04:17.980052 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533868    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 00:04:17.980052 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533870    2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 00:04:17.980052 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533873    2549 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 00:04:17.980052 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533875    2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 00:04:17.980052 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533878    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 00:04:17.980052 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533880    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 00:04:17.980052 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533883    2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 00:04:17.980052 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533887    2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 00:04:17.980052 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533891    2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 00:04:17.980052 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533894    2549 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 00:04:17.980052 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533897    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 00:04:17.980052 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533900    2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 00:04:17.980052 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533902    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 00:04:17.980052 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533905    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 00:04:17.980052 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533907    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 00:04:17.980708 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533910    2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 00:04:17.980708 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533913    2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 00:04:17.980708 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533915    2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 00:04:17.980708 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533918    2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 00:04:17.980708 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533920    2549 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 00:04:17.980708 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533923    2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 00:04:17.980708 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533925    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 00:04:17.980708 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533928    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 00:04:17.980708 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533930    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 00:04:17.980708 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533933    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 00:04:17.980708 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533935    2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 00:04:17.980708 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533938    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 00:04:17.980708 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533940    2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 00:04:17.980708 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533943    2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 00:04:17.980708 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533951    2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 00:04:17.980708 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533953    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 00:04:17.980708 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533956    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 00:04:17.980708 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533959    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 00:04:17.980708 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:17.533961    2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 00:04:17.981350 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.533966    2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 00:04:17.981350 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.534086    2549 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 23 00:04:17.981350 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.536063    2549 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 23 00:04:17.981350 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.537383    2549 server.go:1019] "Starting client certificate rotation"
Jul 23 00:04:17.981350 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.537489    2549 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 00:04:17.981350 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.537526    2549 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 00:04:17.981350 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.539934    2549 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 00:04:17.981350 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.542584    2549 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 00:04:17.981350 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.552738    2549 log.go:25] "Validated CRI v1 runtime API"
Jul 23 00:04:17.981350 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.555284    2549 log.go:25] "Validated CRI v1 image API"
Jul 23 00:04:17.981350 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.556175    2549 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 23 00:04:17.981350 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.560261    2549 fs.go:135] Filesystem UUIDs: map[344911a0-a789-4b30-822c-efbf9210396b:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a5e5c8c1-574b-4680-b8e1-45ded206dd6e:/dev/nvme0n1p4]
Jul 23 00:04:17.981787 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.560275    2549 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 23 00:04:17.981971 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.565092    2549 manager.go:216] Machine: {Timestamp:2026-07-23 00:04:17.564567652 +0000 UTC m=+0.325765955 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102744 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26fe33d707c25e93dcbe7d5a401b88 SystemUUID:ec26fe33-d707-c25e-93dc-be7d5a401b88 BootID:6f2057e2-6c56-4130-aa3b-149949e08d24 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e6:2f:22:9e:d3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e6:2f:22:9e:d3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:c0:c7:a7:3d:05 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 23 00:04:17.981971 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.565194    2549 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 23 00:04:17.981971 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.565295    2549 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 23 00:04:17.981971 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.568387    2549 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 00:04:17.981971 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.568410    2549 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 23 00:04:17.981971 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.568467    2549 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-182.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 23 00:04:17.981971 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.569539    2549 topology_manager.go:138] "Creating topology manager with none policy"
Jul 23 00:04:17.982299 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.569550    2549 container_manager_linux.go:309] "Creating device plugin manager"
Jul 23 00:04:17.982299 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.569558    2549 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 00:04:17.982299 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.570134    2549 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 00:04:17.982299 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.571317    2549 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 23 00:04:17.982299 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.582098    2549 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 00:04:17.982299 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.582224    2549 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 23 00:04:17.982299 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.582249    2549 kubelet.go:486] "Attempting to sync node with API server"
Jul 23 00:04:17.982299 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.582259    2549 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 23 00:04:17.982299 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.582271    2549 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 23 00:04:17.982299 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.582281    2549 kubelet.go:398] "Adding apiserver pod source"
Jul 23 00:04:17.982299 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.582289    2549 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 23 00:04:17.982299 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.582655    2549 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 00:04:17.982299 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.582672    2549 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 00:04:17.982299 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.585037    2549 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 23 00:04:17.982299 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.586775    2549 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 23 00:04:17.982299 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.586802    2549 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 23 00:04:17.982299 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.587783    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 23 00:04:17.982299 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.587807    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 23 00:04:17.982299 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.587814    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 23 00:04:17.982299 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.587820    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 23 00:04:17.982299 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.587829    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 23 00:04:17.982299 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.587835    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 23 00:04:17.982299 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.587844    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 23 00:04:17.982299 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.587850    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 23 00:04:17.982299 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.587856    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 23 00:04:17.982299 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.587862    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 23 00:04:17.982299 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.587878    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 23 00:04:17.982299 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.587884    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 23 00:04:17.982299 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.589265    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 23 00:04:17.982299 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.589274    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 23 00:04:17.982299 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.592538    2549 server.go:1268] "Started kubelet"
Jul 23 00:04:17.982299 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.593016    2549 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 23 00:04:17.982299 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.592764    2549 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 23 00:04:17.982299 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.593278    2549 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 23 00:04:17.982299 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.597441    2549 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 23 00:04:17.982299 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.597627    2549 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-182.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 23 00:04:17.982299 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.598644    2549 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mgxxh"
Jul 23 00:04:17.982299 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:17.598949    2549 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 23 00:04:17.982299 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:17.599033    2549 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-182.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 23 00:04:17.983407 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:17.599930    2549 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 23 00:04:17.983407 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.604855    2549 server.go:310] "Adding debug handlers to kubelet server"
Jul 23 00:04:17.983407 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.605214    2549 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mgxxh"
Jul 23 00:04:17.983407 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.605229    2549 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 23 00:04:17.983407 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.605422    2549 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 23 00:04:17.983407 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:17.605517    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-182.ec2.internal\" not found"
Jul 23 00:04:17.983407 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.606139    2549 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 23 00:04:17.983407 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.606152    2549 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 23 00:04:17.983407 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.606220    2549 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 23 00:04:17.983407 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.606310    2549 reconstruct.go:97] "Volume reconstruction finished"
Jul 23 00:04:17.983407 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.606319    2549 reconciler.go:29] "Reconciler: start to sync state"
Jul 23 00:04:17.983407 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:17.605215    2549 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-182.ec2.internal.18c4c25d2154bfe8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-182.ec2.internal,UID:ip-10-0-138-182.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-182.ec2.internal,},FirstTimestamp:2026-07-23 00:04:17.592508392 +0000 UTC m=+0.353706694,LastTimestamp:2026-07-23 00:04:17.592508392 +0000 UTC m=+0.353706694,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-182.ec2.internal,}"
Jul 23 00:04:17.983407 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.606645    2549 factory.go:55] Registering systemd factory
Jul 23 00:04:17.983407 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.606658    2549 factory.go:223] Registration of the systemd container factory successfully
Jul 23 00:04:17.983407 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.606867    2549 factory.go:153] Registering CRI-O factory
Jul 23 00:04:17.983407 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.606878    2549 factory.go:223] Registration of the crio container factory successfully
Jul 23 00:04:17.983407 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.606924    2549 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 23 00:04:17.983407 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.606996    2549 factory.go:103] Registering Raw factory
Jul 23 00:04:17.983407 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.607009    2549 manager.go:1196] Started watching for new ooms in manager
Jul 23 00:04:17.983407 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.607364    2549 manager.go:349] Starting recovery of all containers
Jul 23 00:04:17.983407 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:17.609626    2549 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 23 00:04:17.983407 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:17.609608    2549 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-182.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 23 00:04:17.983407 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.624654    2549 manager.go:354] Recovery completed
Jul 23 00:04:17.983407 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.629652    2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 00:04:17.983407 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.631545    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-182.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 00:04:17.983407 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.631578    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-182.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 00:04:17.983407 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.631598    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-182.ec2.internal" event="NodeHasSufficientPID"
Jul 23 00:04:17.983407 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.633505    2549 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 23 00:04:17.983407 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.633516    2549 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 23 00:04:17.983407 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.633533    2549 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 00:04:17.983407 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.633538    2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 00:04:17.983407 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.634559    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-182.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 00:04:17.983407 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.634585    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-182.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 00:04:17.984417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.634602    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-182.ec2.internal" event="NodeHasSufficientPID"
Jul 23 00:04:17.984417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.635638    2549 policy_none.go:49] "None policy: Start"
Jul 23 00:04:17.984417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.635652    2549 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 23 00:04:17.984417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.635663    2549 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 23 00:04:17.984417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.637733    2549 policy_none.go:47] "Start"
Jul 23 00:04:17.984417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.686008    2549 manager.go:337] "Starting Device Plugin manager"
Jul 23 00:04:17.984417 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:17.686041    2549 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 23 00:04:17.984417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.686052    2549 server.go:87] "Starting device plugin registration server"
Jul 23 00:04:17.984417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.686298    2549 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 23 00:04:17.984417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.686308    2549 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 23 00:04:17.984417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.686407    2549 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 23 00:04:17.984417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.686535    2549 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 23 00:04:17.984417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.686550    2549 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 23 00:04:17.984417 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:17.687481    2549 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 23 00:04:17.984417 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:17.687661    2549 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-182.ec2.internal\" not found"
Jul 23 00:04:17.984417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.786861    2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 00:04:17.984417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.788200    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-182.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 00:04:17.984417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.788236    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-182.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 00:04:17.984417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.788249    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-182.ec2.internal" event="NodeHasSufficientPID"
Jul 23 00:04:17.984417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.788280    2549 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-182.ec2.internal"
Jul 23 00:04:17.984417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.794874    2549 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 23 00:04:17.984417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.796275    2549 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 23 00:04:17.984417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.796310    2549 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 23 00:04:17.984417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.796336    2549 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 23 00:04:17.984417 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:17.796380    2549 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 23 00:04:17.984417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.799391    2549 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 00:04:17.984417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.799586    2549 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-182.ec2.internal"
Jul 23 00:04:17.984417 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:17.799607    2549 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-182.ec2.internal\": node \"ip-10-0-138-182.ec2.internal\" not found"
Jul 23 00:04:17.984417 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:17.847389    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-182.ec2.internal\" not found"
Jul 23 00:04:17.984417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.900525    2549 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-182.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-182.ec2.internal"]
Jul 23 00:04:17.984417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.900635    2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 00:04:17.984417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.901757    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-182.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 00:04:17.984417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.901798    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-182.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 00:04:17.984417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.901811    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-182.ec2.internal" event="NodeHasSufficientPID"
Jul 23 00:04:17.984417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.904197    2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 00:04:17.984417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.904327    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-182.ec2.internal"
Jul 23 00:04:17.984417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.904361    2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 00:04:17.984417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.905028    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-182.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 00:04:17.985522 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.905033    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-182.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 00:04:17.985522 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.905057    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-182.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 00:04:17.985522 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.905068    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-182.ec2.internal" event="NodeHasSufficientPID"
Jul 23 00:04:17.985522 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.905057    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-182.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 00:04:17.985522 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.905204    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-182.ec2.internal" event="NodeHasSufficientPID"
Jul 23 00:04:17.985522 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.907496    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-182.ec2.internal"
Jul 23 00:04:17.985522 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.907522    2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 00:04:17.985522 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.908399    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-182.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 00:04:17.985522 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.908438    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-182.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 00:04:17.985522 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:17.908449    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-182.ec2.internal" event="NodeHasSufficientPID"
Jul 23 00:04:17.985522 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:17.945255    2549 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-182.ec2.internal\" not found" node="ip-10-0-138-182.ec2.internal"
Jul 23 00:04:17.985522 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:17.947516    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-182.ec2.internal\" not found"
Jul 23 00:04:17.985522 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:17.950031    2549 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-182.ec2.internal\" not found" node="ip-10-0-138-182.ec2.internal"
Jul 23 00:04:18.175417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:18.007526    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/914224a26574b8fab8d59923791f6500-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-182.ec2.internal\" (UID: \"914224a26574b8fab8d59923791f6500\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-182.ec2.internal"
Jul 23 00:04:18.175417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:18.007550    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/914224a26574b8fab8d59923791f6500-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-182.ec2.internal\" (UID: \"914224a26574b8fab8d59923791f6500\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-182.ec2.internal"
Jul 23 00:04:18.175417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:18.007568    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e75ffd7291292d64f0e4db02c0350a31-config\") pod \"kube-apiserver-proxy-ip-10-0-138-182.ec2.internal\" (UID: \"e75ffd7291292d64f0e4db02c0350a31\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-182.ec2.internal"
Jul 23 00:04:18.175417 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:18.048006    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-182.ec2.internal\" not found"
Jul 23 00:04:18.175417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:18.107968    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e75ffd7291292d64f0e4db02c0350a31-config\") pod \"kube-apiserver-proxy-ip-10-0-138-182.ec2.internal\" (UID: \"e75ffd7291292d64f0e4db02c0350a31\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-182.ec2.internal"
Jul 23 00:04:18.175417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:18.107999    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/914224a26574b8fab8d59923791f6500-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-182.ec2.internal\" (UID: \"914224a26574b8fab8d59923791f6500\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-182.ec2.internal"
Jul 23 00:04:18.175417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:18.108018    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/914224a26574b8fab8d59923791f6500-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-182.ec2.internal\" (UID: \"914224a26574b8fab8d59923791f6500\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-182.ec2.internal"
Jul 23 00:04:18.175417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:18.108075    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/914224a26574b8fab8d59923791f6500-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-182.ec2.internal\" (UID: \"914224a26574b8fab8d59923791f6500\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-182.ec2.internal"
Jul 23 00:04:18.175417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:18.108077    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e75ffd7291292d64f0e4db02c0350a31-config\") pod \"kube-apiserver-proxy-ip-10-0-138-182.ec2.internal\" (UID: \"e75ffd7291292d64f0e4db02c0350a31\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-182.ec2.internal"
Jul 23 00:04:18.175417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:18.108131    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/914224a26574b8fab8d59923791f6500-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-182.ec2.internal\" (UID: \"914224a26574b8fab8d59923791f6500\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-182.ec2.internal"
Jul 23 00:04:18.175417 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:18.151330    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-182.ec2.internal\" not found"
Jul 23 00:04:18.415691 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:18.251251    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-182.ec2.internal"
Jul 23 00:04:18.415691 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:18.251488    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-182.ec2.internal\" not found"
Jul 23 00:04:18.415691 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:18.253501    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-182.ec2.internal"
Jul 23 00:04:18.415691 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:18.354302    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-182.ec2.internal\" not found"
Jul 23 00:04:18.599984 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:18.457547    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-182.ec2.internal\" not found"
Jul 23 00:04:18.599984 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:18.515098    2549 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 00:04:18.599984 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:18.536511    2549 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 23 00:04:18.599984 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:18.536640    2549 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 23 00:04:18.599984 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:18.536683    2549 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 23 00:04:18.599984 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:18.557833    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-182.ec2.internal\" not found"
Jul 23 00:04:18.756539 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:18.611513    2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 23:59:18 +0000 UTC" deadline="2028-02-03 12:02:01.190777512 +0000 UTC"
Jul 23 00:04:18.756539 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:18.611548    2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13451h57m42.579233536s"
Jul 23 00:04:18.756539 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:18.660798    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-182.ec2.internal\" not found"
Jul 23 00:04:18.899727 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:18.761865    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-182.ec2.internal\" not found"
Jul 23 00:04:18.899727 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:18.862788    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-182.ec2.internal\" not found"
Jul 23 00:04:19.023004 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:18.965174    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-182.ec2.internal\" not found"
Jul 23 00:04:19.023004 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:19.002393    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod914224a26574b8fab8d59923791f6500.slice/crio-91bcefc2d5a7458bdd19ff4f208c6662406b966f2d707461172c601666f818d2 WatchSource:0}: Error finding container 91bcefc2d5a7458bdd19ff4f208c6662406b966f2d707461172c601666f818d2: Status 404 returned error can't find the container with id 91bcefc2d5a7458bdd19ff4f208c6662406b966f2d707461172c601666f818d2
Jul 23 00:04:19.023004 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:19.009752    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode75ffd7291292d64f0e4db02c0350a31.slice/crio-03f84e65cbc060eeb28a7cfda520ef92159188125b3ff4a6c37b7ca588fd814a WatchSource:0}: Error finding container 03f84e65cbc060eeb28a7cfda520ef92159188125b3ff4a6c37b7ca588fd814a: Status 404 returned error can't find the container with id 03f84e65cbc060eeb28a7cfda520ef92159188125b3ff4a6c37b7ca588fd814a
Jul 23 00:04:19.023004 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.017298    2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 00:04:19.233463 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.064776    2549 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 00:04:19.233463 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:19.066058    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-182.ec2.internal\" not found"
Jul 23 00:04:19.233463 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.153497    2549 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 00:04:19.233463 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.208310    2549 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-182.ec2.internal"
Jul 23 00:04:19.233463 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.220671    2549 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 00:04:19.233463 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.221739    2549 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-182.ec2.internal"
Jul 23 00:04:19.233463 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.228788    2549 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 00:04:19.585353 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.585313    2549 apiserver.go:52] "Watching apiserver"
Jul 23 00:04:19.592893 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.592860    2549 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 23 00:04:19.593392 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.593348    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-mktsc","openshift-network-diagnostics/network-check-target-mnwg9","openshift-network-operator/iptables-alerter-d9w65","openshift-ovn-kubernetes/ovnkube-node-qwd8v","kube-system/global-pull-secret-syncer-fmqcb","kube-system/konnectivity-agent-flsfc","kube-system/kube-apiserver-proxy-ip-10-0-138-182.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztpf9","openshift-dns/node-resolver-b42wl","openshift-image-registry/node-ca-vfqnm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-182.ec2.internal","openshift-multus/multus-mqh4z","openshift-cluster-node-tuning-operator/tuned-twnl8","openshift-multus/multus-additional-cni-plugins-xw482"]
Jul 23 00:04:19.596136 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.596053    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vfqnm"
Jul 23 00:04:19.598944 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.598520    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.598944 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.598932    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zlzs7\""
Jul 23 00:04:19.599159 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.599118    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 23 00:04:19.599159 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.599133    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 23 00:04:19.599281 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.599254    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 23 00:04:19.601285 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.600666    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 23 00:04:19.601285 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.600986    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d9w65"
Jul 23 00:04:19.602622 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.602417    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 23 00:04:19.602622 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.602500    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-t54gt\""
Jul 23 00:04:19.603807 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.603345    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 23 00:04:19.603807 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.603356    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dv6z7\""
Jul 23 00:04:19.603807 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.603392    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 23 00:04:19.603807 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.603660    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 23 00:04:19.604187 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.604169    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.613150 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.607733    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 23 00:04:19.613150 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.607935    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 23 00:04:19.613150 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.612112    2549 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 23 00:04:19.613150 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.612151    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 23 00:04:19.613150 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.612358    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 23 00:04:19.613150 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.612419    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lljm4\""
Jul 23 00:04:19.613150 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.612852    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmqcb"
Jul 23 00:04:19.613150 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:19.612921    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmqcb" podUID="553eb6d0-ca32-4129-99d3-e1459beadee9"
Jul 23 00:04:19.613997 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.613403    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 23 00:04:19.613997 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.613599    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 23 00:04:19.615655 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.615633    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-flsfc"
Jul 23 00:04:19.618438 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.618412    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b42wl"
Jul 23 00:04:19.620866 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.619722    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 23 00:04:19.620866 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.620501    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 23 00:04:19.620866 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.620686    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qtzlw\""
Jul 23 00:04:19.621582 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.621295    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xw482"
Jul 23 00:04:19.622393 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.622371    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 23 00:04:19.622864 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.622840    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-l6w6p\""
Jul 23 00:04:19.622958 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.622887    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 23 00:04:19.624348 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.624322    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-host-kubelet\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.624451 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.624368    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-systemd-units\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.624451 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.624405    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-run-ovn\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.624451 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.624442    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-node-log\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.624636 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.624478    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/86be577e-afe5-47f5-9f88-cba8930f17ce-var-lib-kubelet\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.624636 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.624580    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86be577e-afe5-47f5-9f88-cba8930f17ce-tmp\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.624636 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.624628    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c247\" (UniqueName: \"kubernetes.io/projected/3d027895-b39d-4efe-a38b-9c56633349ce-kube-api-access-7c247\") pod \"iptables-alerter-d9w65\" (UID: \"3d027895-b39d-4efe-a38b-9c56633349ce\") " pod="openshift-network-operator/iptables-alerter-d9w65"
Jul 23 00:04:19.624787 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.624662    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-host-slash\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.624787 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.624723    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-run-systemd\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.624787 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.624761    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-host-cni-netd\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.624917 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.624788    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86be577e-afe5-47f5-9f88-cba8930f17ce-etc-kubernetes\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.632022 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.629371    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 23 00:04:19.632022 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.629847    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 23 00:04:19.632022 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.629856    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-q7vb2\""
Jul 23 00:04:19.632022 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.629875    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 23 00:04:19.632022 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.630008    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 23 00:04:19.632022 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.630277    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 23 00:04:19.632022 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.630562    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/86be577e-afe5-47f5-9f88-cba8930f17ce-lib-modules\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.632022 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.630608    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-host-run-netns\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.632022 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.630645    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-run-openvswitch\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.632022 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.630676    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-log-socket\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.632022 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.630747    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/553eb6d0-ca32-4129-99d3-e1459beadee9-kubelet-config\") pod \"global-pull-secret-syncer-fmqcb\" (UID: \"553eb6d0-ca32-4129-99d3-e1459beadee9\") " pod="kube-system/global-pull-secret-syncer-fmqcb"
Jul 23 00:04:19.632022 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.630780    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3d027895-b39d-4efe-a38b-9c56633349ce-iptables-alerter-script\") pod \"iptables-alerter-d9w65\" (UID: \"3d027895-b39d-4efe-a38b-9c56633349ce\") " pod="openshift-network-operator/iptables-alerter-d9w65"
Jul 23 00:04:19.632022 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.630804    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-host-run-ovn-kubernetes\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.632022 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.630846    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/553eb6d0-ca32-4129-99d3-e1459beadee9-original-pull-secret\") pod \"global-pull-secret-syncer-fmqcb\" (UID: \"553eb6d0-ca32-4129-99d3-e1459beadee9\") " pod="kube-system/global-pull-secret-syncer-fmqcb"
Jul 23 00:04:19.632022 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.630878    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k44ff\" (UniqueName: \"kubernetes.io/projected/79f6db91-6406-4b7b-988a-f7b0b35ded81-kube-api-access-k44ff\") pod \"node-ca-vfqnm\" (UID: \"79f6db91-6406-4b7b-988a-f7b0b35ded81\") " pod="openshift-image-registry/node-ca-vfqnm"
Jul 23 00:04:19.632022 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.630890    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mnwg9"
Jul 23 00:04:19.632022 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.630905    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/86be577e-afe5-47f5-9f88-cba8930f17ce-etc-tuned\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.632966 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.630952    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3d027895-b39d-4efe-a38b-9c56633349ce-host-slash\") pod \"iptables-alerter-d9w65\" (UID: \"3d027895-b39d-4efe-a38b-9c56633349ce\") " pod="openshift-network-operator/iptables-alerter-d9w65"
Jul 23 00:04:19.632966 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.630987    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-etc-openvswitch\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.632966 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:19.630997    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mnwg9" podUID="362cd422-ddfb-47e6-ae23-568f4edcef08"
Jul 23 00:04:19.632966 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.631022    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-ovn-node-metrics-cert\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.632966 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.631074    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w7np\" (UniqueName: \"kubernetes.io/projected/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-kube-api-access-2w7np\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.632966 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.631118    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/553eb6d0-ca32-4129-99d3-e1459beadee9-dbus\") pod \"global-pull-secret-syncer-fmqcb\" (UID: \"553eb6d0-ca32-4129-99d3-e1459beadee9\") " pod="kube-system/global-pull-secret-syncer-fmqcb"
Jul 23 00:04:19.632966 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.631165    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/86be577e-afe5-47f5-9f88-cba8930f17ce-etc-modprobe-d\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.632966 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.631200    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/86be577e-afe5-47f5-9f88-cba8930f17ce-etc-sysctl-conf\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.632966 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.631259    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/86be577e-afe5-47f5-9f88-cba8930f17ce-etc-systemd\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.632966 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.631522    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-ovnkube-config\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.632966 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.631567    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-env-overrides\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.632966 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.631608    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-ovnkube-script-lib\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.632966 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.631672    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/00834f32-b182-4f53-bca5-7188aacc3b2b-konnectivity-ca\") pod \"konnectivity-agent-flsfc\" (UID: \"00834f32-b182-4f53-bca5-7188aacc3b2b\") " pod="kube-system/konnectivity-agent-flsfc"
Jul 23 00:04:19.633678 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.631710    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/86be577e-afe5-47f5-9f88-cba8930f17ce-etc-sysconfig\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.633678 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.631743    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86be577e-afe5-47f5-9f88-cba8930f17ce-sys\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.633678 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.631779    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-host-cni-bin\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.633678 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.631824    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.633678 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.631901    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/00834f32-b182-4f53-bca5-7188aacc3b2b-agent-certs\") pod \"konnectivity-agent-flsfc\" (UID: \"00834f32-b182-4f53-bca5-7188aacc3b2b\") " pod="kube-system/konnectivity-agent-flsfc"
Jul 23 00:04:19.633678 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.631969    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/86be577e-afe5-47f5-9f88-cba8930f17ce-etc-sysctl-d\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.633678 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.631996    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/86be577e-afe5-47f5-9f88-cba8930f17ce-host\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.633678 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.632038    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdw2l\" (UniqueName: \"kubernetes.io/projected/86be577e-afe5-47f5-9f88-cba8930f17ce-kube-api-access-xdw2l\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.633678 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.632069    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-var-lib-openvswitch\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.633678 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.632100    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/79f6db91-6406-4b7b-988a-f7b0b35ded81-host\") pod \"node-ca-vfqnm\" (UID: \"79f6db91-6406-4b7b-988a-f7b0b35ded81\") " pod="openshift-image-registry/node-ca-vfqnm"
Jul 23 00:04:19.633678 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.632127    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/79f6db91-6406-4b7b-988a-f7b0b35ded81-serviceca\") pod \"node-ca-vfqnm\" (UID: \"79f6db91-6406-4b7b-988a-f7b0b35ded81\") " pod="openshift-image-registry/node-ca-vfqnm"
Jul 23 00:04:19.633678 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.632150    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/86be577e-afe5-47f5-9f88-cba8930f17ce-run\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.633678 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.632920    2549 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 00:04:19.635850 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.635817    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mktsc"
Jul 23 00:04:19.635957 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:19.635905    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mktsc" podUID="c10821c9-b943-4ffe-8ba4-09925139665b"
Jul 23 00:04:19.638966 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.638584    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztpf9"
Jul 23 00:04:19.641174 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.641152    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.642190 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.642169    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dqndl\""
Jul 23 00:04:19.642294 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.642267    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 23 00:04:19.642831 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.642810    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 23 00:04:19.642975 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.642820    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 23 00:04:19.645785 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.645764    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-csmwd\""
Jul 23 00:04:19.645889 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.645852    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 23 00:04:19.655248 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.655178    2549 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-btcw6"
Jul 23 00:04:19.667960 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.667927    2549 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-btcw6"
Jul 23 00:04:19.707935 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.707907    2549 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 23 00:04:19.733042 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733008    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-multus-conf-dir\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.733212 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733058    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-etc-kubernetes\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.733212 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733089    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c247\" (UniqueName: \"kubernetes.io/projected/3d027895-b39d-4efe-a38b-9c56633349ce-kube-api-access-7c247\") pod \"iptables-alerter-d9w65\" (UID: \"3d027895-b39d-4efe-a38b-9c56633349ce\") " pod="openshift-network-operator/iptables-alerter-d9w65"
Jul 23 00:04:19.733212 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733109    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-host-slash\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.733212 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733128    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/86be577e-afe5-47f5-9f88-cba8930f17ce-lib-modules\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.733212 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733146    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-host-var-lib-cni-bin\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.733212 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733164    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ce011730-f86a-4290-bd28-e8fc65d1da91-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xw482\" (UID: \"ce011730-f86a-4290-bd28-e8fc65d1da91\") " pod="openshift-multus/multus-additional-cni-plugins-xw482"
Jul 23 00:04:19.733212 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733185    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-host-run-netns\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.733212 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733217    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-run-openvswitch\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.733665 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733234    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/553eb6d0-ca32-4129-99d3-e1459beadee9-kubelet-config\") pod \"global-pull-secret-syncer-fmqcb\" (UID: \"553eb6d0-ca32-4129-99d3-e1459beadee9\") " pod="kube-system/global-pull-secret-syncer-fmqcb"
Jul 23 00:04:19.733665 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733252    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ce011730-f86a-4290-bd28-e8fc65d1da91-os-release\") pod \"multus-additional-cni-plugins-xw482\" (UID: \"ce011730-f86a-4290-bd28-e8fc65d1da91\") " pod="openshift-multus/multus-additional-cni-plugins-xw482"
Jul 23 00:04:19.733665 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733269    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2265f\" (UniqueName: \"kubernetes.io/projected/ce011730-f86a-4290-bd28-e8fc65d1da91-kube-api-access-2265f\") pod \"multus-additional-cni-plugins-xw482\" (UID: \"ce011730-f86a-4290-bd28-e8fc65d1da91\") " pod="openshift-multus/multus-additional-cni-plugins-xw482"
Jul 23 00:04:19.733665 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733293    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z9dq\" (UniqueName: \"kubernetes.io/projected/c10821c9-b943-4ffe-8ba4-09925139665b-kube-api-access-4z9dq\") pod \"network-metrics-daemon-mktsc\" (UID: \"c10821c9-b943-4ffe-8ba4-09925139665b\") " pod="openshift-multus/network-metrics-daemon-mktsc"
Jul 23 00:04:19.733665 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733310    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/86be577e-afe5-47f5-9f88-cba8930f17ce-etc-tuned\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.733665 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733331    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aca54f39-db9c-4e94-b3a1-41680f904cc6-hosts-file\") pod \"node-resolver-b42wl\" (UID: \"aca54f39-db9c-4e94-b3a1-41680f904cc6\") " pod="openshift-dns/node-resolver-b42wl"
Jul 23 00:04:19.733665 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733350    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/43730b45-4c70-4ee9-b344-d538b63092b3-registration-dir\") pod \"aws-ebs-csi-driver-node-ztpf9\" (UID: \"43730b45-4c70-4ee9-b344-d538b63092b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztpf9"
Jul 23 00:04:19.733665 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733375    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3d027895-b39d-4efe-a38b-9c56633349ce-host-slash\") pod \"iptables-alerter-d9w65\" (UID: \"3d027895-b39d-4efe-a38b-9c56633349ce\") " pod="openshift-network-operator/iptables-alerter-d9w65"
Jul 23 00:04:19.733665 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733392    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2w7np\" (UniqueName: \"kubernetes.io/projected/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-kube-api-access-2w7np\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.733665 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733416    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/86be577e-afe5-47f5-9f88-cba8930f17ce-etc-modprobe-d\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.733665 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733439    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86be577e-afe5-47f5-9f88-cba8930f17ce-sys\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.733665 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733457    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ce011730-f86a-4290-bd28-e8fc65d1da91-cni-binary-copy\") pod \"multus-additional-cni-plugins-xw482\" (UID: \"ce011730-f86a-4290-bd28-e8fc65d1da91\") " pod="openshift-multus/multus-additional-cni-plugins-xw482"
Jul 23 00:04:19.733665 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733483    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ce011730-f86a-4290-bd28-e8fc65d1da91-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xw482\" (UID: \"ce011730-f86a-4290-bd28-e8fc65d1da91\") " pod="openshift-multus/multus-additional-cni-plugins-xw482"
Jul 23 00:04:19.734408 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733512    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/43730b45-4c70-4ee9-b344-d538b63092b3-socket-dir\") pod \"aws-ebs-csi-driver-node-ztpf9\" (UID: \"43730b45-4c70-4ee9-b344-d538b63092b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztpf9"
Jul 23 00:04:19.734408 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733528    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-ovnkube-config\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.734408 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733544    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-env-overrides\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.734408 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733568    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/00834f32-b182-4f53-bca5-7188aacc3b2b-konnectivity-ca\") pod \"konnectivity-agent-flsfc\" (UID: \"00834f32-b182-4f53-bca5-7188aacc3b2b\") " pod="kube-system/konnectivity-agent-flsfc"
Jul 23 00:04:19.734408 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733585    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tghrq\" (UniqueName: \"kubernetes.io/projected/4cc1fd1d-50e2-4f20-be5e-a770e402f269-kube-api-access-tghrq\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.734408 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733601    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ce011730-f86a-4290-bd28-e8fc65d1da91-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xw482\" (UID: \"ce011730-f86a-4290-bd28-e8fc65d1da91\") " pod="openshift-multus/multus-additional-cni-plugins-xw482"
Jul 23 00:04:19.734408 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733619    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.734408 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733635    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/86be577e-afe5-47f5-9f88-cba8930f17ce-host\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.734408 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733661    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/43730b45-4c70-4ee9-b344-d538b63092b3-device-dir\") pod \"aws-ebs-csi-driver-node-ztpf9\" (UID: \"43730b45-4c70-4ee9-b344-d538b63092b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztpf9"
Jul 23 00:04:19.734408 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733695    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/79f6db91-6406-4b7b-988a-f7b0b35ded81-serviceca\") pod \"node-ca-vfqnm\" (UID: \"79f6db91-6406-4b7b-988a-f7b0b35ded81\") " pod="openshift-image-registry/node-ca-vfqnm"
Jul 23 00:04:19.734408 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733716    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-os-release\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.734408 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733732    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4xdb\" (UniqueName: \"kubernetes.io/projected/362cd422-ddfb-47e6-ae23-568f4edcef08-kube-api-access-r4xdb\") pod \"network-check-target-mnwg9\" (UID: \"362cd422-ddfb-47e6-ae23-568f4edcef08\") " pod="openshift-network-diagnostics/network-check-target-mnwg9"
Jul 23 00:04:19.734408 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733753    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-node-log\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.734408 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733768    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/86be577e-afe5-47f5-9f88-cba8930f17ce-var-lib-kubelet\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.735175 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733786    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4cc1fd1d-50e2-4f20-be5e-a770e402f269-multus-daemon-config\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.735175 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733803    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-host-run-multus-certs\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.735175 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733819    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/43730b45-4c70-4ee9-b344-d538b63092b3-sys-fs\") pod \"aws-ebs-csi-driver-node-ztpf9\" (UID: \"43730b45-4c70-4ee9-b344-d538b63092b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztpf9"
Jul 23 00:04:19.735175 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733836    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-run-systemd\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.735175 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733853    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-host-cni-netd\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.735175 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733869    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86be577e-afe5-47f5-9f88-cba8930f17ce-etc-kubernetes\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.735175 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733886    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-system-cni-dir\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.735175 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733901    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-multus-cni-dir\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.735175 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733917    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4cc1fd1d-50e2-4f20-be5e-a770e402f269-cni-binary-copy\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.735175 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733938    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-log-socket\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.735175 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733953    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-host-var-lib-cni-multus\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.735175 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.733979    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c10821c9-b943-4ffe-8ba4-09925139665b-metrics-certs\") pod \"network-metrics-daemon-mktsc\" (UID: \"c10821c9-b943-4ffe-8ba4-09925139665b\") " pod="openshift-multus/network-metrics-daemon-mktsc"
Jul 23 00:04:19.735175 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.734004    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj5jx\" (UniqueName: \"kubernetes.io/projected/aca54f39-db9c-4e94-b3a1-41680f904cc6-kube-api-access-kj5jx\") pod \"node-resolver-b42wl\" (UID: \"aca54f39-db9c-4e94-b3a1-41680f904cc6\") " pod="openshift-dns/node-resolver-b42wl"
Jul 23 00:04:19.735175 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.734020    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pcfw\" (UniqueName: \"kubernetes.io/projected/43730b45-4c70-4ee9-b344-d538b63092b3-kube-api-access-5pcfw\") pod \"aws-ebs-csi-driver-node-ztpf9\" (UID: \"43730b45-4c70-4ee9-b344-d538b63092b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztpf9"
Jul 23 00:04:19.735922 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.734055    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3d027895-b39d-4efe-a38b-9c56633349ce-iptables-alerter-script\") pod \"iptables-alerter-d9w65\" (UID: \"3d027895-b39d-4efe-a38b-9c56633349ce\") " pod="openshift-network-operator/iptables-alerter-d9w65"
Jul 23 00:04:19.735922 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.734080    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-host-run-ovn-kubernetes\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.735922 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.734097    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/553eb6d0-ca32-4129-99d3-e1459beadee9-original-pull-secret\") pod \"global-pull-secret-syncer-fmqcb\" (UID: \"553eb6d0-ca32-4129-99d3-e1459beadee9\") " pod="kube-system/global-pull-secret-syncer-fmqcb"
Jul 23 00:04:19.735922 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.734118    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k44ff\" (UniqueName: \"kubernetes.io/projected/79f6db91-6406-4b7b-988a-f7b0b35ded81-kube-api-access-k44ff\") pod \"node-ca-vfqnm\" (UID: \"79f6db91-6406-4b7b-988a-f7b0b35ded81\") " pod="openshift-image-registry/node-ca-vfqnm"
Jul 23 00:04:19.735922 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.734136    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ce011730-f86a-4290-bd28-e8fc65d1da91-cnibin\") pod \"multus-additional-cni-plugins-xw482\" (UID: \"ce011730-f86a-4290-bd28-e8fc65d1da91\") " pod="openshift-multus/multus-additional-cni-plugins-xw482"
Jul 23 00:04:19.735922 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.734153    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/43730b45-4c70-4ee9-b344-d538b63092b3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ztpf9\" (UID: \"43730b45-4c70-4ee9-b344-d538b63092b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztpf9"
Jul 23 00:04:19.735922 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.734172    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-etc-openvswitch\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.735922 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.734190    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-ovn-node-metrics-cert\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.735922 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.734206    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/553eb6d0-ca32-4129-99d3-e1459beadee9-dbus\") pod \"global-pull-secret-syncer-fmqcb\" (UID: \"553eb6d0-ca32-4129-99d3-e1459beadee9\") " pod="kube-system/global-pull-secret-syncer-fmqcb"
Jul 23 00:04:19.735922 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.734231    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/86be577e-afe5-47f5-9f88-cba8930f17ce-etc-sysctl-conf\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.735922 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.734255    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/86be577e-afe5-47f5-9f88-cba8930f17ce-etc-systemd\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.735922 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.734281    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-cnibin\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.735922 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.734301    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-multus-socket-dir-parent\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.735922 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.734316    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aca54f39-db9c-4e94-b3a1-41680f904cc6-tmp-dir\") pod \"node-resolver-b42wl\" (UID: \"aca54f39-db9c-4e94-b3a1-41680f904cc6\") " pod="openshift-dns/node-resolver-b42wl"
Jul 23 00:04:19.736661 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.734334    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-ovnkube-script-lib\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.736661 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.734351    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/86be577e-afe5-47f5-9f88-cba8930f17ce-etc-sysconfig\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.736661 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.734368    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ce011730-f86a-4290-bd28-e8fc65d1da91-system-cni-dir\") pod \"multus-additional-cni-plugins-xw482\" (UID: \"ce011730-f86a-4290-bd28-e8fc65d1da91\") " pod="openshift-multus/multus-additional-cni-plugins-xw482"
Jul 23 00:04:19.736661 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.734386    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/43730b45-4c70-4ee9-b344-d538b63092b3-etc-selinux\") pod \"aws-ebs-csi-driver-node-ztpf9\" (UID: \"43730b45-4c70-4ee9-b344-d538b63092b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztpf9"
Jul 23 00:04:19.736661 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.734408    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-host-cni-bin\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.736661 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.734425    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/00834f32-b182-4f53-bca5-7188aacc3b2b-agent-certs\") pod \"konnectivity-agent-flsfc\" (UID: \"00834f32-b182-4f53-bca5-7188aacc3b2b\") " pod="kube-system/konnectivity-agent-flsfc"
Jul 23 00:04:19.736661 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.734448    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/86be577e-afe5-47f5-9f88-cba8930f17ce-etc-sysctl-d\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.736661 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.734482    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdw2l\" (UniqueName: \"kubernetes.io/projected/86be577e-afe5-47f5-9f88-cba8930f17ce-kube-api-access-xdw2l\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.736661 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.734505    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-var-lib-openvswitch\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.736661 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.734524    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/79f6db91-6406-4b7b-988a-f7b0b35ded81-host\") pod \"node-ca-vfqnm\" (UID: \"79f6db91-6406-4b7b-988a-f7b0b35ded81\") " pod="openshift-image-registry/node-ca-vfqnm"
Jul 23 00:04:19.736661 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.734566    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/86be577e-afe5-47f5-9f88-cba8930f17ce-run\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.736661 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.734613    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-host-run-k8s-cni-cncf-io\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.736661 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.734652    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-hostroot\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.736661 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.734682    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-host-kubelet\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.737374 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.734707    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-systemd-units\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.737374 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.734735    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-run-ovn\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.737374 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.734742    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/86be577e-afe5-47f5-9f88-cba8930f17ce-run\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.737374 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.734765    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86be577e-afe5-47f5-9f88-cba8930f17ce-tmp\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.737374 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.734794    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-host-run-netns\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.737374 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.734811    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-run-systemd\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.737374 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.734822    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-host-var-lib-kubelet\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.737374 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.734861    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-host-cni-netd\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.737374 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.734913    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86be577e-afe5-47f5-9f88-cba8930f17ce-etc-kubernetes\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.737374 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.734974    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-host-slash\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.737374 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.735093    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/86be577e-afe5-47f5-9f88-cba8930f17ce-lib-modules\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.737374 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.735176    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-host-run-netns\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.737374 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.735222    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-run-openvswitch\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.737374 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.735280    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.737374 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:19.735391    2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 00:04:19.738130 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:19.735465    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/553eb6d0-ca32-4129-99d3-e1459beadee9-original-pull-secret podName:553eb6d0-ca32-4129-99d3-e1459beadee9 nodeName:}" failed. No retries permitted until 2026-07-23 00:04:20.235440874 +0000 UTC m=+2.996639183 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/553eb6d0-ca32-4129-99d3-e1459beadee9-original-pull-secret") pod "global-pull-secret-syncer-fmqcb" (UID: "553eb6d0-ca32-4129-99d3-e1459beadee9") : object "kube-system"/"original-pull-secret" not registered
Jul 23 00:04:19.738130 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.735664    2549 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 23 00:04:19.738130 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.735699    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/86be577e-afe5-47f5-9f88-cba8930f17ce-var-lib-kubelet\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.738130 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.735699    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-run-ovn\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.738130 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.735719    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/79f6db91-6406-4b7b-988a-f7b0b35ded81-host\") pod \"node-ca-vfqnm\" (UID: \"79f6db91-6406-4b7b-988a-f7b0b35ded81\") " pod="openshift-image-registry/node-ca-vfqnm"
Jul 23 00:04:19.738130 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.735741    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-systemd-units\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.738130 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.735777    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-host-cni-bin\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.738130 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.735837    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/553eb6d0-ca32-4129-99d3-e1459beadee9-kubelet-config\") pod \"global-pull-secret-syncer-fmqcb\" (UID: \"553eb6d0-ca32-4129-99d3-e1459beadee9\") " pod="kube-system/global-pull-secret-syncer-fmqcb"
Jul 23 00:04:19.738130 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.735977    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3d027895-b39d-4efe-a38b-9c56633349ce-iptables-alerter-script\") pod \"iptables-alerter-d9w65\" (UID: \"3d027895-b39d-4efe-a38b-9c56633349ce\") " pod="openshift-network-operator/iptables-alerter-d9w65"
Jul 23 00:04:19.738130 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.736279    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/79f6db91-6406-4b7b-988a-f7b0b35ded81-serviceca\") pod \"node-ca-vfqnm\" (UID: \"79f6db91-6406-4b7b-988a-f7b0b35ded81\") " pod="openshift-image-registry/node-ca-vfqnm"
Jul 23 00:04:19.738130 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.736323    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-var-lib-openvswitch\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.738130 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.736387    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-env-overrides\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.738130 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.736458    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-log-socket\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.738130 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.736610    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/553eb6d0-ca32-4129-99d3-e1459beadee9-dbus\") pod \"global-pull-secret-syncer-fmqcb\" (UID: \"553eb6d0-ca32-4129-99d3-e1459beadee9\") " pod="kube-system/global-pull-secret-syncer-fmqcb"
Jul 23 00:04:19.738877 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.736784    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/86be577e-afe5-47f5-9f88-cba8930f17ce-etc-sysconfig\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.738877 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.736798    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/86be577e-afe5-47f5-9f88-cba8930f17ce-etc-sysctl-conf\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.738877 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.736833    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/86be577e-afe5-47f5-9f88-cba8930f17ce-etc-systemd\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.738877 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.736835    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3d027895-b39d-4efe-a38b-9c56633349ce-host-slash\") pod \"iptables-alerter-d9w65\" (UID: \"3d027895-b39d-4efe-a38b-9c56633349ce\") " pod="openshift-network-operator/iptables-alerter-d9w65"
Jul 23 00:04:19.738877 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.736901    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/86be577e-afe5-47f5-9f88-cba8930f17ce-etc-modprobe-d\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.738877 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.736944    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86be577e-afe5-47f5-9f88-cba8930f17ce-sys\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.738877 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.737038    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/86be577e-afe5-47f5-9f88-cba8930f17ce-host\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.738877 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.737168    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/86be577e-afe5-47f5-9f88-cba8930f17ce-etc-sysctl-d\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.738877 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.737225    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-node-log\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.738877 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.737287    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-etc-openvswitch\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.738877 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.737394    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-host-kubelet\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.738877 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.737442    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-host-run-ovn-kubernetes\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.738877 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.737464    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-ovnkube-config\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.738877 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.737481    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-ovnkube-script-lib\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.738877 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.738096    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/00834f32-b182-4f53-bca5-7188aacc3b2b-konnectivity-ca\") pod \"konnectivity-agent-flsfc\" (UID: \"00834f32-b182-4f53-bca5-7188aacc3b2b\") " pod="kube-system/konnectivity-agent-flsfc"
Jul 23 00:04:19.740769 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.740745    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-ovn-node-metrics-cert\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.742598 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.742540    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/00834f32-b182-4f53-bca5-7188aacc3b2b-agent-certs\") pod \"konnectivity-agent-flsfc\" (UID: \"00834f32-b182-4f53-bca5-7188aacc3b2b\") " pod="kube-system/konnectivity-agent-flsfc"
Jul 23 00:04:19.742881 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.742858    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/86be577e-afe5-47f5-9f88-cba8930f17ce-etc-tuned\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.743702 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.743651    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86be577e-afe5-47f5-9f88-cba8930f17ce-tmp\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.753472 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.753446    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdw2l\" (UniqueName: \"kubernetes.io/projected/86be577e-afe5-47f5-9f88-cba8930f17ce-kube-api-access-xdw2l\") pod \"tuned-twnl8\" (UID: \"86be577e-afe5-47f5-9f88-cba8930f17ce\") " pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.758858 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.758828    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k44ff\" (UniqueName: \"kubernetes.io/projected/79f6db91-6406-4b7b-988a-f7b0b35ded81-kube-api-access-k44ff\") pod \"node-ca-vfqnm\" (UID: \"79f6db91-6406-4b7b-988a-f7b0b35ded81\") " pod="openshift-image-registry/node-ca-vfqnm"
Jul 23 00:04:19.759278 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.759255    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w7np\" (UniqueName: \"kubernetes.io/projected/7ee67aa4-2a65-4a30-a8c7-4e88ac673577-kube-api-access-2w7np\") pod \"ovnkube-node-qwd8v\" (UID: \"7ee67aa4-2a65-4a30-a8c7-4e88ac673577\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.760985 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.760929    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c247\" (UniqueName: \"kubernetes.io/projected/3d027895-b39d-4efe-a38b-9c56633349ce-kube-api-access-7c247\") pod \"iptables-alerter-d9w65\" (UID: \"3d027895-b39d-4efe-a38b-9c56633349ce\") " pod="openshift-network-operator/iptables-alerter-d9w65"
Jul 23 00:04:19.803047 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.802982    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-182.ec2.internal" event={"ID":"e75ffd7291292d64f0e4db02c0350a31","Type":"ContainerStarted","Data":"03f84e65cbc060eeb28a7cfda520ef92159188125b3ff4a6c37b7ca588fd814a"}
Jul 23 00:04:19.804592 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.804529    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-182.ec2.internal" event={"ID":"914224a26574b8fab8d59923791f6500","Type":"ContainerStarted","Data":"91bcefc2d5a7458bdd19ff4f208c6662406b966f2d707461172c601666f818d2"}
Jul 23 00:04:19.835353 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.835317    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ce011730-f86a-4290-bd28-e8fc65d1da91-cnibin\") pod \"multus-additional-cni-plugins-xw482\" (UID: \"ce011730-f86a-4290-bd28-e8fc65d1da91\") " pod="openshift-multus/multus-additional-cni-plugins-xw482"
Jul 23 00:04:19.835561 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.835366    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/43730b45-4c70-4ee9-b344-d538b63092b3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ztpf9\" (UID: \"43730b45-4c70-4ee9-b344-d538b63092b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztpf9"
Jul 23 00:04:19.835561 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.835397    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-cnibin\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.835561 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.835423    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-multus-socket-dir-parent\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.835561 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.835450    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aca54f39-db9c-4e94-b3a1-41680f904cc6-tmp-dir\") pod \"node-resolver-b42wl\" (UID: \"aca54f39-db9c-4e94-b3a1-41680f904cc6\") " pod="openshift-dns/node-resolver-b42wl"
Jul 23 00:04:19.835561 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.835492    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ce011730-f86a-4290-bd28-e8fc65d1da91-system-cni-dir\") pod \"multus-additional-cni-plugins-xw482\" (UID: \"ce011730-f86a-4290-bd28-e8fc65d1da91\") " pod="openshift-multus/multus-additional-cni-plugins-xw482"
Jul 23 00:04:19.835561 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.835517    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/43730b45-4c70-4ee9-b344-d538b63092b3-etc-selinux\") pod \"aws-ebs-csi-driver-node-ztpf9\" (UID: \"43730b45-4c70-4ee9-b344-d538b63092b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztpf9"
Jul 23 00:04:19.835561 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.835548    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-host-run-k8s-cni-cncf-io\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.835839 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.835572    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-hostroot\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.835839 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.835607    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-host-run-netns\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.835839 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.835631    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-host-var-lib-kubelet\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.835839 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.835658    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-multus-conf-dir\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.835839 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.835682    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-etc-kubernetes\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.835839 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.835741    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-host-var-lib-cni-bin\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.835839 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.835768    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ce011730-f86a-4290-bd28-e8fc65d1da91-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xw482\" (UID: \"ce011730-f86a-4290-bd28-e8fc65d1da91\") " pod="openshift-multus/multus-additional-cni-plugins-xw482"
Jul 23 00:04:19.835839 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.835798    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ce011730-f86a-4290-bd28-e8fc65d1da91-os-release\") pod \"multus-additional-cni-plugins-xw482\" (UID: \"ce011730-f86a-4290-bd28-e8fc65d1da91\") " pod="openshift-multus/multus-additional-cni-plugins-xw482"
Jul 23 00:04:19.835839 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.835824    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2265f\" (UniqueName: \"kubernetes.io/projected/ce011730-f86a-4290-bd28-e8fc65d1da91-kube-api-access-2265f\") pod \"multus-additional-cni-plugins-xw482\" (UID: \"ce011730-f86a-4290-bd28-e8fc65d1da91\") " pod="openshift-multus/multus-additional-cni-plugins-xw482"
Jul 23 00:04:19.836229 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.835853    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z9dq\" (UniqueName: \"kubernetes.io/projected/c10821c9-b943-4ffe-8ba4-09925139665b-kube-api-access-4z9dq\") pod \"network-metrics-daemon-mktsc\" (UID: \"c10821c9-b943-4ffe-8ba4-09925139665b\") " pod="openshift-multus/network-metrics-daemon-mktsc"
Jul 23 00:04:19.836229 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.835879    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aca54f39-db9c-4e94-b3a1-41680f904cc6-hosts-file\") pod \"node-resolver-b42wl\" (UID: \"aca54f39-db9c-4e94-b3a1-41680f904cc6\") " pod="openshift-dns/node-resolver-b42wl"
Jul 23 00:04:19.836229 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.835905    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/43730b45-4c70-4ee9-b344-d538b63092b3-registration-dir\") pod \"aws-ebs-csi-driver-node-ztpf9\" (UID: \"43730b45-4c70-4ee9-b344-d538b63092b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztpf9"
Jul 23 00:04:19.836229 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.835936    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ce011730-f86a-4290-bd28-e8fc65d1da91-cni-binary-copy\") pod \"multus-additional-cni-plugins-xw482\" (UID: \"ce011730-f86a-4290-bd28-e8fc65d1da91\") " pod="openshift-multus/multus-additional-cni-plugins-xw482"
Jul 23 00:04:19.836229 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.835982    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ce011730-f86a-4290-bd28-e8fc65d1da91-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xw482\" (UID: \"ce011730-f86a-4290-bd28-e8fc65d1da91\") " pod="openshift-multus/multus-additional-cni-plugins-xw482"
Jul 23 00:04:19.836229 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.836012    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/43730b45-4c70-4ee9-b344-d538b63092b3-socket-dir\") pod \"aws-ebs-csi-driver-node-ztpf9\" (UID: \"43730b45-4c70-4ee9-b344-d538b63092b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztpf9"
Jul 23 00:04:19.836229 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.836042    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tghrq\" (UniqueName: \"kubernetes.io/projected/4cc1fd1d-50e2-4f20-be5e-a770e402f269-kube-api-access-tghrq\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.836229 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.836070    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ce011730-f86a-4290-bd28-e8fc65d1da91-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xw482\" (UID: \"ce011730-f86a-4290-bd28-e8fc65d1da91\") " pod="openshift-multus/multus-additional-cni-plugins-xw482"
Jul 23 00:04:19.836229 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.836128    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/43730b45-4c70-4ee9-b344-d538b63092b3-device-dir\") pod \"aws-ebs-csi-driver-node-ztpf9\" (UID: \"43730b45-4c70-4ee9-b344-d538b63092b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztpf9"
Jul 23 00:04:19.836229 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.836156    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-os-release\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.836229 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.836188    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4xdb\" (UniqueName: \"kubernetes.io/projected/362cd422-ddfb-47e6-ae23-568f4edcef08-kube-api-access-r4xdb\") pod \"network-check-target-mnwg9\" (UID: \"362cd422-ddfb-47e6-ae23-568f4edcef08\") " pod="openshift-network-diagnostics/network-check-target-mnwg9"
Jul 23 00:04:19.836229 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.836218    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4cc1fd1d-50e2-4f20-be5e-a770e402f269-multus-daemon-config\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.836780 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.836243    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-host-run-multus-certs\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.836780 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.836276    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/43730b45-4c70-4ee9-b344-d538b63092b3-sys-fs\") pod \"aws-ebs-csi-driver-node-ztpf9\" (UID: \"43730b45-4c70-4ee9-b344-d538b63092b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztpf9"
Jul 23 00:04:19.836780 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.836305    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-system-cni-dir\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.836780 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.836329    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-multus-cni-dir\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.836780 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.836358    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4cc1fd1d-50e2-4f20-be5e-a770e402f269-cni-binary-copy\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.836780 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.836384    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-host-var-lib-cni-multus\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.836780 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.836410    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c10821c9-b943-4ffe-8ba4-09925139665b-metrics-certs\") pod \"network-metrics-daemon-mktsc\" (UID: \"c10821c9-b943-4ffe-8ba4-09925139665b\") " pod="openshift-multus/network-metrics-daemon-mktsc"
Jul 23 00:04:19.836780 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.836437    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj5jx\" (UniqueName: \"kubernetes.io/projected/aca54f39-db9c-4e94-b3a1-41680f904cc6-kube-api-access-kj5jx\") pod \"node-resolver-b42wl\" (UID: \"aca54f39-db9c-4e94-b3a1-41680f904cc6\") " pod="openshift-dns/node-resolver-b42wl"
Jul 23 00:04:19.836780 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.836463    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pcfw\" (UniqueName: \"kubernetes.io/projected/43730b45-4c70-4ee9-b344-d538b63092b3-kube-api-access-5pcfw\") pod \"aws-ebs-csi-driver-node-ztpf9\" (UID: \"43730b45-4c70-4ee9-b344-d538b63092b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztpf9"
Jul 23 00:04:19.837282 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.837109    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ce011730-f86a-4290-bd28-e8fc65d1da91-cnibin\") pod \"multus-additional-cni-plugins-xw482\" (UID: \"ce011730-f86a-4290-bd28-e8fc65d1da91\") " pod="openshift-multus/multus-additional-cni-plugins-xw482"
Jul 23 00:04:19.837282 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.837186    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/43730b45-4c70-4ee9-b344-d538b63092b3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ztpf9\" (UID: \"43730b45-4c70-4ee9-b344-d538b63092b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztpf9"
Jul 23 00:04:19.837282 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.837235    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-cnibin\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.837447 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.837288    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-multus-socket-dir-parent\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.837647 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.837627    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aca54f39-db9c-4e94-b3a1-41680f904cc6-tmp-dir\") pod \"node-resolver-b42wl\" (UID: \"aca54f39-db9c-4e94-b3a1-41680f904cc6\") " pod="openshift-dns/node-resolver-b42wl"
Jul 23 00:04:19.837721 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.837692    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ce011730-f86a-4290-bd28-e8fc65d1da91-system-cni-dir\") pod \"multus-additional-cni-plugins-xw482\" (UID: \"ce011730-f86a-4290-bd28-e8fc65d1da91\") " pod="openshift-multus/multus-additional-cni-plugins-xw482"
Jul 23 00:04:19.837816 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.837799    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/43730b45-4c70-4ee9-b344-d538b63092b3-socket-dir\") pod \"aws-ebs-csi-driver-node-ztpf9\" (UID: \"43730b45-4c70-4ee9-b344-d538b63092b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztpf9"
Jul 23 00:04:19.838219 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.838197    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ce011730-f86a-4290-bd28-e8fc65d1da91-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xw482\" (UID: \"ce011730-f86a-4290-bd28-e8fc65d1da91\") " pod="openshift-multus/multus-additional-cni-plugins-xw482"
Jul 23 00:04:19.838292 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.838259    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ce011730-f86a-4290-bd28-e8fc65d1da91-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xw482\" (UID: \"ce011730-f86a-4290-bd28-e8fc65d1da91\") " pod="openshift-multus/multus-additional-cni-plugins-xw482"
Jul 23 00:04:19.838292 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.838275    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/43730b45-4c70-4ee9-b344-d538b63092b3-device-dir\") pod \"aws-ebs-csi-driver-node-ztpf9\" (UID: \"43730b45-4c70-4ee9-b344-d538b63092b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztpf9"
Jul 23 00:04:19.838406 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.838377    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-os-release\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.838462 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.838422    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-host-run-k8s-cni-cncf-io\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.838593 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.838566    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-hostroot\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.838677 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.838654    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-host-run-netns\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.838732 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.838696    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-host-var-lib-kubelet\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.838787 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.838751    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-multus-conf-dir\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.838841 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.838782    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ce011730-f86a-4290-bd28-e8fc65d1da91-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xw482\" (UID: \"ce011730-f86a-4290-bd28-e8fc65d1da91\") " pod="openshift-multus/multus-additional-cni-plugins-xw482"
Jul 23 00:04:19.838841 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.838792    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-etc-kubernetes\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.838841 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.838824    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-host-var-lib-cni-bin\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.838994 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.838903    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ce011730-f86a-4290-bd28-e8fc65d1da91-os-release\") pod \"multus-additional-cni-plugins-xw482\" (UID: \"ce011730-f86a-4290-bd28-e8fc65d1da91\") " pod="openshift-multus/multus-additional-cni-plugins-xw482"
Jul 23 00:04:19.839401 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.839381    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aca54f39-db9c-4e94-b3a1-41680f904cc6-hosts-file\") pod \"node-resolver-b42wl\" (UID: \"aca54f39-db9c-4e94-b3a1-41680f904cc6\") " pod="openshift-dns/node-resolver-b42wl"
Jul 23 00:04:19.839470 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.839453    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/43730b45-4c70-4ee9-b344-d538b63092b3-registration-dir\") pod \"aws-ebs-csi-driver-node-ztpf9\" (UID: \"43730b45-4c70-4ee9-b344-d538b63092b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztpf9"
Jul 23 00:04:19.840381 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.839978    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ce011730-f86a-4290-bd28-e8fc65d1da91-cni-binary-copy\") pod \"multus-additional-cni-plugins-xw482\" (UID: \"ce011730-f86a-4290-bd28-e8fc65d1da91\") " pod="openshift-multus/multus-additional-cni-plugins-xw482"
Jul 23 00:04:19.840381 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.840059    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4cc1fd1d-50e2-4f20-be5e-a770e402f269-cni-binary-copy\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.840381 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:19.840082    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 00:04:19.840381 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.840130    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-host-run-multus-certs\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.840381 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:19.840140    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c10821c9-b943-4ffe-8ba4-09925139665b-metrics-certs podName:c10821c9-b943-4ffe-8ba4-09925139665b nodeName:}" failed. No retries permitted until 2026-07-23 00:04:20.340122087 +0000 UTC m=+3.101320380 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c10821c9-b943-4ffe-8ba4-09925139665b-metrics-certs") pod "network-metrics-daemon-mktsc" (UID: "c10821c9-b943-4ffe-8ba4-09925139665b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 00:04:19.840381 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.840192    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/43730b45-4c70-4ee9-b344-d538b63092b3-sys-fs\") pod \"aws-ebs-csi-driver-node-ztpf9\" (UID: \"43730b45-4c70-4ee9-b344-d538b63092b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztpf9"
Jul 23 00:04:19.840381 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.840251    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-system-cni-dir\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.840381 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.840337    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-multus-cni-dir\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.840381 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.840344    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4cc1fd1d-50e2-4f20-be5e-a770e402f269-host-var-lib-cni-multus\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.840921 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.840467    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/43730b45-4c70-4ee9-b344-d538b63092b3-etc-selinux\") pod \"aws-ebs-csi-driver-node-ztpf9\" (UID: \"43730b45-4c70-4ee9-b344-d538b63092b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztpf9"
Jul 23 00:04:19.840921 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.840630    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4cc1fd1d-50e2-4f20-be5e-a770e402f269-multus-daemon-config\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.849430 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:19.849405    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 00:04:19.849430 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:19.849432    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 00:04:19.849620 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:19.849446    2549 projected.go:196] Error preparing data for projected volume kube-api-access-r4xdb for pod openshift-network-diagnostics/network-check-target-mnwg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 00:04:19.849620 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:19.849527    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/362cd422-ddfb-47e6-ae23-568f4edcef08-kube-api-access-r4xdb podName:362cd422-ddfb-47e6-ae23-568f4edcef08 nodeName:}" failed. No retries permitted until 2026-07-23 00:04:20.349491431 +0000 UTC m=+3.110689744 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-r4xdb" (UniqueName: "kubernetes.io/projected/362cd422-ddfb-47e6-ae23-568f4edcef08-kube-api-access-r4xdb") pod "network-check-target-mnwg9" (UID: "362cd422-ddfb-47e6-ae23-568f4edcef08") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 00:04:19.855005 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.854980    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tghrq\" (UniqueName: \"kubernetes.io/projected/4cc1fd1d-50e2-4f20-be5e-a770e402f269-kube-api-access-tghrq\") pod \"multus-mqh4z\" (UID: \"4cc1fd1d-50e2-4f20-be5e-a770e402f269\") " pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:19.856226 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.856199    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj5jx\" (UniqueName: \"kubernetes.io/projected/aca54f39-db9c-4e94-b3a1-41680f904cc6-kube-api-access-kj5jx\") pod \"node-resolver-b42wl\" (UID: \"aca54f39-db9c-4e94-b3a1-41680f904cc6\") " pod="openshift-dns/node-resolver-b42wl"
Jul 23 00:04:19.856720 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.856673    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2265f\" (UniqueName: \"kubernetes.io/projected/ce011730-f86a-4290-bd28-e8fc65d1da91-kube-api-access-2265f\") pod \"multus-additional-cni-plugins-xw482\" (UID: \"ce011730-f86a-4290-bd28-e8fc65d1da91\") " pod="openshift-multus/multus-additional-cni-plugins-xw482"
Jul 23 00:04:19.859075 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.859023    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z9dq\" (UniqueName: \"kubernetes.io/projected/c10821c9-b943-4ffe-8ba4-09925139665b-kube-api-access-4z9dq\") pod \"network-metrics-daemon-mktsc\" (UID: \"c10821c9-b943-4ffe-8ba4-09925139665b\") " pod="openshift-multus/network-metrics-daemon-mktsc"
Jul 23 00:04:19.860348 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.860303    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pcfw\" (UniqueName: \"kubernetes.io/projected/43730b45-4c70-4ee9-b344-d538b63092b3-kube-api-access-5pcfw\") pod \"aws-ebs-csi-driver-node-ztpf9\" (UID: \"43730b45-4c70-4ee9-b344-d538b63092b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztpf9"
Jul 23 00:04:19.917817 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.917738    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vfqnm"
Jul 23 00:04:19.930762 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:19.930725    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79f6db91_6406_4b7b_988a_f7b0b35ded81.slice/crio-51d8f75aae1dfdf909831c5f42d97042ccb414c73023378e88e8cd6a13d19390 WatchSource:0}: Error finding container 51d8f75aae1dfdf909831c5f42d97042ccb414c73023378e88e8cd6a13d19390: Status 404 returned error can't find the container with id 51d8f75aae1dfdf909831c5f42d97042ccb414c73023378e88e8cd6a13d19390
Jul 23 00:04:19.934060 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.934034    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-twnl8"
Jul 23 00:04:19.945152 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:19.945122    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86be577e_afe5_47f5_9f88_cba8930f17ce.slice/crio-c2131d40365368858f8891e5ed98285a93602425978afb10c012ae08854fa966 WatchSource:0}: Error finding container c2131d40365368858f8891e5ed98285a93602425978afb10c012ae08854fa966: Status 404 returned error can't find the container with id c2131d40365368858f8891e5ed98285a93602425978afb10c012ae08854fa966
Jul 23 00:04:19.949366 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.949341    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d9w65"
Jul 23 00:04:19.958362 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.958342    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:19.961226 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:19.960963    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d027895_b39d_4efe_a38b_9c56633349ce.slice/crio-78a30e4d460d591f753fcd77fd2def8201061246f707c803a957368bf4d690b0 WatchSource:0}: Error finding container 78a30e4d460d591f753fcd77fd2def8201061246f707c803a957368bf4d690b0: Status 404 returned error can't find the container with id 78a30e4d460d591f753fcd77fd2def8201061246f707c803a957368bf4d690b0
Jul 23 00:04:19.965288 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.965179    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-flsfc"
Jul 23 00:04:19.968371 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:19.968321    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ee67aa4_2a65_4a30_a8c7_4e88ac673577.slice/crio-0920483bf00ce3dc185859cbe0d4582a8a73946359bd9ae609731e3e52f13f37 WatchSource:0}: Error finding container 0920483bf00ce3dc185859cbe0d4582a8a73946359bd9ae609731e3e52f13f37: Status 404 returned error can't find the container with id 0920483bf00ce3dc185859cbe0d4582a8a73946359bd9ae609731e3e52f13f37
Jul 23 00:04:19.975857 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.975681    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b42wl"
Jul 23 00:04:19.978139 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:19.978114    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00834f32_b182_4f53_bca5_7188aacc3b2b.slice/crio-f6dc875200da16004d02ed0e3aee9f1c5a665e92778e42a1f916b4734acfc6c9 WatchSource:0}: Error finding container f6dc875200da16004d02ed0e3aee9f1c5a665e92778e42a1f916b4734acfc6c9: Status 404 returned error can't find the container with id f6dc875200da16004d02ed0e3aee9f1c5a665e92778e42a1f916b4734acfc6c9
Jul 23 00:04:19.985522 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.985456    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xw482"
Jul 23 00:04:19.987030 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:19.987003    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaca54f39_db9c_4e94_b3a1_41680f904cc6.slice/crio-8c25302f6ca9cb5308b13f706680cc29f59671194e939fedb0eff389cc0be89b WatchSource:0}: Error finding container 8c25302f6ca9cb5308b13f706680cc29f59671194e939fedb0eff389cc0be89b: Status 404 returned error can't find the container with id 8c25302f6ca9cb5308b13f706680cc29f59671194e939fedb0eff389cc0be89b
Jul 23 00:04:19.994147 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:19.994125    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztpf9"
Jul 23 00:04:19.996899 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:19.996873    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce011730_f86a_4290_bd28_e8fc65d1da91.slice/crio-a28e81e2c6ccac7bc0c4d764d7413a7ec7483c984d0a035fe587d138bc75e010 WatchSource:0}: Error finding container a28e81e2c6ccac7bc0c4d764d7413a7ec7483c984d0a035fe587d138bc75e010: Status 404 returned error can't find the container with id a28e81e2c6ccac7bc0c4d764d7413a7ec7483c984d0a035fe587d138bc75e010
Jul 23 00:04:20.001864 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:20.001846    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mqh4z"
Jul 23 00:04:20.005665 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:20.005640    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43730b45_4c70_4ee9_b344_d538b63092b3.slice/crio-2647192edac30a96501a5b7f36ac0cbf3bccbb789eb2386b66dc02e8674eacf0 WatchSource:0}: Error finding container 2647192edac30a96501a5b7f36ac0cbf3bccbb789eb2386b66dc02e8674eacf0: Status 404 returned error can't find the container with id 2647192edac30a96501a5b7f36ac0cbf3bccbb789eb2386b66dc02e8674eacf0
Jul 23 00:04:20.008152 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:20.007925    2549 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 00:04:20.013784 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:20.013757    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cc1fd1d_50e2_4f20_be5e_a770e402f269.slice/crio-89e0084c2dd5bd0b644c482e712b32b3b3e19a8fdb2cc9943a5a127a5ffb2574 WatchSource:0}: Error finding container 89e0084c2dd5bd0b644c482e712b32b3b3e19a8fdb2cc9943a5a127a5ffb2574: Status 404 returned error can't find the container with id 89e0084c2dd5bd0b644c482e712b32b3b3e19a8fdb2cc9943a5a127a5ffb2574
Jul 23 00:04:20.240686 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:20.240595    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/553eb6d0-ca32-4129-99d3-e1459beadee9-original-pull-secret\") pod \"global-pull-secret-syncer-fmqcb\" (UID: \"553eb6d0-ca32-4129-99d3-e1459beadee9\") " pod="kube-system/global-pull-secret-syncer-fmqcb"
Jul 23 00:04:20.240850 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:20.240721    2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 00:04:20.240850 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:20.240793    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/553eb6d0-ca32-4129-99d3-e1459beadee9-original-pull-secret podName:553eb6d0-ca32-4129-99d3-e1459beadee9 nodeName:}" failed. No retries permitted until 2026-07-23 00:04:21.240778027 +0000 UTC m=+4.001976320 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/553eb6d0-ca32-4129-99d3-e1459beadee9-original-pull-secret") pod "global-pull-secret-syncer-fmqcb" (UID: "553eb6d0-ca32-4129-99d3-e1459beadee9") : object "kube-system"/"original-pull-secret" not registered
Jul 23 00:04:20.341291 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:20.341253    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c10821c9-b943-4ffe-8ba4-09925139665b-metrics-certs\") pod \"network-metrics-daemon-mktsc\" (UID: \"c10821c9-b943-4ffe-8ba4-09925139665b\") " pod="openshift-multus/network-metrics-daemon-mktsc"
Jul 23 00:04:20.341496 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:20.341443    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 00:04:20.341558 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:20.341546    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c10821c9-b943-4ffe-8ba4-09925139665b-metrics-certs podName:c10821c9-b943-4ffe-8ba4-09925139665b nodeName:}" failed. No retries permitted until 2026-07-23 00:04:21.341524144 +0000 UTC m=+4.102722443 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c10821c9-b943-4ffe-8ba4-09925139665b-metrics-certs") pod "network-metrics-daemon-mktsc" (UID: "c10821c9-b943-4ffe-8ba4-09925139665b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 00:04:20.442510 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:20.442462    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4xdb\" (UniqueName: \"kubernetes.io/projected/362cd422-ddfb-47e6-ae23-568f4edcef08-kube-api-access-r4xdb\") pod \"network-check-target-mnwg9\" (UID: \"362cd422-ddfb-47e6-ae23-568f4edcef08\") " pod="openshift-network-diagnostics/network-check-target-mnwg9"
Jul 23 00:04:20.442722 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:20.442701    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 00:04:20.442771 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:20.442729    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 00:04:20.442771 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:20.442740    2549 projected.go:196] Error preparing data for projected volume kube-api-access-r4xdb for pod openshift-network-diagnostics/network-check-target-mnwg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 00:04:20.442842 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:20.442801    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/362cd422-ddfb-47e6-ae23-568f4edcef08-kube-api-access-r4xdb podName:362cd422-ddfb-47e6-ae23-568f4edcef08 nodeName:}" failed. No retries permitted until 2026-07-23 00:04:21.442785057 +0000 UTC m=+4.203983347 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-r4xdb" (UniqueName: "kubernetes.io/projected/362cd422-ddfb-47e6-ae23-568f4edcef08-kube-api-access-r4xdb") pod "network-check-target-mnwg9" (UID: "362cd422-ddfb-47e6-ae23-568f4edcef08") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 00:04:20.672222 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:20.672120    2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 23:59:20 +0000 UTC" deadline="2028-03-05 14:38:52.068217848 +0000 UTC"
Jul 23 00:04:20.672222 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:20.672159    2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14198h34m31.396062931s"
Jul 23 00:04:20.807222 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:20.807177    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b42wl" event={"ID":"aca54f39-db9c-4e94-b3a1-41680f904cc6","Type":"ContainerStarted","Data":"8c25302f6ca9cb5308b13f706680cc29f59671194e939fedb0eff389cc0be89b"}
Jul 23 00:04:20.808568 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:20.808536    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-flsfc" event={"ID":"00834f32-b182-4f53-bca5-7188aacc3b2b","Type":"ContainerStarted","Data":"f6dc875200da16004d02ed0e3aee9f1c5a665e92778e42a1f916b4734acfc6c9"}
Jul 23 00:04:20.809949 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:20.809912    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d9w65" event={"ID":"3d027895-b39d-4efe-a38b-9c56633349ce","Type":"ContainerStarted","Data":"78a30e4d460d591f753fcd77fd2def8201061246f707c803a957368bf4d690b0"}
Jul 23 00:04:20.811271 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:20.811246    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztpf9" event={"ID":"43730b45-4c70-4ee9-b344-d538b63092b3","Type":"ContainerStarted","Data":"2647192edac30a96501a5b7f36ac0cbf3bccbb789eb2386b66dc02e8674eacf0"}
Jul 23 00:04:20.812862 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:20.812834    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v" event={"ID":"7ee67aa4-2a65-4a30-a8c7-4e88ac673577","Type":"ContainerStarted","Data":"0920483bf00ce3dc185859cbe0d4582a8a73946359bd9ae609731e3e52f13f37"}
Jul 23 00:04:20.814090 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:20.814057    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-twnl8" event={"ID":"86be577e-afe5-47f5-9f88-cba8930f17ce","Type":"ContainerStarted","Data":"c2131d40365368858f8891e5ed98285a93602425978afb10c012ae08854fa966"}
Jul 23 00:04:20.815323 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:20.815299    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vfqnm" event={"ID":"79f6db91-6406-4b7b-988a-f7b0b35ded81","Type":"ContainerStarted","Data":"51d8f75aae1dfdf909831c5f42d97042ccb414c73023378e88e8cd6a13d19390"}
Jul 23 00:04:20.816885 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:20.816831    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mqh4z" event={"ID":"4cc1fd1d-50e2-4f20-be5e-a770e402f269","Type":"ContainerStarted","Data":"89e0084c2dd5bd0b644c482e712b32b3b3e19a8fdb2cc9943a5a127a5ffb2574"}
Jul 23 00:04:20.818178 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:20.818151    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xw482" event={"ID":"ce011730-f86a-4290-bd28-e8fc65d1da91","Type":"ContainerStarted","Data":"a28e81e2c6ccac7bc0c4d764d7413a7ec7483c984d0a035fe587d138bc75e010"}
Jul 23 00:04:21.250431 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:21.250384    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/553eb6d0-ca32-4129-99d3-e1459beadee9-original-pull-secret\") pod \"global-pull-secret-syncer-fmqcb\" (UID: \"553eb6d0-ca32-4129-99d3-e1459beadee9\") " pod="kube-system/global-pull-secret-syncer-fmqcb"
Jul 23 00:04:21.250652 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:21.250585    2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 00:04:21.250720 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:21.250668    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/553eb6d0-ca32-4129-99d3-e1459beadee9-original-pull-secret podName:553eb6d0-ca32-4129-99d3-e1459beadee9 nodeName:}" failed. No retries permitted until 2026-07-23 00:04:23.250644463 +0000 UTC m=+6.011842758 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/553eb6d0-ca32-4129-99d3-e1459beadee9-original-pull-secret") pod "global-pull-secret-syncer-fmqcb" (UID: "553eb6d0-ca32-4129-99d3-e1459beadee9") : object "kube-system"/"original-pull-secret" not registered
Jul 23 00:04:21.351317 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:21.351265    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c10821c9-b943-4ffe-8ba4-09925139665b-metrics-certs\") pod \"network-metrics-daemon-mktsc\" (UID: \"c10821c9-b943-4ffe-8ba4-09925139665b\") " pod="openshift-multus/network-metrics-daemon-mktsc"
Jul 23 00:04:21.351526 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:21.351422    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 00:04:21.351526 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:21.351518    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c10821c9-b943-4ffe-8ba4-09925139665b-metrics-certs podName:c10821c9-b943-4ffe-8ba4-09925139665b nodeName:}" failed. No retries permitted until 2026-07-23 00:04:23.351471673 +0000 UTC m=+6.112669985 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c10821c9-b943-4ffe-8ba4-09925139665b-metrics-certs") pod "network-metrics-daemon-mktsc" (UID: "c10821c9-b943-4ffe-8ba4-09925139665b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 00:04:21.452781 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:21.452276    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4xdb\" (UniqueName: \"kubernetes.io/projected/362cd422-ddfb-47e6-ae23-568f4edcef08-kube-api-access-r4xdb\") pod \"network-check-target-mnwg9\" (UID: \"362cd422-ddfb-47e6-ae23-568f4edcef08\") " pod="openshift-network-diagnostics/network-check-target-mnwg9"
Jul 23 00:04:21.452781 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:21.452577    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 00:04:21.452781 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:21.452606    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 00:04:21.452781 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:21.452622    2549 projected.go:196] Error preparing data for projected volume kube-api-access-r4xdb for pod openshift-network-diagnostics/network-check-target-mnwg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 00:04:21.452781 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:21.452690    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/362cd422-ddfb-47e6-ae23-568f4edcef08-kube-api-access-r4xdb podName:362cd422-ddfb-47e6-ae23-568f4edcef08 nodeName:}" failed. No retries permitted until 2026-07-23 00:04:23.452669381 +0000 UTC m=+6.213867687 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-r4xdb" (UniqueName: "kubernetes.io/projected/362cd422-ddfb-47e6-ae23-568f4edcef08-kube-api-access-r4xdb") pod "network-check-target-mnwg9" (UID: "362cd422-ddfb-47e6-ae23-568f4edcef08") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 00:04:21.673448 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:21.673118    2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 23:59:20 +0000 UTC" deadline="2028-01-05 13:22:06.673237778 +0000 UTC"
Jul 23 00:04:21.673448 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:21.673421    2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12757h17m44.999822998s"
Jul 23 00:04:21.682833 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:21.682802    2549 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 00:04:21.797821 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:21.797101    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mnwg9"
Jul 23 00:04:21.797821 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:21.797242    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mnwg9" podUID="362cd422-ddfb-47e6-ae23-568f4edcef08"
Jul 23 00:04:21.797821 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:21.797635    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmqcb"
Jul 23 00:04:21.797821 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:21.797743    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmqcb" podUID="553eb6d0-ca32-4129-99d3-e1459beadee9"
Jul 23 00:04:21.797821 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:21.797768    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mktsc"
Jul 23 00:04:21.798200 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:21.797872    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mktsc" podUID="c10821c9-b943-4ffe-8ba4-09925139665b"
Jul 23 00:04:21.834184 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:21.834145    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-182.ec2.internal" event={"ID":"e75ffd7291292d64f0e4db02c0350a31","Type":"ContainerStarted","Data":"e83b00462dc422004f7829cfa2babc4e67b0dcc991b3b2960b8070c789980c4a"}
Jul 23 00:04:21.851554 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:21.851127    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-182.ec2.internal" podStartSLOduration=2.851106175 podStartE2EDuration="2.851106175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 00:04:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:04:21.850796573 +0000 UTC m=+4.611994887" watchObservedRunningTime="2026-07-23 00:04:21.851106175 +0000 UTC m=+4.612304490"
Jul 23 00:04:22.846865 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:22.846824    2549 generic.go:356] "Generic (PLEG): container finished" podID="914224a26574b8fab8d59923791f6500" containerID="1fd18b6ddb6a10aa6d35ba47afb6c7d090d9a8ef009f7cb83ad1e32e18817dc7" exitCode=0
Jul 23 00:04:22.847897 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:22.847866    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-182.ec2.internal" event={"ID":"914224a26574b8fab8d59923791f6500","Type":"ContainerDied","Data":"1fd18b6ddb6a10aa6d35ba47afb6c7d090d9a8ef009f7cb83ad1e32e18817dc7"}
Jul 23 00:04:23.272355 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:23.272237    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/553eb6d0-ca32-4129-99d3-e1459beadee9-original-pull-secret\") pod \"global-pull-secret-syncer-fmqcb\" (UID: \"553eb6d0-ca32-4129-99d3-e1459beadee9\") " pod="kube-system/global-pull-secret-syncer-fmqcb"
Jul 23 00:04:23.272567 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:23.272411    2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 00:04:23.272567 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:23.272498    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/553eb6d0-ca32-4129-99d3-e1459beadee9-original-pull-secret podName:553eb6d0-ca32-4129-99d3-e1459beadee9 nodeName:}" failed. No retries permitted until 2026-07-23 00:04:27.272473787 +0000 UTC m=+10.033672101 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/553eb6d0-ca32-4129-99d3-e1459beadee9-original-pull-secret") pod "global-pull-secret-syncer-fmqcb" (UID: "553eb6d0-ca32-4129-99d3-e1459beadee9") : object "kube-system"/"original-pull-secret" not registered
Jul 23 00:04:23.372873 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:23.372766    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c10821c9-b943-4ffe-8ba4-09925139665b-metrics-certs\") pod \"network-metrics-daemon-mktsc\" (UID: \"c10821c9-b943-4ffe-8ba4-09925139665b\") " pod="openshift-multus/network-metrics-daemon-mktsc"
Jul 23 00:04:23.373059 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:23.372949    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 00:04:23.373059 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:23.373020    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c10821c9-b943-4ffe-8ba4-09925139665b-metrics-certs podName:c10821c9-b943-4ffe-8ba4-09925139665b nodeName:}" failed. No retries permitted until 2026-07-23 00:04:27.37300042 +0000 UTC m=+10.134198727 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c10821c9-b943-4ffe-8ba4-09925139665b-metrics-certs") pod "network-metrics-daemon-mktsc" (UID: "c10821c9-b943-4ffe-8ba4-09925139665b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 00:04:23.473641 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:23.473593    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4xdb\" (UniqueName: \"kubernetes.io/projected/362cd422-ddfb-47e6-ae23-568f4edcef08-kube-api-access-r4xdb\") pod \"network-check-target-mnwg9\" (UID: \"362cd422-ddfb-47e6-ae23-568f4edcef08\") " pod="openshift-network-diagnostics/network-check-target-mnwg9"
Jul 23 00:04:23.473839 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:23.473813    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 00:04:23.473839 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:23.473834    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 00:04:23.473961 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:23.473848    2549 projected.go:196] Error preparing data for projected volume kube-api-access-r4xdb for pod openshift-network-diagnostics/network-check-target-mnwg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 00:04:23.473961 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:23.473910    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/362cd422-ddfb-47e6-ae23-568f4edcef08-kube-api-access-r4xdb podName:362cd422-ddfb-47e6-ae23-568f4edcef08 nodeName:}" failed. No retries permitted until 2026-07-23 00:04:27.473891533 +0000 UTC m=+10.235089838 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-r4xdb" (UniqueName: "kubernetes.io/projected/362cd422-ddfb-47e6-ae23-568f4edcef08-kube-api-access-r4xdb") pod "network-check-target-mnwg9" (UID: "362cd422-ddfb-47e6-ae23-568f4edcef08") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 00:04:23.797353 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:23.797269    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmqcb"
Jul 23 00:04:23.797537 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:23.797420    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmqcb" podUID="553eb6d0-ca32-4129-99d3-e1459beadee9"
Jul 23 00:04:23.797610 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:23.797571    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mktsc"
Jul 23 00:04:23.797741 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:23.797684    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mktsc" podUID="c10821c9-b943-4ffe-8ba4-09925139665b"
Jul 23 00:04:23.797985 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:23.797800    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mnwg9"
Jul 23 00:04:23.798322 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:23.798293    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mnwg9" podUID="362cd422-ddfb-47e6-ae23-568f4edcef08"
Jul 23 00:04:23.857388 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:23.857349    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-182.ec2.internal" event={"ID":"914224a26574b8fab8d59923791f6500","Type":"ContainerStarted","Data":"5e8af030a99fbd307300b353ee8c13db63bcf6b4fc311387c0bc69c2a1c1d9ec"}
Jul 23 00:04:25.798381 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:25.797617    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mnwg9"
Jul 23 00:04:25.798381 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:25.797763    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mnwg9" podUID="362cd422-ddfb-47e6-ae23-568f4edcef08"
Jul 23 00:04:25.798381 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:25.798216    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmqcb"
Jul 23 00:04:25.798381 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:25.798323    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmqcb" podUID="553eb6d0-ca32-4129-99d3-e1459beadee9"
Jul 23 00:04:25.799491 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:25.799142    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mktsc"
Jul 23 00:04:25.799491 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:25.799268    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mktsc" podUID="c10821c9-b943-4ffe-8ba4-09925139665b"
Jul 23 00:04:27.306440 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:27.306316    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/553eb6d0-ca32-4129-99d3-e1459beadee9-original-pull-secret\") pod \"global-pull-secret-syncer-fmqcb\" (UID: \"553eb6d0-ca32-4129-99d3-e1459beadee9\") " pod="kube-system/global-pull-secret-syncer-fmqcb"
Jul 23 00:04:27.306932 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:27.306484    2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 00:04:27.306932 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:27.306569    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/553eb6d0-ca32-4129-99d3-e1459beadee9-original-pull-secret podName:553eb6d0-ca32-4129-99d3-e1459beadee9 nodeName:}" failed. No retries permitted until 2026-07-23 00:04:35.306547153 +0000 UTC m=+18.067745441 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/553eb6d0-ca32-4129-99d3-e1459beadee9-original-pull-secret") pod "global-pull-secret-syncer-fmqcb" (UID: "553eb6d0-ca32-4129-99d3-e1459beadee9") : object "kube-system"/"original-pull-secret" not registered
Jul 23 00:04:27.407381 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:27.407288    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c10821c9-b943-4ffe-8ba4-09925139665b-metrics-certs\") pod \"network-metrics-daemon-mktsc\" (UID: \"c10821c9-b943-4ffe-8ba4-09925139665b\") " pod="openshift-multus/network-metrics-daemon-mktsc"
Jul 23 00:04:27.407598 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:27.407506    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 00:04:27.407598 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:27.407573    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c10821c9-b943-4ffe-8ba4-09925139665b-metrics-certs podName:c10821c9-b943-4ffe-8ba4-09925139665b nodeName:}" failed. No retries permitted until 2026-07-23 00:04:35.407554122 +0000 UTC m=+18.168752410 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c10821c9-b943-4ffe-8ba4-09925139665b-metrics-certs") pod "network-metrics-daemon-mktsc" (UID: "c10821c9-b943-4ffe-8ba4-09925139665b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 00:04:27.508709 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:27.508602    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4xdb\" (UniqueName: \"kubernetes.io/projected/362cd422-ddfb-47e6-ae23-568f4edcef08-kube-api-access-r4xdb\") pod \"network-check-target-mnwg9\" (UID: \"362cd422-ddfb-47e6-ae23-568f4edcef08\") " pod="openshift-network-diagnostics/network-check-target-mnwg9"
Jul 23 00:04:27.508902 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:27.508815    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 00:04:27.508902 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:27.508842    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 00:04:27.508902 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:27.508895    2549 projected.go:196] Error preparing data for projected volume kube-api-access-r4xdb for pod openshift-network-diagnostics/network-check-target-mnwg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 00:04:27.509062 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:27.508965    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/362cd422-ddfb-47e6-ae23-568f4edcef08-kube-api-access-r4xdb podName:362cd422-ddfb-47e6-ae23-568f4edcef08 nodeName:}" failed. No retries permitted until 2026-07-23 00:04:35.508942803 +0000 UTC m=+18.270141105 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-r4xdb" (UniqueName: "kubernetes.io/projected/362cd422-ddfb-47e6-ae23-568f4edcef08-kube-api-access-r4xdb") pod "network-check-target-mnwg9" (UID: "362cd422-ddfb-47e6-ae23-568f4edcef08") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 00:04:27.798035 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:27.797943    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mnwg9"
Jul 23 00:04:27.798209 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:27.798062    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mnwg9" podUID="362cd422-ddfb-47e6-ae23-568f4edcef08"
Jul 23 00:04:27.798733 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:27.798435    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mktsc"
Jul 23 00:04:27.798733 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:27.798566    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mktsc" podUID="c10821c9-b943-4ffe-8ba4-09925139665b"
Jul 23 00:04:27.798733 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:27.798617    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmqcb"
Jul 23 00:04:27.798733 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:27.798688    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmqcb" podUID="553eb6d0-ca32-4129-99d3-e1459beadee9"
Jul 23 00:04:29.797640 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:29.797553    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mnwg9"
Jul 23 00:04:29.798076 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:29.797706    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mnwg9" podUID="362cd422-ddfb-47e6-ae23-568f4edcef08"
Jul 23 00:04:29.798160 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:29.798130    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mktsc"
Jul 23 00:04:29.798298 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:29.798255    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mktsc" podUID="c10821c9-b943-4ffe-8ba4-09925139665b"
Jul 23 00:04:29.798365 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:29.798313    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmqcb"
Jul 23 00:04:29.798415 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:29.798384    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmqcb" podUID="553eb6d0-ca32-4129-99d3-e1459beadee9"
Jul 23 00:04:31.797591 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:31.797550    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmqcb"
Jul 23 00:04:31.798054 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:31.797557    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mktsc"
Jul 23 00:04:31.798054 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:31.797684    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmqcb" podUID="553eb6d0-ca32-4129-99d3-e1459beadee9"
Jul 23 00:04:31.798054 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:31.797562    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mnwg9"
Jul 23 00:04:31.798054 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:31.797741    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mktsc" podUID="c10821c9-b943-4ffe-8ba4-09925139665b"
Jul 23 00:04:31.798054 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:31.797857    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mnwg9" podUID="362cd422-ddfb-47e6-ae23-568f4edcef08"
Jul 23 00:04:33.797727 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:33.797691    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mktsc"
Jul 23 00:04:33.798191 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:33.797697    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmqcb"
Jul 23 00:04:33.798191 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:33.797839    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mktsc" podUID="c10821c9-b943-4ffe-8ba4-09925139665b"
Jul 23 00:04:33.798191 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:33.797698    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mnwg9"
Jul 23 00:04:33.798191 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:33.797896    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmqcb" podUID="553eb6d0-ca32-4129-99d3-e1459beadee9"
Jul 23 00:04:33.798191 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:33.797993    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mnwg9" podUID="362cd422-ddfb-47e6-ae23-568f4edcef08"
Jul 23 00:04:35.372704 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:35.372657    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/553eb6d0-ca32-4129-99d3-e1459beadee9-original-pull-secret\") pod \"global-pull-secret-syncer-fmqcb\" (UID: \"553eb6d0-ca32-4129-99d3-e1459beadee9\") " pod="kube-system/global-pull-secret-syncer-fmqcb"
Jul 23 00:04:35.373140 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:35.372816    2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 00:04:35.373140 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:35.372892    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/553eb6d0-ca32-4129-99d3-e1459beadee9-original-pull-secret podName:553eb6d0-ca32-4129-99d3-e1459beadee9 nodeName:}" failed. No retries permitted until 2026-07-23 00:04:51.372874927 +0000 UTC m=+34.134073215 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/553eb6d0-ca32-4129-99d3-e1459beadee9-original-pull-secret") pod "global-pull-secret-syncer-fmqcb" (UID: "553eb6d0-ca32-4129-99d3-e1459beadee9") : object "kube-system"/"original-pull-secret" not registered
Jul 23 00:04:35.473284 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:35.473249    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c10821c9-b943-4ffe-8ba4-09925139665b-metrics-certs\") pod \"network-metrics-daemon-mktsc\" (UID: \"c10821c9-b943-4ffe-8ba4-09925139665b\") " pod="openshift-multus/network-metrics-daemon-mktsc"
Jul 23 00:04:35.473486 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:35.473384    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 00:04:35.473486 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:35.473463    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c10821c9-b943-4ffe-8ba4-09925139665b-metrics-certs podName:c10821c9-b943-4ffe-8ba4-09925139665b nodeName:}" failed. No retries permitted until 2026-07-23 00:04:51.473435121 +0000 UTC m=+34.234633422 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c10821c9-b943-4ffe-8ba4-09925139665b-metrics-certs") pod "network-metrics-daemon-mktsc" (UID: "c10821c9-b943-4ffe-8ba4-09925139665b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 00:04:35.574496 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:35.574432    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4xdb\" (UniqueName: \"kubernetes.io/projected/362cd422-ddfb-47e6-ae23-568f4edcef08-kube-api-access-r4xdb\") pod \"network-check-target-mnwg9\" (UID: \"362cd422-ddfb-47e6-ae23-568f4edcef08\") " pod="openshift-network-diagnostics/network-check-target-mnwg9"
Jul 23 00:04:35.574686 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:35.574606    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 00:04:35.574686 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:35.574635    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 00:04:35.574686 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:35.574649    2549 projected.go:196] Error preparing data for projected volume kube-api-access-r4xdb for pod openshift-network-diagnostics/network-check-target-mnwg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 00:04:35.574823 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:35.574715    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/362cd422-ddfb-47e6-ae23-568f4edcef08-kube-api-access-r4xdb podName:362cd422-ddfb-47e6-ae23-568f4edcef08 nodeName:}" failed. No retries permitted until 2026-07-23 00:04:51.574695762 +0000 UTC m=+34.335894051 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-r4xdb" (UniqueName: "kubernetes.io/projected/362cd422-ddfb-47e6-ae23-568f4edcef08-kube-api-access-r4xdb") pod "network-check-target-mnwg9" (UID: "362cd422-ddfb-47e6-ae23-568f4edcef08") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 00:04:35.797015 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:35.796933    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mktsc"
Jul 23 00:04:35.797166 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:35.796933    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mnwg9"
Jul 23 00:04:35.797166 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:35.797090    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mktsc" podUID="c10821c9-b943-4ffe-8ba4-09925139665b"
Jul 23 00:04:35.797166 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:35.796933    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmqcb"
Jul 23 00:04:35.797166 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:35.797154    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mnwg9" podUID="362cd422-ddfb-47e6-ae23-568f4edcef08"
Jul 23 00:04:35.797367 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:35.797241    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmqcb" podUID="553eb6d0-ca32-4129-99d3-e1459beadee9"
Jul 23 00:04:37.798410 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:37.798370    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mktsc"
Jul 23 00:04:37.799017 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:37.798531    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmqcb"
Jul 23 00:04:37.799017 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:37.798583    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mnwg9"
Jul 23 00:04:37.799017 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:37.798659    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmqcb" podUID="553eb6d0-ca32-4129-99d3-e1459beadee9"
Jul 23 00:04:37.799017 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:37.798532    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mktsc" podUID="c10821c9-b943-4ffe-8ba4-09925139665b"
Jul 23 00:04:37.799017 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:37.798747    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mnwg9" podUID="362cd422-ddfb-47e6-ae23-568f4edcef08"
Jul 23 00:04:39.796567 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:39.796535    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mktsc"
Jul 23 00:04:39.796963 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:39.796533    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmqcb"
Jul 23 00:04:39.796963 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:39.796673    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mktsc" podUID="c10821c9-b943-4ffe-8ba4-09925139665b"
Jul 23 00:04:39.796963 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:39.796542    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mnwg9"
Jul 23 00:04:39.796963 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:39.796722    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmqcb" podUID="553eb6d0-ca32-4129-99d3-e1459beadee9"
Jul 23 00:04:39.796963 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:39.796779    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mnwg9" podUID="362cd422-ddfb-47e6-ae23-568f4edcef08"
Jul 23 00:04:40.896170 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:40.895742    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztpf9" event={"ID":"43730b45-4c70-4ee9-b344-d538b63092b3","Type":"ContainerStarted","Data":"39a3d3fd86605f5d7de946339c63f0ae347be3f0f81f02d07266ec4d73875b3c"}
Jul 23 00:04:40.899256 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:40.899225    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v" event={"ID":"7ee67aa4-2a65-4a30-a8c7-4e88ac673577","Type":"ContainerStarted","Data":"d97e3da7e470c22e36c8c9be8b2d9c1a634044b2c79bc03c853400c5273eb284"}
Jul 23 00:04:40.899386 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:40.899297    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v" event={"ID":"7ee67aa4-2a65-4a30-a8c7-4e88ac673577","Type":"ContainerStarted","Data":"1c82f2be1ab27262b4b2bd8c27f567a446c92e827e49e25f5c5537a31e977aef"}
Jul 23 00:04:40.899386 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:40.899345    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v" event={"ID":"7ee67aa4-2a65-4a30-a8c7-4e88ac673577","Type":"ContainerStarted","Data":"a1f471fd3f54c7535af25ab00eb4bfbdc836d95ea585b138eaf44008d214f91b"}
Jul 23 00:04:40.899525 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:40.899392    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v" event={"ID":"7ee67aa4-2a65-4a30-a8c7-4e88ac673577","Type":"ContainerStarted","Data":"b314630d8b4b6b38d767fe56eed77e0425d65ec602e8ec47d4c40f481b0db7e8"}
Jul 23 00:04:40.899525 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:40.899438    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v" event={"ID":"7ee67aa4-2a65-4a30-a8c7-4e88ac673577","Type":"ContainerStarted","Data":"2adbacae73ff5c8057d84261f1426847a6136b1f256d7061518e6b6fb23e7757"}
Jul 23 00:04:40.899525 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:40.899493    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v" event={"ID":"7ee67aa4-2a65-4a30-a8c7-4e88ac673577","Type":"ContainerStarted","Data":"79ae75d2489aa7030c3f8619f996ac1b7e5b6577b81f04cd9fb2432da5c6eb34"}
Jul 23 00:04:40.900815 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:40.900787    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-twnl8" event={"ID":"86be577e-afe5-47f5-9f88-cba8930f17ce","Type":"ContainerStarted","Data":"1d2c9786d35358d55ce23b49c676db6448b6e256ba6be265e5ef9df7d8c1379b"}
Jul 23 00:04:40.909367 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:40.909335    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vfqnm" event={"ID":"79f6db91-6406-4b7b-988a-f7b0b35ded81","Type":"ContainerStarted","Data":"87cb881b1e636381e40eba2046960f83f60d7baec0ef3274431788e692297884"}
Jul 23 00:04:40.910928 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:40.910902    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mqh4z" event={"ID":"4cc1fd1d-50e2-4f20-be5e-a770e402f269","Type":"ContainerStarted","Data":"379bb666871f20c40f3d64dc782c9f3f518d47bbc4c7f9233a10715ce4b7e905"}
Jul 23 00:04:40.912535 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:40.912510    2549 generic.go:356] "Generic (PLEG): container finished" podID="ce011730-f86a-4290-bd28-e8fc65d1da91" containerID="c5b67c5482680465d3dab7f3b542319fd51238e58db30d55d30fc50751db98e8" exitCode=0
Jul 23 00:04:40.912638 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:40.912601    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xw482" event={"ID":"ce011730-f86a-4290-bd28-e8fc65d1da91","Type":"ContainerDied","Data":"c5b67c5482680465d3dab7f3b542319fd51238e58db30d55d30fc50751db98e8"}
Jul 23 00:04:40.914067 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:40.914046    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b42wl" event={"ID":"aca54f39-db9c-4e94-b3a1-41680f904cc6","Type":"ContainerStarted","Data":"7be17cdd6fc64c50ef04cc0ab6492fe07315c3e2c942fdc3e22fa59fe536d13a"}
Jul 23 00:04:40.915824 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:40.915795    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-flsfc" event={"ID":"00834f32-b182-4f53-bca5-7188aacc3b2b","Type":"ContainerStarted","Data":"29cb7453e18a9ebc52cd1ccc9ed8f713fa2ad5939718c01a66f306d7ec104016"}
Jul 23 00:04:40.920250 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:40.920213    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-182.ec2.internal" podStartSLOduration=21.920199320000002 podStartE2EDuration="21.92019932s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 00:04:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:04:23.876287201 +0000 UTC m=+6.637485519" watchObservedRunningTime="2026-07-23 00:04:40.92019932 +0000 UTC m=+23.681397631"
Jul 23 00:04:40.920415 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:40.920386    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-twnl8" podStartSLOduration=2.891293797 podStartE2EDuration="22.920378656s" totalImagesPullingTime="20.029084859s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 00:04:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:04:40.919610204 +0000 UTC m=+23.680808517" watchObservedRunningTime="2026-07-23 00:04:40.920378656 +0000 UTC m=+23.681576966"
Jul 23 00:04:40.935694 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:40.935648    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vfqnm" podStartSLOduration=2.894233949 podStartE2EDuration="22.935636306s" totalImagesPullingTime="20.041402357s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 00:04:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:04:40.935299779 +0000 UTC m=+23.696498089" watchObservedRunningTime="2026-07-23 00:04:40.935636306 +0000 UTC m=+23.696834616"
Jul 23 00:04:40.952037 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:40.951982    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-flsfc" podStartSLOduration=11.218258989 podStartE2EDuration="22.951965154s" totalImagesPullingTime="11.733706165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:04:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:04:40.951347683 +0000 UTC m=+23.712545992" watchObservedRunningTime="2026-07-23 00:04:40.951965154 +0000 UTC m=+23.713163489"
Jul 23 00:04:40.968636 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:40.968588    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-b42wl" podStartSLOduration=2.982936761 podStartE2EDuration="22.968572891s" totalImagesPullingTime="19.98563613s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 00:04:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:04:40.968509532 +0000 UTC m=+23.729707842" watchObservedRunningTime="2026-07-23 00:04:40.968572891 +0000 UTC m=+23.729771200"
Jul 23 00:04:40.986624 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:40.986575    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mqh4z" podStartSLOduration=2.958868994 podStartE2EDuration="22.986561496s" totalImagesPullingTime="20.027692502s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 00:04:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:04:40.98626934 +0000 UTC m=+23.747467651" watchObservedRunningTime="2026-07-23 00:04:40.986561496 +0000 UTC m=+23.747759805"
Jul 23 00:04:41.519195 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:41.519156    2549 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 23 00:04:41.700785 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:41.700591    2549 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T00:04:41.519181761Z","UUID":"676f8841-6b3d-4aeb-8a71-e8ca423c272a","Handler":null,"Name":"","Endpoint":""}
Jul 23 00:04:41.702349 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:41.702328    2549 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 23 00:04:41.702519 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:41.702369    2549 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 23 00:04:41.797256 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:41.797216    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mktsc"
Jul 23 00:04:41.797256 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:41.797261    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mnwg9"
Jul 23 00:04:41.797520 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:41.797216    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmqcb"
Jul 23 00:04:41.797520 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:41.797362    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mktsc" podUID="c10821c9-b943-4ffe-8ba4-09925139665b"
Jul 23 00:04:41.797520 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:41.797491    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmqcb" podUID="553eb6d0-ca32-4129-99d3-e1459beadee9"
Jul 23 00:04:41.797684 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:41.797566    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mnwg9" podUID="362cd422-ddfb-47e6-ae23-568f4edcef08"
Jul 23 00:04:41.920022 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:41.919979    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztpf9" event={"ID":"43730b45-4c70-4ee9-b344-d538b63092b3","Type":"ContainerStarted","Data":"2724b0902a974b18ded1ff51295e200a04bea842f824a85bf83517592559397b"}
Jul 23 00:04:41.921847 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:41.921816    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d9w65" event={"ID":"3d027895-b39d-4efe-a38b-9c56633349ce","Type":"ContainerStarted","Data":"1da81e4b7c2cd0cbbe12776fcd9d993d8bc199f3f6b4900e5d49ad7f0ac946f9"}
Jul 23 00:04:41.940722 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:41.940662    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-d9w65" podStartSLOduration=3.933967782 podStartE2EDuration="23.940640842s" totalImagesPullingTime="20.00667306s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 00:04:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:04:41.939833213 +0000 UTC m=+24.701031525" watchObservedRunningTime="2026-07-23 00:04:41.940640842 +0000 UTC m=+24.701839155"
Jul 23 00:04:43.796953 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:43.796859    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mktsc"
Jul 23 00:04:43.796953 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:43.796929    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mnwg9"
Jul 23 00:04:43.797480 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:43.796859    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmqcb"
Jul 23 00:04:43.797480 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:43.797008    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mktsc" podUID="c10821c9-b943-4ffe-8ba4-09925139665b"
Jul 23 00:04:43.797480 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:43.797086    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmqcb" podUID="553eb6d0-ca32-4129-99d3-e1459beadee9"
Jul 23 00:04:43.797480 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:43.797165    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mnwg9" podUID="362cd422-ddfb-47e6-ae23-568f4edcef08"
Jul 23 00:04:43.929490 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:43.929434    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztpf9" event={"ID":"43730b45-4c70-4ee9-b344-d538b63092b3","Type":"ContainerStarted","Data":"0623dbbf32a09012c030e344eeb6436a8aacf2221c9970d4efaf1233cf85ccec"}
Jul 23 00:04:43.933274 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:43.933239    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v" event={"ID":"7ee67aa4-2a65-4a30-a8c7-4e88ac673577","Type":"ContainerStarted","Data":"00f572e7824ae76c4a8374519c5bdd822f132780f4a840665d189dea98ff434d"}
Jul 23 00:04:43.949588 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:43.949528    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztpf9" podStartSLOduration=2.965112806 podStartE2EDuration="25.949508902s" totalImagesPullingTime="22.984396096s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 00:04:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:04:43.949024743 +0000 UTC m=+26.710223052" watchObservedRunningTime="2026-07-23 00:04:43.949508902 +0000 UTC m=+26.710707215"
Jul 23 00:04:45.339442 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:45.339278    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-flsfc"
Jul 23 00:04:45.340121 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:45.339998    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-flsfc"
Jul 23 00:04:45.797840 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:45.797524    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmqcb"
Jul 23 00:04:45.797840 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:45.797537    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mktsc"
Jul 23 00:04:45.798003 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:45.797877    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmqcb" podUID="553eb6d0-ca32-4129-99d3-e1459beadee9"
Jul 23 00:04:45.798003 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:45.797592    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mnwg9"
Jul 23 00:04:45.798003 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:45.797933    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mktsc" podUID="c10821c9-b943-4ffe-8ba4-09925139665b"
Jul 23 00:04:45.798003 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:45.797990    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mnwg9" podUID="362cd422-ddfb-47e6-ae23-568f4edcef08"
Jul 23 00:04:45.941626 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:45.941597    2549 generic.go:356] "Generic (PLEG): container finished" podID="ce011730-f86a-4290-bd28-e8fc65d1da91" containerID="6be4561082fa8cf6ab7146f96847a407ffd2e4539ca828fa925fa7b680ea049e" exitCode=0
Jul 23 00:04:45.941794 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:45.941685    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xw482" event={"ID":"ce011730-f86a-4290-bd28-e8fc65d1da91","Type":"ContainerDied","Data":"6be4561082fa8cf6ab7146f96847a407ffd2e4539ca828fa925fa7b680ea049e"}
Jul 23 00:04:45.945466 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:45.945430    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v" event={"ID":"7ee67aa4-2a65-4a30-a8c7-4e88ac673577","Type":"ContainerStarted","Data":"d9ca9214c28c41a825643a526fe18377c1974a8abb4e94d94227686e1be11848"}
Jul 23 00:04:45.945708 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:45.945684    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-flsfc"
Jul 23 00:04:45.945826 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:45.945734    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:45.945826 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:45.945783    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:45.946268 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:45.946243    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-flsfc"
Jul 23 00:04:45.961522 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:45.961491    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:46.032827 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:46.032770    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v" podStartSLOduration=7.968326062 podStartE2EDuration="28.03275355s" totalImagesPullingTime="20.064427488s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 00:04:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:04:46.031416926 +0000 UTC m=+28.792615238" watchObservedRunningTime="2026-07-23 00:04:46.03275355 +0000 UTC m=+28.793951898"
Jul 23 00:04:46.948606 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:46.948573    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:46.963838 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:46.963811    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:04:47.167533 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:47.167465    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fmqcb"]
Jul 23 00:04:47.167699 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:47.167583    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmqcb"
Jul 23 00:04:47.167699 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:47.167673    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmqcb" podUID="553eb6d0-ca32-4129-99d3-e1459beadee9"
Jul 23 00:04:47.170931 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:47.170906    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mktsc"]
Jul 23 00:04:47.171088 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:47.171011    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mktsc"
Jul 23 00:04:47.171153 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:47.171099    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mktsc" podUID="c10821c9-b943-4ffe-8ba4-09925139665b"
Jul 23 00:04:47.171605 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:47.171577    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mnwg9"]
Jul 23 00:04:47.171721 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:47.171677    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mnwg9"
Jul 23 00:04:47.171803 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:47.171780    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mnwg9" podUID="362cd422-ddfb-47e6-ae23-568f4edcef08"
Jul 23 00:04:47.952287 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:47.952252    2549 generic.go:356] "Generic (PLEG): container finished" podID="ce011730-f86a-4290-bd28-e8fc65d1da91" containerID="b84f663ea94a41fa60d43b9240a377480246adb1d077324796537fde3c3e46a8" exitCode=0
Jul 23 00:04:47.952808 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:47.952344    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xw482" event={"ID":"ce011730-f86a-4290-bd28-e8fc65d1da91","Type":"ContainerDied","Data":"b84f663ea94a41fa60d43b9240a377480246adb1d077324796537fde3c3e46a8"}
Jul 23 00:04:48.796865 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:48.796618    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmqcb"
Jul 23 00:04:48.797079 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:48.796649    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mktsc"
Jul 23 00:04:48.797079 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:48.796968    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmqcb" podUID="553eb6d0-ca32-4129-99d3-e1459beadee9"
Jul 23 00:04:48.797079 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:48.796662    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mnwg9"
Jul 23 00:04:48.797079 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:48.797051    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mktsc" podUID="c10821c9-b943-4ffe-8ba4-09925139665b"
Jul 23 00:04:48.797309 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:48.797094    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mnwg9" podUID="362cd422-ddfb-47e6-ae23-568f4edcef08"
Jul 23 00:04:49.959031 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:49.958996    2549 generic.go:356] "Generic (PLEG): container finished" podID="ce011730-f86a-4290-bd28-e8fc65d1da91" containerID="b12b73d9f57d92d2ba3587afbcd4df22920782c74b2e7fcedf32a7a87fc74123" exitCode=0
Jul 23 00:04:49.959579 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:49.959042    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xw482" event={"ID":"ce011730-f86a-4290-bd28-e8fc65d1da91","Type":"ContainerDied","Data":"b12b73d9f57d92d2ba3587afbcd4df22920782c74b2e7fcedf32a7a87fc74123"}
Jul 23 00:04:50.796621 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:50.796584    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmqcb"
Jul 23 00:04:50.796805 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:50.796585    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mnwg9"
Jul 23 00:04:50.796805 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:50.796695    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmqcb" podUID="553eb6d0-ca32-4129-99d3-e1459beadee9"
Jul 23 00:04:50.796805 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:50.796585    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mktsc"
Jul 23 00:04:50.796805 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:50.796765    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mnwg9" podUID="362cd422-ddfb-47e6-ae23-568f4edcef08"
Jul 23 00:04:50.796930 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:50.796851    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mktsc" podUID="c10821c9-b943-4ffe-8ba4-09925139665b"
Jul 23 00:04:51.391740 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:51.391699    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/553eb6d0-ca32-4129-99d3-e1459beadee9-original-pull-secret\") pod \"global-pull-secret-syncer-fmqcb\" (UID: \"553eb6d0-ca32-4129-99d3-e1459beadee9\") " pod="kube-system/global-pull-secret-syncer-fmqcb"
Jul 23 00:04:51.392253 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:51.391877    2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 00:04:51.392253 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:51.391959    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/553eb6d0-ca32-4129-99d3-e1459beadee9-original-pull-secret podName:553eb6d0-ca32-4129-99d3-e1459beadee9 nodeName:}" failed. No retries permitted until 2026-07-23 00:05:23.391937773 +0000 UTC m=+66.153136065 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/553eb6d0-ca32-4129-99d3-e1459beadee9-original-pull-secret") pod "global-pull-secret-syncer-fmqcb" (UID: "553eb6d0-ca32-4129-99d3-e1459beadee9") : object "kube-system"/"original-pull-secret" not registered
Jul 23 00:04:51.492671 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:51.492630    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c10821c9-b943-4ffe-8ba4-09925139665b-metrics-certs\") pod \"network-metrics-daemon-mktsc\" (UID: \"c10821c9-b943-4ffe-8ba4-09925139665b\") " pod="openshift-multus/network-metrics-daemon-mktsc"
Jul 23 00:04:51.492838 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:51.492814    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 00:04:51.492916 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:51.492904    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c10821c9-b943-4ffe-8ba4-09925139665b-metrics-certs podName:c10821c9-b943-4ffe-8ba4-09925139665b nodeName:}" failed. No retries permitted until 2026-07-23 00:05:23.492882106 +0000 UTC m=+66.254080417 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c10821c9-b943-4ffe-8ba4-09925139665b-metrics-certs") pod "network-metrics-daemon-mktsc" (UID: "c10821c9-b943-4ffe-8ba4-09925139665b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 00:04:51.593512 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:51.593468    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4xdb\" (UniqueName: \"kubernetes.io/projected/362cd422-ddfb-47e6-ae23-568f4edcef08-kube-api-access-r4xdb\") pod \"network-check-target-mnwg9\" (UID: \"362cd422-ddfb-47e6-ae23-568f4edcef08\") " pod="openshift-network-diagnostics/network-check-target-mnwg9"
Jul 23 00:04:51.593690 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:51.593578    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 00:04:51.593690 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:51.593602    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 00:04:51.593690 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:51.593615    2549 projected.go:196] Error preparing data for projected volume kube-api-access-r4xdb for pod openshift-network-diagnostics/network-check-target-mnwg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 00:04:51.593690 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:51.593676    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/362cd422-ddfb-47e6-ae23-568f4edcef08-kube-api-access-r4xdb podName:362cd422-ddfb-47e6-ae23-568f4edcef08 nodeName:}" failed. No retries permitted until 2026-07-23 00:05:23.593657519 +0000 UTC m=+66.354855820 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-r4xdb" (UniqueName: "kubernetes.io/projected/362cd422-ddfb-47e6-ae23-568f4edcef08-kube-api-access-r4xdb") pod "network-check-target-mnwg9" (UID: "362cd422-ddfb-47e6-ae23-568f4edcef08") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 00:04:52.796981 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:52.796947    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mktsc"
Jul 23 00:04:52.797423 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:52.796988    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mnwg9"
Jul 23 00:04:52.797423 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:52.797001    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmqcb"
Jul 23 00:04:52.797423 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:52.797095    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mktsc" podUID="c10821c9-b943-4ffe-8ba4-09925139665b"
Jul 23 00:04:52.797423 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:52.797187    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mnwg9" podUID="362cd422-ddfb-47e6-ae23-568f4edcef08"
Jul 23 00:04:52.797423 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:52.797280    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmqcb" podUID="553eb6d0-ca32-4129-99d3-e1459beadee9"
Jul 23 00:04:53.601739 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:53.601711    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-182.ec2.internal" event="NodeReady"
Jul 23 00:04:53.601891 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:53.601840    2549 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 23 00:04:53.646308 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:53.646280    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9zp45"]
Jul 23 00:04:53.648614 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:53.648590    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9zp45"
Jul 23 00:04:53.649782 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:53.649756    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tnhnq"]
Jul 23 00:04:53.651002 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:53.650977    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-r4q8j\""
Jul 23 00:04:53.651297 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:53.651279    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tnhnq"
Jul 23 00:04:53.651784 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:53.651763    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 23 00:04:53.651895 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:53.651805    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 23 00:04:53.652097 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:53.652082    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 23 00:04:53.653692 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:53.653622    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 23 00:04:53.653692 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:53.653625    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 23 00:04:53.653879 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:53.653865    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6vlrt\""
Jul 23 00:04:53.660805 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:53.660553    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9zp45"]
Jul 23 00:04:53.664691 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:53.664582    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tnhnq"]
Jul 23 00:04:53.809365 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:53.809283    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5wlp\" (UniqueName: \"kubernetes.io/projected/2250b59e-6d47-4ee7-be3a-c2a2849eb1a6-kube-api-access-m5wlp\") pod \"ingress-canary-9zp45\" (UID: \"2250b59e-6d47-4ee7-be3a-c2a2849eb1a6\") " pod="openshift-ingress-canary/ingress-canary-9zp45"
Jul 23 00:04:53.809365 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:53.809323    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b10668c-fed1-431f-bd1e-e18e59098619-metrics-tls\") pod \"dns-default-tnhnq\" (UID: \"9b10668c-fed1-431f-bd1e-e18e59098619\") " pod="openshift-dns/dns-default-tnhnq"
Jul 23 00:04:53.809365 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:53.809349    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9b10668c-fed1-431f-bd1e-e18e59098619-config-volume\") pod \"dns-default-tnhnq\" (UID: \"9b10668c-fed1-431f-bd1e-e18e59098619\") " pod="openshift-dns/dns-default-tnhnq"
Jul 23 00:04:53.809911 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:53.809396    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b10668c-fed1-431f-bd1e-e18e59098619-tmp-dir\") pod \"dns-default-tnhnq\" (UID: \"9b10668c-fed1-431f-bd1e-e18e59098619\") " pod="openshift-dns/dns-default-tnhnq"
Jul 23 00:04:53.809911 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:53.809524    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sscz\" (UniqueName: \"kubernetes.io/projected/9b10668c-fed1-431f-bd1e-e18e59098619-kube-api-access-7sscz\") pod \"dns-default-tnhnq\" (UID: \"9b10668c-fed1-431f-bd1e-e18e59098619\") " pod="openshift-dns/dns-default-tnhnq"
Jul 23 00:04:53.809911 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:53.809561    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2250b59e-6d47-4ee7-be3a-c2a2849eb1a6-cert\") pod \"ingress-canary-9zp45\" (UID: \"2250b59e-6d47-4ee7-be3a-c2a2849eb1a6\") " pod="openshift-ingress-canary/ingress-canary-9zp45"
Jul 23 00:04:53.910667 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:53.910625    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sscz\" (UniqueName: \"kubernetes.io/projected/9b10668c-fed1-431f-bd1e-e18e59098619-kube-api-access-7sscz\") pod \"dns-default-tnhnq\" (UID: \"9b10668c-fed1-431f-bd1e-e18e59098619\") " pod="openshift-dns/dns-default-tnhnq"
Jul 23 00:04:53.910846 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:53.910682    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2250b59e-6d47-4ee7-be3a-c2a2849eb1a6-cert\") pod \"ingress-canary-9zp45\" (UID: \"2250b59e-6d47-4ee7-be3a-c2a2849eb1a6\") " pod="openshift-ingress-canary/ingress-canary-9zp45"
Jul 23 00:04:53.910846 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:53.910755    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5wlp\" (UniqueName: \"kubernetes.io/projected/2250b59e-6d47-4ee7-be3a-c2a2849eb1a6-kube-api-access-m5wlp\") pod \"ingress-canary-9zp45\" (UID: \"2250b59e-6d47-4ee7-be3a-c2a2849eb1a6\") " pod="openshift-ingress-canary/ingress-canary-9zp45"
Jul 23 00:04:53.910846 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:53.910776    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b10668c-fed1-431f-bd1e-e18e59098619-metrics-tls\") pod \"dns-default-tnhnq\" (UID: \"9b10668c-fed1-431f-bd1e-e18e59098619\") " pod="openshift-dns/dns-default-tnhnq"
Jul 23 00:04:53.910846 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:53.910799    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9b10668c-fed1-431f-bd1e-e18e59098619-config-volume\") pod \"dns-default-tnhnq\" (UID: \"9b10668c-fed1-431f-bd1e-e18e59098619\") " pod="openshift-dns/dns-default-tnhnq"
Jul 23 00:04:53.910846 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:53.910820    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b10668c-fed1-431f-bd1e-e18e59098619-tmp-dir\") pod \"dns-default-tnhnq\" (UID: \"9b10668c-fed1-431f-bd1e-e18e59098619\") " pod="openshift-dns/dns-default-tnhnq"
Jul 23 00:04:53.911099 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:53.910953    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 00:04:53.911099 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:53.911031    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b10668c-fed1-431f-bd1e-e18e59098619-metrics-tls podName:9b10668c-fed1-431f-bd1e-e18e59098619 nodeName:}" failed. No retries permitted until 2026-07-23 00:04:54.411008298 +0000 UTC m=+37.172206604 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9b10668c-fed1-431f-bd1e-e18e59098619-metrics-tls") pod "dns-default-tnhnq" (UID: "9b10668c-fed1-431f-bd1e-e18e59098619") : secret "dns-default-metrics-tls" not found
Jul 23 00:04:53.911220 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:53.911199    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b10668c-fed1-431f-bd1e-e18e59098619-tmp-dir\") pod \"dns-default-tnhnq\" (UID: \"9b10668c-fed1-431f-bd1e-e18e59098619\") " pod="openshift-dns/dns-default-tnhnq"
Jul 23 00:04:53.911498 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:53.911476    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9b10668c-fed1-431f-bd1e-e18e59098619-config-volume\") pod \"dns-default-tnhnq\" (UID: \"9b10668c-fed1-431f-bd1e-e18e59098619\") " pod="openshift-dns/dns-default-tnhnq"
Jul 23 00:04:53.915912 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:53.915890    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2250b59e-6d47-4ee7-be3a-c2a2849eb1a6-cert\") pod \"ingress-canary-9zp45\" (UID: \"2250b59e-6d47-4ee7-be3a-c2a2849eb1a6\") " pod="openshift-ingress-canary/ingress-canary-9zp45"
Jul 23 00:04:53.921997 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:53.921974    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sscz\" (UniqueName: \"kubernetes.io/projected/9b10668c-fed1-431f-bd1e-e18e59098619-kube-api-access-7sscz\") pod \"dns-default-tnhnq\" (UID: \"9b10668c-fed1-431f-bd1e-e18e59098619\") " pod="openshift-dns/dns-default-tnhnq"
Jul 23 00:04:53.922235 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:53.922210    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5wlp\" (UniqueName: \"kubernetes.io/projected/2250b59e-6d47-4ee7-be3a-c2a2849eb1a6-kube-api-access-m5wlp\") pod \"ingress-canary-9zp45\" (UID: \"2250b59e-6d47-4ee7-be3a-c2a2849eb1a6\") " pod="openshift-ingress-canary/ingress-canary-9zp45"
Jul 23 00:04:53.967162 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:53.967126    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9zp45"
Jul 23 00:04:54.395812 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:54.395788    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9zp45"]
Jul 23 00:04:54.398927 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:04:54.398904    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2250b59e_6d47_4ee7_be3a_c2a2849eb1a6.slice/crio-9d3c5e19e2513493c3492eb4001b2465ad4bc366e5aeaa50f7a33369d6b713d9 WatchSource:0}: Error finding container 9d3c5e19e2513493c3492eb4001b2465ad4bc366e5aeaa50f7a33369d6b713d9: Status 404 returned error can't find the container with id 9d3c5e19e2513493c3492eb4001b2465ad4bc366e5aeaa50f7a33369d6b713d9
Jul 23 00:04:54.414439 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:54.414419    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b10668c-fed1-431f-bd1e-e18e59098619-metrics-tls\") pod \"dns-default-tnhnq\" (UID: \"9b10668c-fed1-431f-bd1e-e18e59098619\") " pod="openshift-dns/dns-default-tnhnq"
Jul 23 00:04:54.414592 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:54.414573    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 00:04:54.414665 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:54.414652    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b10668c-fed1-431f-bd1e-e18e59098619-metrics-tls podName:9b10668c-fed1-431f-bd1e-e18e59098619 nodeName:}" failed. No retries permitted until 2026-07-23 00:04:55.414631196 +0000 UTC m=+38.175829486 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9b10668c-fed1-431f-bd1e-e18e59098619-metrics-tls") pod "dns-default-tnhnq" (UID: "9b10668c-fed1-431f-bd1e-e18e59098619") : secret "dns-default-metrics-tls" not found
Jul 23 00:04:54.796936 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:54.796895    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmqcb"
Jul 23 00:04:54.797139 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:54.796895    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mnwg9"
Jul 23 00:04:54.797212 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:54.796895    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mktsc"
Jul 23 00:04:54.799895 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:54.799878    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 00:04:54.800809 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:54.800779    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-djfbd\""
Jul 23 00:04:54.800906 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:54.800816    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pdllw\""
Jul 23 00:04:54.800906 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:54.800866    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 00:04:54.800906 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:54.800823    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 00:04:54.800906 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:54.800891    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 00:04:54.973311 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:54.973268    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9zp45" event={"ID":"2250b59e-6d47-4ee7-be3a-c2a2849eb1a6","Type":"ContainerStarted","Data":"9d3c5e19e2513493c3492eb4001b2465ad4bc366e5aeaa50f7a33369d6b713d9"}
Jul 23 00:04:54.976691 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:54.976660    2549 generic.go:356] "Generic (PLEG): container finished" podID="ce011730-f86a-4290-bd28-e8fc65d1da91" containerID="afec3f7170b0eae18527054d672c784a749f4d2efac64a8317faf1ca77409503" exitCode=0
Jul 23 00:04:54.976831 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:54.976709    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xw482" event={"ID":"ce011730-f86a-4290-bd28-e8fc65d1da91","Type":"ContainerDied","Data":"afec3f7170b0eae18527054d672c784a749f4d2efac64a8317faf1ca77409503"}
Jul 23 00:04:55.424107 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:55.424066    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b10668c-fed1-431f-bd1e-e18e59098619-metrics-tls\") pod \"dns-default-tnhnq\" (UID: \"9b10668c-fed1-431f-bd1e-e18e59098619\") " pod="openshift-dns/dns-default-tnhnq"
Jul 23 00:04:55.424284 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:55.424241    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 00:04:55.424333 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:55.424321    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b10668c-fed1-431f-bd1e-e18e59098619-metrics-tls podName:9b10668c-fed1-431f-bd1e-e18e59098619 nodeName:}" failed. No retries permitted until 2026-07-23 00:04:57.424301476 +0000 UTC m=+40.185499779 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9b10668c-fed1-431f-bd1e-e18e59098619-metrics-tls") pod "dns-default-tnhnq" (UID: "9b10668c-fed1-431f-bd1e-e18e59098619") : secret "dns-default-metrics-tls" not found
Jul 23 00:04:55.983574 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:55.983525    2549 generic.go:356] "Generic (PLEG): container finished" podID="ce011730-f86a-4290-bd28-e8fc65d1da91" containerID="31b838315d9ea20794d1b16238ffc8ea92f14fd2fe21ac068d6e7f1a368291e3" exitCode=0
Jul 23 00:04:55.984050 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:55.983611    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xw482" event={"ID":"ce011730-f86a-4290-bd28-e8fc65d1da91","Type":"ContainerDied","Data":"31b838315d9ea20794d1b16238ffc8ea92f14fd2fe21ac068d6e7f1a368291e3"}
Jul 23 00:04:56.988090 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:56.987879    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9zp45" event={"ID":"2250b59e-6d47-4ee7-be3a-c2a2849eb1a6","Type":"ContainerStarted","Data":"9e043f8e7b9a6093aaef325ef08e6eed1e904db90808eb60c97e9aefd0673dee"}
Jul 23 00:04:56.991112 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:56.991084    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xw482" event={"ID":"ce011730-f86a-4290-bd28-e8fc65d1da91","Type":"ContainerStarted","Data":"1263268de70d2bf3b7610016ca0d1fd7d053a99db729ac1965e80d831aa5ed63"}
Jul 23 00:04:57.003905 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:57.003864    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9zp45" podStartSLOduration=1.807678621 podStartE2EDuration="4.003848606s" totalImagesPullingTime="2.196169985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:04:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:04:57.003526831 +0000 UTC m=+39.764725141" watchObservedRunningTime="2026-07-23 00:04:57.003848606 +0000 UTC m=+39.765046919"
Jul 23 00:04:57.025977 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:57.025919    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xw482" podStartSLOduration=8.114730019 podStartE2EDuration="39.02590203s" totalImagesPullingTime="30.911172011s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 00:04:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:04:57.025121719 +0000 UTC m=+39.786320040" watchObservedRunningTime="2026-07-23 00:04:57.02590203 +0000 UTC m=+39.787100341"
Jul 23 00:04:57.438787 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:04:57.438752    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b10668c-fed1-431f-bd1e-e18e59098619-metrics-tls\") pod \"dns-default-tnhnq\" (UID: \"9b10668c-fed1-431f-bd1e-e18e59098619\") " pod="openshift-dns/dns-default-tnhnq"
Jul 23 00:04:57.438941 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:57.438900    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 00:04:57.438983 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:04:57.438962    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b10668c-fed1-431f-bd1e-e18e59098619-metrics-tls podName:9b10668c-fed1-431f-bd1e-e18e59098619 nodeName:}" failed. No retries permitted until 2026-07-23 00:05:01.438944972 +0000 UTC m=+44.200143272 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9b10668c-fed1-431f-bd1e-e18e59098619-metrics-tls") pod "dns-default-tnhnq" (UID: "9b10668c-fed1-431f-bd1e-e18e59098619") : secret "dns-default-metrics-tls" not found
Jul 23 00:05:01.466997 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:01.466954    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b10668c-fed1-431f-bd1e-e18e59098619-metrics-tls\") pod \"dns-default-tnhnq\" (UID: \"9b10668c-fed1-431f-bd1e-e18e59098619\") " pod="openshift-dns/dns-default-tnhnq"
Jul 23 00:05:01.467469 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:05:01.467098    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 00:05:01.467469 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:05:01.467157    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b10668c-fed1-431f-bd1e-e18e59098619-metrics-tls podName:9b10668c-fed1-431f-bd1e-e18e59098619 nodeName:}" failed. No retries permitted until 2026-07-23 00:05:09.467142524 +0000 UTC m=+52.228340811 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9b10668c-fed1-431f-bd1e-e18e59098619-metrics-tls") pod "dns-default-tnhnq" (UID: "9b10668c-fed1-431f-bd1e-e18e59098619") : secret "dns-default-metrics-tls" not found
Jul 23 00:05:09.528100 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:09.528054    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b10668c-fed1-431f-bd1e-e18e59098619-metrics-tls\") pod \"dns-default-tnhnq\" (UID: \"9b10668c-fed1-431f-bd1e-e18e59098619\") " pod="openshift-dns/dns-default-tnhnq"
Jul 23 00:05:09.528620 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:05:09.528170    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 00:05:09.528620 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:05:09.528232    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b10668c-fed1-431f-bd1e-e18e59098619-metrics-tls podName:9b10668c-fed1-431f-bd1e-e18e59098619 nodeName:}" failed. No retries permitted until 2026-07-23 00:05:25.528218711 +0000 UTC m=+68.289416999 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9b10668c-fed1-431f-bd1e-e18e59098619-metrics-tls") pod "dns-default-tnhnq" (UID: "9b10668c-fed1-431f-bd1e-e18e59098619") : secret "dns-default-metrics-tls" not found
Jul 23 00:05:13.711138 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:13.711101    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f5c5b98b-p8pcn"]
Jul 23 00:05:13.713164 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:13.713140    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f5c5b98b-p8pcn"
Jul 23 00:05:13.715812 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:13.715789    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 23 00:05:13.716715 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:13.716694    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 23 00:05:13.716780 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:13.716759    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 23 00:05:13.716824 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:13.716789    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 23 00:05:13.722798 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:13.722776    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f5c5b98b-p8pcn"]
Jul 23 00:05:13.752591 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:13.752561    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d979fdd5-l5djb"]
Jul 23 00:05:13.754270 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:13.754251    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d979fdd5-l5djb"
Jul 23 00:05:13.756549 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:13.756528    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 23 00:05:13.756908 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:13.756894    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 23 00:05:13.756959 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:13.756897    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 23 00:05:13.757604 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:13.757587    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 23 00:05:13.758561 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:13.758544    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6e89d26-9156-45e0-af33-5595eeec09cd-tmp\") pod \"klusterlet-addon-workmgr-78f5c5b98b-p8pcn\" (UID: \"a6e89d26-9156-45e0-af33-5595eeec09cd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f5c5b98b-p8pcn"
Jul 23 00:05:13.758642 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:13.758571    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t74v2\" (UniqueName: \"kubernetes.io/projected/a6e89d26-9156-45e0-af33-5595eeec09cd-kube-api-access-t74v2\") pod \"klusterlet-addon-workmgr-78f5c5b98b-p8pcn\" (UID: \"a6e89d26-9156-45e0-af33-5595eeec09cd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f5c5b98b-p8pcn"
Jul 23 00:05:13.758642 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:13.758601    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a6e89d26-9156-45e0-af33-5595eeec09cd-klusterlet-config\") pod \"klusterlet-addon-workmgr-78f5c5b98b-p8pcn\" (UID: \"a6e89d26-9156-45e0-af33-5595eeec09cd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f5c5b98b-p8pcn"
Jul 23 00:05:13.767806 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:13.767785    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d979fdd5-l5djb"]
Jul 23 00:05:13.859622 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:13.859578    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e5d437ee-ca8b-4155-8b8b-885170dc3b0f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-76d979fdd5-l5djb\" (UID: \"e5d437ee-ca8b-4155-8b8b-885170dc3b0f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d979fdd5-l5djb"
Jul 23 00:05:13.859622 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:13.859622    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e5d437ee-ca8b-4155-8b8b-885170dc3b0f-ca\") pod \"cluster-proxy-proxy-agent-76d979fdd5-l5djb\" (UID: \"e5d437ee-ca8b-4155-8b8b-885170dc3b0f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d979fdd5-l5djb"
Jul 23 00:05:13.859846 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:13.859685    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e5d437ee-ca8b-4155-8b8b-885170dc3b0f-hub\") pod \"cluster-proxy-proxy-agent-76d979fdd5-l5djb\" (UID: \"e5d437ee-ca8b-4155-8b8b-885170dc3b0f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d979fdd5-l5djb"
Jul 23 00:05:13.859846 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:13.859701    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e5d437ee-ca8b-4155-8b8b-885170dc3b0f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-76d979fdd5-l5djb\" (UID: \"e5d437ee-ca8b-4155-8b8b-885170dc3b0f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d979fdd5-l5djb"
Jul 23 00:05:13.859846 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:13.859732    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6e89d26-9156-45e0-af33-5595eeec09cd-tmp\") pod \"klusterlet-addon-workmgr-78f5c5b98b-p8pcn\" (UID: \"a6e89d26-9156-45e0-af33-5595eeec09cd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f5c5b98b-p8pcn"
Jul 23 00:05:13.859846 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:13.859796    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t74v2\" (UniqueName: \"kubernetes.io/projected/a6e89d26-9156-45e0-af33-5595eeec09cd-kube-api-access-t74v2\") pod \"klusterlet-addon-workmgr-78f5c5b98b-p8pcn\" (UID: \"a6e89d26-9156-45e0-af33-5595eeec09cd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f5c5b98b-p8pcn"
Jul 23 00:05:13.859846 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:13.859840    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a6e89d26-9156-45e0-af33-5595eeec09cd-klusterlet-config\") pod \"klusterlet-addon-workmgr-78f5c5b98b-p8pcn\" (UID: \"a6e89d26-9156-45e0-af33-5595eeec09cd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f5c5b98b-p8pcn"
Jul 23 00:05:13.860018 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:13.859867    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qr7d\" (UniqueName: \"kubernetes.io/projected/e5d437ee-ca8b-4155-8b8b-885170dc3b0f-kube-api-access-5qr7d\") pod \"cluster-proxy-proxy-agent-76d979fdd5-l5djb\" (UID: \"e5d437ee-ca8b-4155-8b8b-885170dc3b0f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d979fdd5-l5djb"
Jul 23 00:05:13.860018 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:13.859894    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5d437ee-ca8b-4155-8b8b-885170dc3b0f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-76d979fdd5-l5djb\" (UID: \"e5d437ee-ca8b-4155-8b8b-885170dc3b0f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d979fdd5-l5djb"
Jul 23 00:05:13.860087 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:13.860078    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6e89d26-9156-45e0-af33-5595eeec09cd-tmp\") pod \"klusterlet-addon-workmgr-78f5c5b98b-p8pcn\" (UID: \"a6e89d26-9156-45e0-af33-5595eeec09cd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f5c5b98b-p8pcn"
Jul 23 00:05:13.864410 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:13.864377    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a6e89d26-9156-45e0-af33-5595eeec09cd-klusterlet-config\") pod \"klusterlet-addon-workmgr-78f5c5b98b-p8pcn\" (UID: \"a6e89d26-9156-45e0-af33-5595eeec09cd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f5c5b98b-p8pcn"
Jul 23 00:05:13.868415 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:13.868387    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t74v2\" (UniqueName: \"kubernetes.io/projected/a6e89d26-9156-45e0-af33-5595eeec09cd-kube-api-access-t74v2\") pod \"klusterlet-addon-workmgr-78f5c5b98b-p8pcn\" (UID: \"a6e89d26-9156-45e0-af33-5595eeec09cd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f5c5b98b-p8pcn"
Jul 23 00:05:13.960688 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:13.960639    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5d437ee-ca8b-4155-8b8b-885170dc3b0f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-76d979fdd5-l5djb\" (UID: \"e5d437ee-ca8b-4155-8b8b-885170dc3b0f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d979fdd5-l5djb"
Jul 23 00:05:13.960688 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:13.960706    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e5d437ee-ca8b-4155-8b8b-885170dc3b0f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-76d979fdd5-l5djb\" (UID: \"e5d437ee-ca8b-4155-8b8b-885170dc3b0f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d979fdd5-l5djb"
Jul 23 00:05:13.960954 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:13.960726    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e5d437ee-ca8b-4155-8b8b-885170dc3b0f-ca\") pod \"cluster-proxy-proxy-agent-76d979fdd5-l5djb\" (UID: \"e5d437ee-ca8b-4155-8b8b-885170dc3b0f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d979fdd5-l5djb"
Jul 23 00:05:13.960954 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:13.960891    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e5d437ee-ca8b-4155-8b8b-885170dc3b0f-hub\") pod \"cluster-proxy-proxy-agent-76d979fdd5-l5djb\" (UID: \"e5d437ee-ca8b-4155-8b8b-885170dc3b0f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d979fdd5-l5djb"
Jul 23 00:05:13.960954 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:13.960934    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e5d437ee-ca8b-4155-8b8b-885170dc3b0f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-76d979fdd5-l5djb\" (UID: \"e5d437ee-ca8b-4155-8b8b-885170dc3b0f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d979fdd5-l5djb"
Jul 23 00:05:13.961105 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:13.961014    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qr7d\" (UniqueName: \"kubernetes.io/projected/e5d437ee-ca8b-4155-8b8b-885170dc3b0f-kube-api-access-5qr7d\") pod \"cluster-proxy-proxy-agent-76d979fdd5-l5djb\" (UID: \"e5d437ee-ca8b-4155-8b8b-885170dc3b0f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d979fdd5-l5djb"
Jul 23 00:05:13.961606 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:13.961541    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5d437ee-ca8b-4155-8b8b-885170dc3b0f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-76d979fdd5-l5djb\" (UID: \"e5d437ee-ca8b-4155-8b8b-885170dc3b0f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d979fdd5-l5djb"
Jul 23 00:05:13.963248 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:13.963219    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e5d437ee-ca8b-4155-8b8b-885170dc3b0f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-76d979fdd5-l5djb\" (UID: \"e5d437ee-ca8b-4155-8b8b-885170dc3b0f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d979fdd5-l5djb"
Jul 23 00:05:13.963362 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:13.963244    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e5d437ee-ca8b-4155-8b8b-885170dc3b0f-ca\") pod \"cluster-proxy-proxy-agent-76d979fdd5-l5djb\" (UID: \"e5d437ee-ca8b-4155-8b8b-885170dc3b0f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d979fdd5-l5djb"
Jul 23 00:05:13.963362 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:13.963276    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e5d437ee-ca8b-4155-8b8b-885170dc3b0f-hub\") pod \"cluster-proxy-proxy-agent-76d979fdd5-l5djb\" (UID: \"e5d437ee-ca8b-4155-8b8b-885170dc3b0f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d979fdd5-l5djb"
Jul 23 00:05:13.963362 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:13.963347    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e5d437ee-ca8b-4155-8b8b-885170dc3b0f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-76d979fdd5-l5djb\" (UID: \"e5d437ee-ca8b-4155-8b8b-885170dc3b0f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d979fdd5-l5djb"
Jul 23 00:05:13.969587 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:13.969560    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qr7d\" (UniqueName: \"kubernetes.io/projected/e5d437ee-ca8b-4155-8b8b-885170dc3b0f-kube-api-access-5qr7d\") pod \"cluster-proxy-proxy-agent-76d979fdd5-l5djb\" (UID: \"e5d437ee-ca8b-4155-8b8b-885170dc3b0f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d979fdd5-l5djb"
Jul 23 00:05:14.022433 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:14.022387    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f5c5b98b-p8pcn"
Jul 23 00:05:14.075405 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:14.075371    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d979fdd5-l5djb"
Jul 23 00:05:14.159662 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:14.159628    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f5c5b98b-p8pcn"]
Jul 23 00:05:14.163587 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:05:14.163557    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6e89d26_9156_45e0_af33_5595eeec09cd.slice/crio-97ce8c8b53f4312dc905eb1bb809858907dd8acdf84f331667803d94c2745a42 WatchSource:0}: Error finding container 97ce8c8b53f4312dc905eb1bb809858907dd8acdf84f331667803d94c2745a42: Status 404 returned error can't find the container with id 97ce8c8b53f4312dc905eb1bb809858907dd8acdf84f331667803d94c2745a42
Jul 23 00:05:14.214325 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:14.214197    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d979fdd5-l5djb"]
Jul 23 00:05:14.216554 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:05:14.216526    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5d437ee_ca8b_4155_8b8b_885170dc3b0f.slice/crio-3ab5818e3b55db06af7005bb3741b53dbb88e826c9e9f210ff1f03c348ad5611 WatchSource:0}: Error finding container 3ab5818e3b55db06af7005bb3741b53dbb88e826c9e9f210ff1f03c348ad5611: Status 404 returned error can't find the container with id 3ab5818e3b55db06af7005bb3741b53dbb88e826c9e9f210ff1f03c348ad5611
Jul 23 00:05:15.033289 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:15.033249    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d979fdd5-l5djb" event={"ID":"e5d437ee-ca8b-4155-8b8b-885170dc3b0f","Type":"ContainerStarted","Data":"3ab5818e3b55db06af7005bb3741b53dbb88e826c9e9f210ff1f03c348ad5611"}
Jul 23 00:05:15.034886 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:15.034854    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f5c5b98b-p8pcn" event={"ID":"a6e89d26-9156-45e0-af33-5595eeec09cd","Type":"ContainerStarted","Data":"97ce8c8b53f4312dc905eb1bb809858907dd8acdf84f331667803d94c2745a42"}
Jul 23 00:05:18.968258 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:18.968222    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qwd8v"
Jul 23 00:05:20.052718 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:20.052672    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f5c5b98b-p8pcn" event={"ID":"a6e89d26-9156-45e0-af33-5595eeec09cd","Type":"ContainerStarted","Data":"54184d5ed050dc7e77c727283008037ae119724a906519da69e6872729b55605"}
Jul 23 00:05:20.053288 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:20.052745    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f5c5b98b-p8pcn"
Jul 23 00:05:20.054797 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:20.054773    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f5c5b98b-p8pcn"
Jul 23 00:05:20.054934 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:20.054886    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d979fdd5-l5djb" event={"ID":"e5d437ee-ca8b-4155-8b8b-885170dc3b0f","Type":"ContainerStarted","Data":"78b9efb70932585b8f5312446b56f3fe0cef93d41e3045460272df0fee72b62c"}
Jul 23 00:05:20.054980 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:20.054932    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d979fdd5-l5djb" event={"ID":"e5d437ee-ca8b-4155-8b8b-885170dc3b0f","Type":"ContainerStarted","Data":"cda9b0d51189ac88ba8295ede8bbb772e9afeda8b56b24d2b76a484ff1ca8a16"}
Jul 23 00:05:20.054980 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:20.054947    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d979fdd5-l5djb" event={"ID":"e5d437ee-ca8b-4155-8b8b-885170dc3b0f","Type":"ContainerStarted","Data":"c561134d2dd67479949520befb179f65c4ef113ae37685ee450d79cb8ce43f2c"}
Jul 23 00:05:20.069981 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:20.069929    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f5c5b98b-p8pcn" podStartSLOduration=1.69442457 podStartE2EDuration="7.069910716s" totalImagesPullingTime="5.375486146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:05:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:05:20.068802169 +0000 UTC m=+62.830000495" watchObservedRunningTime="2026-07-23 00:05:20.069910716 +0000 UTC m=+62.831109028"
Jul 23 00:05:20.087424 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:20.087375    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d979fdd5-l5djb" podStartSLOduration=1.7538678079999999 podStartE2EDuration="7.087356488s" totalImagesPullingTime="5.33348868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:05:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:05:20.086644245 +0000 UTC m=+62.847842556" watchObservedRunningTime="2026-07-23 00:05:20.087356488 +0000 UTC m=+62.848554811"
Jul 23 00:05:23.439333 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:23.439270    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/553eb6d0-ca32-4129-99d3-e1459beadee9-original-pull-secret\") pod \"global-pull-secret-syncer-fmqcb\" (UID: \"553eb6d0-ca32-4129-99d3-e1459beadee9\") " pod="kube-system/global-pull-secret-syncer-fmqcb"
Jul 23 00:05:23.442611 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:23.442591    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 00:05:23.452168 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:23.452136    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/553eb6d0-ca32-4129-99d3-e1459beadee9-original-pull-secret\") pod \"global-pull-secret-syncer-fmqcb\" (UID: \"553eb6d0-ca32-4129-99d3-e1459beadee9\") " pod="kube-system/global-pull-secret-syncer-fmqcb"
Jul 23 00:05:23.540572 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:23.540522    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c10821c9-b943-4ffe-8ba4-09925139665b-metrics-certs\") pod \"network-metrics-daemon-mktsc\" (UID: \"c10821c9-b943-4ffe-8ba4-09925139665b\") " pod="openshift-multus/network-metrics-daemon-mktsc"
Jul 23 00:05:23.543335 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:23.543317    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 00:05:23.551347 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:05:23.551330    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 23 00:05:23.551401 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:05:23.551390    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c10821c9-b943-4ffe-8ba4-09925139665b-metrics-certs podName:c10821c9-b943-4ffe-8ba4-09925139665b nodeName:}" failed. No retries permitted until 2026-07-23 00:06:27.551373713 +0000 UTC m=+130.312572002 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c10821c9-b943-4ffe-8ba4-09925139665b-metrics-certs") pod "network-metrics-daemon-mktsc" (UID: "c10821c9-b943-4ffe-8ba4-09925139665b") : secret "metrics-daemon-secret" not found
Jul 23 00:05:23.606928 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:23.606885    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmqcb"
Jul 23 00:05:23.641255 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:23.641220    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4xdb\" (UniqueName: \"kubernetes.io/projected/362cd422-ddfb-47e6-ae23-568f4edcef08-kube-api-access-r4xdb\") pod \"network-check-target-mnwg9\" (UID: \"362cd422-ddfb-47e6-ae23-568f4edcef08\") " pod="openshift-network-diagnostics/network-check-target-mnwg9"
Jul 23 00:05:23.644172 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:23.644147    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 00:05:23.654955 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:23.654870    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 00:05:23.665166 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:23.665107    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4xdb\" (UniqueName: \"kubernetes.io/projected/362cd422-ddfb-47e6-ae23-568f4edcef08-kube-api-access-r4xdb\") pod \"network-check-target-mnwg9\" (UID: \"362cd422-ddfb-47e6-ae23-568f4edcef08\") " pod="openshift-network-diagnostics/network-check-target-mnwg9"
Jul 23 00:05:23.730324 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:23.730236    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fmqcb"]
Jul 23 00:05:23.734065 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:05:23.734023    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod553eb6d0_ca32_4129_99d3_e1459beadee9.slice/crio-a497b28ba478a2913180fd47439886145cf734401dc9b4a7b09ac3eefbc903b1 WatchSource:0}: Error finding container a497b28ba478a2913180fd47439886145cf734401dc9b4a7b09ac3eefbc903b1: Status 404 returned error can't find the container with id a497b28ba478a2913180fd47439886145cf734401dc9b4a7b09ac3eefbc903b1
Jul 23 00:05:23.914788 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:23.914748    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pdllw\""
Jul 23 00:05:23.922784 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:23.922738    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mnwg9"
Jul 23 00:05:24.044206 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:24.044172    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mnwg9"]
Jul 23 00:05:24.047703 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:05:24.047676    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod362cd422_ddfb_47e6_ae23_568f4edcef08.slice/crio-924b49d5002a221f4eb66abbc31af31bb51887848669f3256ba08b609d07d3d1 WatchSource:0}: Error finding container 924b49d5002a221f4eb66abbc31af31bb51887848669f3256ba08b609d07d3d1: Status 404 returned error can't find the container with id 924b49d5002a221f4eb66abbc31af31bb51887848669f3256ba08b609d07d3d1
Jul 23 00:05:24.066877 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:24.066845    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mnwg9" event={"ID":"362cd422-ddfb-47e6-ae23-568f4edcef08","Type":"ContainerStarted","Data":"924b49d5002a221f4eb66abbc31af31bb51887848669f3256ba08b609d07d3d1"}
Jul 23 00:05:24.067960 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:24.067939    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fmqcb" event={"ID":"553eb6d0-ca32-4129-99d3-e1459beadee9","Type":"ContainerStarted","Data":"a497b28ba478a2913180fd47439886145cf734401dc9b4a7b09ac3eefbc903b1"}
Jul 23 00:05:25.555249 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:25.555212    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b10668c-fed1-431f-bd1e-e18e59098619-metrics-tls\") pod \"dns-default-tnhnq\" (UID: \"9b10668c-fed1-431f-bd1e-e18e59098619\") " pod="openshift-dns/dns-default-tnhnq"
Jul 23 00:05:25.555711 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:05:25.555357    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 00:05:25.555711 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:05:25.555423    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b10668c-fed1-431f-bd1e-e18e59098619-metrics-tls podName:9b10668c-fed1-431f-bd1e-e18e59098619 nodeName:}" failed. No retries permitted until 2026-07-23 00:05:57.555405411 +0000 UTC m=+100.316603721 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9b10668c-fed1-431f-bd1e-e18e59098619-metrics-tls") pod "dns-default-tnhnq" (UID: "9b10668c-fed1-431f-bd1e-e18e59098619") : secret "dns-default-metrics-tls" not found
Jul 23 00:05:29.085856 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:29.085812    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fmqcb" event={"ID":"553eb6d0-ca32-4129-99d3-e1459beadee9","Type":"ContainerStarted","Data":"b3255a8c150be8874f6898cd38e9b542a25b239f998c7fd636899fb02fbc575f"}
Jul 23 00:05:29.087311 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:29.087284    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mnwg9" event={"ID":"362cd422-ddfb-47e6-ae23-568f4edcef08","Type":"ContainerStarted","Data":"61af163a1e38cf8c4f95b09ff105e8ca53304ab16782e14db6a2361d5036f00e"}
Jul 23 00:05:29.087425 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:29.087342    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mnwg9"
Jul 23 00:05:29.104342 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:29.104277    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fmqcb" podStartSLOduration=66.374137475 podStartE2EDuration="1m11.104259192s" totalImagesPullingTime="4.730121717s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 00:04:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:05:29.103989196 +0000 UTC m=+71.865187516" watchObservedRunningTime="2026-07-23 00:05:29.104259192 +0000 UTC m=+71.865457503"
Jul 23 00:05:57.597336 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:05:57.597294    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b10668c-fed1-431f-bd1e-e18e59098619-metrics-tls\") pod \"dns-default-tnhnq\" (UID: \"9b10668c-fed1-431f-bd1e-e18e59098619\") " pod="openshift-dns/dns-default-tnhnq"
Jul 23 00:05:57.597809 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:05:57.597403    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 00:05:57.597809 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:05:57.597469    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b10668c-fed1-431f-bd1e-e18e59098619-metrics-tls podName:9b10668c-fed1-431f-bd1e-e18e59098619 nodeName:}" failed. No retries permitted until 2026-07-23 00:07:01.59743907 +0000 UTC m=+164.358637358 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9b10668c-fed1-431f-bd1e-e18e59098619-metrics-tls") pod "dns-default-tnhnq" (UID: "9b10668c-fed1-431f-bd1e-e18e59098619") : secret "dns-default-metrics-tls" not found
Jul 23 00:06:00.093054 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:06:00.093024    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mnwg9"
Jul 23 00:06:00.110101 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:06:00.110050    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mnwg9" podStartSLOduration=97.696284827 podStartE2EDuration="1m42.110035836s" totalImagesPullingTime="4.413751009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:04:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:05:29.11896309 +0000 UTC m=+71.880161405" watchObservedRunningTime="2026-07-23 00:06:00.110035836 +0000 UTC m=+102.871234145"
Jul 23 00:06:27.607689 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:06:27.607650    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c10821c9-b943-4ffe-8ba4-09925139665b-metrics-certs\") pod \"network-metrics-daemon-mktsc\" (UID: \"c10821c9-b943-4ffe-8ba4-09925139665b\") " pod="openshift-multus/network-metrics-daemon-mktsc"
Jul 23 00:06:27.608190 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:06:27.607798    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 23 00:06:27.608190 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:06:27.607871    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c10821c9-b943-4ffe-8ba4-09925139665b-metrics-certs podName:c10821c9-b943-4ffe-8ba4-09925139665b nodeName:}" failed. No retries permitted until 2026-07-23 00:08:29.607855257 +0000 UTC m=+252.369053546 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c10821c9-b943-4ffe-8ba4-09925139665b-metrics-certs") pod "network-metrics-daemon-mktsc" (UID: "c10821c9-b943-4ffe-8ba4-09925139665b") : secret "metrics-daemon-secret" not found
Jul 23 00:06:56.672728 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:06:56.672684    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-tnhnq" podUID="9b10668c-fed1-431f-bd1e-e18e59098619"
Jul 23 00:06:57.340364 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:06:57.340326    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tnhnq"
Jul 23 00:06:57.817676 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:06:57.817635    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-mktsc" podUID="c10821c9-b943-4ffe-8ba4-09925139665b"
Jul 23 00:07:01.648985 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:07:01.648951    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b10668c-fed1-431f-bd1e-e18e59098619-metrics-tls\") pod \"dns-default-tnhnq\" (UID: \"9b10668c-fed1-431f-bd1e-e18e59098619\") " pod="openshift-dns/dns-default-tnhnq"
Jul 23 00:07:01.649357 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:07:01.649063    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 00:07:01.649357 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:07:01.649114    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b10668c-fed1-431f-bd1e-e18e59098619-metrics-tls podName:9b10668c-fed1-431f-bd1e-e18e59098619 nodeName:}" failed. No retries permitted until 2026-07-23 00:09:03.649101811 +0000 UTC m=+286.410300099 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9b10668c-fed1-431f-bd1e-e18e59098619-metrics-tls") pod "dns-default-tnhnq" (UID: "9b10668c-fed1-431f-bd1e-e18e59098619") : secret "dns-default-metrics-tls" not found
Jul 23 00:07:13.797337 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:07:13.797251    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mktsc"
Jul 23 00:07:20.053584 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:07:20.053482    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f5c5b98b-p8pcn" podUID="a6e89d26-9156-45e0-af33-5595eeec09cd" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.8:8000/readyz\": dial tcp 10.133.0.8:8000: connect: connection refused"
Jul 23 00:07:20.409881 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:07:20.409842    2549 generic.go:356] "Generic (PLEG): container finished" podID="a6e89d26-9156-45e0-af33-5595eeec09cd" containerID="54184d5ed050dc7e77c727283008037ae119724a906519da69e6872729b55605" exitCode=1
Jul 23 00:07:20.410058 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:07:20.409916    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f5c5b98b-p8pcn" event={"ID":"a6e89d26-9156-45e0-af33-5595eeec09cd","Type":"ContainerDied","Data":"54184d5ed050dc7e77c727283008037ae119724a906519da69e6872729b55605"}
Jul 23 00:07:20.410232 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:07:20.410220    2549 scope.go:117] "RemoveContainer" containerID="54184d5ed050dc7e77c727283008037ae119724a906519da69e6872729b55605"
Jul 23 00:07:21.414082 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:07:21.414039    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f5c5b98b-p8pcn" event={"ID":"a6e89d26-9156-45e0-af33-5595eeec09cd","Type":"ContainerStarted","Data":"40a4e591b991a3606a5db7e0d47ff1398d15e7414feba20beb590ff75e6d1b1c"}
Jul 23 00:07:21.414502 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:07:21.414331    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f5c5b98b-p8pcn"
Jul 23 00:07:21.414966 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:07:21.414951    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f5c5b98b-p8pcn"
Jul 23 00:08:08.196159 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:08.196116    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vgw4k"]
Jul 23 00:08:08.198187 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:08.198165    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vgw4k"
Jul 23 00:08:08.201506 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:08.201475    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 23 00:08:08.201506 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:08.201494    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 23 00:08:08.201656 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:08.201478    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 23 00:08:08.201656 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:08.201546    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7jhfv\""
Jul 23 00:08:08.201810 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:08.201694    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 23 00:08:08.211395 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:08.211371    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vgw4k"]
Jul 23 00:08:08.314917 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:08.314869    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d7100866-dd6a-42cf-8400-bd2fc033f7af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vgw4k\" (UID: \"d7100866-dd6a-42cf-8400-bd2fc033f7af\") " pod="openshift-insights/insights-runtime-extractor-vgw4k"
Jul 23 00:08:08.314917 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:08.314918    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d7100866-dd6a-42cf-8400-bd2fc033f7af-data-volume\") pod \"insights-runtime-extractor-vgw4k\" (UID: \"d7100866-dd6a-42cf-8400-bd2fc033f7af\") " pod="openshift-insights/insights-runtime-extractor-vgw4k"
Jul 23 00:08:08.315132 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:08.314942    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d7100866-dd6a-42cf-8400-bd2fc033f7af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vgw4k\" (UID: \"d7100866-dd6a-42cf-8400-bd2fc033f7af\") " pod="openshift-insights/insights-runtime-extractor-vgw4k"
Jul 23 00:08:08.315132 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:08.315002    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j76b\" (UniqueName: \"kubernetes.io/projected/d7100866-dd6a-42cf-8400-bd2fc033f7af-kube-api-access-6j76b\") pod \"insights-runtime-extractor-vgw4k\" (UID: \"d7100866-dd6a-42cf-8400-bd2fc033f7af\") " pod="openshift-insights/insights-runtime-extractor-vgw4k"
Jul 23 00:08:08.315132 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:08.315048    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d7100866-dd6a-42cf-8400-bd2fc033f7af-crio-socket\") pod \"insights-runtime-extractor-vgw4k\" (UID: \"d7100866-dd6a-42cf-8400-bd2fc033f7af\") " pod="openshift-insights/insights-runtime-extractor-vgw4k"
Jul 23 00:08:08.415921 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:08.415884    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j76b\" (UniqueName: \"kubernetes.io/projected/d7100866-dd6a-42cf-8400-bd2fc033f7af-kube-api-access-6j76b\") pod \"insights-runtime-extractor-vgw4k\" (UID: \"d7100866-dd6a-42cf-8400-bd2fc033f7af\") " pod="openshift-insights/insights-runtime-extractor-vgw4k"
Jul 23 00:08:08.415921 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:08.415922    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d7100866-dd6a-42cf-8400-bd2fc033f7af-crio-socket\") pod \"insights-runtime-extractor-vgw4k\" (UID: \"d7100866-dd6a-42cf-8400-bd2fc033f7af\") " pod="openshift-insights/insights-runtime-extractor-vgw4k"
Jul 23 00:08:08.416169 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:08.415969    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d7100866-dd6a-42cf-8400-bd2fc033f7af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vgw4k\" (UID: \"d7100866-dd6a-42cf-8400-bd2fc033f7af\") " pod="openshift-insights/insights-runtime-extractor-vgw4k"
Jul 23 00:08:08.416169 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:08.416003    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d7100866-dd6a-42cf-8400-bd2fc033f7af-data-volume\") pod \"insights-runtime-extractor-vgw4k\" (UID: \"d7100866-dd6a-42cf-8400-bd2fc033f7af\") " pod="openshift-insights/insights-runtime-extractor-vgw4k"
Jul 23 00:08:08.416169 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:08.416068    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d7100866-dd6a-42cf-8400-bd2fc033f7af-crio-socket\") pod \"insights-runtime-extractor-vgw4k\" (UID: \"d7100866-dd6a-42cf-8400-bd2fc033f7af\") " pod="openshift-insights/insights-runtime-extractor-vgw4k"
Jul 23 00:08:08.416169 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:08:08.416102    2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 00:08:08.416169 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:08.416118    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d7100866-dd6a-42cf-8400-bd2fc033f7af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vgw4k\" (UID: \"d7100866-dd6a-42cf-8400-bd2fc033f7af\") " pod="openshift-insights/insights-runtime-extractor-vgw4k"
Jul 23 00:08:08.416169 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:08:08.416152    2549 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 00:08:08.416169 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:08:08.416167    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7100866-dd6a-42cf-8400-bd2fc033f7af-insights-runtime-extractor-tls podName:d7100866-dd6a-42cf-8400-bd2fc033f7af nodeName:}" failed. No retries permitted until 2026-07-23 00:08:08.916146731 +0000 UTC m=+231.677345033 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d7100866-dd6a-42cf-8400-bd2fc033f7af-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vgw4k" (UID: "d7100866-dd6a-42cf-8400-bd2fc033f7af") : secret "insights-runtime-extractor-tls" not found
Jul 23 00:08:08.416429 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:08:08.416220    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d7100866-dd6a-42cf-8400-bd2fc033f7af-kube-rbac-proxy-cm podName:d7100866-dd6a-42cf-8400-bd2fc033f7af nodeName:}" failed. No retries permitted until 2026-07-23 00:08:08.916202989 +0000 UTC m=+231.677401297 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d7100866-dd6a-42cf-8400-bd2fc033f7af-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vgw4k" (UID: "d7100866-dd6a-42cf-8400-bd2fc033f7af") : configmap "kube-rbac-proxy" not found
Jul 23 00:08:08.416429 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:08.416295    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d7100866-dd6a-42cf-8400-bd2fc033f7af-data-volume\") pod \"insights-runtime-extractor-vgw4k\" (UID: \"d7100866-dd6a-42cf-8400-bd2fc033f7af\") " pod="openshift-insights/insights-runtime-extractor-vgw4k"
Jul 23 00:08:08.425293 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:08.425272    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j76b\" (UniqueName: \"kubernetes.io/projected/d7100866-dd6a-42cf-8400-bd2fc033f7af-kube-api-access-6j76b\") pod \"insights-runtime-extractor-vgw4k\" (UID: \"d7100866-dd6a-42cf-8400-bd2fc033f7af\") " pod="openshift-insights/insights-runtime-extractor-vgw4k"
Jul 23 00:08:08.919349 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:08.919309    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d7100866-dd6a-42cf-8400-bd2fc033f7af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vgw4k\" (UID: \"d7100866-dd6a-42cf-8400-bd2fc033f7af\") " pod="openshift-insights/insights-runtime-extractor-vgw4k"
Jul 23 00:08:08.919548 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:08.919360    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d7100866-dd6a-42cf-8400-bd2fc033f7af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vgw4k\" (UID: \"d7100866-dd6a-42cf-8400-bd2fc033f7af\") " pod="openshift-insights/insights-runtime-extractor-vgw4k"
Jul 23 00:08:08.919548 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:08:08.919485    2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 00:08:08.919548 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:08:08.919493    2549 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 00:08:08.919548 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:08:08.919546    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7100866-dd6a-42cf-8400-bd2fc033f7af-insights-runtime-extractor-tls podName:d7100866-dd6a-42cf-8400-bd2fc033f7af nodeName:}" failed. No retries permitted until 2026-07-23 00:08:09.919532147 +0000 UTC m=+232.680730435 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d7100866-dd6a-42cf-8400-bd2fc033f7af-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vgw4k" (UID: "d7100866-dd6a-42cf-8400-bd2fc033f7af") : secret "insights-runtime-extractor-tls" not found
Jul 23 00:08:08.919720 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:08:08.919587    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d7100866-dd6a-42cf-8400-bd2fc033f7af-kube-rbac-proxy-cm podName:d7100866-dd6a-42cf-8400-bd2fc033f7af nodeName:}" failed. No retries permitted until 2026-07-23 00:08:09.919566401 +0000 UTC m=+232.680764702 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d7100866-dd6a-42cf-8400-bd2fc033f7af-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vgw4k" (UID: "d7100866-dd6a-42cf-8400-bd2fc033f7af") : configmap "kube-rbac-proxy" not found
Jul 23 00:08:09.927564 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:09.927502    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d7100866-dd6a-42cf-8400-bd2fc033f7af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vgw4k\" (UID: \"d7100866-dd6a-42cf-8400-bd2fc033f7af\") " pod="openshift-insights/insights-runtime-extractor-vgw4k"
Jul 23 00:08:09.927564 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:09.927569    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d7100866-dd6a-42cf-8400-bd2fc033f7af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vgw4k\" (UID: \"d7100866-dd6a-42cf-8400-bd2fc033f7af\") " pod="openshift-insights/insights-runtime-extractor-vgw4k"
Jul 23 00:08:09.928007 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:08:09.927637    2549 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 00:08:09.928007 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:08:09.927650    2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 00:08:09.928007 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:08:09.927691    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d7100866-dd6a-42cf-8400-bd2fc033f7af-kube-rbac-proxy-cm podName:d7100866-dd6a-42cf-8400-bd2fc033f7af nodeName:}" failed. No retries permitted until 2026-07-23 00:08:11.927676933 +0000 UTC m=+234.688875221 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d7100866-dd6a-42cf-8400-bd2fc033f7af-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vgw4k" (UID: "d7100866-dd6a-42cf-8400-bd2fc033f7af") : configmap "kube-rbac-proxy" not found
Jul 23 00:08:09.928007 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:08:09.927716    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7100866-dd6a-42cf-8400-bd2fc033f7af-insights-runtime-extractor-tls podName:d7100866-dd6a-42cf-8400-bd2fc033f7af nodeName:}" failed. No retries permitted until 2026-07-23 00:08:11.927701071 +0000 UTC m=+234.688899360 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d7100866-dd6a-42cf-8400-bd2fc033f7af-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vgw4k" (UID: "d7100866-dd6a-42cf-8400-bd2fc033f7af") : secret "insights-runtime-extractor-tls" not found
Jul 23 00:08:10.165878 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:10.165849    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b42wl_aca54f39-db9c-4e94-b3a1-41680f904cc6/dns-node-resolver/0.log"
Jul 23 00:08:11.565592 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:11.565563    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vfqnm_79f6db91-6406-4b7b-988a-f7b0b35ded81/node-ca/0.log"
Jul 23 00:08:11.943382 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:11.943293    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d7100866-dd6a-42cf-8400-bd2fc033f7af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vgw4k\" (UID: \"d7100866-dd6a-42cf-8400-bd2fc033f7af\") " pod="openshift-insights/insights-runtime-extractor-vgw4k"
Jul 23 00:08:11.943382 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:11.943343    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d7100866-dd6a-42cf-8400-bd2fc033f7af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vgw4k\" (UID: \"d7100866-dd6a-42cf-8400-bd2fc033f7af\") " pod="openshift-insights/insights-runtime-extractor-vgw4k"
Jul 23 00:08:11.943587 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:08:11.943444    2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 00:08:11.943587 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:08:11.943522    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7100866-dd6a-42cf-8400-bd2fc033f7af-insights-runtime-extractor-tls podName:d7100866-dd6a-42cf-8400-bd2fc033f7af nodeName:}" failed. No retries permitted until 2026-07-23 00:08:15.943506481 +0000 UTC m=+238.704704773 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d7100866-dd6a-42cf-8400-bd2fc033f7af-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vgw4k" (UID: "d7100866-dd6a-42cf-8400-bd2fc033f7af") : secret "insights-runtime-extractor-tls" not found
Jul 23 00:08:11.943587 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:08:11.943465    2549 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 00:08:11.943687 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:08:11.943597    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d7100866-dd6a-42cf-8400-bd2fc033f7af-kube-rbac-proxy-cm podName:d7100866-dd6a-42cf-8400-bd2fc033f7af nodeName:}" failed. No retries permitted until 2026-07-23 00:08:15.943585181 +0000 UTC m=+238.704783474 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d7100866-dd6a-42cf-8400-bd2fc033f7af-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vgw4k" (UID: "d7100866-dd6a-42cf-8400-bd2fc033f7af") : configmap "kube-rbac-proxy" not found
Jul 23 00:08:11.966879 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:11.966848    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9zp45_2250b59e-6d47-4ee7-be3a-c2a2849eb1a6/serve-healthcheck-canary/0.log"
Jul 23 00:08:15.971958 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:15.971925    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d7100866-dd6a-42cf-8400-bd2fc033f7af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vgw4k\" (UID: \"d7100866-dd6a-42cf-8400-bd2fc033f7af\") " pod="openshift-insights/insights-runtime-extractor-vgw4k"
Jul 23 00:08:15.972393 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:15.971981    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d7100866-dd6a-42cf-8400-bd2fc033f7af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vgw4k\" (UID: \"d7100866-dd6a-42cf-8400-bd2fc033f7af\") " pod="openshift-insights/insights-runtime-extractor-vgw4k"
Jul 23 00:08:15.972393 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:08:15.972071    2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 00:08:15.972393 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:08:15.972092    2549 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 00:08:15.972393 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:08:15.972139    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7100866-dd6a-42cf-8400-bd2fc033f7af-insights-runtime-extractor-tls podName:d7100866-dd6a-42cf-8400-bd2fc033f7af nodeName:}" failed. No retries permitted until 2026-07-23 00:08:23.972120999 +0000 UTC m=+246.733319304 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d7100866-dd6a-42cf-8400-bd2fc033f7af-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vgw4k" (UID: "d7100866-dd6a-42cf-8400-bd2fc033f7af") : secret "insights-runtime-extractor-tls" not found
Jul 23 00:08:15.972393 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:08:15.972152    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d7100866-dd6a-42cf-8400-bd2fc033f7af-kube-rbac-proxy-cm podName:d7100866-dd6a-42cf-8400-bd2fc033f7af nodeName:}" failed. No retries permitted until 2026-07-23 00:08:23.972146447 +0000 UTC m=+246.733344735 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d7100866-dd6a-42cf-8400-bd2fc033f7af-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vgw4k" (UID: "d7100866-dd6a-42cf-8400-bd2fc033f7af") : configmap "kube-rbac-proxy" not found
Jul 23 00:08:24.029973 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:24.029941    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d7100866-dd6a-42cf-8400-bd2fc033f7af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vgw4k\" (UID: \"d7100866-dd6a-42cf-8400-bd2fc033f7af\") " pod="openshift-insights/insights-runtime-extractor-vgw4k"
Jul 23 00:08:24.029973 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:24.029986    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d7100866-dd6a-42cf-8400-bd2fc033f7af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vgw4k\" (UID: \"d7100866-dd6a-42cf-8400-bd2fc033f7af\") " pod="openshift-insights/insights-runtime-extractor-vgw4k"
Jul 23 00:08:24.030393 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:08:24.030084    2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 00:08:24.030393 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:08:24.030158    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7100866-dd6a-42cf-8400-bd2fc033f7af-insights-runtime-extractor-tls podName:d7100866-dd6a-42cf-8400-bd2fc033f7af nodeName:}" failed. No retries permitted until 2026-07-23 00:08:40.030142784 +0000 UTC m=+262.791341072 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d7100866-dd6a-42cf-8400-bd2fc033f7af-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vgw4k" (UID: "d7100866-dd6a-42cf-8400-bd2fc033f7af") : secret "insights-runtime-extractor-tls" not found
Jul 23 00:08:24.030491 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:24.030435    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d7100866-dd6a-42cf-8400-bd2fc033f7af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vgw4k\" (UID: \"d7100866-dd6a-42cf-8400-bd2fc033f7af\") " pod="openshift-insights/insights-runtime-extractor-vgw4k"
Jul 23 00:08:29.670135 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:29.670086    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c10821c9-b943-4ffe-8ba4-09925139665b-metrics-certs\") pod \"network-metrics-daemon-mktsc\" (UID: \"c10821c9-b943-4ffe-8ba4-09925139665b\") " pod="openshift-multus/network-metrics-daemon-mktsc"
Jul 23 00:08:29.672349 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:29.672329    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c10821c9-b943-4ffe-8ba4-09925139665b-metrics-certs\") pod \"network-metrics-daemon-mktsc\" (UID: \"c10821c9-b943-4ffe-8ba4-09925139665b\") " pod="openshift-multus/network-metrics-daemon-mktsc"
Jul 23 00:08:29.700390 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:29.700364    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-djfbd\""
Jul 23 00:08:29.709182 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:29.709164    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mktsc"
Jul 23 00:08:29.827984 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:29.827956    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mktsc"]
Jul 23 00:08:29.830892 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:08:29.830868    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc10821c9_b943_4ffe_8ba4_09925139665b.slice/crio-2516726697d499ec6e5ce60281362be3fbf3feeeb2f687fa691c60cbfab29b77 WatchSource:0}: Error finding container 2516726697d499ec6e5ce60281362be3fbf3feeeb2f687fa691c60cbfab29b77: Status 404 returned error can't find the container with id 2516726697d499ec6e5ce60281362be3fbf3feeeb2f687fa691c60cbfab29b77
Jul 23 00:08:30.609200 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:30.609159    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mktsc" event={"ID":"c10821c9-b943-4ffe-8ba4-09925139665b","Type":"ContainerStarted","Data":"2516726697d499ec6e5ce60281362be3fbf3feeeb2f687fa691c60cbfab29b77"}
Jul 23 00:08:31.613415 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:31.613380    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mktsc" event={"ID":"c10821c9-b943-4ffe-8ba4-09925139665b","Type":"ContainerStarted","Data":"4a5664677a9ab39f075ecffc94eba4e584241fbe39b9191321d439fb9efc6597"}
Jul 23 00:08:31.613813 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:31.613440    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mktsc" event={"ID":"c10821c9-b943-4ffe-8ba4-09925139665b","Type":"ContainerStarted","Data":"b1235d07e62084e3a032ae3525122dec28722b93e0622253d5e7473899eab59b"}
Jul 23 00:08:31.629952 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:31.629880    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mktsc" podStartSLOduration=252.737963064 podStartE2EDuration="4m13.629862684s" totalImagesPullingTime="891.89962ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:04:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:08:31.62895052 +0000 UTC m=+254.390148853" watchObservedRunningTime="2026-07-23 00:08:31.629862684 +0000 UTC m=+254.391060994"
Jul 23 00:08:33.206382 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:33.206347    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d546949f9-hzd8r"]
Jul 23 00:08:33.208762 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:33.208737    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d546949f9-hzd8r"
Jul 23 00:08:33.212052 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:33.212028    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 23 00:08:33.212165 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:33.212032    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 23 00:08:33.212997 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:33.212976    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 23 00:08:33.213103 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:33.212985    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8tjsp\""
Jul 23 00:08:33.216331 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:33.216311    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 23 00:08:33.227021 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:33.226997    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d546949f9-hzd8r"]
Jul 23 00:08:33.297869 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:33.297827    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/340b9647-c773-4998-84f6-4cdcadbc302b-installation-pull-secrets\") pod \"image-registry-5d546949f9-hzd8r\" (UID: \"340b9647-c773-4998-84f6-4cdcadbc302b\") " pod="openshift-image-registry/image-registry-5d546949f9-hzd8r"
Jul 23 00:08:33.298052 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:33.297877    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/340b9647-c773-4998-84f6-4cdcadbc302b-bound-sa-token\") pod \"image-registry-5d546949f9-hzd8r\" (UID: \"340b9647-c773-4998-84f6-4cdcadbc302b\") " pod="openshift-image-registry/image-registry-5d546949f9-hzd8r"
Jul 23 00:08:33.298052 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:33.297957    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/340b9647-c773-4998-84f6-4cdcadbc302b-trusted-ca\") pod \"image-registry-5d546949f9-hzd8r\" (UID: \"340b9647-c773-4998-84f6-4cdcadbc302b\") " pod="openshift-image-registry/image-registry-5d546949f9-hzd8r"
Jul 23 00:08:33.298052 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:33.298008    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/340b9647-c773-4998-84f6-4cdcadbc302b-registry-certificates\") pod \"image-registry-5d546949f9-hzd8r\" (UID: \"340b9647-c773-4998-84f6-4cdcadbc302b\") " pod="openshift-image-registry/image-registry-5d546949f9-hzd8r"
Jul 23 00:08:33.298052 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:33.298031    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/340b9647-c773-4998-84f6-4cdcadbc302b-registry-tls\") pod \"image-registry-5d546949f9-hzd8r\" (UID: \"340b9647-c773-4998-84f6-4cdcadbc302b\") " pod="openshift-image-registry/image-registry-5d546949f9-hzd8r"
Jul 23 00:08:33.298236 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:33.298051    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/340b9647-c773-4998-84f6-4cdcadbc302b-image-registry-private-configuration\") pod \"image-registry-5d546949f9-hzd8r\" (UID: \"340b9647-c773-4998-84f6-4cdcadbc302b\") " pod="openshift-image-registry/image-registry-5d546949f9-hzd8r"
Jul 23 00:08:33.298236 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:33.298074    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rxw2\" (UniqueName: \"kubernetes.io/projected/340b9647-c773-4998-84f6-4cdcadbc302b-kube-api-access-9rxw2\") pod \"image-registry-5d546949f9-hzd8r\" (UID: \"340b9647-c773-4998-84f6-4cdcadbc302b\") " pod="openshift-image-registry/image-registry-5d546949f9-hzd8r"
Jul 23 00:08:33.298236 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:33.298116    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/340b9647-c773-4998-84f6-4cdcadbc302b-ca-trust-extracted\") pod \"image-registry-5d546949f9-hzd8r\" (UID: \"340b9647-c773-4998-84f6-4cdcadbc302b\") " pod="openshift-image-registry/image-registry-5d546949f9-hzd8r"
Jul 23 00:08:33.399382 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:33.399347    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/340b9647-c773-4998-84f6-4cdcadbc302b-registry-certificates\") pod \"image-registry-5d546949f9-hzd8r\" (UID: \"340b9647-c773-4998-84f6-4cdcadbc302b\") " pod="openshift-image-registry/image-registry-5d546949f9-hzd8r"
Jul 23 00:08:33.399382 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:33.399384    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/340b9647-c773-4998-84f6-4cdcadbc302b-registry-tls\") pod \"image-registry-5d546949f9-hzd8r\" (UID: \"340b9647-c773-4998-84f6-4cdcadbc302b\") " pod="openshift-image-registry/image-registry-5d546949f9-hzd8r"
Jul 23 00:08:33.399656 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:33.399407    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/340b9647-c773-4998-84f6-4cdcadbc302b-image-registry-private-configuration\") pod \"image-registry-5d546949f9-hzd8r\" (UID: \"340b9647-c773-4998-84f6-4cdcadbc302b\") " pod="openshift-image-registry/image-registry-5d546949f9-hzd8r"
Jul 23 00:08:33.399656 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:33.399431    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rxw2\" (UniqueName: \"kubernetes.io/projected/340b9647-c773-4998-84f6-4cdcadbc302b-kube-api-access-9rxw2\") pod \"image-registry-5d546949f9-hzd8r\" (UID: \"340b9647-c773-4998-84f6-4cdcadbc302b\") " pod="openshift-image-registry/image-registry-5d546949f9-hzd8r"
Jul 23 00:08:33.399656 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:33.399469    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/340b9647-c773-4998-84f6-4cdcadbc302b-ca-trust-extracted\") pod \"image-registry-5d546949f9-hzd8r\" (UID: \"340b9647-c773-4998-84f6-4cdcadbc302b\") " pod="openshift-image-registry/image-registry-5d546949f9-hzd8r"
Jul 23 00:08:33.399656 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:33.399636    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/340b9647-c773-4998-84f6-4cdcadbc302b-installation-pull-secrets\") pod \"image-registry-5d546949f9-hzd8r\" (UID: \"340b9647-c773-4998-84f6-4cdcadbc302b\") " pod="openshift-image-registry/image-registry-5d546949f9-hzd8r"
Jul 23 00:08:33.399850 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:33.399685    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/340b9647-c773-4998-84f6-4cdcadbc302b-bound-sa-token\") pod \"image-registry-5d546949f9-hzd8r\" (UID: \"340b9647-c773-4998-84f6-4cdcadbc302b\") " pod="openshift-image-registry/image-registry-5d546949f9-hzd8r"
Jul 23 00:08:33.399850 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:33.399726    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/340b9647-c773-4998-84f6-4cdcadbc302b-trusted-ca\") pod \"image-registry-5d546949f9-hzd8r\" (UID: \"340b9647-c773-4998-84f6-4cdcadbc302b\") " pod="openshift-image-registry/image-registry-5d546949f9-hzd8r"
Jul 23 00:08:33.400137 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:33.400109    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/340b9647-c773-4998-84f6-4cdcadbc302b-ca-trust-extracted\") pod \"image-registry-5d546949f9-hzd8r\" (UID: \"340b9647-c773-4998-84f6-4cdcadbc302b\") " pod="openshift-image-registry/image-registry-5d546949f9-hzd8r"
Jul 23 00:08:33.400370 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:33.400334    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/340b9647-c773-4998-84f6-4cdcadbc302b-registry-certificates\") pod \"image-registry-5d546949f9-hzd8r\" (UID: \"340b9647-c773-4998-84f6-4cdcadbc302b\") " pod="openshift-image-registry/image-registry-5d546949f9-hzd8r"
Jul 23 00:08:33.400616 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:33.400598    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/340b9647-c773-4998-84f6-4cdcadbc302b-trusted-ca\") pod \"image-registry-5d546949f9-hzd8r\" (UID: \"340b9647-c773-4998-84f6-4cdcadbc302b\") " pod="openshift-image-registry/image-registry-5d546949f9-hzd8r"
Jul 23 00:08:33.401969 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:33.401950    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/340b9647-c773-4998-84f6-4cdcadbc302b-registry-tls\") pod \"image-registry-5d546949f9-hzd8r\" (UID: \"340b9647-c773-4998-84f6-4cdcadbc302b\") " pod="openshift-image-registry/image-registry-5d546949f9-hzd8r"
Jul 23 00:08:33.402087 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:33.402068    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/340b9647-c773-4998-84f6-4cdcadbc302b-installation-pull-secrets\") pod \"image-registry-5d546949f9-hzd8r\" (UID: \"340b9647-c773-4998-84f6-4cdcadbc302b\") " pod="openshift-image-registry/image-registry-5d546949f9-hzd8r"
Jul 23 00:08:33.402208 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:33.402189    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/340b9647-c773-4998-84f6-4cdcadbc302b-image-registry-private-configuration\") pod \"image-registry-5d546949f9-hzd8r\" (UID: \"340b9647-c773-4998-84f6-4cdcadbc302b\") " pod="openshift-image-registry/image-registry-5d546949f9-hzd8r"
Jul 23 00:08:33.423027 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:33.423003    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/340b9647-c773-4998-84f6-4cdcadbc302b-bound-sa-token\") pod \"image-registry-5d546949f9-hzd8r\" (UID: \"340b9647-c773-4998-84f6-4cdcadbc302b\") " pod="openshift-image-registry/image-registry-5d546949f9-hzd8r"
Jul 23 00:08:33.425126 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:33.425105    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rxw2\" (UniqueName: \"kubernetes.io/projected/340b9647-c773-4998-84f6-4cdcadbc302b-kube-api-access-9rxw2\") pod \"image-registry-5d546949f9-hzd8r\" (UID: \"340b9647-c773-4998-84f6-4cdcadbc302b\") " pod="openshift-image-registry/image-registry-5d546949f9-hzd8r"
Jul 23 00:08:33.518378 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:33.518316    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d546949f9-hzd8r"
Jul 23 00:08:33.640757 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:33.640720    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d546949f9-hzd8r"]
Jul 23 00:08:33.643219 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:08:33.643197    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod340b9647_c773_4998_84f6_4cdcadbc302b.slice/crio-2a2d9ae9b2033f52370f462840f4001da495600779eb90c1f920a01fd3ad3718 WatchSource:0}: Error finding container 2a2d9ae9b2033f52370f462840f4001da495600779eb90c1f920a01fd3ad3718: Status 404 returned error can't find the container with id 2a2d9ae9b2033f52370f462840f4001da495600779eb90c1f920a01fd3ad3718
Jul 23 00:08:34.628725 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:34.628688    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d546949f9-hzd8r" event={"ID":"340b9647-c773-4998-84f6-4cdcadbc302b","Type":"ContainerStarted","Data":"1d8fb8f138edd30b3c3f32a4045b1a316d251d2756517bdbb96f525ebae23994"}
Jul 23 00:08:34.629107 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:34.628739    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d546949f9-hzd8r" event={"ID":"340b9647-c773-4998-84f6-4cdcadbc302b","Type":"ContainerStarted","Data":"2a2d9ae9b2033f52370f462840f4001da495600779eb90c1f920a01fd3ad3718"}
Jul 23 00:08:34.629107 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:34.628805    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d546949f9-hzd8r"
Jul 23 00:08:34.650085 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:34.650035    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d546949f9-hzd8r" podStartSLOduration=1.6500206290000001 podStartE2EDuration="1.650020629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:08:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:08:34.649051485 +0000 UTC m=+257.410249796" watchObservedRunningTime="2026-07-23 00:08:34.650020629 +0000 UTC m=+257.411218938"
Jul 23 00:08:40.051728 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:40.051649    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d7100866-dd6a-42cf-8400-bd2fc033f7af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vgw4k\" (UID: \"d7100866-dd6a-42cf-8400-bd2fc033f7af\") " pod="openshift-insights/insights-runtime-extractor-vgw4k"
Jul 23 00:08:40.053848 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:40.053826    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d7100866-dd6a-42cf-8400-bd2fc033f7af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vgw4k\" (UID: \"d7100866-dd6a-42cf-8400-bd2fc033f7af\") " pod="openshift-insights/insights-runtime-extractor-vgw4k"
Jul 23 00:08:40.308833 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:40.308762    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7jhfv\""
Jul 23 00:08:40.317057 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:40.317035    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vgw4k"
Jul 23 00:08:40.436467 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:40.436416    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vgw4k"]
Jul 23 00:08:40.439418 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:08:40.439397    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7100866_dd6a_42cf_8400_bd2fc033f7af.slice/crio-3f63f50b2350c49b8cca46489616afc1e5867ea133c5d65c6eb5aa56310238f6 WatchSource:0}: Error finding container 3f63f50b2350c49b8cca46489616afc1e5867ea133c5d65c6eb5aa56310238f6: Status 404 returned error can't find the container with id 3f63f50b2350c49b8cca46489616afc1e5867ea133c5d65c6eb5aa56310238f6
Jul 23 00:08:40.648063 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:40.648036    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vgw4k" event={"ID":"d7100866-dd6a-42cf-8400-bd2fc033f7af","Type":"ContainerStarted","Data":"3f63f50b2350c49b8cca46489616afc1e5867ea133c5d65c6eb5aa56310238f6"}
Jul 23 00:08:42.103000 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:42.102942    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-dkdpg"]
Jul 23 00:08:42.105201 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:42.105181    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-dkdpg"
Jul 23 00:08:42.108890 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:42.108749    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 23 00:08:42.108890 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:42.108773    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-tkpn5\""
Jul 23 00:08:42.108890 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:42.108791    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 23 00:08:42.108890 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:42.108804    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 23 00:08:42.108890 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:42.108815    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 23 00:08:42.109185 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:42.108978    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 23 00:08:42.114485 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:42.114415    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-dkdpg"]
Jul 23 00:08:42.269537 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:42.269501    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf01ae28-c43e-400c-8123-86ab08e9d518-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-dkdpg\" (UID: \"bf01ae28-c43e-400c-8123-86ab08e9d518\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-dkdpg"
Jul 23 00:08:42.269686 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:42.269571    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bf01ae28-c43e-400c-8123-86ab08e9d518-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-dkdpg\" (UID: \"bf01ae28-c43e-400c-8123-86ab08e9d518\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-dkdpg"
Jul 23 00:08:42.269686 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:42.269625    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9kmk\" (UniqueName: \"kubernetes.io/projected/bf01ae28-c43e-400c-8123-86ab08e9d518-kube-api-access-v9kmk\") pod \"prometheus-operator-5945b5cfd-dkdpg\" (UID: \"bf01ae28-c43e-400c-8123-86ab08e9d518\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-dkdpg"
Jul 23 00:08:42.269686 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:42.269668    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bf01ae28-c43e-400c-8123-86ab08e9d518-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-dkdpg\" (UID: \"bf01ae28-c43e-400c-8123-86ab08e9d518\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-dkdpg"
Jul 23 00:08:42.370107 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:42.370029    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf01ae28-c43e-400c-8123-86ab08e9d518-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-dkdpg\" (UID: \"bf01ae28-c43e-400c-8123-86ab08e9d518\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-dkdpg"
Jul 23 00:08:42.370107 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:42.370068    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bf01ae28-c43e-400c-8123-86ab08e9d518-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-dkdpg\" (UID: \"bf01ae28-c43e-400c-8123-86ab08e9d518\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-dkdpg"
Jul 23 00:08:42.370107 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:42.370095    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9kmk\" (UniqueName: \"kubernetes.io/projected/bf01ae28-c43e-400c-8123-86ab08e9d518-kube-api-access-v9kmk\") pod \"prometheus-operator-5945b5cfd-dkdpg\" (UID: \"bf01ae28-c43e-400c-8123-86ab08e9d518\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-dkdpg"
Jul 23 00:08:42.370367 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:42.370134    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bf01ae28-c43e-400c-8123-86ab08e9d518-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-dkdpg\" (UID: \"bf01ae28-c43e-400c-8123-86ab08e9d518\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-dkdpg"
Jul 23 00:08:42.370367 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:08:42.370239    2549 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 23 00:08:42.370367 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:08:42.370302    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf01ae28-c43e-400c-8123-86ab08e9d518-prometheus-operator-tls podName:bf01ae28-c43e-400c-8123-86ab08e9d518 nodeName:}" failed. No retries permitted until 2026-07-23 00:08:42.87028404 +0000 UTC m=+265.631482346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/bf01ae28-c43e-400c-8123-86ab08e9d518-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-dkdpg" (UID: "bf01ae28-c43e-400c-8123-86ab08e9d518") : secret "prometheus-operator-tls" not found
Jul 23 00:08:42.370883 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:42.370857    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf01ae28-c43e-400c-8123-86ab08e9d518-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-dkdpg\" (UID: \"bf01ae28-c43e-400c-8123-86ab08e9d518\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-dkdpg"
Jul 23 00:08:42.372764 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:42.372742    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bf01ae28-c43e-400c-8123-86ab08e9d518-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-dkdpg\" (UID: \"bf01ae28-c43e-400c-8123-86ab08e9d518\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-dkdpg"
Jul 23 00:08:42.379184 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:42.379162    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9kmk\" (UniqueName: \"kubernetes.io/projected/bf01ae28-c43e-400c-8123-86ab08e9d518-kube-api-access-v9kmk\") pod \"prometheus-operator-5945b5cfd-dkdpg\" (UID: \"bf01ae28-c43e-400c-8123-86ab08e9d518\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-dkdpg"
Jul 23 00:08:42.876020 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:42.875816    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bf01ae28-c43e-400c-8123-86ab08e9d518-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-dkdpg\" (UID: \"bf01ae28-c43e-400c-8123-86ab08e9d518\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-dkdpg"
Jul 23 00:08:42.880326 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:42.880284    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bf01ae28-c43e-400c-8123-86ab08e9d518-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-dkdpg\" (UID: \"bf01ae28-c43e-400c-8123-86ab08e9d518\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-dkdpg"
Jul 23 00:08:43.016977 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:43.016940    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-dkdpg"
Jul 23 00:08:45.452907 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:45.452877    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-dkdpg"]
Jul 23 00:08:45.455635 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:08:45.455606    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf01ae28_c43e_400c_8123_86ab08e9d518.slice/crio-89abd9b3fd9248e710988d4eab23cc9f5794b234890ccaf0f842e51008b1d9bf WatchSource:0}: Error finding container 89abd9b3fd9248e710988d4eab23cc9f5794b234890ccaf0f842e51008b1d9bf: Status 404 returned error can't find the container with id 89abd9b3fd9248e710988d4eab23cc9f5794b234890ccaf0f842e51008b1d9bf
Jul 23 00:08:45.665293 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:45.665188    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-dkdpg" event={"ID":"bf01ae28-c43e-400c-8123-86ab08e9d518","Type":"ContainerStarted","Data":"89abd9b3fd9248e710988d4eab23cc9f5794b234890ccaf0f842e51008b1d9bf"}
Jul 23 00:08:45.666691 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:45.666654    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vgw4k" event={"ID":"d7100866-dd6a-42cf-8400-bd2fc033f7af","Type":"ContainerStarted","Data":"0e7688d8ddd85dd10ab643928d2dca7b5f262a739842b3cf2fd5437529cfe55f"}
Jul 23 00:08:49.683653 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:49.683610    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-dkdpg" event={"ID":"bf01ae28-c43e-400c-8123-86ab08e9d518","Type":"ContainerStarted","Data":"3dd3dbec45f4a4645f824c923ebc95f710b90a6fb319dc221bd2a0f2c821f1e9"}
Jul 23 00:08:49.684162 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:49.683723    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-dkdpg" event={"ID":"bf01ae28-c43e-400c-8123-86ab08e9d518","Type":"ContainerStarted","Data":"620aead322f499505efc0f3eabb588aad454807aafc1533e6392904fc966dff4"}
Jul 23 00:08:49.685712 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:49.685678    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vgw4k" event={"ID":"d7100866-dd6a-42cf-8400-bd2fc033f7af","Type":"ContainerStarted","Data":"f4034cad87a45d1659d974278892b216017edc13d843c64c30a7b2b2ac12241a"}
Jul 23 00:08:49.700469 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:49.700384    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-dkdpg" podStartSLOduration=4.33963437 podStartE2EDuration="7.700362314s" totalImagesPullingTime="3.360727944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:08:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:08:49.698872352 +0000 UTC m=+272.460070662" watchObservedRunningTime="2026-07-23 00:08:49.700362314 +0000 UTC m=+272.461560625"
Jul 23 00:08:51.469562 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:51.469528    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-r5k8z"]
Jul 23 00:08:51.483651 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:51.483624    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r5k8z"
Jul 23 00:08:51.487688 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:51.487652    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 23 00:08:51.487835 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:51.487811    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 23 00:08:51.487942 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:51.487897    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fmrvj\""
Jul 23 00:08:51.488397 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:51.488372    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 23 00:08:51.647558 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:51.647520    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6397fbd7-9bf5-4303-94fe-d4f001d98c45-root\") pod \"node-exporter-r5k8z\" (UID: \"6397fbd7-9bf5-4303-94fe-d4f001d98c45\") " pod="openshift-monitoring/node-exporter-r5k8z"
Jul 23 00:08:51.647558 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:51.647556    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6397fbd7-9bf5-4303-94fe-d4f001d98c45-sys\") pod \"node-exporter-r5k8z\" (UID: \"6397fbd7-9bf5-4303-94fe-d4f001d98c45\") " pod="openshift-monitoring/node-exporter-r5k8z"
Jul 23 00:08:51.647762 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:51.647575    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6397fbd7-9bf5-4303-94fe-d4f001d98c45-metrics-client-ca\") pod \"node-exporter-r5k8z\" (UID: \"6397fbd7-9bf5-4303-94fe-d4f001d98c45\") " pod="openshift-monitoring/node-exporter-r5k8z"
Jul 23 00:08:51.647762 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:51.647599    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6397fbd7-9bf5-4303-94fe-d4f001d98c45-node-exporter-accelerators-collector-config\") pod \"node-exporter-r5k8z\" (UID: \"6397fbd7-9bf5-4303-94fe-d4f001d98c45\") " pod="openshift-monitoring/node-exporter-r5k8z"
Jul 23 00:08:51.647762 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:51.647626    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6397fbd7-9bf5-4303-94fe-d4f001d98c45-node-exporter-textfile\") pod \"node-exporter-r5k8z\" (UID: \"6397fbd7-9bf5-4303-94fe-d4f001d98c45\") " pod="openshift-monitoring/node-exporter-r5k8z"
Jul 23 00:08:51.647762 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:51.647669    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6397fbd7-9bf5-4303-94fe-d4f001d98c45-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r5k8z\" (UID: \"6397fbd7-9bf5-4303-94fe-d4f001d98c45\") " pod="openshift-monitoring/node-exporter-r5k8z"
Jul 23 00:08:51.647762 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:51.647697    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlrz7\" (UniqueName: \"kubernetes.io/projected/6397fbd7-9bf5-4303-94fe-d4f001d98c45-kube-api-access-vlrz7\") pod \"node-exporter-r5k8z\" (UID: \"6397fbd7-9bf5-4303-94fe-d4f001d98c45\") " pod="openshift-monitoring/node-exporter-r5k8z"
Jul 23 00:08:51.647959 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:51.647774    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6397fbd7-9bf5-4303-94fe-d4f001d98c45-node-exporter-wtmp\") pod \"node-exporter-r5k8z\" (UID: \"6397fbd7-9bf5-4303-94fe-d4f001d98c45\") " pod="openshift-monitoring/node-exporter-r5k8z"
Jul 23 00:08:51.647959 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:51.647816    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6397fbd7-9bf5-4303-94fe-d4f001d98c45-node-exporter-tls\") pod \"node-exporter-r5k8z\" (UID: \"6397fbd7-9bf5-4303-94fe-d4f001d98c45\") " pod="openshift-monitoring/node-exporter-r5k8z"
Jul 23 00:08:51.749072 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:51.748993    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6397fbd7-9bf5-4303-94fe-d4f001d98c45-node-exporter-wtmp\") pod \"node-exporter-r5k8z\" (UID: \"6397fbd7-9bf5-4303-94fe-d4f001d98c45\") " pod="openshift-monitoring/node-exporter-r5k8z"
Jul 23 00:08:51.749072 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:51.749041    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6397fbd7-9bf5-4303-94fe-d4f001d98c45-node-exporter-tls\") pod \"node-exporter-r5k8z\" (UID: \"6397fbd7-9bf5-4303-94fe-d4f001d98c45\") " pod="openshift-monitoring/node-exporter-r5k8z"
Jul 23 00:08:51.749289 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:51.749098    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6397fbd7-9bf5-4303-94fe-d4f001d98c45-root\") pod \"node-exporter-r5k8z\" (UID: \"6397fbd7-9bf5-4303-94fe-d4f001d98c45\") " pod="openshift-monitoring/node-exporter-r5k8z"
Jul 23 00:08:51.749289 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:51.749119    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6397fbd7-9bf5-4303-94fe-d4f001d98c45-sys\") pod \"node-exporter-r5k8z\" (UID: \"6397fbd7-9bf5-4303-94fe-d4f001d98c45\") " pod="openshift-monitoring/node-exporter-r5k8z"
Jul 23 00:08:51.749289 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:51.749142    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6397fbd7-9bf5-4303-94fe-d4f001d98c45-metrics-client-ca\") pod \"node-exporter-r5k8z\" (UID: \"6397fbd7-9bf5-4303-94fe-d4f001d98c45\") " pod="openshift-monitoring/node-exporter-r5k8z"
Jul 23 00:08:51.749289 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:51.749170    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6397fbd7-9bf5-4303-94fe-d4f001d98c45-node-exporter-accelerators-collector-config\") pod \"node-exporter-r5k8z\" (UID: \"6397fbd7-9bf5-4303-94fe-d4f001d98c45\") " pod="openshift-monitoring/node-exporter-r5k8z"
Jul 23 00:08:51.749289 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:51.749183    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6397fbd7-9bf5-4303-94fe-d4f001d98c45-node-exporter-wtmp\") pod \"node-exporter-r5k8z\" (UID: \"6397fbd7-9bf5-4303-94fe-d4f001d98c45\") " pod="openshift-monitoring/node-exporter-r5k8z"
Jul 23 00:08:51.749289 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:51.749206    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6397fbd7-9bf5-4303-94fe-d4f001d98c45-node-exporter-textfile\") pod \"node-exporter-r5k8z\" (UID: \"6397fbd7-9bf5-4303-94fe-d4f001d98c45\") " pod="openshift-monitoring/node-exporter-r5k8z"
Jul 23 00:08:51.749289 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:51.749208    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6397fbd7-9bf5-4303-94fe-d4f001d98c45-sys\") pod \"node-exporter-r5k8z\" (UID: \"6397fbd7-9bf5-4303-94fe-d4f001d98c45\") " pod="openshift-monitoring/node-exporter-r5k8z"
Jul 23 00:08:51.749289 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:51.749215    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6397fbd7-9bf5-4303-94fe-d4f001d98c45-root\") pod \"node-exporter-r5k8z\" (UID: \"6397fbd7-9bf5-4303-94fe-d4f001d98c45\") " pod="openshift-monitoring/node-exporter-r5k8z"
Jul 23 00:08:51.749289 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:51.749269    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6397fbd7-9bf5-4303-94fe-d4f001d98c45-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r5k8z\" (UID: \"6397fbd7-9bf5-4303-94fe-d4f001d98c45\") " pod="openshift-monitoring/node-exporter-r5k8z"
Jul 23 00:08:51.749742 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:08:51.749297    2549 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 23 00:08:51.749742 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:08:51.749369    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6397fbd7-9bf5-4303-94fe-d4f001d98c45-node-exporter-tls podName:6397fbd7-9bf5-4303-94fe-d4f001d98c45 nodeName:}" failed. No retries permitted until 2026-07-23 00:08:52.24934879 +0000 UTC m=+275.010547081 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6397fbd7-9bf5-4303-94fe-d4f001d98c45-node-exporter-tls") pod "node-exporter-r5k8z" (UID: "6397fbd7-9bf5-4303-94fe-d4f001d98c45") : secret "node-exporter-tls" not found
Jul 23 00:08:51.749742 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:51.749299    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlrz7\" (UniqueName: \"kubernetes.io/projected/6397fbd7-9bf5-4303-94fe-d4f001d98c45-kube-api-access-vlrz7\") pod \"node-exporter-r5k8z\" (UID: \"6397fbd7-9bf5-4303-94fe-d4f001d98c45\") " pod="openshift-monitoring/node-exporter-r5k8z"
Jul 23 00:08:51.749742 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:51.749535    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6397fbd7-9bf5-4303-94fe-d4f001d98c45-node-exporter-textfile\") pod \"node-exporter-r5k8z\" (UID: \"6397fbd7-9bf5-4303-94fe-d4f001d98c45\") " pod="openshift-monitoring/node-exporter-r5k8z"
Jul 23 00:08:51.749932 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:51.749845    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6397fbd7-9bf5-4303-94fe-d4f001d98c45-metrics-client-ca\") pod \"node-exporter-r5k8z\" (UID: \"6397fbd7-9bf5-4303-94fe-d4f001d98c45\") " pod="openshift-monitoring/node-exporter-r5k8z"
Jul 23 00:08:51.749932 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:51.749833    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6397fbd7-9bf5-4303-94fe-d4f001d98c45-node-exporter-accelerators-collector-config\") pod \"node-exporter-r5k8z\" (UID: \"6397fbd7-9bf5-4303-94fe-d4f001d98c45\") " pod="openshift-monitoring/node-exporter-r5k8z"
Jul 23 00:08:51.751910 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:51.751885    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6397fbd7-9bf5-4303-94fe-d4f001d98c45-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r5k8z\" (UID: \"6397fbd7-9bf5-4303-94fe-d4f001d98c45\") " pod="openshift-monitoring/node-exporter-r5k8z"
Jul 23 00:08:51.757586 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:51.757560    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlrz7\" (UniqueName: \"kubernetes.io/projected/6397fbd7-9bf5-4303-94fe-d4f001d98c45-kube-api-access-vlrz7\") pod \"node-exporter-r5k8z\" (UID: \"6397fbd7-9bf5-4303-94fe-d4f001d98c45\") " pod="openshift-monitoring/node-exporter-r5k8z"
Jul 23 00:08:52.253406 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:52.253368    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6397fbd7-9bf5-4303-94fe-d4f001d98c45-node-exporter-tls\") pod \"node-exporter-r5k8z\" (UID: \"6397fbd7-9bf5-4303-94fe-d4f001d98c45\") " pod="openshift-monitoring/node-exporter-r5k8z"
Jul 23 00:08:52.255635 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:52.255614    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6397fbd7-9bf5-4303-94fe-d4f001d98c45-node-exporter-tls\") pod \"node-exporter-r5k8z\" (UID: \"6397fbd7-9bf5-4303-94fe-d4f001d98c45\") " pod="openshift-monitoring/node-exporter-r5k8z"
Jul 23 00:08:52.394593 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:52.394567    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r5k8z"
Jul 23 00:08:52.699555 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:52.699510    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vgw4k" event={"ID":"d7100866-dd6a-42cf-8400-bd2fc033f7af","Type":"ContainerStarted","Data":"d4867af09355eb38c536680b0b394525368731f55158138935fd6e88ab2a0b53"}
Jul 23 00:08:52.700621 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:52.700599    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r5k8z" event={"ID":"6397fbd7-9bf5-4303-94fe-d4f001d98c45","Type":"ContainerStarted","Data":"6760eb92d77b152fe446b51b691e3b63fda9672046bbfe31992d9d33671a4a99"}
Jul 23 00:08:52.717275 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:52.717231    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vgw4k" podStartSLOduration=32.958559831 podStartE2EDuration="44.717216241s" totalImagesPullingTime="11.75865641s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 00:08:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:08:52.71664539 +0000 UTC m=+275.477843702" watchObservedRunningTime="2026-07-23 00:08:52.717216241 +0000 UTC m=+275.478414550"
Jul 23 00:08:53.523323 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:53.523285    2549 patch_prober.go:28] interesting pod/image-registry-5d546949f9-hzd8r container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 23 00:08:53.523521 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:53.523353    2549 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5d546949f9-hzd8r" podUID="340b9647-c773-4998-84f6-4cdcadbc302b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 00:08:53.706849 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:53.706040    2549 generic.go:356] "Generic (PLEG): container finished" podID="6397fbd7-9bf5-4303-94fe-d4f001d98c45" containerID="b72401ecbe306cbbcd8a1fe1da8ec4483f0e594a115933fa5ab694ad0cedfd9c" exitCode=0
Jul 23 00:08:53.706849 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:53.706706    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r5k8z" event={"ID":"6397fbd7-9bf5-4303-94fe-d4f001d98c45","Type":"ContainerDied","Data":"b72401ecbe306cbbcd8a1fe1da8ec4483f0e594a115933fa5ab694ad0cedfd9c"}
Jul 23 00:08:54.711878 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:54.711835    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r5k8z" event={"ID":"6397fbd7-9bf5-4303-94fe-d4f001d98c45","Type":"ContainerStarted","Data":"5620940456a7f8dab78a3288e04c896a81cc3e3a8340c378d72f1215fbb9ffc3"}
Jul 23 00:08:54.712369 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:54.711898    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r5k8z" event={"ID":"6397fbd7-9bf5-4303-94fe-d4f001d98c45","Type":"ContainerStarted","Data":"d7580862e00903c60726358e557e00ec7bd52c34795826a696e10ab2b101c056"}
Jul 23 00:08:54.730814 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:54.730754    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-r5k8z" podStartSLOduration=2.517020379 podStartE2EDuration="3.73073527s" totalImagesPullingTime="1.148213728s" totalInitContainerRuntime="65.501163ms" isStatefulPod=true podCreationTimestamp="2026-07-23 00:08:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:08:54.730048504 +0000 UTC m=+277.491246814" watchObservedRunningTime="2026-07-23 00:08:54.73073527 +0000 UTC m=+277.491933580"
Jul 23 00:08:55.636027 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:55.635992    2549 patch_prober.go:28] interesting pod/image-registry-5d546949f9-hzd8r container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 23 00:08:55.636211 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:55.636045    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5d546949f9-hzd8r" podUID="340b9647-c773-4998-84f6-4cdcadbc302b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 00:08:56.210648 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:56.210619    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-fhfl6"]
Jul 23 00:08:56.213734 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:56.213716    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-fhfl6"
Jul 23 00:08:56.215884 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:56.215857    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 23 00:08:56.216068 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:56.216056    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-jthpq\""
Jul 23 00:08:56.221753 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:56.221732    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-fhfl6"]
Jul 23 00:08:56.284604 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:56.284567    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gm7j\" (UniqueName: \"kubernetes.io/projected/11dd8ecb-e4c0-4632-87df-7557b28abf8d-kube-api-access-7gm7j\") pod \"monitoring-plugin-7b7b7bc8bf-fhfl6\" (UID: \"11dd8ecb-e4c0-4632-87df-7557b28abf8d\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-fhfl6"
Jul 23 00:08:56.284697 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:56.284614    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/11dd8ecb-e4c0-4632-87df-7557b28abf8d-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-fhfl6\" (UID: \"11dd8ecb-e4c0-4632-87df-7557b28abf8d\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-fhfl6"
Jul 23 00:08:56.385885 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:56.385854    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gm7j\" (UniqueName: \"kubernetes.io/projected/11dd8ecb-e4c0-4632-87df-7557b28abf8d-kube-api-access-7gm7j\") pod \"monitoring-plugin-7b7b7bc8bf-fhfl6\" (UID: \"11dd8ecb-e4c0-4632-87df-7557b28abf8d\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-fhfl6"
Jul 23 00:08:56.385973 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:56.385897    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/11dd8ecb-e4c0-4632-87df-7557b28abf8d-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-fhfl6\" (UID: \"11dd8ecb-e4c0-4632-87df-7557b28abf8d\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-fhfl6"
Jul 23 00:08:56.386016 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:08:56.386005    2549 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 23 00:08:56.386074 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:08:56.386063    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11dd8ecb-e4c0-4632-87df-7557b28abf8d-monitoring-plugin-cert podName:11dd8ecb-e4c0-4632-87df-7557b28abf8d nodeName:}" failed. No retries permitted until 2026-07-23 00:08:56.886045707 +0000 UTC m=+279.647243998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/11dd8ecb-e4c0-4632-87df-7557b28abf8d-monitoring-plugin-cert") pod "monitoring-plugin-7b7b7bc8bf-fhfl6" (UID: "11dd8ecb-e4c0-4632-87df-7557b28abf8d") : secret "monitoring-plugin-cert" not found
Jul 23 00:08:56.394019 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:56.393998    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gm7j\" (UniqueName: \"kubernetes.io/projected/11dd8ecb-e4c0-4632-87df-7557b28abf8d-kube-api-access-7gm7j\") pod \"monitoring-plugin-7b7b7bc8bf-fhfl6\" (UID: \"11dd8ecb-e4c0-4632-87df-7557b28abf8d\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-fhfl6"
Jul 23 00:08:56.889965 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:56.889917    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/11dd8ecb-e4c0-4632-87df-7557b28abf8d-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-fhfl6\" (UID: \"11dd8ecb-e4c0-4632-87df-7557b28abf8d\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-fhfl6"
Jul 23 00:08:56.892384 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:56.892358    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/11dd8ecb-e4c0-4632-87df-7557b28abf8d-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-fhfl6\" (UID: \"11dd8ecb-e4c0-4632-87df-7557b28abf8d\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-fhfl6"
Jul 23 00:08:57.123520 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:57.123473    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-fhfl6"
Jul 23 00:08:57.242532 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:57.242502    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-fhfl6"]
Jul 23 00:08:57.245365 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:08:57.245339    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11dd8ecb_e4c0_4632_87df_7557b28abf8d.slice/crio-55047d3c7278b910ebd36fb2d031c2a0baf41f4593fb4ee816028a5ab2848d98 WatchSource:0}: Error finding container 55047d3c7278b910ebd36fb2d031c2a0baf41f4593fb4ee816028a5ab2848d98: Status 404 returned error can't find the container with id 55047d3c7278b910ebd36fb2d031c2a0baf41f4593fb4ee816028a5ab2848d98
Jul 23 00:08:57.723170 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:57.723133    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-fhfl6" event={"ID":"11dd8ecb-e4c0-4632-87df-7557b28abf8d","Type":"ContainerStarted","Data":"55047d3c7278b910ebd36fb2d031c2a0baf41f4593fb4ee816028a5ab2848d98"}
Jul 23 00:08:59.731312 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:59.731276    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-fhfl6" event={"ID":"11dd8ecb-e4c0-4632-87df-7557b28abf8d","Type":"ContainerStarted","Data":"45401548116b921bdba3dfc55c01f3ca12edd131891227cac9b6c74a3d1dd0b2"}
Jul 23 00:08:59.731791 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:59.731428    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-fhfl6"
Jul 23 00:08:59.736067 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:59.736042    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-fhfl6"
Jul 23 00:08:59.746597 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:08:59.746555    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-fhfl6" podStartSLOduration=2.178701526 podStartE2EDuration="3.746542197s" totalImagesPullingTime="1.567840671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:08:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:08:59.745309131 +0000 UTC m=+282.506507441" watchObservedRunningTime="2026-07-23 00:08:59.746542197 +0000 UTC m=+282.507740506"
Jul 23 00:09:00.341254 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:09:00.341206    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-tnhnq" podUID="9b10668c-fed1-431f-bd1e-e18e59098619"
Jul 23 00:09:00.734542 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:00.734471    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tnhnq"
Jul 23 00:09:03.523037 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:03.522995    2549 patch_prober.go:28] interesting pod/image-registry-5d546949f9-hzd8r container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 23 00:09:03.523390 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:03.523050    2549 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5d546949f9-hzd8r" podUID="340b9647-c773-4998-84f6-4cdcadbc302b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 00:09:03.742086 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:03.742051    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b10668c-fed1-431f-bd1e-e18e59098619-metrics-tls\") pod \"dns-default-tnhnq\" (UID: \"9b10668c-fed1-431f-bd1e-e18e59098619\") " pod="openshift-dns/dns-default-tnhnq"
Jul 23 00:09:03.744391 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:03.744362    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b10668c-fed1-431f-bd1e-e18e59098619-metrics-tls\") pod \"dns-default-tnhnq\" (UID: \"9b10668c-fed1-431f-bd1e-e18e59098619\") " pod="openshift-dns/dns-default-tnhnq"
Jul 23 00:09:04.037732 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:04.037708    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6vlrt\""
Jul 23 00:09:04.045608 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:04.045587    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tnhnq"
Jul 23 00:09:04.166421 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:04.166396    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tnhnq"]
Jul 23 00:09:04.169202 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:09:04.169175    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b10668c_fed1_431f_bd1e_e18e59098619.slice/crio-3b8981b6bcb73f4ff6b5851f9631ef248ed15a18a0bce48d8e51c9d144d04bbc WatchSource:0}: Error finding container 3b8981b6bcb73f4ff6b5851f9631ef248ed15a18a0bce48d8e51c9d144d04bbc: Status 404 returned error can't find the container with id 3b8981b6bcb73f4ff6b5851f9631ef248ed15a18a0bce48d8e51c9d144d04bbc
Jul 23 00:09:04.749649 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:04.749599    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tnhnq" event={"ID":"9b10668c-fed1-431f-bd1e-e18e59098619","Type":"ContainerStarted","Data":"3b8981b6bcb73f4ff6b5851f9631ef248ed15a18a0bce48d8e51c9d144d04bbc"}
Jul 23 00:09:05.636746 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:05.636710    2549 patch_prober.go:28] interesting pod/image-registry-5d546949f9-hzd8r container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 23 00:09:05.636932 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:05.636771    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5d546949f9-hzd8r" podUID="340b9647-c773-4998-84f6-4cdcadbc302b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 00:09:06.064168 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:06.064139    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-68bb8667-w6nrd"]
Jul 23 00:09:06.067169 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:06.067153    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68bb8667-w6nrd"
Jul 23 00:09:06.069505 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:06.069483    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 23 00:09:06.070528 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:06.070504    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 23 00:09:06.070528 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:06.070521    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 23 00:09:06.070688 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:06.070537    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 23 00:09:06.070688 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:06.070589    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 23 00:09:06.070688 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:06.070614    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 23 00:09:06.070688 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:06.070512    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-dgbq4\""
Jul 23 00:09:06.070688 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:06.070525    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 23 00:09:06.075201 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:06.075183    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 23 00:09:06.080158 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:06.080135    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68bb8667-w6nrd"]
Jul 23 00:09:06.159738 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:06.159672    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-console-config\") pod \"console-68bb8667-w6nrd\" (UID: \"ae5ad91a-106d-4b9b-b8ff-fc5029d315a3\") " pod="openshift-console/console-68bb8667-w6nrd"
Jul 23 00:09:06.159738 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:06.159705    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-trusted-ca-bundle\") pod \"console-68bb8667-w6nrd\" (UID: \"ae5ad91a-106d-4b9b-b8ff-fc5029d315a3\") " pod="openshift-console/console-68bb8667-w6nrd"
Jul 23 00:09:06.159930 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:06.159739    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-oauth-serving-cert\") pod \"console-68bb8667-w6nrd\" (UID: \"ae5ad91a-106d-4b9b-b8ff-fc5029d315a3\") " pod="openshift-console/console-68bb8667-w6nrd"
Jul 23 00:09:06.159930 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:06.159843    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-console-oauth-config\") pod \"console-68bb8667-w6nrd\" (UID: \"ae5ad91a-106d-4b9b-b8ff-fc5029d315a3\") " pod="openshift-console/console-68bb8667-w6nrd"
Jul 23 00:09:06.159930 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:06.159874    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml4k8\" (UniqueName: \"kubernetes.io/projected/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-kube-api-access-ml4k8\") pod \"console-68bb8667-w6nrd\" (UID: \"ae5ad91a-106d-4b9b-b8ff-fc5029d315a3\") " pod="openshift-console/console-68bb8667-w6nrd"
Jul 23 00:09:06.159930 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:06.159911    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-console-serving-cert\") pod \"console-68bb8667-w6nrd\" (UID: \"ae5ad91a-106d-4b9b-b8ff-fc5029d315a3\") " pod="openshift-console/console-68bb8667-w6nrd"
Jul 23 00:09:06.160094 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:06.159950    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-service-ca\") pod \"console-68bb8667-w6nrd\" (UID: \"ae5ad91a-106d-4b9b-b8ff-fc5029d315a3\") " pod="openshift-console/console-68bb8667-w6nrd"
Jul 23 00:09:06.260507 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:06.260479    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-oauth-serving-cert\") pod \"console-68bb8667-w6nrd\" (UID: \"ae5ad91a-106d-4b9b-b8ff-fc5029d315a3\") " pod="openshift-console/console-68bb8667-w6nrd"
Jul 23 00:09:06.260634 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:06.260521    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-console-oauth-config\") pod \"console-68bb8667-w6nrd\" (UID: \"ae5ad91a-106d-4b9b-b8ff-fc5029d315a3\") " pod="openshift-console/console-68bb8667-w6nrd"
Jul 23 00:09:06.260634 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:06.260548    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml4k8\" (UniqueName: \"kubernetes.io/projected/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-kube-api-access-ml4k8\") pod \"console-68bb8667-w6nrd\" (UID: \"ae5ad91a-106d-4b9b-b8ff-fc5029d315a3\") " pod="openshift-console/console-68bb8667-w6nrd"
Jul 23 00:09:06.260634 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:06.260578    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-console-serving-cert\") pod \"console-68bb8667-w6nrd\" (UID: \"ae5ad91a-106d-4b9b-b8ff-fc5029d315a3\") " pod="openshift-console/console-68bb8667-w6nrd"
Jul 23 00:09:06.260634 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:06.260609    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-service-ca\") pod \"console-68bb8667-w6nrd\" (UID: \"ae5ad91a-106d-4b9b-b8ff-fc5029d315a3\") " pod="openshift-console/console-68bb8667-w6nrd"
Jul 23 00:09:06.260634 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:06.260633    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-console-config\") pod \"console-68bb8667-w6nrd\" (UID: \"ae5ad91a-106d-4b9b-b8ff-fc5029d315a3\") " pod="openshift-console/console-68bb8667-w6nrd"
Jul 23 00:09:06.260876 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:06.260663    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-trusted-ca-bundle\") pod \"console-68bb8667-w6nrd\" (UID: \"ae5ad91a-106d-4b9b-b8ff-fc5029d315a3\") " pod="openshift-console/console-68bb8667-w6nrd"
Jul 23 00:09:06.261381 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:06.261336    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-console-config\") pod \"console-68bb8667-w6nrd\" (UID: \"ae5ad91a-106d-4b9b-b8ff-fc5029d315a3\") " pod="openshift-console/console-68bb8667-w6nrd"
Jul 23 00:09:06.261381 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:06.261371    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-oauth-serving-cert\") pod \"console-68bb8667-w6nrd\" (UID: \"ae5ad91a-106d-4b9b-b8ff-fc5029d315a3\") " pod="openshift-console/console-68bb8667-w6nrd"
Jul 23 00:09:06.261575 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:06.261466    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-service-ca\") pod \"console-68bb8667-w6nrd\" (UID: \"ae5ad91a-106d-4b9b-b8ff-fc5029d315a3\") " pod="openshift-console/console-68bb8667-w6nrd"
Jul 23 00:09:06.261739 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:06.261718    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-trusted-ca-bundle\") pod \"console-68bb8667-w6nrd\" (UID: \"ae5ad91a-106d-4b9b-b8ff-fc5029d315a3\") " pod="openshift-console/console-68bb8667-w6nrd"
Jul 23 00:09:06.263232 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:06.263210    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-console-oauth-config\") pod \"console-68bb8667-w6nrd\" (UID: \"ae5ad91a-106d-4b9b-b8ff-fc5029d315a3\") " pod="openshift-console/console-68bb8667-w6nrd"
Jul 23 00:09:06.263326 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:06.263287    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-console-serving-cert\") pod \"console-68bb8667-w6nrd\" (UID: \"ae5ad91a-106d-4b9b-b8ff-fc5029d315a3\") " pod="openshift-console/console-68bb8667-w6nrd"
Jul 23 00:09:06.268227 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:06.268181    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml4k8\" (UniqueName: \"kubernetes.io/projected/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-kube-api-access-ml4k8\") pod \"console-68bb8667-w6nrd\" (UID: \"ae5ad91a-106d-4b9b-b8ff-fc5029d315a3\") " pod="openshift-console/console-68bb8667-w6nrd"
Jul 23 00:09:06.376946 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:06.376895    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68bb8667-w6nrd"
Jul 23 00:09:06.503692 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:06.503658    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68bb8667-w6nrd"]
Jul 23 00:09:06.506444 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:09:06.506417    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae5ad91a_106d_4b9b_b8ff_fc5029d315a3.slice/crio-2d3ceefcc750ca1ee4d86e302fc9e4da14449e4c045ce5482bb4c20ac7a13ab6 WatchSource:0}: Error finding container 2d3ceefcc750ca1ee4d86e302fc9e4da14449e4c045ce5482bb4c20ac7a13ab6: Status 404 returned error can't find the container with id 2d3ceefcc750ca1ee4d86e302fc9e4da14449e4c045ce5482bb4c20ac7a13ab6
Jul 23 00:09:06.759594 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:06.759427    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tnhnq" event={"ID":"9b10668c-fed1-431f-bd1e-e18e59098619","Type":"ContainerStarted","Data":"4761770e0808705fdc319354df1ed016f3e48b8d7c3e63b14b462501d1acb7b2"}
Jul 23 00:09:06.759594 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:06.759558    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tnhnq"
Jul 23 00:09:06.759594 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:06.759580    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tnhnq" event={"ID":"9b10668c-fed1-431f-bd1e-e18e59098619","Type":"ContainerStarted","Data":"706e45b033987c6fc1e2bf5fc41997419b79f7ec1a43b25253b348bfbf1cc8b1"}
Jul 23 00:09:06.760767 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:06.760739    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68bb8667-w6nrd" event={"ID":"ae5ad91a-106d-4b9b-b8ff-fc5029d315a3","Type":"ContainerStarted","Data":"2d3ceefcc750ca1ee4d86e302fc9e4da14449e4c045ce5482bb4c20ac7a13ab6"}
Jul 23 00:09:06.778077 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:06.778028    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tnhnq" podStartSLOduration=252.096508325 podStartE2EDuration="4m13.778012731s" totalImagesPullingTime="1.681504406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:04:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:09:06.777203652 +0000 UTC m=+289.538401962" watchObservedRunningTime="2026-07-23 00:09:06.778012731 +0000 UTC m=+289.539211041"
Jul 23 00:09:09.773257 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:09.773173    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68bb8667-w6nrd" event={"ID":"ae5ad91a-106d-4b9b-b8ff-fc5029d315a3","Type":"ContainerStarted","Data":"94b68a1f2f6fd8fc809a1daadd97e309411ea43ce51e21b751ba111c3810ba89"}
Jul 23 00:09:09.791494 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:09.791430    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-68bb8667-w6nrd" podStartSLOduration=0.95094251 podStartE2EDuration="3.791413153s" totalImagesPullingTime="2.840470643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:09:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:09:09.789497455 +0000 UTC m=+292.550695762" watchObservedRunningTime="2026-07-23 00:09:09.791413153 +0000 UTC m=+292.552611463"
Jul 23 00:09:13.523037 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:13.523003    2549 patch_prober.go:28] interesting pod/image-registry-5d546949f9-hzd8r container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 23 00:09:13.523571 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:13.523059    2549 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5d546949f9-hzd8r" podUID="340b9647-c773-4998-84f6-4cdcadbc302b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 00:09:13.523571 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:13.523105    2549 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-5d546949f9-hzd8r"
Jul 23 00:09:13.523696 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:13.523657    2549 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"1d8fb8f138edd30b3c3f32a4045b1a316d251d2756517bdbb96f525ebae23994"} pod="openshift-image-registry/image-registry-5d546949f9-hzd8r" containerMessage="Container registry failed liveness probe, will be restarted"
Jul 23 00:09:13.527029 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:13.526999    2549 patch_prober.go:28] interesting pod/image-registry-5d546949f9-hzd8r container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 23 00:09:13.527148 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:13.527054    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5d546949f9-hzd8r" podUID="340b9647-c773-4998-84f6-4cdcadbc302b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 00:09:14.076712 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:14.076673    2549 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d979fdd5-l5djb" podUID="e5d437ee-ca8b-4155-8b8b-885170dc3b0f" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 23 00:09:16.377919 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:16.377882    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-68bb8667-w6nrd"
Jul 23 00:09:16.378398 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:16.377980    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68bb8667-w6nrd"
Jul 23 00:09:16.382766 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:16.382744    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-68bb8667-w6nrd"
Jul 23 00:09:16.766538 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:16.766441    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tnhnq"
Jul 23 00:09:16.805922 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:16.805895    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-68bb8667-w6nrd"
Jul 23 00:09:17.631781 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:17.631749    2549 kubelet.go:1648] "Image garbage collection succeeded"
Jul 23 00:09:23.528198 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:23.528166    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d546949f9-hzd8r"
Jul 23 00:09:24.077177 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:24.077135    2549 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d979fdd5-l5djb" podUID="e5d437ee-ca8b-4155-8b8b-885170dc3b0f" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 23 00:09:34.077036 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:34.076994    2549 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d979fdd5-l5djb" podUID="e5d437ee-ca8b-4155-8b8b-885170dc3b0f" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 23 00:09:34.077519 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:34.077082    2549 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d979fdd5-l5djb"
Jul 23 00:09:34.077707 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:34.077684    2549 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"78b9efb70932585b8f5312446b56f3fe0cef93d41e3045460272df0fee72b62c"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d979fdd5-l5djb" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 23 00:09:34.077781 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:34.077735    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d979fdd5-l5djb" podUID="e5d437ee-ca8b-4155-8b8b-885170dc3b0f" containerName="service-proxy" containerID="cri-o://78b9efb70932585b8f5312446b56f3fe0cef93d41e3045460272df0fee72b62c" gracePeriod=30
Jul 23 00:09:34.858735 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:34.858698    2549 generic.go:356] "Generic (PLEG): container finished" podID="e5d437ee-ca8b-4155-8b8b-885170dc3b0f" containerID="78b9efb70932585b8f5312446b56f3fe0cef93d41e3045460272df0fee72b62c" exitCode=2
Jul 23 00:09:34.858921 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:34.858770    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d979fdd5-l5djb" event={"ID":"e5d437ee-ca8b-4155-8b8b-885170dc3b0f","Type":"ContainerDied","Data":"78b9efb70932585b8f5312446b56f3fe0cef93d41e3045460272df0fee72b62c"}
Jul 23 00:09:34.858921 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:34.858813    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d979fdd5-l5djb" event={"ID":"e5d437ee-ca8b-4155-8b8b-885170dc3b0f","Type":"ContainerStarted","Data":"62b81b6f40178b8f0ab7457cbb325351335358a99ecac1a944713859efbe8de1"}
Jul 23 00:09:38.543183 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:38.543138    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5d546949f9-hzd8r" podUID="340b9647-c773-4998-84f6-4cdcadbc302b" containerName="registry" containerID="cri-o://1d8fb8f138edd30b3c3f32a4045b1a316d251d2756517bdbb96f525ebae23994" gracePeriod=30
Jul 23 00:09:39.879075 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:39.878985    2549 generic.go:356] "Generic (PLEG): container finished" podID="340b9647-c773-4998-84f6-4cdcadbc302b" containerID="1d8fb8f138edd30b3c3f32a4045b1a316d251d2756517bdbb96f525ebae23994" exitCode=0
Jul 23 00:09:39.879437 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:39.879071    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d546949f9-hzd8r" event={"ID":"340b9647-c773-4998-84f6-4cdcadbc302b","Type":"ContainerDied","Data":"1d8fb8f138edd30b3c3f32a4045b1a316d251d2756517bdbb96f525ebae23994"}
Jul 23 00:09:39.879437 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:39.879141    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d546949f9-hzd8r" event={"ID":"340b9647-c773-4998-84f6-4cdcadbc302b","Type":"ContainerStarted","Data":"4db231c6be5b30b516a3690c3b051fc7f3c3fa62b8dece6614083ad8fbf9d429"}
Jul 23 00:09:39.879437 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:09:39.879168    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d546949f9-hzd8r"
Jul 23 00:10:00.886436 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:10:00.886407    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d546949f9-hzd8r"
Jul 23 00:10:31.122206 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:10:31.122167    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68bb8667-w6nrd"]
Jul 23 00:10:56.146200 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:10:56.146158    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-68bb8667-w6nrd" podUID="ae5ad91a-106d-4b9b-b8ff-fc5029d315a3" containerName="console" containerID="cri-o://94b68a1f2f6fd8fc809a1daadd97e309411ea43ce51e21b751ba111c3810ba89" gracePeriod=15
Jul 23 00:10:56.383208 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:10:56.383184    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68bb8667-w6nrd"
Jul 23 00:10:56.424990 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:10:56.424912    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-console-config\") pod \"ae5ad91a-106d-4b9b-b8ff-fc5029d315a3\" (UID: \"ae5ad91a-106d-4b9b-b8ff-fc5029d315a3\") "
Jul 23 00:10:56.424990 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:10:56.424946    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-service-ca\") pod \"ae5ad91a-106d-4b9b-b8ff-fc5029d315a3\" (UID: \"ae5ad91a-106d-4b9b-b8ff-fc5029d315a3\") "
Jul 23 00:10:56.424990 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:10:56.424967    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-trusted-ca-bundle\") pod \"ae5ad91a-106d-4b9b-b8ff-fc5029d315a3\" (UID: \"ae5ad91a-106d-4b9b-b8ff-fc5029d315a3\") "
Jul 23 00:10:56.425249 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:10:56.425039    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-console-oauth-config\") pod \"ae5ad91a-106d-4b9b-b8ff-fc5029d315a3\" (UID: \"ae5ad91a-106d-4b9b-b8ff-fc5029d315a3\") "
Jul 23 00:10:56.425249 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:10:56.425064    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ml4k8\" (UniqueName: \"kubernetes.io/projected/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-kube-api-access-ml4k8\") pod \"ae5ad91a-106d-4b9b-b8ff-fc5029d315a3\" (UID: \"ae5ad91a-106d-4b9b-b8ff-fc5029d315a3\") "
Jul 23 00:10:56.425249 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:10:56.425095    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-oauth-serving-cert\") pod \"ae5ad91a-106d-4b9b-b8ff-fc5029d315a3\" (UID: \"ae5ad91a-106d-4b9b-b8ff-fc5029d315a3\") "
Jul 23 00:10:56.425249 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:10:56.425121    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-console-serving-cert\") pod \"ae5ad91a-106d-4b9b-b8ff-fc5029d315a3\" (UID: \"ae5ad91a-106d-4b9b-b8ff-fc5029d315a3\") "
Jul 23 00:10:56.425477 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:10:56.425293    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-console-config" (OuterVolumeSpecName: "console-config") pod "ae5ad91a-106d-4b9b-b8ff-fc5029d315a3" (UID: "ae5ad91a-106d-4b9b-b8ff-fc5029d315a3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:10:56.425477 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:10:56.425364    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ae5ad91a-106d-4b9b-b8ff-fc5029d315a3" (UID: "ae5ad91a-106d-4b9b-b8ff-fc5029d315a3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:10:56.425574 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:10:56.425564    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-service-ca" (OuterVolumeSpecName: "service-ca") pod "ae5ad91a-106d-4b9b-b8ff-fc5029d315a3" (UID: "ae5ad91a-106d-4b9b-b8ff-fc5029d315a3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:10:56.425804 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:10:56.425776    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ae5ad91a-106d-4b9b-b8ff-fc5029d315a3" (UID: "ae5ad91a-106d-4b9b-b8ff-fc5029d315a3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:10:56.427266 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:10:56.427249    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ae5ad91a-106d-4b9b-b8ff-fc5029d315a3" (UID: "ae5ad91a-106d-4b9b-b8ff-fc5029d315a3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 00:10:56.427607 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:10:56.427578    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-kube-api-access-ml4k8" (OuterVolumeSpecName: "kube-api-access-ml4k8") pod "ae5ad91a-106d-4b9b-b8ff-fc5029d315a3" (UID: "ae5ad91a-106d-4b9b-b8ff-fc5029d315a3"). InnerVolumeSpecName "kube-api-access-ml4k8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:10:56.427700 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:10:56.427601    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ae5ad91a-106d-4b9b-b8ff-fc5029d315a3" (UID: "ae5ad91a-106d-4b9b-b8ff-fc5029d315a3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 00:10:56.526076 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:10:56.526051    2549 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-service-ca\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:10:56.526076 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:10:56.526073    2549 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-trusted-ca-bundle\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:10:56.526226 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:10:56.526082    2549 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-console-oauth-config\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:10:56.526226 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:10:56.526092    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ml4k8\" (UniqueName: \"kubernetes.io/projected/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-kube-api-access-ml4k8\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:10:56.526226 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:10:56.526101    2549 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-oauth-serving-cert\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:10:56.526226 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:10:56.526110    2549 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-console-serving-cert\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:10:56.526226 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:10:56.526117    2549 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3-console-config\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:10:57.139059 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:10:57.139025    2549 generic.go:356] "Generic (PLEG): container finished" podID="ae5ad91a-106d-4b9b-b8ff-fc5029d315a3" containerID="94b68a1f2f6fd8fc809a1daadd97e309411ea43ce51e21b751ba111c3810ba89" exitCode=0
Jul 23 00:10:57.139059 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:10:57.139055    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68bb8667-w6nrd" event={"ID":"ae5ad91a-106d-4b9b-b8ff-fc5029d315a3","Type":"ContainerDied","Data":"94b68a1f2f6fd8fc809a1daadd97e309411ea43ce51e21b751ba111c3810ba89"}
Jul 23 00:10:57.139271 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:10:57.139069    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68bb8667-w6nrd"
Jul 23 00:10:57.139271 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:10:57.139115    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68bb8667-w6nrd" event={"ID":"ae5ad91a-106d-4b9b-b8ff-fc5029d315a3","Type":"ContainerDied","Data":"2d3ceefcc750ca1ee4d86e302fc9e4da14449e4c045ce5482bb4c20ac7a13ab6"}
Jul 23 00:10:57.139271 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:10:57.139139    2549 scope.go:117] "RemoveContainer" containerID="94b68a1f2f6fd8fc809a1daadd97e309411ea43ce51e21b751ba111c3810ba89"
Jul 23 00:10:57.147799 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:10:57.147702    2549 scope.go:117] "RemoveContainer" containerID="94b68a1f2f6fd8fc809a1daadd97e309411ea43ce51e21b751ba111c3810ba89"
Jul 23 00:10:57.148033 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:10:57.147964    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94b68a1f2f6fd8fc809a1daadd97e309411ea43ce51e21b751ba111c3810ba89\": container with ID starting with 94b68a1f2f6fd8fc809a1daadd97e309411ea43ce51e21b751ba111c3810ba89 not found: ID does not exist" containerID="94b68a1f2f6fd8fc809a1daadd97e309411ea43ce51e21b751ba111c3810ba89"
Jul 23 00:10:57.148033 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:10:57.147999    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94b68a1f2f6fd8fc809a1daadd97e309411ea43ce51e21b751ba111c3810ba89"} err="failed to get container status \"94b68a1f2f6fd8fc809a1daadd97e309411ea43ce51e21b751ba111c3810ba89\": rpc error: code = NotFound desc = could not find container \"94b68a1f2f6fd8fc809a1daadd97e309411ea43ce51e21b751ba111c3810ba89\": container with ID starting with 94b68a1f2f6fd8fc809a1daadd97e309411ea43ce51e21b751ba111c3810ba89 not found: ID does not exist"
Jul 23 00:10:57.159804 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:10:57.159781    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68bb8667-w6nrd"]
Jul 23 00:10:57.162955 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:10:57.162935    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-68bb8667-w6nrd"]
Jul 23 00:10:57.801555 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:10:57.801526    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae5ad91a-106d-4b9b-b8ff-fc5029d315a3" path="/var/lib/kubelet/pods/ae5ad91a-106d-4b9b-b8ff-fc5029d315a3/volumes"
Jul 23 00:12:46.791201 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:12:46.791160    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2t94"]
Jul 23 00:12:46.791779 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:12:46.791512    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae5ad91a-106d-4b9b-b8ff-fc5029d315a3" containerName="console"
Jul 23 00:12:46.791779 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:12:46.791529    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae5ad91a-106d-4b9b-b8ff-fc5029d315a3" containerName="console"
Jul 23 00:12:46.791779 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:12:46.791620    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae5ad91a-106d-4b9b-b8ff-fc5029d315a3" containerName="console"
Jul 23 00:12:46.794726 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:12:46.794702    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2t94"
Jul 23 00:12:46.797363 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:12:46.797340    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qt6wm\""
Jul 23 00:12:46.797615 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:12:46.797602    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 23 00:12:46.798267 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:12:46.798250    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 23 00:12:46.811152 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:12:46.811131    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2t94"]
Jul 23 00:12:46.886445 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:12:46.886421    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db297740-e589-43b9-a021-76ca476ff5e9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2t94\" (UID: \"db297740-e589-43b9-a021-76ca476ff5e9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2t94"
Jul 23 00:12:46.886553 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:12:46.886469    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjmw8\" (UniqueName: \"kubernetes.io/projected/db297740-e589-43b9-a021-76ca476ff5e9-kube-api-access-zjmw8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2t94\" (UID: \"db297740-e589-43b9-a021-76ca476ff5e9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2t94"
Jul 23 00:12:46.886594 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:12:46.886551    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db297740-e589-43b9-a021-76ca476ff5e9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2t94\" (UID: \"db297740-e589-43b9-a021-76ca476ff5e9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2t94"
Jul 23 00:12:46.987814 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:12:46.987791    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db297740-e589-43b9-a021-76ca476ff5e9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2t94\" (UID: \"db297740-e589-43b9-a021-76ca476ff5e9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2t94"
Jul 23 00:12:46.987909 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:12:46.987829    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db297740-e589-43b9-a021-76ca476ff5e9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2t94\" (UID: \"db297740-e589-43b9-a021-76ca476ff5e9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2t94"
Jul 23 00:12:46.987909 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:12:46.987861    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjmw8\" (UniqueName: \"kubernetes.io/projected/db297740-e589-43b9-a021-76ca476ff5e9-kube-api-access-zjmw8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2t94\" (UID: \"db297740-e589-43b9-a021-76ca476ff5e9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2t94"
Jul 23 00:12:46.988193 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:12:46.988176    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db297740-e589-43b9-a021-76ca476ff5e9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2t94\" (UID: \"db297740-e589-43b9-a021-76ca476ff5e9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2t94"
Jul 23 00:12:46.988233 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:12:46.988180    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db297740-e589-43b9-a021-76ca476ff5e9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2t94\" (UID: \"db297740-e589-43b9-a021-76ca476ff5e9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2t94"
Jul 23 00:12:46.996484 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:12:46.996434    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjmw8\" (UniqueName: \"kubernetes.io/projected/db297740-e589-43b9-a021-76ca476ff5e9-kube-api-access-zjmw8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2t94\" (UID: \"db297740-e589-43b9-a021-76ca476ff5e9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2t94"
Jul 23 00:12:47.103115 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:12:47.103096    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2t94"
Jul 23 00:12:47.226462 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:12:47.226417    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2t94"]
Jul 23 00:12:47.231010 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:12:47.230985    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb297740_e589_43b9_a021_76ca476ff5e9.slice/crio-dfc3518039b75108467c9c08e6da33de49d032a50f6f9590ca28781c34d5c8a2 WatchSource:0}: Error finding container dfc3518039b75108467c9c08e6da33de49d032a50f6f9590ca28781c34d5c8a2: Status 404 returned error can't find the container with id dfc3518039b75108467c9c08e6da33de49d032a50f6f9590ca28781c34d5c8a2
Jul 23 00:12:47.232981 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:12:47.232967    2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 00:12:47.508024 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:12:47.507943    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2t94" event={"ID":"db297740-e589-43b9-a021-76ca476ff5e9","Type":"ContainerStarted","Data":"dfc3518039b75108467c9c08e6da33de49d032a50f6f9590ca28781c34d5c8a2"}
Jul 23 00:12:54.533974 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:12:54.533940    2549 generic.go:356] "Generic (PLEG): container finished" podID="db297740-e589-43b9-a021-76ca476ff5e9" containerID="46d03b82339458df719668ed0ae4f6338fd0c73a2b842606fc3d7204587cb00e" exitCode=0
Jul 23 00:12:54.534344 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:12:54.533985    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2t94" event={"ID":"db297740-e589-43b9-a021-76ca476ff5e9","Type":"ContainerDied","Data":"46d03b82339458df719668ed0ae4f6338fd0c73a2b842606fc3d7204587cb00e"}
Jul 23 00:12:57.546740 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:12:57.546710    2549 generic.go:356] "Generic (PLEG): container finished" podID="db297740-e589-43b9-a021-76ca476ff5e9" containerID="6377e3a0539540f12481780455ca9b85650395434a5bc58a2dd6a8afabc44cb2" exitCode=0
Jul 23 00:12:57.546740 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:12:57.546745    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2t94" event={"ID":"db297740-e589-43b9-a021-76ca476ff5e9","Type":"ContainerDied","Data":"6377e3a0539540f12481780455ca9b85650395434a5bc58a2dd6a8afabc44cb2"}
Jul 23 00:12:58.767008 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:12:58.766975    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-7bd26"]
Jul 23 00:12:58.770043 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:12:58.770020    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-7bd26"
Jul 23 00:12:58.772439 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:12:58.772417    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 23 00:12:58.772572 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:12:58.772478    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-gxjvh\""
Jul 23 00:12:58.773424 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:12:58.773406    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 23 00:12:58.782580 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:12:58.782555    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-7bd26"]
Jul 23 00:12:58.878972 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:12:58.878943    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41569f82-4c9b-4abd-85dd-179c5a8bf871-bound-sa-token\") pod \"cert-manager-55b4d954d5-7bd26\" (UID: \"41569f82-4c9b-4abd-85dd-179c5a8bf871\") " pod="cert-manager/cert-manager-55b4d954d5-7bd26"
Jul 23 00:12:58.879107 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:12:58.879006    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsr7b\" (UniqueName: \"kubernetes.io/projected/41569f82-4c9b-4abd-85dd-179c5a8bf871-kube-api-access-gsr7b\") pod \"cert-manager-55b4d954d5-7bd26\" (UID: \"41569f82-4c9b-4abd-85dd-179c5a8bf871\") " pod="cert-manager/cert-manager-55b4d954d5-7bd26"
Jul 23 00:12:58.980043 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:12:58.980007    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsr7b\" (UniqueName: \"kubernetes.io/projected/41569f82-4c9b-4abd-85dd-179c5a8bf871-kube-api-access-gsr7b\") pod \"cert-manager-55b4d954d5-7bd26\" (UID: \"41569f82-4c9b-4abd-85dd-179c5a8bf871\") " pod="cert-manager/cert-manager-55b4d954d5-7bd26"
Jul 23 00:12:58.980188 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:12:58.980059    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41569f82-4c9b-4abd-85dd-179c5a8bf871-bound-sa-token\") pod \"cert-manager-55b4d954d5-7bd26\" (UID: \"41569f82-4c9b-4abd-85dd-179c5a8bf871\") " pod="cert-manager/cert-manager-55b4d954d5-7bd26"
Jul 23 00:12:58.988670 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:12:58.988617    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41569f82-4c9b-4abd-85dd-179c5a8bf871-bound-sa-token\") pod \"cert-manager-55b4d954d5-7bd26\" (UID: \"41569f82-4c9b-4abd-85dd-179c5a8bf871\") " pod="cert-manager/cert-manager-55b4d954d5-7bd26"
Jul 23 00:12:58.988795 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:12:58.988754    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsr7b\" (UniqueName: \"kubernetes.io/projected/41569f82-4c9b-4abd-85dd-179c5a8bf871-kube-api-access-gsr7b\") pod \"cert-manager-55b4d954d5-7bd26\" (UID: \"41569f82-4c9b-4abd-85dd-179c5a8bf871\") " pod="cert-manager/cert-manager-55b4d954d5-7bd26"
Jul 23 00:12:59.081003 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:12:59.080974    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-7bd26"
Jul 23 00:12:59.218207 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:12:59.218179    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-7bd26"]
Jul 23 00:12:59.220416 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:12:59.220387    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod41569f82_4c9b_4abd_85dd_179c5a8bf871.slice/crio-2168e0ca7946e51dba50b4ec8cc09c9123ed1674b4d782042b1aa95818936a8a WatchSource:0}: Error finding container 2168e0ca7946e51dba50b4ec8cc09c9123ed1674b4d782042b1aa95818936a8a: Status 404 returned error can't find the container with id 2168e0ca7946e51dba50b4ec8cc09c9123ed1674b4d782042b1aa95818936a8a
Jul 23 00:12:59.555088 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:12:59.555009    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-7bd26" event={"ID":"41569f82-4c9b-4abd-85dd-179c5a8bf871","Type":"ContainerStarted","Data":"2168e0ca7946e51dba50b4ec8cc09c9123ed1674b4d782042b1aa95818936a8a"}
Jul 23 00:13:05.581707 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:05.581671    2549 generic.go:356] "Generic (PLEG): container finished" podID="db297740-e589-43b9-a021-76ca476ff5e9" containerID="705eda2a299802e607f91d09ee0d7533014699e9f62ab23232977680037f460f" exitCode=0
Jul 23 00:13:05.582133 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:05.581753    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2t94" event={"ID":"db297740-e589-43b9-a021-76ca476ff5e9","Type":"ContainerDied","Data":"705eda2a299802e607f91d09ee0d7533014699e9f62ab23232977680037f460f"}
Jul 23 00:13:05.583258 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:05.583232    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-7bd26" event={"ID":"41569f82-4c9b-4abd-85dd-179c5a8bf871","Type":"ContainerStarted","Data":"ea1159f8f302cc364a3f8144754ab68bd5b217b10512ca1a7d72340386009231"}
Jul 23 00:13:05.613432 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:05.613389    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-7bd26" podStartSLOduration=2.075191453 podStartE2EDuration="7.613377213s" totalImagesPullingTime="5.53818576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:12:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:13:05.612539216 +0000 UTC m=+528.373737529" watchObservedRunningTime="2026-07-23 00:13:05.613377213 +0000 UTC m=+528.374575523"
Jul 23 00:13:06.710528 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:06.710507    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2t94"
Jul 23 00:13:06.843603 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:06.843508    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db297740-e589-43b9-a021-76ca476ff5e9-bundle\") pod \"db297740-e589-43b9-a021-76ca476ff5e9\" (UID: \"db297740-e589-43b9-a021-76ca476ff5e9\") "
Jul 23 00:13:06.843603 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:06.843602    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db297740-e589-43b9-a021-76ca476ff5e9-util\") pod \"db297740-e589-43b9-a021-76ca476ff5e9\" (UID: \"db297740-e589-43b9-a021-76ca476ff5e9\") "
Jul 23 00:13:06.843788 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:06.843648    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zjmw8\" (UniqueName: \"kubernetes.io/projected/db297740-e589-43b9-a021-76ca476ff5e9-kube-api-access-zjmw8\") pod \"db297740-e589-43b9-a021-76ca476ff5e9\" (UID: \"db297740-e589-43b9-a021-76ca476ff5e9\") "
Jul 23 00:13:06.843932 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:06.843913    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db297740-e589-43b9-a021-76ca476ff5e9-bundle" (OuterVolumeSpecName: "bundle") pod "db297740-e589-43b9-a021-76ca476ff5e9" (UID: "db297740-e589-43b9-a021-76ca476ff5e9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:13:06.845747 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:06.845719    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db297740-e589-43b9-a021-76ca476ff5e9-kube-api-access-zjmw8" (OuterVolumeSpecName: "kube-api-access-zjmw8") pod "db297740-e589-43b9-a021-76ca476ff5e9" (UID: "db297740-e589-43b9-a021-76ca476ff5e9"). InnerVolumeSpecName "kube-api-access-zjmw8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:13:06.847475 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:06.847442    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db297740-e589-43b9-a021-76ca476ff5e9-util" (OuterVolumeSpecName: "util") pod "db297740-e589-43b9-a021-76ca476ff5e9" (UID: "db297740-e589-43b9-a021-76ca476ff5e9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:13:06.944727 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:06.944698    2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db297740-e589-43b9-a021-76ca476ff5e9-util\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:13:06.944727 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:06.944726    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjmw8\" (UniqueName: \"kubernetes.io/projected/db297740-e589-43b9-a021-76ca476ff5e9-kube-api-access-zjmw8\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:13:06.944865 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:06.944741    2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db297740-e589-43b9-a021-76ca476ff5e9-bundle\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:13:07.591403 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:07.591369    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2t94" event={"ID":"db297740-e589-43b9-a021-76ca476ff5e9","Type":"ContainerDied","Data":"dfc3518039b75108467c9c08e6da33de49d032a50f6f9590ca28781c34d5c8a2"}
Jul 23 00:13:07.591403 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:07.591413    2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dfc3518039b75108467c9c08e6da33de49d032a50f6f9590ca28781c34d5c8a2"
Jul 23 00:13:07.591628 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:07.591384    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2t94"
Jul 23 00:13:30.607407 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:30.607367    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af96764"]
Jul 23 00:13:30.607901 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:30.607690    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db297740-e589-43b9-a021-76ca476ff5e9" containerName="util"
Jul 23 00:13:30.607901 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:30.607705    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="db297740-e589-43b9-a021-76ca476ff5e9" containerName="util"
Jul 23 00:13:30.607901 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:30.607725    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db297740-e589-43b9-a021-76ca476ff5e9" containerName="extract"
Jul 23 00:13:30.607901 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:30.607731    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="db297740-e589-43b9-a021-76ca476ff5e9" containerName="extract"
Jul 23 00:13:30.607901 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:30.607739    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db297740-e589-43b9-a021-76ca476ff5e9" containerName="pull"
Jul 23 00:13:30.607901 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:30.607745    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="db297740-e589-43b9-a021-76ca476ff5e9" containerName="pull"
Jul 23 00:13:30.607901 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:30.607791    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="db297740-e589-43b9-a021-76ca476ff5e9" containerName="extract"
Jul 23 00:13:30.609674 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:30.609658    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af96764"
Jul 23 00:13:30.612062 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:30.612043    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 23 00:13:30.612062 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:30.612055    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 23 00:13:30.612899 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:30.612882    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qt6wm\""
Jul 23 00:13:30.620241 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:30.620216    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af96764"]
Jul 23 00:13:30.713181 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:30.713149    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7409decf-b341-4c99-8b5c-392db1cbff72-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af96764\" (UID: \"7409decf-b341-4c99-8b5c-392db1cbff72\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af96764"
Jul 23 00:13:30.713181 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:30.713185    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7409decf-b341-4c99-8b5c-392db1cbff72-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af96764\" (UID: \"7409decf-b341-4c99-8b5c-392db1cbff72\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af96764"
Jul 23 00:13:30.713380 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:30.713219    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48jzn\" (UniqueName: \"kubernetes.io/projected/7409decf-b341-4c99-8b5c-392db1cbff72-kube-api-access-48jzn\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af96764\" (UID: \"7409decf-b341-4c99-8b5c-392db1cbff72\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af96764"
Jul 23 00:13:30.814150 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:30.814120    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48jzn\" (UniqueName: \"kubernetes.io/projected/7409decf-b341-4c99-8b5c-392db1cbff72-kube-api-access-48jzn\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af96764\" (UID: \"7409decf-b341-4c99-8b5c-392db1cbff72\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af96764"
Jul 23 00:13:30.814286 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:30.814173    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7409decf-b341-4c99-8b5c-392db1cbff72-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af96764\" (UID: \"7409decf-b341-4c99-8b5c-392db1cbff72\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af96764"
Jul 23 00:13:30.814286 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:30.814201    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7409decf-b341-4c99-8b5c-392db1cbff72-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af96764\" (UID: \"7409decf-b341-4c99-8b5c-392db1cbff72\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af96764"
Jul 23 00:13:30.814571 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:30.814548    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7409decf-b341-4c99-8b5c-392db1cbff72-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af96764\" (UID: \"7409decf-b341-4c99-8b5c-392db1cbff72\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af96764"
Jul 23 00:13:30.814654 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:30.814583    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7409decf-b341-4c99-8b5c-392db1cbff72-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af96764\" (UID: \"7409decf-b341-4c99-8b5c-392db1cbff72\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af96764"
Jul 23 00:13:30.822093 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:30.822074    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48jzn\" (UniqueName: \"kubernetes.io/projected/7409decf-b341-4c99-8b5c-392db1cbff72-kube-api-access-48jzn\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af96764\" (UID: \"7409decf-b341-4c99-8b5c-392db1cbff72\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af96764"
Jul 23 00:13:30.919002 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:30.918950    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af96764"
Jul 23 00:13:31.042951 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:31.042899    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af96764"]
Jul 23 00:13:31.045109 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:13:31.045085    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7409decf_b341_4c99_8b5c_392db1cbff72.slice/crio-bfb24e97c5e23bae9c1d13529efed3fc43ce352a9048bd8e1647521da2a0d78f WatchSource:0}: Error finding container bfb24e97c5e23bae9c1d13529efed3fc43ce352a9048bd8e1647521da2a0d78f: Status 404 returned error can't find the container with id bfb24e97c5e23bae9c1d13529efed3fc43ce352a9048bd8e1647521da2a0d78f
Jul 23 00:13:31.677429 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:31.677393    2549 generic.go:356] "Generic (PLEG): container finished" podID="7409decf-b341-4c99-8b5c-392db1cbff72" containerID="0db0c96bd63954a377a56065a8405863be9960994103e4efe5588a895031e707" exitCode=0
Jul 23 00:13:31.677819 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:31.677484    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af96764" event={"ID":"7409decf-b341-4c99-8b5c-392db1cbff72","Type":"ContainerDied","Data":"0db0c96bd63954a377a56065a8405863be9960994103e4efe5588a895031e707"}
Jul 23 00:13:31.677819 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:31.677539    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af96764" event={"ID":"7409decf-b341-4c99-8b5c-392db1cbff72","Type":"ContainerStarted","Data":"bfb24e97c5e23bae9c1d13529efed3fc43ce352a9048bd8e1647521da2a0d78f"}
Jul 23 00:13:32.683150 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:32.683063    2549 generic.go:356] "Generic (PLEG): container finished" podID="7409decf-b341-4c99-8b5c-392db1cbff72" containerID="a38ddf3446f54a8636a9928e01c134414dfd4fdc542840a4e11abd82398e41b9" exitCode=0
Jul 23 00:13:32.683150 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:32.683113    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af96764" event={"ID":"7409decf-b341-4c99-8b5c-392db1cbff72","Type":"ContainerDied","Data":"a38ddf3446f54a8636a9928e01c134414dfd4fdc542840a4e11abd82398e41b9"}
Jul 23 00:13:33.689057 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:33.689023    2549 generic.go:356] "Generic (PLEG): container finished" podID="7409decf-b341-4c99-8b5c-392db1cbff72" containerID="8d78fac7a7cf93123ec10fe2818061786082bce5022c65ee21f90e9171eec5fb" exitCode=0
Jul 23 00:13:33.689437 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:33.689109    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af96764" event={"ID":"7409decf-b341-4c99-8b5c-392db1cbff72","Type":"ContainerDied","Data":"8d78fac7a7cf93123ec10fe2818061786082bce5022c65ee21f90e9171eec5fb"}
Jul 23 00:13:34.812032 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:34.812011    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af96764"
Jul 23 00:13:34.945516 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:34.945425    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48jzn\" (UniqueName: \"kubernetes.io/projected/7409decf-b341-4c99-8b5c-392db1cbff72-kube-api-access-48jzn\") pod \"7409decf-b341-4c99-8b5c-392db1cbff72\" (UID: \"7409decf-b341-4c99-8b5c-392db1cbff72\") "
Jul 23 00:13:34.945516 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:34.945508    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7409decf-b341-4c99-8b5c-392db1cbff72-util\") pod \"7409decf-b341-4c99-8b5c-392db1cbff72\" (UID: \"7409decf-b341-4c99-8b5c-392db1cbff72\") "
Jul 23 00:13:34.945745 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:34.945586    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7409decf-b341-4c99-8b5c-392db1cbff72-bundle\") pod \"7409decf-b341-4c99-8b5c-392db1cbff72\" (UID: \"7409decf-b341-4c99-8b5c-392db1cbff72\") "
Jul 23 00:13:34.946303 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:34.946270    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7409decf-b341-4c99-8b5c-392db1cbff72-bundle" (OuterVolumeSpecName: "bundle") pod "7409decf-b341-4c99-8b5c-392db1cbff72" (UID: "7409decf-b341-4c99-8b5c-392db1cbff72"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:13:34.947575 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:34.947552    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7409decf-b341-4c99-8b5c-392db1cbff72-kube-api-access-48jzn" (OuterVolumeSpecName: "kube-api-access-48jzn") pod "7409decf-b341-4c99-8b5c-392db1cbff72" (UID: "7409decf-b341-4c99-8b5c-392db1cbff72"). InnerVolumeSpecName "kube-api-access-48jzn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:13:34.951229 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:34.951196    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7409decf-b341-4c99-8b5c-392db1cbff72-util" (OuterVolumeSpecName: "util") pod "7409decf-b341-4c99-8b5c-392db1cbff72" (UID: "7409decf-b341-4c99-8b5c-392db1cbff72"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:13:35.046429 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:35.046401    2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7409decf-b341-4c99-8b5c-392db1cbff72-bundle\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:13:35.046429 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:35.046423    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48jzn\" (UniqueName: \"kubernetes.io/projected/7409decf-b341-4c99-8b5c-392db1cbff72-kube-api-access-48jzn\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:13:35.046429 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:35.046433    2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7409decf-b341-4c99-8b5c-392db1cbff72-util\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:13:35.698081 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:35.698048    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af96764" event={"ID":"7409decf-b341-4c99-8b5c-392db1cbff72","Type":"ContainerDied","Data":"bfb24e97c5e23bae9c1d13529efed3fc43ce352a9048bd8e1647521da2a0d78f"}
Jul 23 00:13:35.698245 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:35.698091    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af96764"
Jul 23 00:13:35.698245 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:35.698094    2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bfb24e97c5e23bae9c1d13529efed3fc43ce352a9048bd8e1647521da2a0d78f"
Jul 23 00:13:42.504310 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:42.502164    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86b98fc76f-669vg"]
Jul 23 00:13:42.504310 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:42.502697    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7409decf-b341-4c99-8b5c-392db1cbff72" containerName="util"
Jul 23 00:13:42.504310 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:42.502716    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="7409decf-b341-4c99-8b5c-392db1cbff72" containerName="util"
Jul 23 00:13:42.504310 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:42.502736    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7409decf-b341-4c99-8b5c-392db1cbff72" containerName="extract"
Jul 23 00:13:42.504310 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:42.502744    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="7409decf-b341-4c99-8b5c-392db1cbff72" containerName="extract"
Jul 23 00:13:42.504310 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:42.502787    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7409decf-b341-4c99-8b5c-392db1cbff72" containerName="pull"
Jul 23 00:13:42.504310 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:42.502796    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="7409decf-b341-4c99-8b5c-392db1cbff72" containerName="pull"
Jul 23 00:13:42.504310 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:42.502906    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="7409decf-b341-4c99-8b5c-392db1cbff72" containerName="extract"
Jul 23 00:13:42.506267 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:42.506239    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-669vg"
Jul 23 00:13:42.509478 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:42.509435    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 23 00:13:42.509598 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:42.509439    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 23 00:13:42.509835 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:42.509821    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 23 00:13:42.510145 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:42.510130    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zvmmz\""
Jul 23 00:13:42.510344 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:42.510323    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 23 00:13:42.524930 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:42.524909    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86b98fc76f-669vg"]
Jul 23 00:13:42.606586 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:42.606553    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a7d7bf86-c01d-4ae8-b7ea-b68a146a69d3-manifests\") pod \"opendatahub-operator-controller-manager-86b98fc76f-669vg\" (UID: \"a7d7bf86-c01d-4ae8-b7ea-b68a146a69d3\") " pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-669vg"
Jul 23 00:13:42.606586 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:42.606581    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f52gx\" (UniqueName: \"kubernetes.io/projected/a7d7bf86-c01d-4ae8-b7ea-b68a146a69d3-kube-api-access-f52gx\") pod \"opendatahub-operator-controller-manager-86b98fc76f-669vg\" (UID: \"a7d7bf86-c01d-4ae8-b7ea-b68a146a69d3\") " pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-669vg"
Jul 23 00:13:42.606750 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:42.606602    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a7d7bf86-c01d-4ae8-b7ea-b68a146a69d3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86b98fc76f-669vg\" (UID: \"a7d7bf86-c01d-4ae8-b7ea-b68a146a69d3\") " pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-669vg"
Jul 23 00:13:42.606750 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:42.606626    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7d7bf86-c01d-4ae8-b7ea-b68a146a69d3-webhook-cert\") pod \"opendatahub-operator-controller-manager-86b98fc76f-669vg\" (UID: \"a7d7bf86-c01d-4ae8-b7ea-b68a146a69d3\") " pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-669vg"
Jul 23 00:13:42.606750 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:42.606661    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a7d7bf86-c01d-4ae8-b7ea-b68a146a69d3-tmp\") pod \"opendatahub-operator-controller-manager-86b98fc76f-669vg\" (UID: \"a7d7bf86-c01d-4ae8-b7ea-b68a146a69d3\") " pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-669vg"
Jul 23 00:13:42.707033 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:42.707009    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a7d7bf86-c01d-4ae8-b7ea-b68a146a69d3-manifests\") pod \"opendatahub-operator-controller-manager-86b98fc76f-669vg\" (UID: \"a7d7bf86-c01d-4ae8-b7ea-b68a146a69d3\") " pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-669vg"
Jul 23 00:13:42.707165 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:42.707038    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f52gx\" (UniqueName: \"kubernetes.io/projected/a7d7bf86-c01d-4ae8-b7ea-b68a146a69d3-kube-api-access-f52gx\") pod \"opendatahub-operator-controller-manager-86b98fc76f-669vg\" (UID: \"a7d7bf86-c01d-4ae8-b7ea-b68a146a69d3\") " pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-669vg"
Jul 23 00:13:42.707165 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:42.707059    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a7d7bf86-c01d-4ae8-b7ea-b68a146a69d3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86b98fc76f-669vg\" (UID: \"a7d7bf86-c01d-4ae8-b7ea-b68a146a69d3\") " pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-669vg"
Jul 23 00:13:42.707165 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:42.707086    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7d7bf86-c01d-4ae8-b7ea-b68a146a69d3-webhook-cert\") pod \"opendatahub-operator-controller-manager-86b98fc76f-669vg\" (UID: \"a7d7bf86-c01d-4ae8-b7ea-b68a146a69d3\") " pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-669vg"
Jul 23 00:13:42.707165 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:42.707116    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a7d7bf86-c01d-4ae8-b7ea-b68a146a69d3-tmp\") pod \"opendatahub-operator-controller-manager-86b98fc76f-669vg\" (UID: \"a7d7bf86-c01d-4ae8-b7ea-b68a146a69d3\") " pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-669vg"
Jul 23 00:13:42.707526 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:42.707493    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a7d7bf86-c01d-4ae8-b7ea-b68a146a69d3-manifests\") pod \"opendatahub-operator-controller-manager-86b98fc76f-669vg\" (UID: \"a7d7bf86-c01d-4ae8-b7ea-b68a146a69d3\") " pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-669vg"
Jul 23 00:13:42.709411 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:42.709382    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a7d7bf86-c01d-4ae8-b7ea-b68a146a69d3-tmp\") pod \"opendatahub-operator-controller-manager-86b98fc76f-669vg\" (UID: \"a7d7bf86-c01d-4ae8-b7ea-b68a146a69d3\") " pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-669vg"
Jul 23 00:13:42.709543 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:42.709524    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7d7bf86-c01d-4ae8-b7ea-b68a146a69d3-webhook-cert\") pod \"opendatahub-operator-controller-manager-86b98fc76f-669vg\" (UID: \"a7d7bf86-c01d-4ae8-b7ea-b68a146a69d3\") " pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-669vg"
Jul 23 00:13:42.709627 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:42.709611    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a7d7bf86-c01d-4ae8-b7ea-b68a146a69d3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86b98fc76f-669vg\" (UID: \"a7d7bf86-c01d-4ae8-b7ea-b68a146a69d3\") " pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-669vg"
Jul 23 00:13:42.726834 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:42.726813    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f52gx\" (UniqueName: \"kubernetes.io/projected/a7d7bf86-c01d-4ae8-b7ea-b68a146a69d3-kube-api-access-f52gx\") pod \"opendatahub-operator-controller-manager-86b98fc76f-669vg\" (UID: \"a7d7bf86-c01d-4ae8-b7ea-b68a146a69d3\") " pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-669vg"
Jul 23 00:13:42.815991 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:42.815973    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-669vg"
Jul 23 00:13:42.949994 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:42.949968    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86b98fc76f-669vg"]
Jul 23 00:13:42.952703 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:13:42.952667    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7d7bf86_c01d_4ae8_b7ea_b68a146a69d3.slice/crio-c6ba583f46fa86ad1f54dbc5e697410db300a1799170469206999f1f8a10d685 WatchSource:0}: Error finding container c6ba583f46fa86ad1f54dbc5e697410db300a1799170469206999f1f8a10d685: Status 404 returned error can't find the container with id c6ba583f46fa86ad1f54dbc5e697410db300a1799170469206999f1f8a10d685
Jul 23 00:13:43.728056 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:43.728017    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-669vg" event={"ID":"a7d7bf86-c01d-4ae8-b7ea-b68a146a69d3","Type":"ContainerStarted","Data":"c6ba583f46fa86ad1f54dbc5e697410db300a1799170469206999f1f8a10d685"}
Jul 23 00:13:46.741637 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:46.741604    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-669vg" event={"ID":"a7d7bf86-c01d-4ae8-b7ea-b68a146a69d3","Type":"ContainerStarted","Data":"2e7c807e2070662affacaff5a32c91ab71086159b6ec66f80c4518f7246bad1b"}
Jul 23 00:13:47.747410 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:47.747377    2549 generic.go:356] "Generic (PLEG): container finished" podID="a7d7bf86-c01d-4ae8-b7ea-b68a146a69d3" containerID="2e7c807e2070662affacaff5a32c91ab71086159b6ec66f80c4518f7246bad1b" exitCode=0
Jul 23 00:13:47.747410 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:47.747415    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-669vg" event={"ID":"a7d7bf86-c01d-4ae8-b7ea-b68a146a69d3","Type":"ContainerDied","Data":"2e7c807e2070662affacaff5a32c91ab71086159b6ec66f80c4518f7246bad1b"}
Jul 23 00:13:48.754777 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:48.754745    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-669vg" event={"ID":"a7d7bf86-c01d-4ae8-b7ea-b68a146a69d3","Type":"ContainerStarted","Data":"5e549ee1d77e6be3dcab2e637fb29f0662d62a188d158f6f0f6434fe6d63c483"}
Jul 23 00:13:48.755182 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:48.754845    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-669vg"
Jul 23 00:13:48.785781 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:48.785730    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-669vg" podStartSLOduration=2.3140712949999998 podStartE2EDuration="6.785716802s" totalImagesPullingTime="3.44078085s" totalInitContainerRuntime="1.030864657s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:13:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:13:48.783815094 +0000 UTC m=+571.545013403" watchObservedRunningTime="2026-07-23 00:13:48.785716802 +0000 UTC m=+571.546915112"
Jul 23 00:13:59.761322 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:13:59.761291    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-86b98fc76f-669vg"
Jul 23 00:14:02.941210 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:02.941172    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jshl7"]
Jul 23 00:14:02.949617 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:02.949593    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-jshl7"
Jul 23 00:14:02.953080 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:02.953061    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-rthw9\""
Jul 23 00:14:02.954205 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:02.954188    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 23 00:14:02.978782 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:02.978761    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jshl7"]
Jul 23 00:14:03.048124 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:03.048089    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2cvz\" (UniqueName: \"kubernetes.io/projected/02c2ed65-f107-4e58-bb14-6828fe419c7c-kube-api-access-t2cvz\") pod \"odh-model-controller-7998c67dc4-jshl7\" (UID: \"02c2ed65-f107-4e58-bb14-6828fe419c7c\") " pod="opendatahub/odh-model-controller-7998c67dc4-jshl7"
Jul 23 00:14:03.048124 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:03.048122    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02c2ed65-f107-4e58-bb14-6828fe419c7c-cert\") pod \"odh-model-controller-7998c67dc4-jshl7\" (UID: \"02c2ed65-f107-4e58-bb14-6828fe419c7c\") " pod="opendatahub/odh-model-controller-7998c67dc4-jshl7"
Jul 23 00:14:03.149410 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:03.149372    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2cvz\" (UniqueName: \"kubernetes.io/projected/02c2ed65-f107-4e58-bb14-6828fe419c7c-kube-api-access-t2cvz\") pod \"odh-model-controller-7998c67dc4-jshl7\" (UID: \"02c2ed65-f107-4e58-bb14-6828fe419c7c\") " pod="opendatahub/odh-model-controller-7998c67dc4-jshl7"
Jul 23 00:14:03.149410 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:03.149416    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02c2ed65-f107-4e58-bb14-6828fe419c7c-cert\") pod \"odh-model-controller-7998c67dc4-jshl7\" (UID: \"02c2ed65-f107-4e58-bb14-6828fe419c7c\") " pod="opendatahub/odh-model-controller-7998c67dc4-jshl7"
Jul 23 00:14:03.149635 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:14:03.149544    2549 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 23 00:14:03.149635 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:14:03.149604    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02c2ed65-f107-4e58-bb14-6828fe419c7c-cert podName:02c2ed65-f107-4e58-bb14-6828fe419c7c nodeName:}" failed. No retries permitted until 2026-07-23 00:14:03.649586068 +0000 UTC m=+586.410784364 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/02c2ed65-f107-4e58-bb14-6828fe419c7c-cert") pod "odh-model-controller-7998c67dc4-jshl7" (UID: "02c2ed65-f107-4e58-bb14-6828fe419c7c") : secret "odh-model-controller-webhook-cert" not found
Jul 23 00:14:03.162106 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:03.162079    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2cvz\" (UniqueName: \"kubernetes.io/projected/02c2ed65-f107-4e58-bb14-6828fe419c7c-kube-api-access-t2cvz\") pod \"odh-model-controller-7998c67dc4-jshl7\" (UID: \"02c2ed65-f107-4e58-bb14-6828fe419c7c\") " pod="opendatahub/odh-model-controller-7998c67dc4-jshl7"
Jul 23 00:14:03.653210 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:03.653177    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02c2ed65-f107-4e58-bb14-6828fe419c7c-cert\") pod \"odh-model-controller-7998c67dc4-jshl7\" (UID: \"02c2ed65-f107-4e58-bb14-6828fe419c7c\") " pod="opendatahub/odh-model-controller-7998c67dc4-jshl7"
Jul 23 00:14:03.655653 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:03.655633    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02c2ed65-f107-4e58-bb14-6828fe419c7c-cert\") pod \"odh-model-controller-7998c67dc4-jshl7\" (UID: \"02c2ed65-f107-4e58-bb14-6828fe419c7c\") " pod="opendatahub/odh-model-controller-7998c67dc4-jshl7"
Jul 23 00:14:03.859796 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:03.859756    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-jshl7"
Jul 23 00:14:03.999267 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:03.999235    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jshl7"]
Jul 23 00:14:04.001273 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:14:04.001244    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02c2ed65_f107_4e58_bb14_6828fe419c7c.slice/crio-923d7eb617a21defb7f32e24906b0aa5941e9cbc763a3bf2d8c09eda38c5075e WatchSource:0}: Error finding container 923d7eb617a21defb7f32e24906b0aa5941e9cbc763a3bf2d8c09eda38c5075e: Status 404 returned error can't find the container with id 923d7eb617a21defb7f32e24906b0aa5941e9cbc763a3bf2d8c09eda38c5075e
Jul 23 00:14:04.141330 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:04.141289    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-974kz"]
Jul 23 00:14:04.145631 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:04.145607    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-974kz"
Jul 23 00:14:04.149667 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:04.149648    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 23 00:14:04.162634 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:04.162583    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-974kz"]
Jul 23 00:14:04.257944 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:04.257907    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f58731df-6dc5-4a7c-afa5-5ad4b91ba278-tls-certs\") pod \"model-serving-api-54d89bd5fc-974kz\" (UID: \"f58731df-6dc5-4a7c-afa5-5ad4b91ba278\") " pod="opendatahub/model-serving-api-54d89bd5fc-974kz"
Jul 23 00:14:04.258107 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:04.257949    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7r7k\" (UniqueName: \"kubernetes.io/projected/f58731df-6dc5-4a7c-afa5-5ad4b91ba278-kube-api-access-k7r7k\") pod \"model-serving-api-54d89bd5fc-974kz\" (UID: \"f58731df-6dc5-4a7c-afa5-5ad4b91ba278\") " pod="opendatahub/model-serving-api-54d89bd5fc-974kz"
Jul 23 00:14:04.358557 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:04.358520    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7r7k\" (UniqueName: \"kubernetes.io/projected/f58731df-6dc5-4a7c-afa5-5ad4b91ba278-kube-api-access-k7r7k\") pod \"model-serving-api-54d89bd5fc-974kz\" (UID: \"f58731df-6dc5-4a7c-afa5-5ad4b91ba278\") " pod="opendatahub/model-serving-api-54d89bd5fc-974kz"
Jul 23 00:14:04.358716 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:04.358603    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f58731df-6dc5-4a7c-afa5-5ad4b91ba278-tls-certs\") pod \"model-serving-api-54d89bd5fc-974kz\" (UID: \"f58731df-6dc5-4a7c-afa5-5ad4b91ba278\") " pod="opendatahub/model-serving-api-54d89bd5fc-974kz"
Jul 23 00:14:04.360943 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:04.360925    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f58731df-6dc5-4a7c-afa5-5ad4b91ba278-tls-certs\") pod \"model-serving-api-54d89bd5fc-974kz\" (UID: \"f58731df-6dc5-4a7c-afa5-5ad4b91ba278\") " pod="opendatahub/model-serving-api-54d89bd5fc-974kz"
Jul 23 00:14:04.369579 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:04.369558    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7r7k\" (UniqueName: \"kubernetes.io/projected/f58731df-6dc5-4a7c-afa5-5ad4b91ba278-kube-api-access-k7r7k\") pod \"model-serving-api-54d89bd5fc-974kz\" (UID: \"f58731df-6dc5-4a7c-afa5-5ad4b91ba278\") " pod="opendatahub/model-serving-api-54d89bd5fc-974kz"
Jul 23 00:14:04.455174 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:04.455077    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-974kz"
Jul 23 00:14:04.602431 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:04.602401    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-974kz"]
Jul 23 00:14:04.606573 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:14:04.606540    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf58731df_6dc5_4a7c_afa5_5ad4b91ba278.slice/crio-0b8a69dfd3ff2f760da5d5fdff32e422437676d0e59dcaedd7d7d79e6165dcb2 WatchSource:0}: Error finding container 0b8a69dfd3ff2f760da5d5fdff32e422437676d0e59dcaedd7d7d79e6165dcb2: Status 404 returned error can't find the container with id 0b8a69dfd3ff2f760da5d5fdff32e422437676d0e59dcaedd7d7d79e6165dcb2
Jul 23 00:14:04.817629 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:04.817583    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-974kz" event={"ID":"f58731df-6dc5-4a7c-afa5-5ad4b91ba278","Type":"ContainerStarted","Data":"0b8a69dfd3ff2f760da5d5fdff32e422437676d0e59dcaedd7d7d79e6165dcb2"}
Jul 23 00:14:04.819205 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:04.819170    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-jshl7" event={"ID":"02c2ed65-f107-4e58-bb14-6828fe419c7c","Type":"ContainerStarted","Data":"923d7eb617a21defb7f32e24906b0aa5941e9cbc763a3bf2d8c09eda38c5075e"}
Jul 23 00:14:07.835139 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:07.835096    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-974kz" event={"ID":"f58731df-6dc5-4a7c-afa5-5ad4b91ba278","Type":"ContainerStarted","Data":"68a8f9bfb66e607ac0719d9361ba4641f2ae5765c213cb4c794e7419976e587f"}
Jul 23 00:14:07.835615 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:07.835194    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-974kz"
Jul 23 00:14:07.836685 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:07.836656    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-jshl7" event={"ID":"02c2ed65-f107-4e58-bb14-6828fe419c7c","Type":"ContainerStarted","Data":"2314970cb74decc663696e2adac622e9ebe023bcb5f16b03d50a139059570ee9"}
Jul 23 00:14:07.836800 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:07.836783    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-jshl7"
Jul 23 00:14:07.859556 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:07.859491    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-974kz" podStartSLOduration=1.004764215 podStartE2EDuration="3.85947142s" totalImagesPullingTime="2.854707205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:14:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:14:07.857697743 +0000 UTC m=+590.618896055" watchObservedRunningTime="2026-07-23 00:14:07.85947142 +0000 UTC m=+590.620669727"
Jul 23 00:14:07.875493 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:07.875439    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-jshl7" podStartSLOduration=2.412328574 podStartE2EDuration="5.875429463s" totalImagesPullingTime="3.463100889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:14:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:14:07.873402898 +0000 UTC m=+590.634601232" watchObservedRunningTime="2026-07-23 00:14:07.875429463 +0000 UTC m=+590.636627832"
Jul 23 00:14:13.003646 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.003608    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-xzw9f"]
Jul 23 00:14:13.006142 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.006123    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xzw9f"
Jul 23 00:14:13.011107 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.011080    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 23 00:14:13.011623 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.011602    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-8zdd5\""
Jul 23 00:14:13.021125 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.021093    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zlrfl"]
Jul 23 00:14:13.024299 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.024280    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zlrfl"
Jul 23 00:14:13.028111 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.028092    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 23 00:14:13.028315 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.028302    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-m4jtv\""
Jul 23 00:14:13.038438 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.038413    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-xzw9f"]
Jul 23 00:14:13.045315 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.045289    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zlrfl"]
Jul 23 00:14:13.132411 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.132378    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73228d62-3a86-4121-a620-4c8d76858b92-cert\") pod \"kserve-controller-manager-d6f4b65b8-xzw9f\" (UID: \"73228d62-3a86-4121-a620-4c8d76858b92\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xzw9f"
Jul 23 00:14:13.132411 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.132420    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26jb5\" (UniqueName: \"kubernetes.io/projected/73228d62-3a86-4121-a620-4c8d76858b92-kube-api-access-26jb5\") pod \"kserve-controller-manager-d6f4b65b8-xzw9f\" (UID: \"73228d62-3a86-4121-a620-4c8d76858b92\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xzw9f"
Jul 23 00:14:13.132624 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.132441    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq6cj\" (UniqueName: \"kubernetes.io/projected/79985d45-c622-41a4-ab3e-e0f3a1ccc115-kube-api-access-xq6cj\") pod \"llmisvc-controller-manager-777c6bd7d5-zlrfl\" (UID: \"79985d45-c622-41a4-ab3e-e0f3a1ccc115\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zlrfl"
Jul 23 00:14:13.132624 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.132518    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/79985d45-c622-41a4-ab3e-e0f3a1ccc115-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zlrfl\" (UID: \"79985d45-c622-41a4-ab3e-e0f3a1ccc115\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zlrfl"
Jul 23 00:14:13.233705 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.233669    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73228d62-3a86-4121-a620-4c8d76858b92-cert\") pod \"kserve-controller-manager-d6f4b65b8-xzw9f\" (UID: \"73228d62-3a86-4121-a620-4c8d76858b92\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xzw9f"
Jul 23 00:14:13.233705 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.233711    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26jb5\" (UniqueName: \"kubernetes.io/projected/73228d62-3a86-4121-a620-4c8d76858b92-kube-api-access-26jb5\") pod \"kserve-controller-manager-d6f4b65b8-xzw9f\" (UID: \"73228d62-3a86-4121-a620-4c8d76858b92\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xzw9f"
Jul 23 00:14:13.233925 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.233729    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq6cj\" (UniqueName: \"kubernetes.io/projected/79985d45-c622-41a4-ab3e-e0f3a1ccc115-kube-api-access-xq6cj\") pod \"llmisvc-controller-manager-777c6bd7d5-zlrfl\" (UID: \"79985d45-c622-41a4-ab3e-e0f3a1ccc115\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zlrfl"
Jul 23 00:14:13.233925 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.233846    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/79985d45-c622-41a4-ab3e-e0f3a1ccc115-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zlrfl\" (UID: \"79985d45-c622-41a4-ab3e-e0f3a1ccc115\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zlrfl"
Jul 23 00:14:13.234047 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:14:13.234029    2549 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 23 00:14:13.234122 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:14:13.234109    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79985d45-c622-41a4-ab3e-e0f3a1ccc115-cert podName:79985d45-c622-41a4-ab3e-e0f3a1ccc115 nodeName:}" failed. No retries permitted until 2026-07-23 00:14:13.734087533 +0000 UTC m=+596.495285826 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/79985d45-c622-41a4-ab3e-e0f3a1ccc115-cert") pod "llmisvc-controller-manager-777c6bd7d5-zlrfl" (UID: "79985d45-c622-41a4-ab3e-e0f3a1ccc115") : secret "llmisvc-webhook-server-cert" not found
Jul 23 00:14:13.236120 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.236100    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73228d62-3a86-4121-a620-4c8d76858b92-cert\") pod \"kserve-controller-manager-d6f4b65b8-xzw9f\" (UID: \"73228d62-3a86-4121-a620-4c8d76858b92\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xzw9f"
Jul 23 00:14:13.262956 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.262902    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq6cj\" (UniqueName: \"kubernetes.io/projected/79985d45-c622-41a4-ab3e-e0f3a1ccc115-kube-api-access-xq6cj\") pod \"llmisvc-controller-manager-777c6bd7d5-zlrfl\" (UID: \"79985d45-c622-41a4-ab3e-e0f3a1ccc115\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zlrfl"
Jul 23 00:14:13.276072 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.276046    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26jb5\" (UniqueName: \"kubernetes.io/projected/73228d62-3a86-4121-a620-4c8d76858b92-kube-api-access-26jb5\") pod \"kserve-controller-manager-d6f4b65b8-xzw9f\" (UID: \"73228d62-3a86-4121-a620-4c8d76858b92\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xzw9f"
Jul 23 00:14:13.316067 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.316044    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xzw9f"
Jul 23 00:14:13.473379 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.473347    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-xzw9f"]
Jul 23 00:14:13.474770 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:14:13.474749    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73228d62_3a86_4121_a620_4c8d76858b92.slice/crio-c56fe297a725c44f1cbd0d2cfa793bf3a5ff62d9292729512557752cba27b071 WatchSource:0}: Error finding container c56fe297a725c44f1cbd0d2cfa793bf3a5ff62d9292729512557752cba27b071: Status 404 returned error can't find the container with id c56fe297a725c44f1cbd0d2cfa793bf3a5ff62d9292729512557752cba27b071
Jul 23 00:14:13.512239 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.512217    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-76d98b647-t5lf9"]
Jul 23 00:14:13.516321 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.516281    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-76d98b647-t5lf9"
Jul 23 00:14:13.520060 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.520040    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 23 00:14:13.520622 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.520600    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 23 00:14:13.520719 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.520619    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 23 00:14:13.520719 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.520659    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 23 00:14:13.532604 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.532583    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-76d98b647-t5lf9"]
Jul 23 00:14:13.636023 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.636000    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75q9v\" (UniqueName: \"kubernetes.io/projected/1eff5a77-e427-4e3f-a811-e95da6d2f12d-kube-api-access-75q9v\") pod \"kube-auth-proxy-76d98b647-t5lf9\" (UID: \"1eff5a77-e427-4e3f-a811-e95da6d2f12d\") " pod="openshift-ingress/kube-auth-proxy-76d98b647-t5lf9"
Jul 23 00:14:13.636139 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.636062    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1eff5a77-e427-4e3f-a811-e95da6d2f12d-tmp\") pod \"kube-auth-proxy-76d98b647-t5lf9\" (UID: \"1eff5a77-e427-4e3f-a811-e95da6d2f12d\") " pod="openshift-ingress/kube-auth-proxy-76d98b647-t5lf9"
Jul 23 00:14:13.636139 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.636119    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1eff5a77-e427-4e3f-a811-e95da6d2f12d-tls-certs\") pod \"kube-auth-proxy-76d98b647-t5lf9\" (UID: \"1eff5a77-e427-4e3f-a811-e95da6d2f12d\") " pod="openshift-ingress/kube-auth-proxy-76d98b647-t5lf9"
Jul 23 00:14:13.737346 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.737319    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/79985d45-c622-41a4-ab3e-e0f3a1ccc115-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zlrfl\" (UID: \"79985d45-c622-41a4-ab3e-e0f3a1ccc115\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zlrfl"
Jul 23 00:14:13.737346 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.737347    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1eff5a77-e427-4e3f-a811-e95da6d2f12d-tmp\") pod \"kube-auth-proxy-76d98b647-t5lf9\" (UID: \"1eff5a77-e427-4e3f-a811-e95da6d2f12d\") " pod="openshift-ingress/kube-auth-proxy-76d98b647-t5lf9"
Jul 23 00:14:13.737548 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.737372    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1eff5a77-e427-4e3f-a811-e95da6d2f12d-tls-certs\") pod \"kube-auth-proxy-76d98b647-t5lf9\" (UID: \"1eff5a77-e427-4e3f-a811-e95da6d2f12d\") " pod="openshift-ingress/kube-auth-proxy-76d98b647-t5lf9"
Jul 23 00:14:13.737548 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.737406    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75q9v\" (UniqueName: \"kubernetes.io/projected/1eff5a77-e427-4e3f-a811-e95da6d2f12d-kube-api-access-75q9v\") pod \"kube-auth-proxy-76d98b647-t5lf9\" (UID: \"1eff5a77-e427-4e3f-a811-e95da6d2f12d\") " pod="openshift-ingress/kube-auth-proxy-76d98b647-t5lf9"
Jul 23 00:14:13.739699 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.739672    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1eff5a77-e427-4e3f-a811-e95da6d2f12d-tmp\") pod \"kube-auth-proxy-76d98b647-t5lf9\" (UID: \"1eff5a77-e427-4e3f-a811-e95da6d2f12d\") " pod="openshift-ingress/kube-auth-proxy-76d98b647-t5lf9"
Jul 23 00:14:13.739834 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.739821    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/79985d45-c622-41a4-ab3e-e0f3a1ccc115-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zlrfl\" (UID: \"79985d45-c622-41a4-ab3e-e0f3a1ccc115\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zlrfl"
Jul 23 00:14:13.739879 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.739861    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1eff5a77-e427-4e3f-a811-e95da6d2f12d-tls-certs\") pod \"kube-auth-proxy-76d98b647-t5lf9\" (UID: \"1eff5a77-e427-4e3f-a811-e95da6d2f12d\") " pod="openshift-ingress/kube-auth-proxy-76d98b647-t5lf9"
Jul 23 00:14:13.747767 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.747749    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75q9v\" (UniqueName: \"kubernetes.io/projected/1eff5a77-e427-4e3f-a811-e95da6d2f12d-kube-api-access-75q9v\") pod \"kube-auth-proxy-76d98b647-t5lf9\" (UID: \"1eff5a77-e427-4e3f-a811-e95da6d2f12d\") " pod="openshift-ingress/kube-auth-proxy-76d98b647-t5lf9"
Jul 23 00:14:13.827173 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.827154    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-76d98b647-t5lf9"
Jul 23 00:14:13.867597 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.867564    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xzw9f" event={"ID":"73228d62-3a86-4121-a620-4c8d76858b92","Type":"ContainerStarted","Data":"c56fe297a725c44f1cbd0d2cfa793bf3a5ff62d9292729512557752cba27b071"}
Jul 23 00:14:13.933741 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.933711    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zlrfl"
Jul 23 00:14:13.968554 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:13.968524    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-76d98b647-t5lf9"]
Jul 23 00:14:13.970240 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:14:13.970213    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1eff5a77_e427_4e3f_a811_e95da6d2f12d.slice/crio-1661397c43d8c7868cdae3fbdb4d88a6a77657f5078dcd0f30f1a0de24e06817 WatchSource:0}: Error finding container 1661397c43d8c7868cdae3fbdb4d88a6a77657f5078dcd0f30f1a0de24e06817: Status 404 returned error can't find the container with id 1661397c43d8c7868cdae3fbdb4d88a6a77657f5078dcd0f30f1a0de24e06817
Jul 23 00:14:14.060973 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:14.060950    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zlrfl"]
Jul 23 00:14:14.062663 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:14:14.062636    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod79985d45_c622_41a4_ab3e_e0f3a1ccc115.slice/crio-36e8a999f27aad3951685679c13b1eb531cc8981f5a64054e02b05acd5a96229 WatchSource:0}: Error finding container 36e8a999f27aad3951685679c13b1eb531cc8981f5a64054e02b05acd5a96229: Status 404 returned error can't find the container with id 36e8a999f27aad3951685679c13b1eb531cc8981f5a64054e02b05acd5a96229
Jul 23 00:14:14.873837 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:14.873800    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zlrfl" event={"ID":"79985d45-c622-41a4-ab3e-e0f3a1ccc115","Type":"ContainerStarted","Data":"36e8a999f27aad3951685679c13b1eb531cc8981f5a64054e02b05acd5a96229"}
Jul 23 00:14:14.875136 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:14.875104    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-76d98b647-t5lf9" event={"ID":"1eff5a77-e427-4e3f-a811-e95da6d2f12d","Type":"ContainerStarted","Data":"1661397c43d8c7868cdae3fbdb4d88a6a77657f5078dcd0f30f1a0de24e06817"}
Jul 23 00:14:15.542471 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:15.542382    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dldw7"]
Jul 23 00:14:15.547503 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:15.547410    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dldw7"
Jul 23 00:14:15.550012 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:15.549889    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 23 00:14:15.550012 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:15.549997    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 23 00:14:15.550252 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:15.550103    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 23 00:14:15.550252 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:15.550209    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 23 00:14:15.550462 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:15.550429    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-76g49\""
Jul 23 00:14:15.558050 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:15.558018    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dldw7"]
Jul 23 00:14:15.652858 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:15.652819    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5675f276-0612-45ba-aad7-b636450c7299-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-dldw7\" (UID: \"5675f276-0612-45ba-aad7-b636450c7299\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dldw7"
Jul 23 00:14:15.653035 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:15.652907    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tltgh\" (UniqueName: \"kubernetes.io/projected/5675f276-0612-45ba-aad7-b636450c7299-kube-api-access-tltgh\") pod \"istiod-openshift-gateway-94bb8fbfd-dldw7\" (UID: \"5675f276-0612-45ba-aad7-b636450c7299\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dldw7"
Jul 23 00:14:15.653035 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:15.652953    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5675f276-0612-45ba-aad7-b636450c7299-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-dldw7\" (UID: \"5675f276-0612-45ba-aad7-b636450c7299\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dldw7"
Jul 23 00:14:15.653035 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:15.652998    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5675f276-0612-45ba-aad7-b636450c7299-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-dldw7\" (UID: \"5675f276-0612-45ba-aad7-b636450c7299\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dldw7"
Jul 23 00:14:15.653035 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:15.653022    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5675f276-0612-45ba-aad7-b636450c7299-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-dldw7\" (UID: \"5675f276-0612-45ba-aad7-b636450c7299\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dldw7"
Jul 23 00:14:15.653196 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:15.653054    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5675f276-0612-45ba-aad7-b636450c7299-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-dldw7\" (UID: \"5675f276-0612-45ba-aad7-b636450c7299\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dldw7"
Jul 23 00:14:15.653196 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:15.653078    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5675f276-0612-45ba-aad7-b636450c7299-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-dldw7\" (UID: \"5675f276-0612-45ba-aad7-b636450c7299\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dldw7"
Jul 23 00:14:15.754246 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:15.754210    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5675f276-0612-45ba-aad7-b636450c7299-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-dldw7\" (UID: \"5675f276-0612-45ba-aad7-b636450c7299\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dldw7"
Jul 23 00:14:15.754443 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:15.754259    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5675f276-0612-45ba-aad7-b636450c7299-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-dldw7\" (UID: \"5675f276-0612-45ba-aad7-b636450c7299\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dldw7"
Jul 23 00:14:15.754443 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:15.754295    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5675f276-0612-45ba-aad7-b636450c7299-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-dldw7\" (UID: \"5675f276-0612-45ba-aad7-b636450c7299\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dldw7"
Jul 23 00:14:15.754443 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:15.754322    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5675f276-0612-45ba-aad7-b636450c7299-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-dldw7\" (UID: \"5675f276-0612-45ba-aad7-b636450c7299\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dldw7"
Jul 23 00:14:15.754443 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:15.754373    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5675f276-0612-45ba-aad7-b636450c7299-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-dldw7\" (UID: \"5675f276-0612-45ba-aad7-b636450c7299\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dldw7"
Jul 23 00:14:15.754443 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:15.754409    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tltgh\" (UniqueName: \"kubernetes.io/projected/5675f276-0612-45ba-aad7-b636450c7299-kube-api-access-tltgh\") pod \"istiod-openshift-gateway-94bb8fbfd-dldw7\" (UID: \"5675f276-0612-45ba-aad7-b636450c7299\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dldw7"
Jul 23 00:14:15.754813 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:15.754478    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5675f276-0612-45ba-aad7-b636450c7299-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-dldw7\" (UID: \"5675f276-0612-45ba-aad7-b636450c7299\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dldw7"
Jul 23 00:14:15.755109 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:15.755077    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5675f276-0612-45ba-aad7-b636450c7299-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-dldw7\" (UID: \"5675f276-0612-45ba-aad7-b636450c7299\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dldw7"
Jul 23 00:14:15.757439 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:15.757394    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5675f276-0612-45ba-aad7-b636450c7299-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-dldw7\" (UID: \"5675f276-0612-45ba-aad7-b636450c7299\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dldw7"
Jul 23 00:14:15.757999 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:15.757971    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5675f276-0612-45ba-aad7-b636450c7299-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-dldw7\" (UID: \"5675f276-0612-45ba-aad7-b636450c7299\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dldw7"
Jul 23 00:14:15.758297 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:15.758251    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5675f276-0612-45ba-aad7-b636450c7299-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-dldw7\" (UID: \"5675f276-0612-45ba-aad7-b636450c7299\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dldw7"
Jul 23 00:14:15.758606 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:15.758555    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5675f276-0612-45ba-aad7-b636450c7299-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-dldw7\" (UID: \"5675f276-0612-45ba-aad7-b636450c7299\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dldw7"
Jul 23 00:14:15.764084 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:15.764041    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tltgh\" (UniqueName: \"kubernetes.io/projected/5675f276-0612-45ba-aad7-b636450c7299-kube-api-access-tltgh\") pod \"istiod-openshift-gateway-94bb8fbfd-dldw7\" (UID: \"5675f276-0612-45ba-aad7-b636450c7299\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dldw7"
Jul 23 00:14:15.764198 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:15.764157    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5675f276-0612-45ba-aad7-b636450c7299-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-dldw7\" (UID: \"5675f276-0612-45ba-aad7-b636450c7299\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dldw7"
Jul 23 00:14:15.862171 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:15.862132    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dldw7"
Jul 23 00:14:16.554585 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:16.554511    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dldw7"]
Jul 23 00:14:16.556254 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:14:16.556223    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5675f276_0612_45ba_aad7_b636450c7299.slice/crio-4acb67b2f9bb181ab38fee8d87526226263cd50af3633e834b5e252e827c3c8b WatchSource:0}: Error finding container 4acb67b2f9bb181ab38fee8d87526226263cd50af3633e834b5e252e827c3c8b: Status 404 returned error can't find the container with id 4acb67b2f9bb181ab38fee8d87526226263cd50af3633e834b5e252e827c3c8b
Jul 23 00:14:16.892691 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:16.892650    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dldw7" event={"ID":"5675f276-0612-45ba-aad7-b636450c7299","Type":"ContainerStarted","Data":"4acb67b2f9bb181ab38fee8d87526226263cd50af3633e834b5e252e827c3c8b"}
Jul 23 00:14:16.894480 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:16.894429    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xzw9f" event={"ID":"73228d62-3a86-4121-a620-4c8d76858b92","Type":"ContainerStarted","Data":"9a23423f4421a90af8a0720f5bbe316e82b74b33c49d107e323f7fa1239d0a31"}
Jul 23 00:14:16.894610 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:16.894574    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xzw9f"
Jul 23 00:14:16.928151 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:16.928096    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xzw9f" podStartSLOduration=2.045362543 podStartE2EDuration="4.928076418s" totalImagesPullingTime="2.882713875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:14:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:14:16.927937149 +0000 UTC m=+599.689135461" watchObservedRunningTime="2026-07-23 00:14:16.928076418 +0000 UTC m=+599.689274728"
Jul 23 00:14:17.854389 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:17.854363    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 23 00:14:18.843220 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:18.843169    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-jshl7"
Jul 23 00:14:18.845668 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:18.845644    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-974kz"
Jul 23 00:14:18.910126 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:18.909322    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zlrfl" event={"ID":"79985d45-c622-41a4-ab3e-e0f3a1ccc115","Type":"ContainerStarted","Data":"bb0e3944f978cb9708655f546af3d8b923e7405266ab64b37fbce987529fcc9c"}
Jul 23 00:14:18.910126 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:18.909975    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zlrfl"
Jul 23 00:14:18.912416 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:18.912391    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-76d98b647-t5lf9" event={"ID":"1eff5a77-e427-4e3f-a811-e95da6d2f12d","Type":"ContainerStarted","Data":"2de52e8158c0515cb832b8de63d61aae1616da3687c291c1adb635120f038b19"}
Jul 23 00:14:18.928947 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:18.928894    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zlrfl" podStartSLOduration=3.146392737 podStartE2EDuration="6.928875341s" totalImagesPullingTime="3.782482604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:14:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:14:18.927025093 +0000 UTC m=+601.688223403" watchObservedRunningTime="2026-07-23 00:14:18.928875341 +0000 UTC m=+601.690073653"
Jul 23 00:14:18.942114 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:18.942062    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-76d98b647-t5lf9" podStartSLOduration=2.062470162 podStartE2EDuration="5.942049058s" totalImagesPullingTime="3.879578896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:14:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:14:18.940777869 +0000 UTC m=+601.701976193" watchObservedRunningTime="2026-07-23 00:14:18.942049058 +0000 UTC m=+601.703247368"
Jul 23 00:14:19.401530 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:19.401489    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:14:19.401630 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:19.401572    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:14:19.918434 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:19.918387    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dldw7" event={"ID":"5675f276-0612-45ba-aad7-b636450c7299","Type":"ContainerStarted","Data":"f94ac64167c7ea19dbc6d66fafdd9ed4af7dd8178173b3b05844f277f26b3bb7"}
Jul 23 00:14:19.918912 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:19.918675    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dldw7"
Jul 23 00:14:19.955268 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:19.955214    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dldw7" podStartSLOduration=2.112561128 podStartE2EDuration="4.955198151s" totalImagesPullingTime="2.842637023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:14:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:14:19.952492518 +0000 UTC m=+602.713690821" watchObservedRunningTime="2026-07-23 00:14:19.955198151 +0000 UTC m=+602.716396462"
Jul 23 00:14:20.928965 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:20.928937    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dldw7"
Jul 23 00:14:47.906724 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:47.906645    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xzw9f"
Jul 23 00:14:50.927716 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:14:50.927686    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zlrfl"
Jul 23 00:15:46.741322 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:15:46.741290    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d5pb4"]
Jul 23 00:15:46.744827 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:15:46.744803    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d5pb4"
Jul 23 00:15:46.747680 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:15:46.747657    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-9rnlp\""
Jul 23 00:15:46.747793 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:15:46.747711    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 23 00:15:46.748510 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:15:46.748490    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 23 00:15:46.756485 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:15:46.756464    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d5pb4"]
Jul 23 00:15:46.854824 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:15:46.854798    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54h4b\" (UniqueName: \"kubernetes.io/projected/b10e2975-b343-44a0-9637-bd3f7cceae76-kube-api-access-54h4b\") pod \"limitador-operator-controller-manager-859d7b78bd-d5pb4\" (UID: \"b10e2975-b343-44a0-9637-bd3f7cceae76\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d5pb4"
Jul 23 00:15:46.955189 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:15:46.955164    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54h4b\" (UniqueName: \"kubernetes.io/projected/b10e2975-b343-44a0-9637-bd3f7cceae76-kube-api-access-54h4b\") pod \"limitador-operator-controller-manager-859d7b78bd-d5pb4\" (UID: \"b10e2975-b343-44a0-9637-bd3f7cceae76\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d5pb4"
Jul 23 00:15:46.963404 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:15:46.963374    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54h4b\" (UniqueName: \"kubernetes.io/projected/b10e2975-b343-44a0-9637-bd3f7cceae76-kube-api-access-54h4b\") pod \"limitador-operator-controller-manager-859d7b78bd-d5pb4\" (UID: \"b10e2975-b343-44a0-9637-bd3f7cceae76\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d5pb4"
Jul 23 00:15:47.054352 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:15:47.054289    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d5pb4"
Jul 23 00:15:47.179432 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:15:47.179410    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d5pb4"]
Jul 23 00:15:47.181913 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:15:47.181889    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb10e2975_b343_44a0_9637_bd3f7cceae76.slice/crio-59b67a8fe7500a3b9f410519d804c744beaff0d3979f021d3ca521b43483427e WatchSource:0}: Error finding container 59b67a8fe7500a3b9f410519d804c744beaff0d3979f021d3ca521b43483427e: Status 404 returned error can't find the container with id 59b67a8fe7500a3b9f410519d804c744beaff0d3979f021d3ca521b43483427e
Jul 23 00:15:47.296113 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:15:47.296063    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d5pb4" event={"ID":"b10e2975-b343-44a0-9637-bd3f7cceae76","Type":"ContainerStarted","Data":"59b67a8fe7500a3b9f410519d804c744beaff0d3979f021d3ca521b43483427e"}
Jul 23 00:15:49.307878 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:15:49.307784    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d5pb4" event={"ID":"b10e2975-b343-44a0-9637-bd3f7cceae76","Type":"ContainerStarted","Data":"5f03bfcb6197650787d8b9628bc41fd09409a4905dcdb7b7dc4bdd8b5026e3b9"}
Jul 23 00:15:49.308259 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:15:49.307929    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d5pb4"
Jul 23 00:15:49.325799 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:15:49.325753    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d5pb4" podStartSLOduration=1.521498421 podStartE2EDuration="3.325737278s" totalImagesPullingTime="1.804238857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:15:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:15:49.324951115 +0000 UTC m=+692.086149425" watchObservedRunningTime="2026-07-23 00:15:49.325737278 +0000 UTC m=+692.086935587"
Jul 23 00:16:00.314304 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:00.314270    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d5pb4"
Jul 23 00:16:00.480381 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:00.480347    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95vfd"]
Jul 23 00:16:00.483649 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:00.483628    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95vfd"
Jul 23 00:16:00.485942 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:00.485922    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mdpk6\""
Jul 23 00:16:00.497036 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:00.497012    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95vfd"]
Jul 23 00:16:00.547819 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:00.547787    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d5pb4"]
Jul 23 00:16:00.548093 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:00.548043    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d5pb4" podUID="b10e2975-b343-44a0-9637-bd3f7cceae76" containerName="manager" containerID="cri-o://5f03bfcb6197650787d8b9628bc41fd09409a4905dcdb7b7dc4bdd8b5026e3b9" gracePeriod=2
Jul 23 00:16:00.550069 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:16:00.550034    2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-d5pb4\" is forbidden: User \"system:node:ip-10-0-138-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-182.ec2.internal' and this object" podUID="b10e2975-b343-44a0-9637-bd3f7cceae76" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d5pb4"
Jul 23 00:16:00.551420 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:00.551394    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d5pb4"]
Jul 23 00:16:00.662219 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:00.662126    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7htr\" (UniqueName: \"kubernetes.io/projected/ace3629f-2d20-4e08-8bca-40575df7db1d-kube-api-access-f7htr\") pod \"kuadrant-operator-controller-manager-55467d9f7-95vfd\" (UID: \"ace3629f-2d20-4e08-8bca-40575df7db1d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95vfd"
Jul 23 00:16:00.662386 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:00.662300    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ace3629f-2d20-4e08-8bca-40575df7db1d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-95vfd\" (UID: \"ace3629f-2d20-4e08-8bca-40575df7db1d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95vfd"
Jul 23 00:16:00.763614 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:00.763576    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7htr\" (UniqueName: \"kubernetes.io/projected/ace3629f-2d20-4e08-8bca-40575df7db1d-kube-api-access-f7htr\") pod \"kuadrant-operator-controller-manager-55467d9f7-95vfd\" (UID: \"ace3629f-2d20-4e08-8bca-40575df7db1d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95vfd"
Jul 23 00:16:00.763789 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:00.763674    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ace3629f-2d20-4e08-8bca-40575df7db1d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-95vfd\" (UID: \"ace3629f-2d20-4e08-8bca-40575df7db1d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95vfd"
Jul 23 00:16:00.764187 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:00.764163    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ace3629f-2d20-4e08-8bca-40575df7db1d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-95vfd\" (UID: \"ace3629f-2d20-4e08-8bca-40575df7db1d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95vfd"
Jul 23 00:16:00.773030 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:00.772999    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7htr\" (UniqueName: \"kubernetes.io/projected/ace3629f-2d20-4e08-8bca-40575df7db1d-kube-api-access-f7htr\") pod \"kuadrant-operator-controller-manager-55467d9f7-95vfd\" (UID: \"ace3629f-2d20-4e08-8bca-40575df7db1d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95vfd"
Jul 23 00:16:00.790420 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:00.790399    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d5pb4"
Jul 23 00:16:00.792645 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:16:00.792618    2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-d5pb4\" is forbidden: User \"system:node:ip-10-0-138-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-182.ec2.internal' and this object" podUID="b10e2975-b343-44a0-9637-bd3f7cceae76" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d5pb4"
Jul 23 00:16:00.793719 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:00.793706    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95vfd"
Jul 23 00:16:00.942053 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:00.942032    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95vfd"]
Jul 23 00:16:00.944572 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:16:00.944541    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podace3629f_2d20_4e08_8bca_40575df7db1d.slice/crio-76e38206ec40f3837c209139f2fb35814c1726ab4c383d68c562773141e05db7 WatchSource:0}: Error finding container 76e38206ec40f3837c209139f2fb35814c1726ab4c383d68c562773141e05db7: Status 404 returned error can't find the container with id 76e38206ec40f3837c209139f2fb35814c1726ab4c383d68c562773141e05db7
Jul 23 00:16:00.965588 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:00.965569    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54h4b\" (UniqueName: \"kubernetes.io/projected/b10e2975-b343-44a0-9637-bd3f7cceae76-kube-api-access-54h4b\") pod \"b10e2975-b343-44a0-9637-bd3f7cceae76\" (UID: \"b10e2975-b343-44a0-9637-bd3f7cceae76\") "
Jul 23 00:16:00.967566 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:00.967544    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b10e2975-b343-44a0-9637-bd3f7cceae76-kube-api-access-54h4b" (OuterVolumeSpecName: "kube-api-access-54h4b") pod "b10e2975-b343-44a0-9637-bd3f7cceae76" (UID: "b10e2975-b343-44a0-9637-bd3f7cceae76"). InnerVolumeSpecName "kube-api-access-54h4b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:16:01.067050 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:01.067022    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54h4b\" (UniqueName: \"kubernetes.io/projected/b10e2975-b343-44a0-9637-bd3f7cceae76-kube-api-access-54h4b\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:16:01.369437 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:01.369401    2549 generic.go:356] "Generic (PLEG): container finished" podID="b10e2975-b343-44a0-9637-bd3f7cceae76" containerID="5f03bfcb6197650787d8b9628bc41fd09409a4905dcdb7b7dc4bdd8b5026e3b9" exitCode=0
Jul 23 00:16:01.369905 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:01.369445    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d5pb4"
Jul 23 00:16:01.369905 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:01.369469    2549 scope.go:117] "RemoveContainer" containerID="5f03bfcb6197650787d8b9628bc41fd09409a4905dcdb7b7dc4bdd8b5026e3b9"
Jul 23 00:16:01.371008 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:01.370976    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95vfd" event={"ID":"ace3629f-2d20-4e08-8bca-40575df7db1d","Type":"ContainerStarted","Data":"76e38206ec40f3837c209139f2fb35814c1726ab4c383d68c562773141e05db7"}
Jul 23 00:16:01.371700 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:16:01.371673    2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-d5pb4\" is forbidden: User \"system:node:ip-10-0-138-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-182.ec2.internal' and this object" podUID="b10e2975-b343-44a0-9637-bd3f7cceae76" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d5pb4"
Jul 23 00:16:01.378551 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:01.378530    2549 scope.go:117] "RemoveContainer" containerID="5f03bfcb6197650787d8b9628bc41fd09409a4905dcdb7b7dc4bdd8b5026e3b9"
Jul 23 00:16:01.378814 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:16:01.378795    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f03bfcb6197650787d8b9628bc41fd09409a4905dcdb7b7dc4bdd8b5026e3b9\": container with ID starting with 5f03bfcb6197650787d8b9628bc41fd09409a4905dcdb7b7dc4bdd8b5026e3b9 not found: ID does not exist" containerID="5f03bfcb6197650787d8b9628bc41fd09409a4905dcdb7b7dc4bdd8b5026e3b9"
Jul 23 00:16:01.378905 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:01.378824    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f03bfcb6197650787d8b9628bc41fd09409a4905dcdb7b7dc4bdd8b5026e3b9"} err="failed to get container status \"5f03bfcb6197650787d8b9628bc41fd09409a4905dcdb7b7dc4bdd8b5026e3b9\": rpc error: code = NotFound desc = could not find container \"5f03bfcb6197650787d8b9628bc41fd09409a4905dcdb7b7dc4bdd8b5026e3b9\": container with ID starting with 5f03bfcb6197650787d8b9628bc41fd09409a4905dcdb7b7dc4bdd8b5026e3b9 not found: ID does not exist"
Jul 23 00:16:01.381818 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:16:01.381794    2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-d5pb4\" is forbidden: User \"system:node:ip-10-0-138-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-182.ec2.internal' and this object" podUID="b10e2975-b343-44a0-9637-bd3f7cceae76" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d5pb4"
Jul 23 00:16:01.805133 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:01.805055    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b10e2975-b343-44a0-9637-bd3f7cceae76" path="/var/lib/kubelet/pods/b10e2975-b343-44a0-9637-bd3f7cceae76/volumes"
Jul 23 00:16:05.393962 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:05.393914    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95vfd" event={"ID":"ace3629f-2d20-4e08-8bca-40575df7db1d","Type":"ContainerStarted","Data":"bff42aa787f6d59bb88c1d08e4f4c2159fad4ed486512300ffe40c8d2f957142"}
Jul 23 00:16:05.394540 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:05.394037    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95vfd"
Jul 23 00:16:05.414854 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:05.414794    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95vfd" podStartSLOduration=1.083854774 podStartE2EDuration="5.414771385s" totalImagesPullingTime="4.330916611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:16:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:16:05.412823812 +0000 UTC m=+708.174022119" watchObservedRunningTime="2026-07-23 00:16:05.414771385 +0000 UTC m=+708.175969697"
Jul 23 00:16:16.401070 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:16.400990    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95vfd"
Jul 23 00:16:28.917847 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:28.917804    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95vfd"]
Jul 23 00:16:28.918402 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:28.918004    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95vfd" podUID="ace3629f-2d20-4e08-8bca-40575df7db1d" containerName="manager" containerID="cri-o://bff42aa787f6d59bb88c1d08e4f4c2159fad4ed486512300ffe40c8d2f957142" gracePeriod=10
Jul 23 00:16:29.159643 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:29.159618    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95vfd"
Jul 23 00:16:29.171282 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:29.171207    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7htr\" (UniqueName: \"kubernetes.io/projected/ace3629f-2d20-4e08-8bca-40575df7db1d-kube-api-access-f7htr\") pod \"ace3629f-2d20-4e08-8bca-40575df7db1d\" (UID: \"ace3629f-2d20-4e08-8bca-40575df7db1d\") "
Jul 23 00:16:29.171431 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:29.171303    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ace3629f-2d20-4e08-8bca-40575df7db1d-extensions-socket-volume\") pod \"ace3629f-2d20-4e08-8bca-40575df7db1d\" (UID: \"ace3629f-2d20-4e08-8bca-40575df7db1d\") "
Jul 23 00:16:29.171659 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:29.171635    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ace3629f-2d20-4e08-8bca-40575df7db1d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ace3629f-2d20-4e08-8bca-40575df7db1d" (UID: "ace3629f-2d20-4e08-8bca-40575df7db1d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:16:29.173342 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:29.173318    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ace3629f-2d20-4e08-8bca-40575df7db1d-kube-api-access-f7htr" (OuterVolumeSpecName: "kube-api-access-f7htr") pod "ace3629f-2d20-4e08-8bca-40575df7db1d" (UID: "ace3629f-2d20-4e08-8bca-40575df7db1d"). InnerVolumeSpecName "kube-api-access-f7htr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:16:29.272730 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:29.272694    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7htr\" (UniqueName: \"kubernetes.io/projected/ace3629f-2d20-4e08-8bca-40575df7db1d-kube-api-access-f7htr\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:16:29.272730 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:29.272723    2549 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ace3629f-2d20-4e08-8bca-40575df7db1d-extensions-socket-volume\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:16:29.496091 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:29.496002    2549 generic.go:356] "Generic (PLEG): container finished" podID="ace3629f-2d20-4e08-8bca-40575df7db1d" containerID="bff42aa787f6d59bb88c1d08e4f4c2159fad4ed486512300ffe40c8d2f957142" exitCode=0
Jul 23 00:16:29.496091 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:29.496074    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95vfd"
Jul 23 00:16:29.496252 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:29.496092    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95vfd" event={"ID":"ace3629f-2d20-4e08-8bca-40575df7db1d","Type":"ContainerDied","Data":"bff42aa787f6d59bb88c1d08e4f4c2159fad4ed486512300ffe40c8d2f957142"}
Jul 23 00:16:29.496252 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:29.496171    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95vfd" event={"ID":"ace3629f-2d20-4e08-8bca-40575df7db1d","Type":"ContainerDied","Data":"76e38206ec40f3837c209139f2fb35814c1726ab4c383d68c562773141e05db7"}
Jul 23 00:16:29.496252 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:29.496194    2549 scope.go:117] "RemoveContainer" containerID="bff42aa787f6d59bb88c1d08e4f4c2159fad4ed486512300ffe40c8d2f957142"
Jul 23 00:16:29.504754 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:29.504739    2549 scope.go:117] "RemoveContainer" containerID="bff42aa787f6d59bb88c1d08e4f4c2159fad4ed486512300ffe40c8d2f957142"
Jul 23 00:16:29.505020 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:16:29.505002    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bff42aa787f6d59bb88c1d08e4f4c2159fad4ed486512300ffe40c8d2f957142\": container with ID starting with bff42aa787f6d59bb88c1d08e4f4c2159fad4ed486512300ffe40c8d2f957142 not found: ID does not exist" containerID="bff42aa787f6d59bb88c1d08e4f4c2159fad4ed486512300ffe40c8d2f957142"
Jul 23 00:16:29.505080 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:29.505031    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bff42aa787f6d59bb88c1d08e4f4c2159fad4ed486512300ffe40c8d2f957142"} err="failed to get container status \"bff42aa787f6d59bb88c1d08e4f4c2159fad4ed486512300ffe40c8d2f957142\": rpc error: code = NotFound desc = could not find container \"bff42aa787f6d59bb88c1d08e4f4c2159fad4ed486512300ffe40c8d2f957142\": container with ID starting with bff42aa787f6d59bb88c1d08e4f4c2159fad4ed486512300ffe40c8d2f957142 not found: ID does not exist"
Jul 23 00:16:29.519939 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:29.519916    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95vfd"]
Jul 23 00:16:29.524922 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:29.524903    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95vfd"]
Jul 23 00:16:29.802168 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:29.802105    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ace3629f-2d20-4e08-8bca-40575df7db1d" path="/var/lib/kubelet/pods/ace3629f-2d20-4e08-8bca-40575df7db1d/volumes"
Jul 23 00:16:32.769715 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:32.769684    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb"]
Jul 23 00:16:32.770151 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:32.770105    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b10e2975-b343-44a0-9637-bd3f7cceae76" containerName="manager"
Jul 23 00:16:32.770151 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:32.770122    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="b10e2975-b343-44a0-9637-bd3f7cceae76" containerName="manager"
Jul 23 00:16:32.770151 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:32.770149    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ace3629f-2d20-4e08-8bca-40575df7db1d" containerName="manager"
Jul 23 00:16:32.770304 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:32.770158    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="ace3629f-2d20-4e08-8bca-40575df7db1d" containerName="manager"
Jul 23 00:16:32.770304 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:32.770230    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="ace3629f-2d20-4e08-8bca-40575df7db1d" containerName="manager"
Jul 23 00:16:32.770304 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:32.770244    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="b10e2975-b343-44a0-9637-bd3f7cceae76" containerName="manager"
Jul 23 00:16:32.775260 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:32.775238    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb"
Jul 23 00:16:32.777338 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:32.777316    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-jqtb2\""
Jul 23 00:16:32.786975 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:32.786950    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb"]
Jul 23 00:16:32.800708 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:32.800685    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df3cbd45-9a29-4f51-994a-b04ab3db4a34-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-bplzb\" (UID: \"df3cbd45-9a29-4f51-994a-b04ab3db4a34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb"
Jul 23 00:16:32.800802 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:32.800721    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p59wt\" (UniqueName: \"kubernetes.io/projected/df3cbd45-9a29-4f51-994a-b04ab3db4a34-kube-api-access-p59wt\") pod \"maas-default-gateway-openshift-default-56654dcf7-bplzb\" (UID: \"df3cbd45-9a29-4f51-994a-b04ab3db4a34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb"
Jul 23 00:16:32.800802 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:32.800748    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df3cbd45-9a29-4f51-994a-b04ab3db4a34-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-bplzb\" (UID: \"df3cbd45-9a29-4f51-994a-b04ab3db4a34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb"
Jul 23 00:16:32.800886 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:32.800814    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df3cbd45-9a29-4f51-994a-b04ab3db4a34-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-bplzb\" (UID: \"df3cbd45-9a29-4f51-994a-b04ab3db4a34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb"
Jul 23 00:16:32.800886 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:32.800840    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df3cbd45-9a29-4f51-994a-b04ab3db4a34-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-bplzb\" (UID: \"df3cbd45-9a29-4f51-994a-b04ab3db4a34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb"
Jul 23 00:16:32.800886 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:32.800858    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df3cbd45-9a29-4f51-994a-b04ab3db4a34-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-bplzb\" (UID: \"df3cbd45-9a29-4f51-994a-b04ab3db4a34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb"
Jul 23 00:16:32.800886 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:32.800875    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df3cbd45-9a29-4f51-994a-b04ab3db4a34-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-bplzb\" (UID: \"df3cbd45-9a29-4f51-994a-b04ab3db4a34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb"
Jul 23 00:16:32.801024 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:32.800890    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df3cbd45-9a29-4f51-994a-b04ab3db4a34-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-bplzb\" (UID: \"df3cbd45-9a29-4f51-994a-b04ab3db4a34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb"
Jul 23 00:16:32.801024 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:32.800993    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df3cbd45-9a29-4f51-994a-b04ab3db4a34-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-bplzb\" (UID: \"df3cbd45-9a29-4f51-994a-b04ab3db4a34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb"
Jul 23 00:16:32.901516 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:32.901485    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df3cbd45-9a29-4f51-994a-b04ab3db4a34-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-bplzb\" (UID: \"df3cbd45-9a29-4f51-994a-b04ab3db4a34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb"
Jul 23 00:16:32.901703 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:32.901535    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df3cbd45-9a29-4f51-994a-b04ab3db4a34-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-bplzb\" (UID: \"df3cbd45-9a29-4f51-994a-b04ab3db4a34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb"
Jul 23 00:16:32.901703 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:32.901620    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df3cbd45-9a29-4f51-994a-b04ab3db4a34-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-bplzb\" (UID: \"df3cbd45-9a29-4f51-994a-b04ab3db4a34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb"
Jul 23 00:16:32.901703 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:32.901656    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df3cbd45-9a29-4f51-994a-b04ab3db4a34-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-bplzb\" (UID: \"df3cbd45-9a29-4f51-994a-b04ab3db4a34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb"
Jul 23 00:16:32.901703 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:32.901684    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df3cbd45-9a29-4f51-994a-b04ab3db4a34-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-bplzb\" (UID: \"df3cbd45-9a29-4f51-994a-b04ab3db4a34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb"
Jul 23 00:16:32.901927 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:32.901720    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df3cbd45-9a29-4f51-994a-b04ab3db4a34-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-bplzb\" (UID: \"df3cbd45-9a29-4f51-994a-b04ab3db4a34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb"
Jul 23 00:16:32.901927 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:32.901781    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df3cbd45-9a29-4f51-994a-b04ab3db4a34-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-bplzb\" (UID: \"df3cbd45-9a29-4f51-994a-b04ab3db4a34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb"
Jul 23 00:16:32.901927 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:32.901824    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p59wt\" (UniqueName: \"kubernetes.io/projected/df3cbd45-9a29-4f51-994a-b04ab3db4a34-kube-api-access-p59wt\") pod \"maas-default-gateway-openshift-default-56654dcf7-bplzb\" (UID: \"df3cbd45-9a29-4f51-994a-b04ab3db4a34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb"
Jul 23 00:16:32.901927 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:32.901876    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df3cbd45-9a29-4f51-994a-b04ab3db4a34-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-bplzb\" (UID: \"df3cbd45-9a29-4f51-994a-b04ab3db4a34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb"
Jul 23 00:16:32.902085 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:32.902026    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df3cbd45-9a29-4f51-994a-b04ab3db4a34-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-bplzb\" (UID: \"df3cbd45-9a29-4f51-994a-b04ab3db4a34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb"
Jul 23 00:16:32.902319 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:32.902297    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df3cbd45-9a29-4f51-994a-b04ab3db4a34-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-bplzb\" (UID: \"df3cbd45-9a29-4f51-994a-b04ab3db4a34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb"
Jul 23 00:16:32.902400 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:32.902337    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df3cbd45-9a29-4f51-994a-b04ab3db4a34-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-bplzb\" (UID: \"df3cbd45-9a29-4f51-994a-b04ab3db4a34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb"
Jul 23 00:16:32.902478 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:32.902413    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df3cbd45-9a29-4f51-994a-b04ab3db4a34-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-bplzb\" (UID: \"df3cbd45-9a29-4f51-994a-b04ab3db4a34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb"
Jul 23 00:16:32.902596 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:32.902573    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df3cbd45-9a29-4f51-994a-b04ab3db4a34-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-bplzb\" (UID: \"df3cbd45-9a29-4f51-994a-b04ab3db4a34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb"
Jul 23 00:16:32.904250 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:32.904232    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df3cbd45-9a29-4f51-994a-b04ab3db4a34-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-bplzb\" (UID: \"df3cbd45-9a29-4f51-994a-b04ab3db4a34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb"
Jul 23 00:16:32.904666 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:32.904650    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df3cbd45-9a29-4f51-994a-b04ab3db4a34-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-bplzb\" (UID: \"df3cbd45-9a29-4f51-994a-b04ab3db4a34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb"
Jul 23 00:16:32.909279 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:32.909256    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df3cbd45-9a29-4f51-994a-b04ab3db4a34-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-bplzb\" (UID: \"df3cbd45-9a29-4f51-994a-b04ab3db4a34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb"
Jul 23 00:16:32.909417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:32.909396    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p59wt\" (UniqueName: \"kubernetes.io/projected/df3cbd45-9a29-4f51-994a-b04ab3db4a34-kube-api-access-p59wt\") pod \"maas-default-gateway-openshift-default-56654dcf7-bplzb\" (UID: \"df3cbd45-9a29-4f51-994a-b04ab3db4a34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb"
Jul 23 00:16:33.086521 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:33.086488    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb"
Jul 23 00:16:33.216095 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:33.216066    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb"]
Jul 23 00:16:33.218644 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:16:33.218616    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf3cbd45_9a29_4f51_994a_b04ab3db4a34.slice/crio-5f65ea978776cc69e394e2477d35e0b5b8aa65e75f43db13beaf01bafaad56ac WatchSource:0}: Error finding container 5f65ea978776cc69e394e2477d35e0b5b8aa65e75f43db13beaf01bafaad56ac: Status 404 returned error can't find the container with id 5f65ea978776cc69e394e2477d35e0b5b8aa65e75f43db13beaf01bafaad56ac
Jul 23 00:16:33.520380 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:33.520287    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb" event={"ID":"df3cbd45-9a29-4f51-994a-b04ab3db4a34","Type":"ContainerStarted","Data":"5f65ea978776cc69e394e2477d35e0b5b8aa65e75f43db13beaf01bafaad56ac"}
Jul 23 00:16:35.733029 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:35.732969    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:16:35.733269 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:35.733066    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:16:35.733269 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:35.733093    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:16:36.535995 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:36.535949    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb" event={"ID":"df3cbd45-9a29-4f51-994a-b04ab3db4a34","Type":"ContainerStarted","Data":"46021e562d75519dc5c186a44d76c0dbce964a1b8e94683b6e664dc33593cf0e"}
Jul 23 00:16:36.556497 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:36.556433    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb" podStartSLOduration=2.044390998 podStartE2EDuration="4.556417751s" totalImagesPullingTime="2.512026753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:16:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:16:36.555753408 +0000 UTC m=+739.316951718" watchObservedRunningTime="2026-07-23 00:16:36.556417751 +0000 UTC m=+739.317616061"
Jul 23 00:16:37.087304 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:37.087272    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb"
Jul 23 00:16:37.092015 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:37.091992    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb"
Jul 23 00:16:37.541324 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:37.541238    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb"
Jul 23 00:16:37.542150 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:37.542131    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb"
Jul 23 00:16:47.046625 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:47.046596    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4zfrd"]
Jul 23 00:16:47.049781 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:47.049756    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4zfrd"
Jul 23 00:16:47.052670 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:47.052648    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mrkb7\""
Jul 23 00:16:47.052771 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:47.052648    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 23 00:16:47.052771 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:47.052656    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 23 00:16:47.053808 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:47.053791    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 23 00:16:47.058057 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:47.058036    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4zfrd"]
Jul 23 00:16:47.111775 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:47.111729    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5979036f-2fda-4e21-ab7b-ecbcf0e347cf-config-file\") pod \"limitador-limitador-64c94fd64f-4zfrd\" (UID: \"5979036f-2fda-4e21-ab7b-ecbcf0e347cf\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4zfrd"
Jul 23 00:16:47.111982 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:47.111804    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4t6w\" (UniqueName: \"kubernetes.io/projected/5979036f-2fda-4e21-ab7b-ecbcf0e347cf-kube-api-access-w4t6w\") pod \"limitador-limitador-64c94fd64f-4zfrd\" (UID: \"5979036f-2fda-4e21-ab7b-ecbcf0e347cf\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4zfrd"
Jul 23 00:16:47.146660 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:47.146633    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4zfrd"]
Jul 23 00:16:47.213227 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:47.213200    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4t6w\" (UniqueName: \"kubernetes.io/projected/5979036f-2fda-4e21-ab7b-ecbcf0e347cf-kube-api-access-w4t6w\") pod \"limitador-limitador-64c94fd64f-4zfrd\" (UID: \"5979036f-2fda-4e21-ab7b-ecbcf0e347cf\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4zfrd"
Jul 23 00:16:47.213389 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:47.213283    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5979036f-2fda-4e21-ab7b-ecbcf0e347cf-config-file\") pod \"limitador-limitador-64c94fd64f-4zfrd\" (UID: \"5979036f-2fda-4e21-ab7b-ecbcf0e347cf\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4zfrd"
Jul 23 00:16:47.213907 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:47.213882    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5979036f-2fda-4e21-ab7b-ecbcf0e347cf-config-file\") pod \"limitador-limitador-64c94fd64f-4zfrd\" (UID: \"5979036f-2fda-4e21-ab7b-ecbcf0e347cf\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4zfrd"
Jul 23 00:16:47.221543 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:47.221524    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4t6w\" (UniqueName: \"kubernetes.io/projected/5979036f-2fda-4e21-ab7b-ecbcf0e347cf-kube-api-access-w4t6w\") pod \"limitador-limitador-64c94fd64f-4zfrd\" (UID: \"5979036f-2fda-4e21-ab7b-ecbcf0e347cf\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4zfrd"
Jul 23 00:16:47.360556 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:47.360533    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4zfrd"
Jul 23 00:16:47.485626 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:47.485600    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4zfrd"]
Jul 23 00:16:47.487750 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:16:47.487722    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5979036f_2fda_4e21_ab7b_ecbcf0e347cf.slice/crio-8bf16b3f0683c425b8aa66720679b9d9d1b0318138d6f4f2988d11ef5fd86499 WatchSource:0}: Error finding container 8bf16b3f0683c425b8aa66720679b9d9d1b0318138d6f4f2988d11ef5fd86499: Status 404 returned error can't find the container with id 8bf16b3f0683c425b8aa66720679b9d9d1b0318138d6f4f2988d11ef5fd86499
Jul 23 00:16:47.582281 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:47.582252    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4zfrd" event={"ID":"5979036f-2fda-4e21-ab7b-ecbcf0e347cf","Type":"ContainerStarted","Data":"8bf16b3f0683c425b8aa66720679b9d9d1b0318138d6f4f2988d11ef5fd86499"}
Jul 23 00:16:51.603887 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:51.603853    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4zfrd" event={"ID":"5979036f-2fda-4e21-ab7b-ecbcf0e347cf","Type":"ContainerStarted","Data":"e1c816d4eb20992cf944b5124e1f2963a6a6ebd55fa43cca3b95bbd91964edb5"}
Jul 23 00:16:51.604264 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:51.603981    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-4zfrd"
Jul 23 00:16:51.619741 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:16:51.619700    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-4zfrd" podStartSLOduration=1.558059488 podStartE2EDuration="4.619687544s" totalImagesPullingTime="3.061628056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:16:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:16:51.618844822 +0000 UTC m=+754.380043132" watchObservedRunningTime="2026-07-23 00:16:51.619687544 +0000 UTC m=+754.380885852"
Jul 23 00:17:02.609554 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:02.609526    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-4zfrd"
Jul 23 00:17:03.740192 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:03.740156    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4zfrd"]
Jul 23 00:17:03.740680 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:03.740333    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-4zfrd" podUID="5979036f-2fda-4e21-ab7b-ecbcf0e347cf" containerName="limitador" containerID="cri-o://e1c816d4eb20992cf944b5124e1f2963a6a6ebd55fa43cca3b95bbd91964edb5" gracePeriod=30
Jul 23 00:17:04.293851 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:04.293827    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4zfrd"
Jul 23 00:17:04.345875 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:04.345854    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5979036f-2fda-4e21-ab7b-ecbcf0e347cf-config-file\") pod \"5979036f-2fda-4e21-ab7b-ecbcf0e347cf\" (UID: \"5979036f-2fda-4e21-ab7b-ecbcf0e347cf\") "
Jul 23 00:17:04.345996 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:04.345953    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4t6w\" (UniqueName: \"kubernetes.io/projected/5979036f-2fda-4e21-ab7b-ecbcf0e347cf-kube-api-access-w4t6w\") pod \"5979036f-2fda-4e21-ab7b-ecbcf0e347cf\" (UID: \"5979036f-2fda-4e21-ab7b-ecbcf0e347cf\") "
Jul 23 00:17:04.346188 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:04.346164    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5979036f-2fda-4e21-ab7b-ecbcf0e347cf-config-file" (OuterVolumeSpecName: "config-file") pod "5979036f-2fda-4e21-ab7b-ecbcf0e347cf" (UID: "5979036f-2fda-4e21-ab7b-ecbcf0e347cf"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:17:04.347935 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:04.347915    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5979036f-2fda-4e21-ab7b-ecbcf0e347cf-kube-api-access-w4t6w" (OuterVolumeSpecName: "kube-api-access-w4t6w") pod "5979036f-2fda-4e21-ab7b-ecbcf0e347cf" (UID: "5979036f-2fda-4e21-ab7b-ecbcf0e347cf"). InnerVolumeSpecName "kube-api-access-w4t6w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:17:04.451354 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:04.447068    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4t6w\" (UniqueName: \"kubernetes.io/projected/5979036f-2fda-4e21-ab7b-ecbcf0e347cf-kube-api-access-w4t6w\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:17:04.451354 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:04.447108    2549 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5979036f-2fda-4e21-ab7b-ecbcf0e347cf-config-file\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:17:04.661591 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:04.661505    2549 generic.go:356] "Generic (PLEG): container finished" podID="5979036f-2fda-4e21-ab7b-ecbcf0e347cf" containerID="e1c816d4eb20992cf944b5124e1f2963a6a6ebd55fa43cca3b95bbd91964edb5" exitCode=0
Jul 23 00:17:04.661591 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:04.661570    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4zfrd"
Jul 23 00:17:04.661759 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:04.661574    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4zfrd" event={"ID":"5979036f-2fda-4e21-ab7b-ecbcf0e347cf","Type":"ContainerDied","Data":"e1c816d4eb20992cf944b5124e1f2963a6a6ebd55fa43cca3b95bbd91964edb5"}
Jul 23 00:17:04.661759 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:04.661714    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4zfrd" event={"ID":"5979036f-2fda-4e21-ab7b-ecbcf0e347cf","Type":"ContainerDied","Data":"8bf16b3f0683c425b8aa66720679b9d9d1b0318138d6f4f2988d11ef5fd86499"}
Jul 23 00:17:04.661759 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:04.661743    2549 scope.go:117] "RemoveContainer" containerID="e1c816d4eb20992cf944b5124e1f2963a6a6ebd55fa43cca3b95bbd91964edb5"
Jul 23 00:17:04.670090 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:04.670073    2549 scope.go:117] "RemoveContainer" containerID="e1c816d4eb20992cf944b5124e1f2963a6a6ebd55fa43cca3b95bbd91964edb5"
Jul 23 00:17:04.670349 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:17:04.670330    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1c816d4eb20992cf944b5124e1f2963a6a6ebd55fa43cca3b95bbd91964edb5\": container with ID starting with e1c816d4eb20992cf944b5124e1f2963a6a6ebd55fa43cca3b95bbd91964edb5 not found: ID does not exist" containerID="e1c816d4eb20992cf944b5124e1f2963a6a6ebd55fa43cca3b95bbd91964edb5"
Jul 23 00:17:04.670394 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:04.670358    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1c816d4eb20992cf944b5124e1f2963a6a6ebd55fa43cca3b95bbd91964edb5"} err="failed to get container status \"e1c816d4eb20992cf944b5124e1f2963a6a6ebd55fa43cca3b95bbd91964edb5\": rpc error: code = NotFound desc = could not find container \"e1c816d4eb20992cf944b5124e1f2963a6a6ebd55fa43cca3b95bbd91964edb5\": container with ID starting with e1c816d4eb20992cf944b5124e1f2963a6a6ebd55fa43cca3b95bbd91964edb5 not found: ID does not exist"
Jul 23 00:17:04.681432 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:04.681405    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4zfrd"]
Jul 23 00:17:04.683489 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:04.683470    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4zfrd"]
Jul 23 00:17:05.801953 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:05.801916    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5979036f-2fda-4e21-ab7b-ecbcf0e347cf" path="/var/lib/kubelet/pods/5979036f-2fda-4e21-ab7b-ecbcf0e347cf/volumes"
Jul 23 00:17:09.494508 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:09.494443    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-x76l6"]
Jul 23 00:17:09.494976 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:09.494960    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5979036f-2fda-4e21-ab7b-ecbcf0e347cf" containerName="limitador"
Jul 23 00:17:09.495068 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:09.494980    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="5979036f-2fda-4e21-ab7b-ecbcf0e347cf" containerName="limitador"
Jul 23 00:17:09.495104 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:09.495071    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="5979036f-2fda-4e21-ab7b-ecbcf0e347cf" containerName="limitador"
Jul 23 00:17:09.503506 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:09.503477    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-x76l6"
Jul 23 00:17:09.504197 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:09.504173    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-x76l6"]
Jul 23 00:17:09.506247 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:09.506221    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 23 00:17:09.507217 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:09.507188    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 00:17:09.507315 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:09.507196    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 23 00:17:09.507315 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:09.507223    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-mt7cl\""
Jul 23 00:17:09.591634 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:09.591598    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kjmz\" (UniqueName: \"kubernetes.io/projected/d5e00a53-4d46-4336-9af6-47a8b1a23ddb-kube-api-access-5kjmz\") pod \"postgres-69fb4594cf-x76l6\" (UID: \"d5e00a53-4d46-4336-9af6-47a8b1a23ddb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-x76l6"
Jul 23 00:17:09.591796 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:09.591705    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d5e00a53-4d46-4336-9af6-47a8b1a23ddb-data\") pod \"postgres-69fb4594cf-x76l6\" (UID: \"d5e00a53-4d46-4336-9af6-47a8b1a23ddb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-x76l6"
Jul 23 00:17:09.692424 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:09.692393    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d5e00a53-4d46-4336-9af6-47a8b1a23ddb-data\") pod \"postgres-69fb4594cf-x76l6\" (UID: \"d5e00a53-4d46-4336-9af6-47a8b1a23ddb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-x76l6"
Jul 23 00:17:09.692591 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:09.692492    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kjmz\" (UniqueName: \"kubernetes.io/projected/d5e00a53-4d46-4336-9af6-47a8b1a23ddb-kube-api-access-5kjmz\") pod \"postgres-69fb4594cf-x76l6\" (UID: \"d5e00a53-4d46-4336-9af6-47a8b1a23ddb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-x76l6"
Jul 23 00:17:09.692808 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:09.692788    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d5e00a53-4d46-4336-9af6-47a8b1a23ddb-data\") pod \"postgres-69fb4594cf-x76l6\" (UID: \"d5e00a53-4d46-4336-9af6-47a8b1a23ddb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-x76l6"
Jul 23 00:17:09.702218 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:09.702194    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kjmz\" (UniqueName: \"kubernetes.io/projected/d5e00a53-4d46-4336-9af6-47a8b1a23ddb-kube-api-access-5kjmz\") pod \"postgres-69fb4594cf-x76l6\" (UID: \"d5e00a53-4d46-4336-9af6-47a8b1a23ddb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-x76l6"
Jul 23 00:17:09.813857 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:09.813827    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-x76l6"
Jul 23 00:17:09.945615 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:09.945587    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-x76l6"]
Jul 23 00:17:09.947394 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:17:09.947365    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5e00a53_4d46_4336_9af6_47a8b1a23ddb.slice/crio-47c3f317910e354a8e20fcfd36a1df9428ced92f1116e937541fcbf35a80dd97 WatchSource:0}: Error finding container 47c3f317910e354a8e20fcfd36a1df9428ced92f1116e937541fcbf35a80dd97: Status 404 returned error can't find the container with id 47c3f317910e354a8e20fcfd36a1df9428ced92f1116e937541fcbf35a80dd97
Jul 23 00:17:10.699534 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:10.699483    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-x76l6" event={"ID":"d5e00a53-4d46-4336-9af6-47a8b1a23ddb","Type":"ContainerStarted","Data":"47c3f317910e354a8e20fcfd36a1df9428ced92f1116e937541fcbf35a80dd97"}
Jul 23 00:17:14.722694 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:14.722661    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-x76l6" event={"ID":"d5e00a53-4d46-4336-9af6-47a8b1a23ddb","Type":"ContainerStarted","Data":"aed2c806dc2739ec0d2006977d13dbb742d8824939c52528dd3b8f2a996cdfe5"}
Jul 23 00:17:14.723042 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:14.722738    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-x76l6"
Jul 23 00:17:14.740688 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:14.740648    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-x76l6" podStartSLOduration=1.076577646 podStartE2EDuration="5.740634058s" totalImagesPullingTime="4.664056412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:17:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:17:14.739111857 +0000 UTC m=+777.500310168" watchObservedRunningTime="2026-07-23 00:17:14.740634058 +0000 UTC m=+777.501832368"
Jul 23 00:17:20.756094 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:20.756064    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-x76l6"
Jul 23 00:17:28.958071 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:28.958039    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-85758fb78f-9q97r"]
Jul 23 00:17:28.984292 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:28.984261    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85758fb78f-9q97r"]
Jul 23 00:17:28.984436 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:28.984378    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85758fb78f-9q97r"
Jul 23 00:17:28.986928 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:28.986900    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 00:17:28.987088 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:28.986913    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 00:17:28.987088 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:28.987040    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-x6xs5\""
Jul 23 00:17:29.140539 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:29.140507    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-557dfd9f99-v2tmt"]
Jul 23 00:17:29.143832 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:29.143811    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-557dfd9f99-v2tmt"
Jul 23 00:17:29.152221 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:29.152194    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-557dfd9f99-v2tmt"]
Jul 23 00:17:29.157857 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:29.157836    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsd6h\" (UniqueName: \"kubernetes.io/projected/aba5aef4-6b49-4b01-9adc-f85d338a1c77-kube-api-access-zsd6h\") pod \"maas-controller-85758fb78f-9q97r\" (UID: \"aba5aef4-6b49-4b01-9adc-f85d338a1c77\") " pod="opendatahub/maas-controller-85758fb78f-9q97r"
Jul 23 00:17:29.157959 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:29.157867    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aba5aef4-6b49-4b01-9adc-f85d338a1c77-webhook-cert\") pod \"maas-controller-85758fb78f-9q97r\" (UID: \"aba5aef4-6b49-4b01-9adc-f85d338a1c77\") " pod="opendatahub/maas-controller-85758fb78f-9q97r"
Jul 23 00:17:29.258761 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:29.258692    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsd6h\" (UniqueName: \"kubernetes.io/projected/aba5aef4-6b49-4b01-9adc-f85d338a1c77-kube-api-access-zsd6h\") pod \"maas-controller-85758fb78f-9q97r\" (UID: \"aba5aef4-6b49-4b01-9adc-f85d338a1c77\") " pod="opendatahub/maas-controller-85758fb78f-9q97r"
Jul 23 00:17:29.258761 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:29.258728    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aba5aef4-6b49-4b01-9adc-f85d338a1c77-webhook-cert\") pod \"maas-controller-85758fb78f-9q97r\" (UID: \"aba5aef4-6b49-4b01-9adc-f85d338a1c77\") " pod="opendatahub/maas-controller-85758fb78f-9q97r"
Jul 23 00:17:29.258961 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:29.258789    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-225hx\" (UniqueName: \"kubernetes.io/projected/01f8e8f0-89a3-400b-be4c-20caa99c2efa-kube-api-access-225hx\") pod \"maas-controller-557dfd9f99-v2tmt\" (UID: \"01f8e8f0-89a3-400b-be4c-20caa99c2efa\") " pod="opendatahub/maas-controller-557dfd9f99-v2tmt"
Jul 23 00:17:29.258961 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:29.258808    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/01f8e8f0-89a3-400b-be4c-20caa99c2efa-webhook-cert\") pod \"maas-controller-557dfd9f99-v2tmt\" (UID: \"01f8e8f0-89a3-400b-be4c-20caa99c2efa\") " pod="opendatahub/maas-controller-557dfd9f99-v2tmt"
Jul 23 00:17:29.261126 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:29.261102    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aba5aef4-6b49-4b01-9adc-f85d338a1c77-webhook-cert\") pod \"maas-controller-85758fb78f-9q97r\" (UID: \"aba5aef4-6b49-4b01-9adc-f85d338a1c77\") " pod="opendatahub/maas-controller-85758fb78f-9q97r"
Jul 23 00:17:29.268475 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:29.268439    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsd6h\" (UniqueName: \"kubernetes.io/projected/aba5aef4-6b49-4b01-9adc-f85d338a1c77-kube-api-access-zsd6h\") pod \"maas-controller-85758fb78f-9q97r\" (UID: \"aba5aef4-6b49-4b01-9adc-f85d338a1c77\") " pod="opendatahub/maas-controller-85758fb78f-9q97r"
Jul 23 00:17:29.295412 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:29.295392    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85758fb78f-9q97r"
Jul 23 00:17:29.360228 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:29.360194    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-225hx\" (UniqueName: \"kubernetes.io/projected/01f8e8f0-89a3-400b-be4c-20caa99c2efa-kube-api-access-225hx\") pod \"maas-controller-557dfd9f99-v2tmt\" (UID: \"01f8e8f0-89a3-400b-be4c-20caa99c2efa\") " pod="opendatahub/maas-controller-557dfd9f99-v2tmt"
Jul 23 00:17:29.360331 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:29.360255    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/01f8e8f0-89a3-400b-be4c-20caa99c2efa-webhook-cert\") pod \"maas-controller-557dfd9f99-v2tmt\" (UID: \"01f8e8f0-89a3-400b-be4c-20caa99c2efa\") " pod="opendatahub/maas-controller-557dfd9f99-v2tmt"
Jul 23 00:17:29.362612 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:29.362592    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/01f8e8f0-89a3-400b-be4c-20caa99c2efa-webhook-cert\") pod \"maas-controller-557dfd9f99-v2tmt\" (UID: \"01f8e8f0-89a3-400b-be4c-20caa99c2efa\") " pod="opendatahub/maas-controller-557dfd9f99-v2tmt"
Jul 23 00:17:29.369792 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:29.369768    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-225hx\" (UniqueName: \"kubernetes.io/projected/01f8e8f0-89a3-400b-be4c-20caa99c2efa-kube-api-access-225hx\") pod \"maas-controller-557dfd9f99-v2tmt\" (UID: \"01f8e8f0-89a3-400b-be4c-20caa99c2efa\") " pod="opendatahub/maas-controller-557dfd9f99-v2tmt"
Jul 23 00:17:29.424918 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:29.424864    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85758fb78f-9q97r"]
Jul 23 00:17:29.426846 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:17:29.426812    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaba5aef4_6b49_4b01_9adc_f85d338a1c77.slice/crio-392fe0b78029771fac0dfe448bc57c01222e2740053800e879800d1c07f91c39 WatchSource:0}: Error finding container 392fe0b78029771fac0dfe448bc57c01222e2740053800e879800d1c07f91c39: Status 404 returned error can't find the container with id 392fe0b78029771fac0dfe448bc57c01222e2740053800e879800d1c07f91c39
Jul 23 00:17:29.454180 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:29.454151    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-557dfd9f99-v2tmt"
Jul 23 00:17:29.583601 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:29.577832    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-557dfd9f99-v2tmt"]
Jul 23 00:17:29.786548 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:29.786475    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-557dfd9f99-v2tmt" event={"ID":"01f8e8f0-89a3-400b-be4c-20caa99c2efa","Type":"ContainerStarted","Data":"c06c1f2851bf756708524bc260a73fd8061249f51a695e96e22280df16ff3365"}
Jul 23 00:17:29.787701 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:29.787677    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85758fb78f-9q97r" event={"ID":"aba5aef4-6b49-4b01-9adc-f85d338a1c77","Type":"ContainerStarted","Data":"392fe0b78029771fac0dfe448bc57c01222e2740053800e879800d1c07f91c39"}
Jul 23 00:17:32.806646 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:32.806612    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-557dfd9f99-v2tmt" event={"ID":"01f8e8f0-89a3-400b-be4c-20caa99c2efa","Type":"ContainerStarted","Data":"d9bda858988795d19205fde02577fcdd4ace8a3769c44e779bcec97e02a82a38"}
Jul 23 00:17:32.807120 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:32.806695    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-557dfd9f99-v2tmt"
Jul 23 00:17:32.808202 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:32.808180    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85758fb78f-9q97r" event={"ID":"aba5aef4-6b49-4b01-9adc-f85d338a1c77","Type":"ContainerStarted","Data":"db008a99667fccbab51c67252e6350c8fe5fd2b4dacf33ab03d738c796f7e206"}
Jul 23 00:17:32.808308 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:32.808231    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-85758fb78f-9q97r"
Jul 23 00:17:32.827055 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:32.827008    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-557dfd9f99-v2tmt" podStartSLOduration=1.488263227 podStartE2EDuration="3.826995032s" totalImagesPullingTime="2.338731805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:17:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:17:32.824840197 +0000 UTC m=+795.586038507" watchObservedRunningTime="2026-07-23 00:17:32.826995032 +0000 UTC m=+795.588193342"
Jul 23 00:17:32.844237 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:32.844196    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-85758fb78f-9q97r" podStartSLOduration=2.362210474 podStartE2EDuration="4.844182347s" totalImagesPullingTime="2.481971873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:17:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:17:32.842552541 +0000 UTC m=+795.603750850" watchObservedRunningTime="2026-07-23 00:17:32.844182347 +0000 UTC m=+795.605380680"
Jul 23 00:17:43.813595 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:43.813503    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-557dfd9f99-v2tmt"
Jul 23 00:17:43.813595 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:43.813583    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-85758fb78f-9q97r"
Jul 23 00:17:43.868356 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:43.868323    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85758fb78f-9q97r"]
Jul 23 00:17:43.868575 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:43.868551    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-85758fb78f-9q97r" podUID="aba5aef4-6b49-4b01-9adc-f85d338a1c77" containerName="manager" containerID="cri-o://db008a99667fccbab51c67252e6350c8fe5fd2b4dacf33ab03d738c796f7e206" gracePeriod=30
Jul 23 00:17:44.113983 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:44.113959    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85758fb78f-9q97r"
Jul 23 00:17:44.177045 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:44.177008    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aba5aef4-6b49-4b01-9adc-f85d338a1c77-webhook-cert\") pod \"aba5aef4-6b49-4b01-9adc-f85d338a1c77\" (UID: \"aba5aef4-6b49-4b01-9adc-f85d338a1c77\") "
Jul 23 00:17:44.177208 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:44.177065    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zsd6h\" (UniqueName: \"kubernetes.io/projected/aba5aef4-6b49-4b01-9adc-f85d338a1c77-kube-api-access-zsd6h\") pod \"aba5aef4-6b49-4b01-9adc-f85d338a1c77\" (UID: \"aba5aef4-6b49-4b01-9adc-f85d338a1c77\") "
Jul 23 00:17:44.179249 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:44.179214    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aba5aef4-6b49-4b01-9adc-f85d338a1c77-kube-api-access-zsd6h" (OuterVolumeSpecName: "kube-api-access-zsd6h") pod "aba5aef4-6b49-4b01-9adc-f85d338a1c77" (UID: "aba5aef4-6b49-4b01-9adc-f85d338a1c77"). InnerVolumeSpecName "kube-api-access-zsd6h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:17:44.179351 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:44.179215    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aba5aef4-6b49-4b01-9adc-f85d338a1c77-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "aba5aef4-6b49-4b01-9adc-f85d338a1c77" (UID: "aba5aef4-6b49-4b01-9adc-f85d338a1c77"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 00:17:44.278323 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:44.278282    2549 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aba5aef4-6b49-4b01-9adc-f85d338a1c77-webhook-cert\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:17:44.278323 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:44.278314    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsd6h\" (UniqueName: \"kubernetes.io/projected/aba5aef4-6b49-4b01-9adc-f85d338a1c77-kube-api-access-zsd6h\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:17:44.858901 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:44.858854    2549 generic.go:356] "Generic (PLEG): container finished" podID="aba5aef4-6b49-4b01-9adc-f85d338a1c77" containerID="db008a99667fccbab51c67252e6350c8fe5fd2b4dacf33ab03d738c796f7e206" exitCode=0
Jul 23 00:17:44.859382 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:44.858917    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85758fb78f-9q97r"
Jul 23 00:17:44.859382 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:44.858935    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85758fb78f-9q97r" event={"ID":"aba5aef4-6b49-4b01-9adc-f85d338a1c77","Type":"ContainerDied","Data":"db008a99667fccbab51c67252e6350c8fe5fd2b4dacf33ab03d738c796f7e206"}
Jul 23 00:17:44.859382 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:44.858975    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85758fb78f-9q97r" event={"ID":"aba5aef4-6b49-4b01-9adc-f85d338a1c77","Type":"ContainerDied","Data":"392fe0b78029771fac0dfe448bc57c01222e2740053800e879800d1c07f91c39"}
Jul 23 00:17:44.859382 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:44.858998    2549 scope.go:117] "RemoveContainer" containerID="db008a99667fccbab51c67252e6350c8fe5fd2b4dacf33ab03d738c796f7e206"
Jul 23 00:17:44.869545 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:44.869511    2549 scope.go:117] "RemoveContainer" containerID="db008a99667fccbab51c67252e6350c8fe5fd2b4dacf33ab03d738c796f7e206"
Jul 23 00:17:44.869915 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:17:44.869893    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db008a99667fccbab51c67252e6350c8fe5fd2b4dacf33ab03d738c796f7e206\": container with ID starting with db008a99667fccbab51c67252e6350c8fe5fd2b4dacf33ab03d738c796f7e206 not found: ID does not exist" containerID="db008a99667fccbab51c67252e6350c8fe5fd2b4dacf33ab03d738c796f7e206"
Jul 23 00:17:44.869965 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:44.869927    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db008a99667fccbab51c67252e6350c8fe5fd2b4dacf33ab03d738c796f7e206"} err="failed to get container status \"db008a99667fccbab51c67252e6350c8fe5fd2b4dacf33ab03d738c796f7e206\": rpc error: code = NotFound desc = could not find container \"db008a99667fccbab51c67252e6350c8fe5fd2b4dacf33ab03d738c796f7e206\": container with ID starting with db008a99667fccbab51c67252e6350c8fe5fd2b4dacf33ab03d738c796f7e206 not found: ID does not exist"
Jul 23 00:17:44.881844 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:44.881820    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85758fb78f-9q97r"]
Jul 23 00:17:44.883531 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:44.883511    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-85758fb78f-9q97r"]
Jul 23 00:17:45.802510 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:17:45.802480    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aba5aef4-6b49-4b01-9adc-f85d338a1c77" path="/var/lib/kubelet/pods/aba5aef4-6b49-4b01-9adc-f85d338a1c77/volumes"
Jul 23 00:18:04.441222 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:04.441186    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5bc9bfb844-x77kn"]
Jul 23 00:18:04.441842 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:04.441583    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aba5aef4-6b49-4b01-9adc-f85d338a1c77" containerName="manager"
Jul 23 00:18:04.441842 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:04.441596    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="aba5aef4-6b49-4b01-9adc-f85d338a1c77" containerName="manager"
Jul 23 00:18:04.441842 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:04.441664    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="aba5aef4-6b49-4b01-9adc-f85d338a1c77" containerName="manager"
Jul 23 00:18:04.449945 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:04.449925    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5bc9bfb844-x77kn"
Jul 23 00:18:04.452506 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:04.452478    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 23 00:18:04.452627 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:04.452517    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-6q2qh\""
Jul 23 00:18:04.457027 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:04.457002    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5bc9bfb844-x77kn"]
Jul 23 00:18:04.533583 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:04.533543    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ed1fd6a-37ef-4ee9-9d75-670f733186d5-openshift-service-ca\") pod \"maas-api-5bc9bfb844-x77kn\" (UID: \"8ed1fd6a-37ef-4ee9-9d75-670f733186d5\") " pod="odh-ai-gateway-infra/maas-api-5bc9bfb844-x77kn"
Jul 23 00:18:04.533775 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:04.533591    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9r84\" (UniqueName: \"kubernetes.io/projected/8ed1fd6a-37ef-4ee9-9d75-670f733186d5-kube-api-access-v9r84\") pod \"maas-api-5bc9bfb844-x77kn\" (UID: \"8ed1fd6a-37ef-4ee9-9d75-670f733186d5\") " pod="odh-ai-gateway-infra/maas-api-5bc9bfb844-x77kn"
Jul 23 00:18:04.533775 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:04.533624    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ed1fd6a-37ef-4ee9-9d75-670f733186d5-maas-api-tls\") pod \"maas-api-5bc9bfb844-x77kn\" (UID: \"8ed1fd6a-37ef-4ee9-9d75-670f733186d5\") " pod="odh-ai-gateway-infra/maas-api-5bc9bfb844-x77kn"
Jul 23 00:18:04.634572 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:04.634536    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ed1fd6a-37ef-4ee9-9d75-670f733186d5-maas-api-tls\") pod \"maas-api-5bc9bfb844-x77kn\" (UID: \"8ed1fd6a-37ef-4ee9-9d75-670f733186d5\") " pod="odh-ai-gateway-infra/maas-api-5bc9bfb844-x77kn"
Jul 23 00:18:04.634743 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:04.634598    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ed1fd6a-37ef-4ee9-9d75-670f733186d5-openshift-service-ca\") pod \"maas-api-5bc9bfb844-x77kn\" (UID: \"8ed1fd6a-37ef-4ee9-9d75-670f733186d5\") " pod="odh-ai-gateway-infra/maas-api-5bc9bfb844-x77kn"
Jul 23 00:18:04.634743 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:04.634625    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9r84\" (UniqueName: \"kubernetes.io/projected/8ed1fd6a-37ef-4ee9-9d75-670f733186d5-kube-api-access-v9r84\") pod \"maas-api-5bc9bfb844-x77kn\" (UID: \"8ed1fd6a-37ef-4ee9-9d75-670f733186d5\") " pod="odh-ai-gateway-infra/maas-api-5bc9bfb844-x77kn"
Jul 23 00:18:04.635314 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:04.635287    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ed1fd6a-37ef-4ee9-9d75-670f733186d5-openshift-service-ca\") pod \"maas-api-5bc9bfb844-x77kn\" (UID: \"8ed1fd6a-37ef-4ee9-9d75-670f733186d5\") " pod="odh-ai-gateway-infra/maas-api-5bc9bfb844-x77kn"
Jul 23 00:18:04.636994 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:04.636963    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ed1fd6a-37ef-4ee9-9d75-670f733186d5-maas-api-tls\") pod \"maas-api-5bc9bfb844-x77kn\" (UID: \"8ed1fd6a-37ef-4ee9-9d75-670f733186d5\") " pod="odh-ai-gateway-infra/maas-api-5bc9bfb844-x77kn"
Jul 23 00:18:04.641600 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:04.641574    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9r84\" (UniqueName: \"kubernetes.io/projected/8ed1fd6a-37ef-4ee9-9d75-670f733186d5-kube-api-access-v9r84\") pod \"maas-api-5bc9bfb844-x77kn\" (UID: \"8ed1fd6a-37ef-4ee9-9d75-670f733186d5\") " pod="odh-ai-gateway-infra/maas-api-5bc9bfb844-x77kn"
Jul 23 00:18:04.762434 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:04.762346    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5bc9bfb844-x77kn"
Jul 23 00:18:04.904580 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:04.904463    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5bc9bfb844-x77kn"]
Jul 23 00:18:04.907390 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:18:04.907363    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ed1fd6a_37ef_4ee9_9d75_670f733186d5.slice/crio-29ecc9c6aa207fc371a309b25b4e233afa994e50ef10fb6da3b4eaa3c2b9871f WatchSource:0}: Error finding container 29ecc9c6aa207fc371a309b25b4e233afa994e50ef10fb6da3b4eaa3c2b9871f: Status 404 returned error can't find the container with id 29ecc9c6aa207fc371a309b25b4e233afa994e50ef10fb6da3b4eaa3c2b9871f
Jul 23 00:18:04.908754 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:04.908734    2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 00:18:04.914214 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:04.914192    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-fjw84"]
Jul 23 00:18:04.919212 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:04.919194    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-fjw84"
Jul 23 00:18:04.921597 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:04.921576    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 23 00:18:04.928135 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:04.927568    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-fjw84"]
Jul 23 00:18:04.944412 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:04.944385    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5bc9bfb844-x77kn" event={"ID":"8ed1fd6a-37ef-4ee9-9d75-670f733186d5","Type":"ContainerStarted","Data":"29ecc9c6aa207fc371a309b25b4e233afa994e50ef10fb6da3b4eaa3c2b9871f"}
Jul 23 00:18:04.966377 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:04.966354    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-lstnn"]
Jul 23 00:18:04.969835 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:04.969819    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-lstnn"
Jul 23 00:18:04.972604 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:04.972586    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-r2krf\""
Jul 23 00:18:04.982889 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:04.982859    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-lstnn"]
Jul 23 00:18:05.037875 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:05.037800    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/295776fe-d951-4e48-ba46-c16618528f55-plugins-config-volume\") pod \"payload-processing-5bf47cd988-lstnn\" (UID: \"295776fe-d951-4e48-ba46-c16618528f55\") " pod="openshift-ingress/payload-processing-5bf47cd988-lstnn"
Jul 23 00:18:05.037875 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:05.037850    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdts4\" (UniqueName: \"kubernetes.io/projected/c96b796b-090f-4144-922f-92ce06689911-kube-api-access-gdts4\") pod \"payload-pre-processing-7677b774bb-fjw84\" (UID: \"c96b796b-090f-4144-922f-92ce06689911\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fjw84"
Jul 23 00:18:05.038060 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:05.037916    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp2vz\" (UniqueName: \"kubernetes.io/projected/295776fe-d951-4e48-ba46-c16618528f55-kube-api-access-jp2vz\") pod \"payload-processing-5bf47cd988-lstnn\" (UID: \"295776fe-d951-4e48-ba46-c16618528f55\") " pod="openshift-ingress/payload-processing-5bf47cd988-lstnn"
Jul 23 00:18:05.038060 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:05.037984    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c96b796b-090f-4144-922f-92ce06689911-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-fjw84\" (UID: \"c96b796b-090f-4144-922f-92ce06689911\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fjw84"
Jul 23 00:18:05.138776 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:05.138741    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c96b796b-090f-4144-922f-92ce06689911-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-fjw84\" (UID: \"c96b796b-090f-4144-922f-92ce06689911\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fjw84"
Jul 23 00:18:05.138962 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:05.138794    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/295776fe-d951-4e48-ba46-c16618528f55-plugins-config-volume\") pod \"payload-processing-5bf47cd988-lstnn\" (UID: \"295776fe-d951-4e48-ba46-c16618528f55\") " pod="openshift-ingress/payload-processing-5bf47cd988-lstnn"
Jul 23 00:18:05.138962 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:05.138827    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdts4\" (UniqueName: \"kubernetes.io/projected/c96b796b-090f-4144-922f-92ce06689911-kube-api-access-gdts4\") pod \"payload-pre-processing-7677b774bb-fjw84\" (UID: \"c96b796b-090f-4144-922f-92ce06689911\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fjw84"
Jul 23 00:18:05.138962 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:05.138849    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp2vz\" (UniqueName: \"kubernetes.io/projected/295776fe-d951-4e48-ba46-c16618528f55-kube-api-access-jp2vz\") pod \"payload-processing-5bf47cd988-lstnn\" (UID: \"295776fe-d951-4e48-ba46-c16618528f55\") " pod="openshift-ingress/payload-processing-5bf47cd988-lstnn"
Jul 23 00:18:05.139562 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:05.139537    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c96b796b-090f-4144-922f-92ce06689911-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-fjw84\" (UID: \"c96b796b-090f-4144-922f-92ce06689911\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fjw84"
Jul 23 00:18:05.139661 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:05.139560    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/295776fe-d951-4e48-ba46-c16618528f55-plugins-config-volume\") pod \"payload-processing-5bf47cd988-lstnn\" (UID: \"295776fe-d951-4e48-ba46-c16618528f55\") " pod="openshift-ingress/payload-processing-5bf47cd988-lstnn"
Jul 23 00:18:05.155868 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:05.155845    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdts4\" (UniqueName: \"kubernetes.io/projected/c96b796b-090f-4144-922f-92ce06689911-kube-api-access-gdts4\") pod \"payload-pre-processing-7677b774bb-fjw84\" (UID: \"c96b796b-090f-4144-922f-92ce06689911\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fjw84"
Jul 23 00:18:05.156269 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:05.156252    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp2vz\" (UniqueName: \"kubernetes.io/projected/295776fe-d951-4e48-ba46-c16618528f55-kube-api-access-jp2vz\") pod \"payload-processing-5bf47cd988-lstnn\" (UID: \"295776fe-d951-4e48-ba46-c16618528f55\") " pod="openshift-ingress/payload-processing-5bf47cd988-lstnn"
Jul 23 00:18:05.231308 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:05.231280    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-fjw84"
Jul 23 00:18:05.280103 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:05.280081    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-lstnn"
Jul 23 00:18:05.423732 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:05.423706    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-lstnn"]
Jul 23 00:18:05.425388 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:18:05.425363    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod295776fe_d951_4e48_ba46_c16618528f55.slice/crio-fd8017a0fb7974595329b28a1d5680fd9cbb33bcbb5bcc9d58725c4c234c656c WatchSource:0}: Error finding container fd8017a0fb7974595329b28a1d5680fd9cbb33bcbb5bcc9d58725c4c234c656c: Status 404 returned error can't find the container with id fd8017a0fb7974595329b28a1d5680fd9cbb33bcbb5bcc9d58725c4c234c656c
Jul 23 00:18:05.573490 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:05.573434    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-fjw84"]
Jul 23 00:18:05.575607 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:18:05.575578    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc96b796b_090f_4144_922f_92ce06689911.slice/crio-82048f32a120efcc90e36a37beb85ed57f95a29c3e98aa94ab6a699259b71576 WatchSource:0}: Error finding container 82048f32a120efcc90e36a37beb85ed57f95a29c3e98aa94ab6a699259b71576: Status 404 returned error can't find the container with id 82048f32a120efcc90e36a37beb85ed57f95a29c3e98aa94ab6a699259b71576
Jul 23 00:18:05.950405 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:05.950317    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-fjw84" event={"ID":"c96b796b-090f-4144-922f-92ce06689911","Type":"ContainerStarted","Data":"82048f32a120efcc90e36a37beb85ed57f95a29c3e98aa94ab6a699259b71576"}
Jul 23 00:18:05.951408 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:05.951385    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-lstnn" event={"ID":"295776fe-d951-4e48-ba46-c16618528f55","Type":"ContainerStarted","Data":"fd8017a0fb7974595329b28a1d5680fd9cbb33bcbb5bcc9d58725c4c234c656c"}
Jul 23 00:18:07.967862 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:07.967807    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5bc9bfb844-x77kn" event={"ID":"8ed1fd6a-37ef-4ee9-9d75-670f733186d5","Type":"ContainerStarted","Data":"e657f1d6eeac7dbeb03a50ee66f048f9005534fd1b964534b200cdea1b14447d"}
Jul 23 00:18:07.968326 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:07.967890    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5bc9bfb844-x77kn"
Jul 23 00:18:07.985483 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:07.985412    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5bc9bfb844-x77kn" podStartSLOduration=1.370808306 podStartE2EDuration="3.985395216s" totalImagesPullingTime="2.61458691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:18:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:18:07.983348402 +0000 UTC m=+830.744546713" watchObservedRunningTime="2026-07-23 00:18:07.985395216 +0000 UTC m=+830.746593532"
Jul 23 00:18:08.974108 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:08.973674    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-fjw84" event={"ID":"c96b796b-090f-4144-922f-92ce06689911","Type":"ContainerStarted","Data":"56d5e6901361fc4068ddf92cb17ff60f3c8e9f48bc25745903186530ad6c3dda"}
Jul 23 00:18:08.974108 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:08.973940    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-fjw84"
Jul 23 00:18:08.975211 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:08.975185    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-lstnn" event={"ID":"295776fe-d951-4e48-ba46-c16618528f55","Type":"ContainerStarted","Data":"14c329f19c15bec22c6801fc9247cc243ee36889ef4e416e952635a752e907a0"}
Jul 23 00:18:08.975416 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:08.975395    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-lstnn"
Jul 23 00:18:08.989079 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:08.989029    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-fjw84" podStartSLOduration=2.448946737 podStartE2EDuration="4.989012636s" totalImagesPullingTime="2.540065899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:18:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:18:08.987923546 +0000 UTC m=+831.749121867" watchObservedRunningTime="2026-07-23 00:18:08.989012636 +0000 UTC m=+831.750210952"
Jul 23 00:18:12.996827 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:12.996736    2549 generic.go:356] "Generic (PLEG): container finished" podID="df3cbd45-9a29-4f51-994a-b04ab3db4a34" containerID="46021e562d75519dc5c186a44d76c0dbce964a1b8e94683b6e664dc33593cf0e" exitCode=0
Jul 23 00:18:12.996827 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:12.996813    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb" event={"ID":"df3cbd45-9a29-4f51-994a-b04ab3db4a34","Type":"ContainerDied","Data":"46021e562d75519dc5c186a44d76c0dbce964a1b8e94683b6e664dc33593cf0e"}
Jul 23 00:18:12.997236 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:12.997186    2549 scope.go:117] "RemoveContainer" containerID="46021e562d75519dc5c186a44d76c0dbce964a1b8e94683b6e664dc33593cf0e"
Jul 23 00:18:12.998147 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:12.998124    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:18:12.998212 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:12.998192    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:18:12.998259 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:12.998224    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:18:13.019020 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:13.018980    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-lstnn" podStartSLOduration=6.322437133 podStartE2EDuration="9.018966708s" totalImagesPullingTime="2.696529575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:18:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:18:09.006693875 +0000 UTC m=+831.767892185" watchObservedRunningTime="2026-07-23 00:18:13.018966708 +0000 UTC m=+835.780165021"
Jul 23 00:18:13.980741 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:13.980706    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5bc9bfb844-x77kn"
Jul 23 00:18:14.006648 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:14.005779    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb" event={"ID":"df3cbd45-9a29-4f51-994a-b04ab3db4a34","Type":"ContainerStarted","Data":"cf7e44bbe77f6b9def4ff24d645358c2392ea754257746d64683d3a0b13f36a7"}
Jul 23 00:18:14.087296 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:14.087266    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb"
Jul 23 00:18:14.087480 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:14.087401    2549 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-bplzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body=
Jul 23 00:18:14.087534 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:14.087477    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb" podUID="df3cbd45-9a29-4f51-994a-b04ab3db4a34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused"
Jul 23 00:18:15.087002 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:15.086973    2549 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-bplzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body=
Jul 23 00:18:15.087365 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:15.087022    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb" podUID="df3cbd45-9a29-4f51-994a-b04ab3db4a34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused"
Jul 23 00:18:16.087647 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:16.087614    2549 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-bplzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body=
Jul 23 00:18:16.088007 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:16.087687    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb" podUID="df3cbd45-9a29-4f51-994a-b04ab3db4a34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused"
Jul 23 00:18:17.087419 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:17.087387    2549 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-bplzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body=
Jul 23 00:18:17.087609 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:17.087444    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb" podUID="df3cbd45-9a29-4f51-994a-b04ab3db4a34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused"
Jul 23 00:18:18.091035 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:18.091006    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb"
Jul 23 00:18:18.091425 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:18.091404    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb"
Jul 23 00:18:18.092102 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:18.092074    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bplzb"
Jul 23 00:18:19.982508 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:19.982473    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-lstnn"
Jul 23 00:18:19.982947 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:19.982551    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-fjw84"
Jul 23 00:18:21.669752 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:21.669713    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld"]
Jul 23 00:18:21.674050 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:21.674033    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld"
Jul 23 00:18:21.677005 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:21.676984    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 23 00:18:21.677119 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:21.677098    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 23 00:18:21.677170 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:21.677152    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xwdgp\""
Jul 23 00:18:21.678632 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:21.678619    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 23 00:18:21.691761 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:21.691740    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld"]
Jul 23 00:18:21.785966 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:21.785930    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh5tq\" (UniqueName: \"kubernetes.io/projected/d20e2b13-51ba-40c1-9bf0-9846a23f6235-kube-api-access-gh5tq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld\" (UID: \"d20e2b13-51ba-40c1-9bf0-9846a23f6235\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld"
Jul 23 00:18:21.786169 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:21.785994    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d20e2b13-51ba-40c1-9bf0-9846a23f6235-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld\" (UID: \"d20e2b13-51ba-40c1-9bf0-9846a23f6235\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld"
Jul 23 00:18:21.786169 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:21.786017    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d20e2b13-51ba-40c1-9bf0-9846a23f6235-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld\" (UID: \"d20e2b13-51ba-40c1-9bf0-9846a23f6235\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld"
Jul 23 00:18:21.786169 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:21.786062    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d20e2b13-51ba-40c1-9bf0-9846a23f6235-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld\" (UID: \"d20e2b13-51ba-40c1-9bf0-9846a23f6235\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld"
Jul 23 00:18:21.786169 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:21.786079    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d20e2b13-51ba-40c1-9bf0-9846a23f6235-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld\" (UID: \"d20e2b13-51ba-40c1-9bf0-9846a23f6235\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld"
Jul 23 00:18:21.786169 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:21.786094    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d20e2b13-51ba-40c1-9bf0-9846a23f6235-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld\" (UID: \"d20e2b13-51ba-40c1-9bf0-9846a23f6235\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld"
Jul 23 00:18:21.887076 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:21.887042    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh5tq\" (UniqueName: \"kubernetes.io/projected/d20e2b13-51ba-40c1-9bf0-9846a23f6235-kube-api-access-gh5tq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld\" (UID: \"d20e2b13-51ba-40c1-9bf0-9846a23f6235\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld"
Jul 23 00:18:21.887251 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:21.887121    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d20e2b13-51ba-40c1-9bf0-9846a23f6235-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld\" (UID: \"d20e2b13-51ba-40c1-9bf0-9846a23f6235\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld"
Jul 23 00:18:21.887251 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:21.887210    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d20e2b13-51ba-40c1-9bf0-9846a23f6235-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld\" (UID: \"d20e2b13-51ba-40c1-9bf0-9846a23f6235\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld"
Jul 23 00:18:21.887370 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:21.887300    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d20e2b13-51ba-40c1-9bf0-9846a23f6235-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld\" (UID: \"d20e2b13-51ba-40c1-9bf0-9846a23f6235\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld"
Jul 23 00:18:21.887370 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:21.887334    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d20e2b13-51ba-40c1-9bf0-9846a23f6235-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld\" (UID: \"d20e2b13-51ba-40c1-9bf0-9846a23f6235\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld"
Jul 23 00:18:21.887370 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:21.887362    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d20e2b13-51ba-40c1-9bf0-9846a23f6235-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld\" (UID: \"d20e2b13-51ba-40c1-9bf0-9846a23f6235\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld"
Jul 23 00:18:21.887730 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:21.887699    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d20e2b13-51ba-40c1-9bf0-9846a23f6235-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld\" (UID: \"d20e2b13-51ba-40c1-9bf0-9846a23f6235\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld"
Jul 23 00:18:21.887865 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:21.887705    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d20e2b13-51ba-40c1-9bf0-9846a23f6235-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld\" (UID: \"d20e2b13-51ba-40c1-9bf0-9846a23f6235\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld"
Jul 23 00:18:21.887865 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:21.887790    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d20e2b13-51ba-40c1-9bf0-9846a23f6235-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld\" (UID: \"d20e2b13-51ba-40c1-9bf0-9846a23f6235\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld"
Jul 23 00:18:21.889861 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:21.889840    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d20e2b13-51ba-40c1-9bf0-9846a23f6235-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld\" (UID: \"d20e2b13-51ba-40c1-9bf0-9846a23f6235\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld"
Jul 23 00:18:21.889973 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:21.889929    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d20e2b13-51ba-40c1-9bf0-9846a23f6235-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld\" (UID: \"d20e2b13-51ba-40c1-9bf0-9846a23f6235\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld"
Jul 23 00:18:21.898720 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:21.898689    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh5tq\" (UniqueName: \"kubernetes.io/projected/d20e2b13-51ba-40c1-9bf0-9846a23f6235-kube-api-access-gh5tq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld\" (UID: \"d20e2b13-51ba-40c1-9bf0-9846a23f6235\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld"
Jul 23 00:18:21.984648 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:21.984552    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld"
Jul 23 00:18:22.125973 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:22.125947    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld"]
Jul 23 00:18:22.127725 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:18:22.127696    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd20e2b13_51ba_40c1_9bf0_9846a23f6235.slice/crio-bfd81cb8aba7ce3dfabdc47031ef87edd38591f16f4470e7b58d3f8ca58d3173 WatchSource:0}: Error finding container bfd81cb8aba7ce3dfabdc47031ef87edd38591f16f4470e7b58d3f8ca58d3173: Status 404 returned error can't find the container with id bfd81cb8aba7ce3dfabdc47031ef87edd38591f16f4470e7b58d3f8ca58d3173
Jul 23 00:18:23.053012 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:23.052975    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld" event={"ID":"d20e2b13-51ba-40c1-9bf0-9846a23f6235","Type":"ContainerStarted","Data":"bfd81cb8aba7ce3dfabdc47031ef87edd38591f16f4470e7b58d3f8ca58d3173"}
Jul 23 00:18:24.059426 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:24.059392    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld" event={"ID":"d20e2b13-51ba-40c1-9bf0-9846a23f6235","Type":"ContainerStarted","Data":"716d44f9aee2b0038cfe6069a76214c87f3c12e3a8a9a4419df91ea41e39ef9f"}
Jul 23 00:18:24.076002 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:24.075933    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld" podStartSLOduration=2.023535614 podStartE2EDuration="3.075916621s" totalImagesPullingTime="1.052381007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:18:24.075037484 +0000 UTC m=+846.836235795" watchObservedRunningTime="2026-07-23 00:18:24.075916621 +0000 UTC m=+846.837114932"
Jul 23 00:18:31.984885 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:31.984853    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld"
Jul 23 00:18:31.985257 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:31.984903    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld"
Jul 23 00:18:31.997543 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:31.997512    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld"
Jul 23 00:18:32.108155 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:32.108129    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld"
Jul 23 00:18:39.944614 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:39.944576    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8"]
Jul 23 00:18:39.951044 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:39.951022    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8"
Jul 23 00:18:39.953549 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:39.953518    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 23 00:18:39.958980 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:39.958960    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8"]
Jul 23 00:18:40.147890 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:40.147859    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e00d9856-00b6-4737-be4a-dfa64d98f720-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8\" (UID: \"e00d9856-00b6-4737-be4a-dfa64d98f720\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8"
Jul 23 00:18:40.148052 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:40.147903    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e00d9856-00b6-4737-be4a-dfa64d98f720-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8\" (UID: \"e00d9856-00b6-4737-be4a-dfa64d98f720\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8"
Jul 23 00:18:40.148052 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:40.148004    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e00d9856-00b6-4737-be4a-dfa64d98f720-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8\" (UID: \"e00d9856-00b6-4737-be4a-dfa64d98f720\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8"
Jul 23 00:18:40.148052 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:40.148034    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e00d9856-00b6-4737-be4a-dfa64d98f720-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8\" (UID: \"e00d9856-00b6-4737-be4a-dfa64d98f720\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8"
Jul 23 00:18:40.148199 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:40.148059    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e00d9856-00b6-4737-be4a-dfa64d98f720-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8\" (UID: \"e00d9856-00b6-4737-be4a-dfa64d98f720\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8"
Jul 23 00:18:40.148199 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:40.148081    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj4z9\" (UniqueName: \"kubernetes.io/projected/e00d9856-00b6-4737-be4a-dfa64d98f720-kube-api-access-kj4z9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8\" (UID: \"e00d9856-00b6-4737-be4a-dfa64d98f720\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8"
Jul 23 00:18:40.249093 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:40.249009    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e00d9856-00b6-4737-be4a-dfa64d98f720-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8\" (UID: \"e00d9856-00b6-4737-be4a-dfa64d98f720\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8"
Jul 23 00:18:40.249093 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:40.249053    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e00d9856-00b6-4737-be4a-dfa64d98f720-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8\" (UID: \"e00d9856-00b6-4737-be4a-dfa64d98f720\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8"
Jul 23 00:18:40.249275 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:40.249095    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e00d9856-00b6-4737-be4a-dfa64d98f720-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8\" (UID: \"e00d9856-00b6-4737-be4a-dfa64d98f720\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8"
Jul 23 00:18:40.249275 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:40.249113    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e00d9856-00b6-4737-be4a-dfa64d98f720-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8\" (UID: \"e00d9856-00b6-4737-be4a-dfa64d98f720\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8"
Jul 23 00:18:40.249275 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:40.249132    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e00d9856-00b6-4737-be4a-dfa64d98f720-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8\" (UID: \"e00d9856-00b6-4737-be4a-dfa64d98f720\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8"
Jul 23 00:18:40.249275 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:40.249152    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj4z9\" (UniqueName: \"kubernetes.io/projected/e00d9856-00b6-4737-be4a-dfa64d98f720-kube-api-access-kj4z9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8\" (UID: \"e00d9856-00b6-4737-be4a-dfa64d98f720\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8"
Jul 23 00:18:40.249553 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:40.249533    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e00d9856-00b6-4737-be4a-dfa64d98f720-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8\" (UID: \"e00d9856-00b6-4737-be4a-dfa64d98f720\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8"
Jul 23 00:18:40.249626 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:40.249572    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e00d9856-00b6-4737-be4a-dfa64d98f720-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8\" (UID: \"e00d9856-00b6-4737-be4a-dfa64d98f720\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8"
Jul 23 00:18:40.249626 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:40.249613    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e00d9856-00b6-4737-be4a-dfa64d98f720-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8\" (UID: \"e00d9856-00b6-4737-be4a-dfa64d98f720\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8"
Jul 23 00:18:40.251384 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:40.251363    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e00d9856-00b6-4737-be4a-dfa64d98f720-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8\" (UID: \"e00d9856-00b6-4737-be4a-dfa64d98f720\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8"
Jul 23 00:18:40.251574 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:40.251553    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e00d9856-00b6-4737-be4a-dfa64d98f720-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8\" (UID: \"e00d9856-00b6-4737-be4a-dfa64d98f720\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8"
Jul 23 00:18:40.258109 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:40.258083    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj4z9\" (UniqueName: \"kubernetes.io/projected/e00d9856-00b6-4737-be4a-dfa64d98f720-kube-api-access-kj4z9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8\" (UID: \"e00d9856-00b6-4737-be4a-dfa64d98f720\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8"
Jul 23 00:18:40.261791 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:40.261770    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8"
Jul 23 00:18:40.406524 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:40.406378    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8"]
Jul 23 00:18:40.408921 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:18:40.408898    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode00d9856_00b6_4737_be4a_dfa64d98f720.slice/crio-55d801e901b74a7a491bc766f26832761715002ff5f802879fa3ea13e138133a WatchSource:0}: Error finding container 55d801e901b74a7a491bc766f26832761715002ff5f802879fa3ea13e138133a: Status 404 returned error can't find the container with id 55d801e901b74a7a491bc766f26832761715002ff5f802879fa3ea13e138133a
Jul 23 00:18:41.140565 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:41.140525    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8" event={"ID":"e00d9856-00b6-4737-be4a-dfa64d98f720","Type":"ContainerStarted","Data":"c1706001135e9f6d07549afd6a38c98976b5b850e76612c7f3fabc1ab7155d25"}
Jul 23 00:18:41.140989 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:41.140584    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8" event={"ID":"e00d9856-00b6-4737-be4a-dfa64d98f720","Type":"ContainerStarted","Data":"55d801e901b74a7a491bc766f26832761715002ff5f802879fa3ea13e138133a"}
Jul 23 00:18:41.158562 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:41.158507    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8" podStartSLOduration=1.970847536 podStartE2EDuration="2.158491209s" totalImagesPullingTime="187.643673ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:18:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:18:41.156597125 +0000 UTC m=+863.917795436" watchObservedRunningTime="2026-07-23 00:18:41.158491209 +0000 UTC m=+863.919689545"
Jul 23 00:18:50.262564 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:50.262529    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8"
Jul 23 00:18:50.263054 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:50.262582    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8"
Jul 23 00:18:50.275099 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:50.275073    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8"
Jul 23 00:18:51.198192 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:18:51.198155    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8"
Jul 23 00:20:46.968893 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:20:46.968814    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-557dfd9f99-v2tmt"]
Jul 23 00:20:46.969433 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:20:46.969045    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-557dfd9f99-v2tmt" podUID="01f8e8f0-89a3-400b-be4c-20caa99c2efa" containerName="manager" containerID="cri-o://d9bda858988795d19205fde02577fcdd4ace8a3769c44e779bcec97e02a82a38" gracePeriod=30
Jul 23 00:20:47.213463 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:20:47.213422    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-557dfd9f99-v2tmt"
Jul 23 00:20:47.274183 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:20:47.274105    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-225hx\" (UniqueName: \"kubernetes.io/projected/01f8e8f0-89a3-400b-be4c-20caa99c2efa-kube-api-access-225hx\") pod \"01f8e8f0-89a3-400b-be4c-20caa99c2efa\" (UID: \"01f8e8f0-89a3-400b-be4c-20caa99c2efa\") "
Jul 23 00:20:47.274183 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:20:47.274162    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/01f8e8f0-89a3-400b-be4c-20caa99c2efa-webhook-cert\") pod \"01f8e8f0-89a3-400b-be4c-20caa99c2efa\" (UID: \"01f8e8f0-89a3-400b-be4c-20caa99c2efa\") "
Jul 23 00:20:47.276152 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:20:47.276122    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01f8e8f0-89a3-400b-be4c-20caa99c2efa-kube-api-access-225hx" (OuterVolumeSpecName: "kube-api-access-225hx") pod "01f8e8f0-89a3-400b-be4c-20caa99c2efa" (UID: "01f8e8f0-89a3-400b-be4c-20caa99c2efa"). InnerVolumeSpecName "kube-api-access-225hx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:20:47.276256 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:20:47.276126    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01f8e8f0-89a3-400b-be4c-20caa99c2efa-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "01f8e8f0-89a3-400b-be4c-20caa99c2efa" (UID: "01f8e8f0-89a3-400b-be4c-20caa99c2efa"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 00:20:47.375121 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:20:47.375089    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-225hx\" (UniqueName: \"kubernetes.io/projected/01f8e8f0-89a3-400b-be4c-20caa99c2efa-kube-api-access-225hx\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:20:47.375121 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:20:47.375115    2549 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/01f8e8f0-89a3-400b-be4c-20caa99c2efa-webhook-cert\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:20:47.740583 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:20:47.740545    2549 generic.go:356] "Generic (PLEG): container finished" podID="01f8e8f0-89a3-400b-be4c-20caa99c2efa" containerID="d9bda858988795d19205fde02577fcdd4ace8a3769c44e779bcec97e02a82a38" exitCode=0
Jul 23 00:20:47.740792 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:20:47.740598    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-557dfd9f99-v2tmt"
Jul 23 00:20:47.740792 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:20:47.740642    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-557dfd9f99-v2tmt" event={"ID":"01f8e8f0-89a3-400b-be4c-20caa99c2efa","Type":"ContainerDied","Data":"d9bda858988795d19205fde02577fcdd4ace8a3769c44e779bcec97e02a82a38"}
Jul 23 00:20:47.740792 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:20:47.740706    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-557dfd9f99-v2tmt" event={"ID":"01f8e8f0-89a3-400b-be4c-20caa99c2efa","Type":"ContainerDied","Data":"c06c1f2851bf756708524bc260a73fd8061249f51a695e96e22280df16ff3365"}
Jul 23 00:20:47.740792 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:20:47.740731    2549 scope.go:117] "RemoveContainer" containerID="d9bda858988795d19205fde02577fcdd4ace8a3769c44e779bcec97e02a82a38"
Jul 23 00:20:47.749862 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:20:47.749846    2549 scope.go:117] "RemoveContainer" containerID="d9bda858988795d19205fde02577fcdd4ace8a3769c44e779bcec97e02a82a38"
Jul 23 00:20:47.750128 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:20:47.750106    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9bda858988795d19205fde02577fcdd4ace8a3769c44e779bcec97e02a82a38\": container with ID starting with d9bda858988795d19205fde02577fcdd4ace8a3769c44e779bcec97e02a82a38 not found: ID does not exist" containerID="d9bda858988795d19205fde02577fcdd4ace8a3769c44e779bcec97e02a82a38"
Jul 23 00:20:47.750198 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:20:47.750138    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9bda858988795d19205fde02577fcdd4ace8a3769c44e779bcec97e02a82a38"} err="failed to get container status \"d9bda858988795d19205fde02577fcdd4ace8a3769c44e779bcec97e02a82a38\": rpc error: code = NotFound desc = could not find container \"d9bda858988795d19205fde02577fcdd4ace8a3769c44e779bcec97e02a82a38\": container with ID starting with d9bda858988795d19205fde02577fcdd4ace8a3769c44e779bcec97e02a82a38 not found: ID does not exist"
Jul 23 00:20:47.761753 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:20:47.761731    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-557dfd9f99-v2tmt"]
Jul 23 00:20:47.763406 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:20:47.763386    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-557dfd9f99-v2tmt"]
Jul 23 00:20:47.801935 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:20:47.801914    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01f8e8f0-89a3-400b-be4c-20caa99c2efa" path="/var/lib/kubelet/pods/01f8e8f0-89a3-400b-be4c-20caa99c2efa/volumes"
Jul 23 00:21:48.560471 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:21:48.560417    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-557dfd9f99-mbnqg"]
Jul 23 00:21:48.560956 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:21:48.560771    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01f8e8f0-89a3-400b-be4c-20caa99c2efa" containerName="manager"
Jul 23 00:21:48.560956 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:21:48.560783    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="01f8e8f0-89a3-400b-be4c-20caa99c2efa" containerName="manager"
Jul 23 00:21:48.560956 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:21:48.560853    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="01f8e8f0-89a3-400b-be4c-20caa99c2efa" containerName="manager"
Jul 23 00:21:48.563435 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:21:48.563418    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-557dfd9f99-mbnqg"
Jul 23 00:21:48.566498 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:21:48.566475    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-x6xs5\""
Jul 23 00:21:48.566498 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:21:48.566486    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 00:21:48.566673 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:21:48.566518    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 00:21:48.573641 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:21:48.573616    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-557dfd9f99-mbnqg"]
Jul 23 00:21:48.584644 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:21:48.584621    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bmvq\" (UniqueName: \"kubernetes.io/projected/345201fc-30a5-4021-9762-d49777c0e9cb-kube-api-access-9bmvq\") pod \"maas-controller-557dfd9f99-mbnqg\" (UID: \"345201fc-30a5-4021-9762-d49777c0e9cb\") " pod="opendatahub/maas-controller-557dfd9f99-mbnqg"
Jul 23 00:21:48.584757 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:21:48.584734    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/345201fc-30a5-4021-9762-d49777c0e9cb-webhook-cert\") pod \"maas-controller-557dfd9f99-mbnqg\" (UID: \"345201fc-30a5-4021-9762-d49777c0e9cb\") " pod="opendatahub/maas-controller-557dfd9f99-mbnqg"
Jul 23 00:21:48.685661 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:21:48.685625    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bmvq\" (UniqueName: \"kubernetes.io/projected/345201fc-30a5-4021-9762-d49777c0e9cb-kube-api-access-9bmvq\") pod \"maas-controller-557dfd9f99-mbnqg\" (UID: \"345201fc-30a5-4021-9762-d49777c0e9cb\") " pod="opendatahub/maas-controller-557dfd9f99-mbnqg"
Jul 23 00:21:48.685808 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:21:48.685713    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/345201fc-30a5-4021-9762-d49777c0e9cb-webhook-cert\") pod \"maas-controller-557dfd9f99-mbnqg\" (UID: \"345201fc-30a5-4021-9762-d49777c0e9cb\") " pod="opendatahub/maas-controller-557dfd9f99-mbnqg"
Jul 23 00:21:48.688198 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:21:48.688177    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/345201fc-30a5-4021-9762-d49777c0e9cb-webhook-cert\") pod \"maas-controller-557dfd9f99-mbnqg\" (UID: \"345201fc-30a5-4021-9762-d49777c0e9cb\") " pod="opendatahub/maas-controller-557dfd9f99-mbnqg"
Jul 23 00:21:48.693064 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:21:48.693041    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bmvq\" (UniqueName: \"kubernetes.io/projected/345201fc-30a5-4021-9762-d49777c0e9cb-kube-api-access-9bmvq\") pod \"maas-controller-557dfd9f99-mbnqg\" (UID: \"345201fc-30a5-4021-9762-d49777c0e9cb\") " pod="opendatahub/maas-controller-557dfd9f99-mbnqg"
Jul 23 00:21:48.873650 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:21:48.873620    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-557dfd9f99-mbnqg"
Jul 23 00:21:49.007947 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:21:49.007917    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-557dfd9f99-mbnqg"]
Jul 23 00:21:49.009359 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:21:49.009334    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod345201fc_30a5_4021_9762_d49777c0e9cb.slice/crio-2e5a65f6d1fdd33d05ecf829ac5997625f6ca90ed95efb0a085e6221bab94db0 WatchSource:0}: Error finding container 2e5a65f6d1fdd33d05ecf829ac5997625f6ca90ed95efb0a085e6221bab94db0: Status 404 returned error can't find the container with id 2e5a65f6d1fdd33d05ecf829ac5997625f6ca90ed95efb0a085e6221bab94db0
Jul 23 00:21:50.019141 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:21:50.019108    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-557dfd9f99-mbnqg" event={"ID":"345201fc-30a5-4021-9762-d49777c0e9cb","Type":"ContainerStarted","Data":"23173befc977a361d80d4c331cbc2973bc0ddec35e7e12331a5a49b38428b740"}
Jul 23 00:21:50.019528 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:21:50.019161    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-557dfd9f99-mbnqg" event={"ID":"345201fc-30a5-4021-9762-d49777c0e9cb","Type":"ContainerStarted","Data":"2e5a65f6d1fdd33d05ecf829ac5997625f6ca90ed95efb0a085e6221bab94db0"}
Jul 23 00:21:50.019528 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:21:50.019191    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-557dfd9f99-mbnqg"
Jul 23 00:21:50.037871 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:21:50.037822    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-557dfd9f99-mbnqg" podStartSLOduration=1.584775954 podStartE2EDuration="2.037807404s" totalImagesPullingTime="453.03145ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:21:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:21:50.03682008 +0000 UTC m=+1052.798018390" watchObservedRunningTime="2026-07-23 00:21:50.037807404 +0000 UTC m=+1052.799005713"
Jul 23 00:22:01.025620 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:01.025587    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-557dfd9f99-mbnqg"
Jul 23 00:22:05.671569 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:05.671530    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-557dfd9f99-mbnqg"]
Jul 23 00:22:05.672001 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:05.671783    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-557dfd9f99-mbnqg" podUID="345201fc-30a5-4021-9762-d49777c0e9cb" containerName="manager" containerID="cri-o://23173befc977a361d80d4c331cbc2973bc0ddec35e7e12331a5a49b38428b740" gracePeriod=30
Jul 23 00:22:05.922045 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:05.921986    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-557dfd9f99-mbnqg"
Jul 23 00:22:06.033495 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:06.033466    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/345201fc-30a5-4021-9762-d49777c0e9cb-webhook-cert\") pod \"345201fc-30a5-4021-9762-d49777c0e9cb\" (UID: \"345201fc-30a5-4021-9762-d49777c0e9cb\") "
Jul 23 00:22:06.033646 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:06.033524    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9bmvq\" (UniqueName: \"kubernetes.io/projected/345201fc-30a5-4021-9762-d49777c0e9cb-kube-api-access-9bmvq\") pod \"345201fc-30a5-4021-9762-d49777c0e9cb\" (UID: \"345201fc-30a5-4021-9762-d49777c0e9cb\") "
Jul 23 00:22:06.035438 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:06.035408    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/345201fc-30a5-4021-9762-d49777c0e9cb-kube-api-access-9bmvq" (OuterVolumeSpecName: "kube-api-access-9bmvq") pod "345201fc-30a5-4021-9762-d49777c0e9cb" (UID: "345201fc-30a5-4021-9762-d49777c0e9cb"). InnerVolumeSpecName "kube-api-access-9bmvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:22:06.035566 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:06.035435    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/345201fc-30a5-4021-9762-d49777c0e9cb-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "345201fc-30a5-4021-9762-d49777c0e9cb" (UID: "345201fc-30a5-4021-9762-d49777c0e9cb"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 00:22:06.089930 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:06.089897    2549 generic.go:356] "Generic (PLEG): container finished" podID="345201fc-30a5-4021-9762-d49777c0e9cb" containerID="23173befc977a361d80d4c331cbc2973bc0ddec35e7e12331a5a49b38428b740" exitCode=0
Jul 23 00:22:06.090042 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:06.089948    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-557dfd9f99-mbnqg"
Jul 23 00:22:06.090042 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:06.089987    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-557dfd9f99-mbnqg" event={"ID":"345201fc-30a5-4021-9762-d49777c0e9cb","Type":"ContainerDied","Data":"23173befc977a361d80d4c331cbc2973bc0ddec35e7e12331a5a49b38428b740"}
Jul 23 00:22:06.090123 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:06.090045    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-557dfd9f99-mbnqg" event={"ID":"345201fc-30a5-4021-9762-d49777c0e9cb","Type":"ContainerDied","Data":"2e5a65f6d1fdd33d05ecf829ac5997625f6ca90ed95efb0a085e6221bab94db0"}
Jul 23 00:22:06.090123 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:06.090068    2549 scope.go:117] "RemoveContainer" containerID="23173befc977a361d80d4c331cbc2973bc0ddec35e7e12331a5a49b38428b740"
Jul 23 00:22:06.098499 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:06.098483    2549 scope.go:117] "RemoveContainer" containerID="23173befc977a361d80d4c331cbc2973bc0ddec35e7e12331a5a49b38428b740"
Jul 23 00:22:06.098742 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:22:06.098723    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23173befc977a361d80d4c331cbc2973bc0ddec35e7e12331a5a49b38428b740\": container with ID starting with 23173befc977a361d80d4c331cbc2973bc0ddec35e7e12331a5a49b38428b740 not found: ID does not exist" containerID="23173befc977a361d80d4c331cbc2973bc0ddec35e7e12331a5a49b38428b740"
Jul 23 00:22:06.098785 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:06.098750    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23173befc977a361d80d4c331cbc2973bc0ddec35e7e12331a5a49b38428b740"} err="failed to get container status \"23173befc977a361d80d4c331cbc2973bc0ddec35e7e12331a5a49b38428b740\": rpc error: code = NotFound desc = could not find container \"23173befc977a361d80d4c331cbc2973bc0ddec35e7e12331a5a49b38428b740\": container with ID starting with 23173befc977a361d80d4c331cbc2973bc0ddec35e7e12331a5a49b38428b740 not found: ID does not exist"
Jul 23 00:22:06.110903 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:06.110882    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-557dfd9f99-mbnqg"]
Jul 23 00:22:06.114856 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:06.114835    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-557dfd9f99-mbnqg"]
Jul 23 00:22:06.134331 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:06.134305    2549 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/345201fc-30a5-4021-9762-d49777c0e9cb-webhook-cert\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:22:06.134331 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:06.134328    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bmvq\" (UniqueName: \"kubernetes.io/projected/345201fc-30a5-4021-9762-d49777c0e9cb-kube-api-access-9bmvq\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:22:06.926527 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:06.926490    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-557dfd9f99-bfnk9"]
Jul 23 00:22:06.926978 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:06.926826    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="345201fc-30a5-4021-9762-d49777c0e9cb" containerName="manager"
Jul 23 00:22:06.926978 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:06.926837    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="345201fc-30a5-4021-9762-d49777c0e9cb" containerName="manager"
Jul 23 00:22:06.926978 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:06.926915    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="345201fc-30a5-4021-9762-d49777c0e9cb" containerName="manager"
Jul 23 00:22:06.931116 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:06.931098    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-557dfd9f99-bfnk9"
Jul 23 00:22:06.934157 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:06.934135    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-x6xs5\""
Jul 23 00:22:06.934288 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:06.934142    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 00:22:06.934288 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:06.934200    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 00:22:06.937351 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:06.937331    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-557dfd9f99-bfnk9"]
Jul 23 00:22:07.042951 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:07.042912    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsgb6\" (UniqueName: \"kubernetes.io/projected/2a5ad4a7-0dad-4a7b-8179-4a7e8687521e-kube-api-access-hsgb6\") pod \"maas-controller-557dfd9f99-bfnk9\" (UID: \"2a5ad4a7-0dad-4a7b-8179-4a7e8687521e\") " pod="opendatahub/maas-controller-557dfd9f99-bfnk9"
Jul 23 00:22:07.042951 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:07.042956    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a5ad4a7-0dad-4a7b-8179-4a7e8687521e-webhook-cert\") pod \"maas-controller-557dfd9f99-bfnk9\" (UID: \"2a5ad4a7-0dad-4a7b-8179-4a7e8687521e\") " pod="opendatahub/maas-controller-557dfd9f99-bfnk9"
Jul 23 00:22:07.144175 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:07.144136    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsgb6\" (UniqueName: \"kubernetes.io/projected/2a5ad4a7-0dad-4a7b-8179-4a7e8687521e-kube-api-access-hsgb6\") pod \"maas-controller-557dfd9f99-bfnk9\" (UID: \"2a5ad4a7-0dad-4a7b-8179-4a7e8687521e\") " pod="opendatahub/maas-controller-557dfd9f99-bfnk9"
Jul 23 00:22:07.144175 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:07.144175    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a5ad4a7-0dad-4a7b-8179-4a7e8687521e-webhook-cert\") pod \"maas-controller-557dfd9f99-bfnk9\" (UID: \"2a5ad4a7-0dad-4a7b-8179-4a7e8687521e\") " pod="opendatahub/maas-controller-557dfd9f99-bfnk9"
Jul 23 00:22:07.146732 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:07.146706    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a5ad4a7-0dad-4a7b-8179-4a7e8687521e-webhook-cert\") pod \"maas-controller-557dfd9f99-bfnk9\" (UID: \"2a5ad4a7-0dad-4a7b-8179-4a7e8687521e\") " pod="opendatahub/maas-controller-557dfd9f99-bfnk9"
Jul 23 00:22:07.153666 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:07.153645    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsgb6\" (UniqueName: \"kubernetes.io/projected/2a5ad4a7-0dad-4a7b-8179-4a7e8687521e-kube-api-access-hsgb6\") pod \"maas-controller-557dfd9f99-bfnk9\" (UID: \"2a5ad4a7-0dad-4a7b-8179-4a7e8687521e\") " pod="opendatahub/maas-controller-557dfd9f99-bfnk9"
Jul 23 00:22:07.242786 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:07.242666    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-557dfd9f99-bfnk9"
Jul 23 00:22:07.377428 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:07.377406    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-557dfd9f99-bfnk9"]
Jul 23 00:22:07.378797 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:22:07.378769    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a5ad4a7_0dad_4a7b_8179_4a7e8687521e.slice/crio-55d559de7e008cf57f22f100772147a11e5b1e8dd9c8fc769c56313dbd142e1e WatchSource:0}: Error finding container 55d559de7e008cf57f22f100772147a11e5b1e8dd9c8fc769c56313dbd142e1e: Status 404 returned error can't find the container with id 55d559de7e008cf57f22f100772147a11e5b1e8dd9c8fc769c56313dbd142e1e
Jul 23 00:22:07.802616 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:07.802585    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="345201fc-30a5-4021-9762-d49777c0e9cb" path="/var/lib/kubelet/pods/345201fc-30a5-4021-9762-d49777c0e9cb/volumes"
Jul 23 00:22:08.101778 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:08.101740    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-557dfd9f99-bfnk9" event={"ID":"2a5ad4a7-0dad-4a7b-8179-4a7e8687521e","Type":"ContainerStarted","Data":"c6e959171bc67974412ec4f8018720588f7e0ddf6d8725bd4e94c43c6f38ff73"}
Jul 23 00:22:08.102166 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:08.101796    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-557dfd9f99-bfnk9" event={"ID":"2a5ad4a7-0dad-4a7b-8179-4a7e8687521e","Type":"ContainerStarted","Data":"55d559de7e008cf57f22f100772147a11e5b1e8dd9c8fc769c56313dbd142e1e"}
Jul 23 00:22:08.102166 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:08.101834    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-557dfd9f99-bfnk9"
Jul 23 00:22:08.120297 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:08.120234    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-557dfd9f99-bfnk9" podStartSLOduration=1.754115437 podStartE2EDuration="2.120212486s" totalImagesPullingTime="366.097049ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:22:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:22:08.116763404 +0000 UTC m=+1070.877961715" watchObservedRunningTime="2026-07-23 00:22:08.120212486 +0000 UTC m=+1070.881410797"
Jul 23 00:22:19.109170 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:22:19.109142    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-557dfd9f99-bfnk9"
Jul 23 00:35:04.381978 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:04.381945    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"]
Jul 23 00:35:04.385431 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:04.385412    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"
Jul 23 00:35:04.388034 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:04.388011    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-4bcf43ed-openshift-default-dockercfg-5l2r6\""
Jul 23 00:35:04.408175 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:04.408142    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"]
Jul 23 00:35:04.513482 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:04.513410    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d5d040c-eb14-42eb-a3f2-109684d29873-istio-token\") pod \"e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd\" (UID: \"8d5d040c-eb14-42eb-a3f2-109684d29873\") " pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"
Jul 23 00:35:04.513650 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:04.513491    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d5d040c-eb14-42eb-a3f2-109684d29873-istio-podinfo\") pod \"e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd\" (UID: \"8d5d040c-eb14-42eb-a3f2-109684d29873\") " pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"
Jul 23 00:35:04.513650 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:04.513581    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d5d040c-eb14-42eb-a3f2-109684d29873-credential-socket\") pod \"e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd\" (UID: \"8d5d040c-eb14-42eb-a3f2-109684d29873\") " pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"
Jul 23 00:35:04.513650 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:04.513629    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d5d040c-eb14-42eb-a3f2-109684d29873-istiod-ca-cert\") pod \"e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd\" (UID: \"8d5d040c-eb14-42eb-a3f2-109684d29873\") " pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"
Jul 23 00:35:04.513808 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:04.513652    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcm2l\" (UniqueName: \"kubernetes.io/projected/8d5d040c-eb14-42eb-a3f2-109684d29873-kube-api-access-xcm2l\") pod \"e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd\" (UID: \"8d5d040c-eb14-42eb-a3f2-109684d29873\") " pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"
Jul 23 00:35:04.513808 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:04.513676    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d5d040c-eb14-42eb-a3f2-109684d29873-istio-envoy\") pod \"e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd\" (UID: \"8d5d040c-eb14-42eb-a3f2-109684d29873\") " pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"
Jul 23 00:35:04.513808 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:04.513714    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d5d040c-eb14-42eb-a3f2-109684d29873-workload-certs\") pod \"e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd\" (UID: \"8d5d040c-eb14-42eb-a3f2-109684d29873\") " pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"
Jul 23 00:35:04.513808 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:04.513746    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d5d040c-eb14-42eb-a3f2-109684d29873-workload-socket\") pod \"e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd\" (UID: \"8d5d040c-eb14-42eb-a3f2-109684d29873\") " pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"
Jul 23 00:35:04.513808 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:04.513768    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d5d040c-eb14-42eb-a3f2-109684d29873-istio-data\") pod \"e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd\" (UID: \"8d5d040c-eb14-42eb-a3f2-109684d29873\") " pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"
Jul 23 00:35:04.615221 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:04.615184    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d5d040c-eb14-42eb-a3f2-109684d29873-credential-socket\") pod \"e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd\" (UID: \"8d5d040c-eb14-42eb-a3f2-109684d29873\") " pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"
Jul 23 00:35:04.615392 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:04.615234    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d5d040c-eb14-42eb-a3f2-109684d29873-istiod-ca-cert\") pod \"e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd\" (UID: \"8d5d040c-eb14-42eb-a3f2-109684d29873\") " pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"
Jul 23 00:35:04.615392 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:04.615263    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcm2l\" (UniqueName: \"kubernetes.io/projected/8d5d040c-eb14-42eb-a3f2-109684d29873-kube-api-access-xcm2l\") pod \"e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd\" (UID: \"8d5d040c-eb14-42eb-a3f2-109684d29873\") " pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"
Jul 23 00:35:04.615392 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:04.615297    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d5d040c-eb14-42eb-a3f2-109684d29873-istio-envoy\") pod \"e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd\" (UID: \"8d5d040c-eb14-42eb-a3f2-109684d29873\") " pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"
Jul 23 00:35:04.615593 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:04.615481    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d5d040c-eb14-42eb-a3f2-109684d29873-workload-certs\") pod \"e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd\" (UID: \"8d5d040c-eb14-42eb-a3f2-109684d29873\") " pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"
Jul 23 00:35:04.615593 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:04.615545    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d5d040c-eb14-42eb-a3f2-109684d29873-workload-socket\") pod \"e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd\" (UID: \"8d5d040c-eb14-42eb-a3f2-109684d29873\") " pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"
Jul 23 00:35:04.615593 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:04.615573    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d5d040c-eb14-42eb-a3f2-109684d29873-istio-data\") pod \"e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd\" (UID: \"8d5d040c-eb14-42eb-a3f2-109684d29873\") " pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"
Jul 23 00:35:04.615746 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:04.615641    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d5d040c-eb14-42eb-a3f2-109684d29873-credential-socket\") pod \"e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd\" (UID: \"8d5d040c-eb14-42eb-a3f2-109684d29873\") " pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"
Jul 23 00:35:04.615746 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:04.615664    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d5d040c-eb14-42eb-a3f2-109684d29873-istio-token\") pod \"e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd\" (UID: \"8d5d040c-eb14-42eb-a3f2-109684d29873\") " pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"
Jul 23 00:35:04.615746 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:04.615704    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d5d040c-eb14-42eb-a3f2-109684d29873-istio-podinfo\") pod \"e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd\" (UID: \"8d5d040c-eb14-42eb-a3f2-109684d29873\") " pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"
Jul 23 00:35:04.615907 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:04.615781    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d5d040c-eb14-42eb-a3f2-109684d29873-workload-certs\") pod \"e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd\" (UID: \"8d5d040c-eb14-42eb-a3f2-109684d29873\") " pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"
Jul 23 00:35:04.616062 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:04.615990    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d5d040c-eb14-42eb-a3f2-109684d29873-istio-data\") pod \"e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd\" (UID: \"8d5d040c-eb14-42eb-a3f2-109684d29873\") " pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"
Jul 23 00:35:04.616062 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:04.616024    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d5d040c-eb14-42eb-a3f2-109684d29873-workload-socket\") pod \"e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd\" (UID: \"8d5d040c-eb14-42eb-a3f2-109684d29873\") " pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"
Jul 23 00:35:04.616231 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:04.616115    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d5d040c-eb14-42eb-a3f2-109684d29873-istiod-ca-cert\") pod \"e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd\" (UID: \"8d5d040c-eb14-42eb-a3f2-109684d29873\") " pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"
Jul 23 00:35:04.617702 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:04.617677    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d5d040c-eb14-42eb-a3f2-109684d29873-istio-envoy\") pod \"e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd\" (UID: \"8d5d040c-eb14-42eb-a3f2-109684d29873\") " pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"
Jul 23 00:35:04.618159 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:04.618141    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d5d040c-eb14-42eb-a3f2-109684d29873-istio-podinfo\") pod \"e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd\" (UID: \"8d5d040c-eb14-42eb-a3f2-109684d29873\") " pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"
Jul 23 00:35:04.626263 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:04.626242    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d5d040c-eb14-42eb-a3f2-109684d29873-istio-token\") pod \"e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd\" (UID: \"8d5d040c-eb14-42eb-a3f2-109684d29873\") " pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"
Jul 23 00:35:04.626573 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:04.626550    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcm2l\" (UniqueName: \"kubernetes.io/projected/8d5d040c-eb14-42eb-a3f2-109684d29873-kube-api-access-xcm2l\") pod \"e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd\" (UID: \"8d5d040c-eb14-42eb-a3f2-109684d29873\") " pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"
Jul 23 00:35:04.696659 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:04.696590    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"
Jul 23 00:35:04.842471 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:04.842421    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"]
Jul 23 00:35:04.843351 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:35:04.843327    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d5d040c_eb14_42eb_a3f2_109684d29873.slice/crio-ada6e589f69ce4621e33cd09fb306d1a5e12dfadb5ab391f63f7efc8ac33908a WatchSource:0}: Error finding container ada6e589f69ce4621e33cd09fb306d1a5e12dfadb5ab391f63f7efc8ac33908a: Status 404 returned error can't find the container with id ada6e589f69ce4621e33cd09fb306d1a5e12dfadb5ab391f63f7efc8ac33908a
Jul 23 00:35:04.845543 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:04.845506    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:35:04.845618 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:04.845581    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:35:04.845618 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:04.845611    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:35:05.740577 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:05.740537    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd" event={"ID":"8d5d040c-eb14-42eb-a3f2-109684d29873","Type":"ContainerStarted","Data":"8511650a6a3a267f007b67b08bcbc5e6a553755c11f65afdab2a78ef9fbd1863"}
Jul 23 00:35:05.740984 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:05.740610    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd" event={"ID":"8d5d040c-eb14-42eb-a3f2-109684d29873","Type":"ContainerStarted","Data":"ada6e589f69ce4621e33cd09fb306d1a5e12dfadb5ab391f63f7efc8ac33908a"}
Jul 23 00:35:05.763400 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:05.763347    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd" podStartSLOduration=1.7633314549999999 podStartE2EDuration="1.763331455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:35:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:35:05.761548708 +0000 UTC m=+1848.522747022" watchObservedRunningTime="2026-07-23 00:35:05.763331455 +0000 UTC m=+1848.524529764"
Jul 23 00:35:06.697525 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:06.697484    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"
Jul 23 00:35:06.702095 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:06.702069    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"
Jul 23 00:35:06.746744 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:06.746720    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"
Jul 23 00:35:06.747528 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:06.747506    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"
Jul 23 00:35:07.303089 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:07.303046    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4bcf43ed-77cfbf75b-zp7pb"]
Jul 23 00:35:07.306824 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:07.306799    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bcf43ed-77cfbf75b-zp7pb"
Jul 23 00:35:07.309435 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:07.309410    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-4bcf43ed-serving-cert\""
Jul 23 00:35:07.324572 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:07.324547    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4bcf43ed-77cfbf75b-zp7pb"]
Jul 23 00:35:07.442988 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:07.442949    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3c253fe-fedb-434b-bfb8-b8e5f9a468cb-openshift-service-ca\") pod \"maas-api-e2e-ait-4bcf43ed-77cfbf75b-zp7pb\" (UID: \"e3c253fe-fedb-434b-bfb8-b8e5f9a468cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bcf43ed-77cfbf75b-zp7pb"
Jul 23 00:35:07.443169 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:07.443035    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3c253fe-fedb-434b-bfb8-b8e5f9a468cb-maas-api-tls\") pod \"maas-api-e2e-ait-4bcf43ed-77cfbf75b-zp7pb\" (UID: \"e3c253fe-fedb-434b-bfb8-b8e5f9a468cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bcf43ed-77cfbf75b-zp7pb"
Jul 23 00:35:07.443169 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:07.443082    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls7v9\" (UniqueName: \"kubernetes.io/projected/e3c253fe-fedb-434b-bfb8-b8e5f9a468cb-kube-api-access-ls7v9\") pod \"maas-api-e2e-ait-4bcf43ed-77cfbf75b-zp7pb\" (UID: \"e3c253fe-fedb-434b-bfb8-b8e5f9a468cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bcf43ed-77cfbf75b-zp7pb"
Jul 23 00:35:07.543709 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:07.543680    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3c253fe-fedb-434b-bfb8-b8e5f9a468cb-maas-api-tls\") pod \"maas-api-e2e-ait-4bcf43ed-77cfbf75b-zp7pb\" (UID: \"e3c253fe-fedb-434b-bfb8-b8e5f9a468cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bcf43ed-77cfbf75b-zp7pb"
Jul 23 00:35:07.543860 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:07.543743    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls7v9\" (UniqueName: \"kubernetes.io/projected/e3c253fe-fedb-434b-bfb8-b8e5f9a468cb-kube-api-access-ls7v9\") pod \"maas-api-e2e-ait-4bcf43ed-77cfbf75b-zp7pb\" (UID: \"e3c253fe-fedb-434b-bfb8-b8e5f9a468cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bcf43ed-77cfbf75b-zp7pb"
Jul 23 00:35:07.543860 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:07.543794    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3c253fe-fedb-434b-bfb8-b8e5f9a468cb-openshift-service-ca\") pod \"maas-api-e2e-ait-4bcf43ed-77cfbf75b-zp7pb\" (UID: \"e3c253fe-fedb-434b-bfb8-b8e5f9a468cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bcf43ed-77cfbf75b-zp7pb"
Jul 23 00:35:07.543860 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:35:07.543842    2549 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-4bcf43ed-serving-cert: secret "maas-api-e2e-ait-4bcf43ed-serving-cert" not found
Jul 23 00:35:07.544013 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:35:07.543910    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3c253fe-fedb-434b-bfb8-b8e5f9a468cb-maas-api-tls podName:e3c253fe-fedb-434b-bfb8-b8e5f9a468cb nodeName:}" failed. No retries permitted until 2026-07-23 00:35:08.0438887 +0000 UTC m=+1850.805086988 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e3c253fe-fedb-434b-bfb8-b8e5f9a468cb-maas-api-tls") pod "maas-api-e2e-ait-4bcf43ed-77cfbf75b-zp7pb" (UID: "e3c253fe-fedb-434b-bfb8-b8e5f9a468cb") : secret "maas-api-e2e-ait-4bcf43ed-serving-cert" not found
Jul 23 00:35:07.544517 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:07.544496    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3c253fe-fedb-434b-bfb8-b8e5f9a468cb-openshift-service-ca\") pod \"maas-api-e2e-ait-4bcf43ed-77cfbf75b-zp7pb\" (UID: \"e3c253fe-fedb-434b-bfb8-b8e5f9a468cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bcf43ed-77cfbf75b-zp7pb"
Jul 23 00:35:07.556641 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:07.556583    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls7v9\" (UniqueName: \"kubernetes.io/projected/e3c253fe-fedb-434b-bfb8-b8e5f9a468cb-kube-api-access-ls7v9\") pod \"maas-api-e2e-ait-4bcf43ed-77cfbf75b-zp7pb\" (UID: \"e3c253fe-fedb-434b-bfb8-b8e5f9a468cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bcf43ed-77cfbf75b-zp7pb"
Jul 23 00:35:08.048850 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:08.048808    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3c253fe-fedb-434b-bfb8-b8e5f9a468cb-maas-api-tls\") pod \"maas-api-e2e-ait-4bcf43ed-77cfbf75b-zp7pb\" (UID: \"e3c253fe-fedb-434b-bfb8-b8e5f9a468cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bcf43ed-77cfbf75b-zp7pb"
Jul 23 00:35:08.051336 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:08.051309    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3c253fe-fedb-434b-bfb8-b8e5f9a468cb-maas-api-tls\") pod \"maas-api-e2e-ait-4bcf43ed-77cfbf75b-zp7pb\" (UID: \"e3c253fe-fedb-434b-bfb8-b8e5f9a468cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bcf43ed-77cfbf75b-zp7pb"
Jul 23 00:35:08.218221 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:08.218193    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bcf43ed-77cfbf75b-zp7pb"
Jul 23 00:35:08.355400 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:08.355372    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4bcf43ed-77cfbf75b-zp7pb"]
Jul 23 00:35:08.356831 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:35:08.356800    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3c253fe_fedb_434b_bfb8_b8e5f9a468cb.slice/crio-793165121d7f40bb99ea5612e6c96e2555018816898e01b5f7a96fdddad3d48e WatchSource:0}: Error finding container 793165121d7f40bb99ea5612e6c96e2555018816898e01b5f7a96fdddad3d48e: Status 404 returned error can't find the container with id 793165121d7f40bb99ea5612e6c96e2555018816898e01b5f7a96fdddad3d48e
Jul 23 00:35:08.358405 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:08.358385    2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 00:35:08.757292 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:08.757251    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bcf43ed-77cfbf75b-zp7pb" event={"ID":"e3c253fe-fedb-434b-bfb8-b8e5f9a468cb","Type":"ContainerStarted","Data":"793165121d7f40bb99ea5612e6c96e2555018816898e01b5f7a96fdddad3d48e"}
Jul 23 00:35:09.763304 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:09.763267    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bcf43ed-77cfbf75b-zp7pb" event={"ID":"e3c253fe-fedb-434b-bfb8-b8e5f9a468cb","Type":"ContainerStarted","Data":"50b81b2dd82b8214ed806977e0315910b73eab541781d9c7622817ea48342e7a"}
Jul 23 00:35:09.763703 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:09.763335    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bcf43ed-77cfbf75b-zp7pb"
Jul 23 00:35:09.787813 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:09.787765    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bcf43ed-77cfbf75b-zp7pb" podStartSLOduration=2.26681818 podStartE2EDuration="2.78775137s" totalImagesPullingTime="520.93319ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:35:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:35:09.786284811 +0000 UTC m=+1852.547483123" watchObservedRunningTime="2026-07-23 00:35:09.78775137 +0000 UTC m=+1852.548949680"
Jul 23 00:35:15.775157 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:15.775128    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bcf43ed-77cfbf75b-zp7pb"
Jul 23 00:35:21.905361 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:21.904340    2549 patch_prober.go:28] interesting pod/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": read tcp 10.133.0.2:34362->10.133.0.39:15021: read: connection reset by peer" start-of-body=
Jul 23 00:35:21.905361 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:21.904432    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd" podUID="8d5d040c-eb14-42eb-a3f2-109684d29873" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": read tcp 10.133.0.2:34362->10.133.0.39:15021: read: connection reset by peer"
Jul 23 00:35:22.849628 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:22.849596    2549 generic.go:356] "Generic (PLEG): container finished" podID="8d5d040c-eb14-42eb-a3f2-109684d29873" containerID="8511650a6a3a267f007b67b08bcbc5e6a553755c11f65afdab2a78ef9fbd1863" exitCode=0
Jul 23 00:35:22.849792 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:22.849666    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd" event={"ID":"8d5d040c-eb14-42eb-a3f2-109684d29873","Type":"ContainerDied","Data":"8511650a6a3a267f007b67b08bcbc5e6a553755c11f65afdab2a78ef9fbd1863"}
Jul 23 00:35:22.850043 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:22.850030    2549 scope.go:117] "RemoveContainer" containerID="8511650a6a3a267f007b67b08bcbc5e6a553755c11f65afdab2a78ef9fbd1863"
Jul 23 00:35:22.850969 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:22.850944    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:35:22.851027 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:22.851014    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:35:22.851065 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:22.851047    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:35:23.855919 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:23.855883    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd" event={"ID":"8d5d040c-eb14-42eb-a3f2-109684d29873","Type":"ContainerStarted","Data":"2d853024d55d7adb92dfb58882513333cf10bf9443e2b670a38b9b1f18681cf3"}
Jul 23 00:35:24.697919 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:24.697874    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"
Jul 23 00:35:24.698120 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:24.698015    2549 patch_prober.go:28] interesting pod/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 23 00:35:24.698120 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:24.698074    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd" podUID="8d5d040c-eb14-42eb-a3f2-109684d29873" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 23 00:35:25.697475 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:25.697420    2549 patch_prober.go:28] interesting pod/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 23 00:35:25.697967 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:25.697519    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd" podUID="8d5d040c-eb14-42eb-a3f2-109684d29873" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 23 00:35:26.697623 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:26.697584    2549 patch_prober.go:28] interesting pod/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 23 00:35:26.698220 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:26.698172    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd" podUID="8d5d040c-eb14-42eb-a3f2-109684d29873" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 23 00:35:27.701106 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:27.701075    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"
Jul 23 00:35:27.701591 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:27.701474    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"
Jul 23 00:35:27.702134 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:27.702114    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"
Jul 23 00:35:43.360356 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:43.360270    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4bcf43ed-77cfbf75b-zp7pb"]
Jul 23 00:35:43.360918 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:43.360492    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bcf43ed-77cfbf75b-zp7pb" podUID="e3c253fe-fedb-434b-bfb8-b8e5f9a468cb" containerName="maas-api" containerID="cri-o://50b81b2dd82b8214ed806977e0315910b73eab541781d9c7622817ea48342e7a" gracePeriod=30
Jul 23 00:35:43.612039 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:43.611979    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bcf43ed-77cfbf75b-zp7pb"
Jul 23 00:35:43.664877 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:43.664851    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ls7v9\" (UniqueName: \"kubernetes.io/projected/e3c253fe-fedb-434b-bfb8-b8e5f9a468cb-kube-api-access-ls7v9\") pod \"e3c253fe-fedb-434b-bfb8-b8e5f9a468cb\" (UID: \"e3c253fe-fedb-434b-bfb8-b8e5f9a468cb\") "
Jul 23 00:35:43.665040 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:43.664908    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3c253fe-fedb-434b-bfb8-b8e5f9a468cb-maas-api-tls\") pod \"e3c253fe-fedb-434b-bfb8-b8e5f9a468cb\" (UID: \"e3c253fe-fedb-434b-bfb8-b8e5f9a468cb\") "
Jul 23 00:35:43.665040 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:43.665002    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3c253fe-fedb-434b-bfb8-b8e5f9a468cb-openshift-service-ca\") pod \"e3c253fe-fedb-434b-bfb8-b8e5f9a468cb\" (UID: \"e3c253fe-fedb-434b-bfb8-b8e5f9a468cb\") "
Jul 23 00:35:43.665351 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:43.665328    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3c253fe-fedb-434b-bfb8-b8e5f9a468cb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e3c253fe-fedb-434b-bfb8-b8e5f9a468cb" (UID: "e3c253fe-fedb-434b-bfb8-b8e5f9a468cb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:35:43.667007 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:43.666985    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3c253fe-fedb-434b-bfb8-b8e5f9a468cb-kube-api-access-ls7v9" (OuterVolumeSpecName: "kube-api-access-ls7v9") pod "e3c253fe-fedb-434b-bfb8-b8e5f9a468cb" (UID: "e3c253fe-fedb-434b-bfb8-b8e5f9a468cb"). InnerVolumeSpecName "kube-api-access-ls7v9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:35:43.667007 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:43.666999    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3c253fe-fedb-434b-bfb8-b8e5f9a468cb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e3c253fe-fedb-434b-bfb8-b8e5f9a468cb" (UID: "e3c253fe-fedb-434b-bfb8-b8e5f9a468cb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 00:35:43.765586 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:43.765554    2549 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3c253fe-fedb-434b-bfb8-b8e5f9a468cb-openshift-service-ca\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:35:43.765586 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:43.765583    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ls7v9\" (UniqueName: \"kubernetes.io/projected/e3c253fe-fedb-434b-bfb8-b8e5f9a468cb-kube-api-access-ls7v9\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:35:43.765756 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:43.765597    2549 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3c253fe-fedb-434b-bfb8-b8e5f9a468cb-maas-api-tls\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:35:43.952858 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:43.952785    2549 generic.go:356] "Generic (PLEG): container finished" podID="e3c253fe-fedb-434b-bfb8-b8e5f9a468cb" containerID="50b81b2dd82b8214ed806977e0315910b73eab541781d9c7622817ea48342e7a" exitCode=0
Jul 23 00:35:43.952858 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:43.952825    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bcf43ed-77cfbf75b-zp7pb"
Jul 23 00:35:43.953011 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:43.952867    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bcf43ed-77cfbf75b-zp7pb" event={"ID":"e3c253fe-fedb-434b-bfb8-b8e5f9a468cb","Type":"ContainerDied","Data":"50b81b2dd82b8214ed806977e0315910b73eab541781d9c7622817ea48342e7a"}
Jul 23 00:35:43.953011 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:43.952917    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bcf43ed-77cfbf75b-zp7pb" event={"ID":"e3c253fe-fedb-434b-bfb8-b8e5f9a468cb","Type":"ContainerDied","Data":"793165121d7f40bb99ea5612e6c96e2555018816898e01b5f7a96fdddad3d48e"}
Jul 23 00:35:43.953011 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:43.952939    2549 scope.go:117] "RemoveContainer" containerID="50b81b2dd82b8214ed806977e0315910b73eab541781d9c7622817ea48342e7a"
Jul 23 00:35:43.961303 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:43.961281    2549 scope.go:117] "RemoveContainer" containerID="50b81b2dd82b8214ed806977e0315910b73eab541781d9c7622817ea48342e7a"
Jul 23 00:35:43.961605 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:35:43.961579    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50b81b2dd82b8214ed806977e0315910b73eab541781d9c7622817ea48342e7a\": container with ID starting with 50b81b2dd82b8214ed806977e0315910b73eab541781d9c7622817ea48342e7a not found: ID does not exist" containerID="50b81b2dd82b8214ed806977e0315910b73eab541781d9c7622817ea48342e7a"
Jul 23 00:35:43.961665 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:43.961613    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50b81b2dd82b8214ed806977e0315910b73eab541781d9c7622817ea48342e7a"} err="failed to get container status \"50b81b2dd82b8214ed806977e0315910b73eab541781d9c7622817ea48342e7a\": rpc error: code = NotFound desc = could not find container \"50b81b2dd82b8214ed806977e0315910b73eab541781d9c7622817ea48342e7a\": container with ID starting with 50b81b2dd82b8214ed806977e0315910b73eab541781d9c7622817ea48342e7a not found: ID does not exist"
Jul 23 00:35:43.982338 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:43.982311    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4bcf43ed-77cfbf75b-zp7pb"]
Jul 23 00:35:43.986944 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:43.986914    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4bcf43ed-77cfbf75b-zp7pb"]
Jul 23 00:35:45.803078 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:45.803041    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3c253fe-fedb-434b-bfb8-b8e5f9a468cb" path="/var/lib/kubelet/pods/e3c253fe-fedb-434b-bfb8-b8e5f9a468cb/volumes"
Jul 23 00:35:48.043799 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:48.043761    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"]
Jul 23 00:35:48.044149 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:48.044008    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd" podUID="8d5d040c-eb14-42eb-a3f2-109684d29873" containerName="istio-proxy" containerID="cri-o://2d853024d55d7adb92dfb58882513333cf10bf9443e2b670a38b9b1f18681cf3" gracePeriod=30
Jul 23 00:35:49.178345 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:49.178260    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"]
Jul 23 00:35:49.178839 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:49.178806    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3c253fe-fedb-434b-bfb8-b8e5f9a468cb" containerName="maas-api"
Jul 23 00:35:49.178839 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:49.178826    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3c253fe-fedb-434b-bfb8-b8e5f9a468cb" containerName="maas-api"
Jul 23 00:35:49.179026 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:49.178961    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3c253fe-fedb-434b-bfb8-b8e5f9a468cb" containerName="maas-api"
Jul 23 00:35:49.183025 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:49.183002    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"
Jul 23 00:35:49.186572 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:49.186553    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-04b6cb45-gw-openshift-default-dockercfg-4kmhr\""
Jul 23 00:35:49.204057 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:49.204031    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"]
Jul 23 00:35:49.313848 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:49.313821    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/218d9e74-4fd3-43b3-9411-53203a6231e4-workload-certs\") pod \"e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb\" (UID: \"218d9e74-4fd3-43b3-9411-53203a6231e4\") " pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"
Jul 23 00:35:49.314019 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:49.313868    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/218d9e74-4fd3-43b3-9411-53203a6231e4-workload-socket\") pod \"e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb\" (UID: \"218d9e74-4fd3-43b3-9411-53203a6231e4\") " pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"
Jul 23 00:35:49.314019 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:49.313894    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/218d9e74-4fd3-43b3-9411-53203a6231e4-credential-socket\") pod \"e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb\" (UID: \"218d9e74-4fd3-43b3-9411-53203a6231e4\") " pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"
Jul 23 00:35:49.314019 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:49.313972    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/218d9e74-4fd3-43b3-9411-53203a6231e4-istio-data\") pod \"e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb\" (UID: \"218d9e74-4fd3-43b3-9411-53203a6231e4\") " pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"
Jul 23 00:35:49.314138 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:49.314055    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/218d9e74-4fd3-43b3-9411-53203a6231e4-istio-envoy\") pod \"e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb\" (UID: \"218d9e74-4fd3-43b3-9411-53203a6231e4\") " pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"
Jul 23 00:35:49.314138 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:49.314107    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/218d9e74-4fd3-43b3-9411-53203a6231e4-istio-podinfo\") pod \"e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb\" (UID: \"218d9e74-4fd3-43b3-9411-53203a6231e4\") " pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"
Jul 23 00:35:49.314209 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:49.314151    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/218d9e74-4fd3-43b3-9411-53203a6231e4-istio-token\") pod \"e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb\" (UID: \"218d9e74-4fd3-43b3-9411-53203a6231e4\") " pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"
Jul 23 00:35:49.314209 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:49.314168    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/218d9e74-4fd3-43b3-9411-53203a6231e4-istiod-ca-cert\") pod \"e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb\" (UID: \"218d9e74-4fd3-43b3-9411-53203a6231e4\") " pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"
Jul 23 00:35:49.314209 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:49.314186    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl4p7\" (UniqueName: \"kubernetes.io/projected/218d9e74-4fd3-43b3-9411-53203a6231e4-kube-api-access-gl4p7\") pod \"e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb\" (UID: \"218d9e74-4fd3-43b3-9411-53203a6231e4\") " pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"
Jul 23 00:35:49.415616 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:49.415585    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/218d9e74-4fd3-43b3-9411-53203a6231e4-istio-podinfo\") pod \"e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb\" (UID: \"218d9e74-4fd3-43b3-9411-53203a6231e4\") " pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"
Jul 23 00:35:49.415763 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:49.415622    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/218d9e74-4fd3-43b3-9411-53203a6231e4-istio-token\") pod \"e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb\" (UID: \"218d9e74-4fd3-43b3-9411-53203a6231e4\") " pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"
Jul 23 00:35:49.415763 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:49.415639    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/218d9e74-4fd3-43b3-9411-53203a6231e4-istiod-ca-cert\") pod \"e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb\" (UID: \"218d9e74-4fd3-43b3-9411-53203a6231e4\") " pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"
Jul 23 00:35:49.415763 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:49.415660    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl4p7\" (UniqueName: \"kubernetes.io/projected/218d9e74-4fd3-43b3-9411-53203a6231e4-kube-api-access-gl4p7\") pod \"e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb\" (UID: \"218d9e74-4fd3-43b3-9411-53203a6231e4\") " pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"
Jul 23 00:35:49.415763 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:49.415691    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/218d9e74-4fd3-43b3-9411-53203a6231e4-workload-certs\") pod \"e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb\" (UID: \"218d9e74-4fd3-43b3-9411-53203a6231e4\") " pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"
Jul 23 00:35:49.415763 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:49.415748    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/218d9e74-4fd3-43b3-9411-53203a6231e4-workload-socket\") pod \"e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb\" (UID: \"218d9e74-4fd3-43b3-9411-53203a6231e4\") " pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"
Jul 23 00:35:49.416008 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:49.415771    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/218d9e74-4fd3-43b3-9411-53203a6231e4-credential-socket\") pod \"e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb\" (UID: \"218d9e74-4fd3-43b3-9411-53203a6231e4\") " pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"
Jul 23 00:35:49.416008 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:49.415801    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/218d9e74-4fd3-43b3-9411-53203a6231e4-istio-data\") pod \"e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb\" (UID: \"218d9e74-4fd3-43b3-9411-53203a6231e4\") " pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"
Jul 23 00:35:49.416136 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:49.416099    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/218d9e74-4fd3-43b3-9411-53203a6231e4-istio-envoy\") pod \"e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb\" (UID: \"218d9e74-4fd3-43b3-9411-53203a6231e4\") " pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"
Jul 23 00:35:49.416217 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:49.416159    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/218d9e74-4fd3-43b3-9411-53203a6231e4-credential-socket\") pod \"e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb\" (UID: \"218d9e74-4fd3-43b3-9411-53203a6231e4\") " pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"
Jul 23 00:35:49.416274 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:49.416220    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/218d9e74-4fd3-43b3-9411-53203a6231e4-workload-certs\") pod \"e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb\" (UID: \"218d9e74-4fd3-43b3-9411-53203a6231e4\") " pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"
Jul 23 00:35:49.416328 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:49.416264    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/218d9e74-4fd3-43b3-9411-53203a6231e4-istio-data\") pod \"e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb\" (UID: \"218d9e74-4fd3-43b3-9411-53203a6231e4\") " pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"
Jul 23 00:35:49.416380 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:49.416328    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/218d9e74-4fd3-43b3-9411-53203a6231e4-workload-socket\") pod \"e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb\" (UID: \"218d9e74-4fd3-43b3-9411-53203a6231e4\") " pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"
Jul 23 00:35:49.416442 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:49.416424    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/218d9e74-4fd3-43b3-9411-53203a6231e4-istiod-ca-cert\") pod \"e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb\" (UID: \"218d9e74-4fd3-43b3-9411-53203a6231e4\") " pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"
Jul 23 00:35:49.418098 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:49.418076    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/218d9e74-4fd3-43b3-9411-53203a6231e4-istio-envoy\") pod \"e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb\" (UID: \"218d9e74-4fd3-43b3-9411-53203a6231e4\") " pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"
Jul 23 00:35:49.418233 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:49.418215    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/218d9e74-4fd3-43b3-9411-53203a6231e4-istio-podinfo\") pod \"e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb\" (UID: \"218d9e74-4fd3-43b3-9411-53203a6231e4\") " pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"
Jul 23 00:35:49.423873 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:49.423845    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl4p7\" (UniqueName: \"kubernetes.io/projected/218d9e74-4fd3-43b3-9411-53203a6231e4-kube-api-access-gl4p7\") pod \"e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb\" (UID: \"218d9e74-4fd3-43b3-9411-53203a6231e4\") " pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"
Jul 23 00:35:49.423959 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:49.423907    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/218d9e74-4fd3-43b3-9411-53203a6231e4-istio-token\") pod \"e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb\" (UID: \"218d9e74-4fd3-43b3-9411-53203a6231e4\") " pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"
Jul 23 00:35:49.493386 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:49.493296    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"
Jul 23 00:35:49.635497 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:49.635469    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"]
Jul 23 00:35:49.637752 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:35:49.637718    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod218d9e74_4fd3_43b3_9411_53203a6231e4.slice/crio-2a0bf0cf4a8c505d6f2eb89bef01ef7cf049a94bee96c9c3607dda42726b38ba WatchSource:0}: Error finding container 2a0bf0cf4a8c505d6f2eb89bef01ef7cf049a94bee96c9c3607dda42726b38ba: Status 404 returned error can't find the container with id 2a0bf0cf4a8c505d6f2eb89bef01ef7cf049a94bee96c9c3607dda42726b38ba
Jul 23 00:35:49.639907 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:49.639874    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:35:49.639987 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:49.639939    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:35:49.639987 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:49.639970    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:35:49.982738 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:49.982701    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb" event={"ID":"218d9e74-4fd3-43b3-9411-53203a6231e4","Type":"ContainerStarted","Data":"03820cc1aa8b8ea90bb94e74b8ff86b11c242d02d078ba7c2a84ec8e01975611"}
Jul 23 00:35:49.982928 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:49.982765    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb" event={"ID":"218d9e74-4fd3-43b3-9411-53203a6231e4","Type":"ContainerStarted","Data":"2a0bf0cf4a8c505d6f2eb89bef01ef7cf049a94bee96c9c3607dda42726b38ba"}
Jul 23 00:35:50.001750 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:50.001697    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb" podStartSLOduration=1.001679583 podStartE2EDuration="1.001679583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:35:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:35:50.001092879 +0000 UTC m=+1892.762291189" watchObservedRunningTime="2026-07-23 00:35:50.001679583 +0000 UTC m=+1892.762877894"
Jul 23 00:35:50.493778 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:50.493734    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"
Jul 23 00:35:50.499091 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:50.499064    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"
Jul 23 00:35:50.987838 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:50.987804    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"
Jul 23 00:35:50.988938 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:50.988913    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"
Jul 23 00:35:53.305105 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:53.305080    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"
Jul 23 00:35:53.460143 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:53.460108    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d5d040c-eb14-42eb-a3f2-109684d29873-istio-token\") pod \"8d5d040c-eb14-42eb-a3f2-109684d29873\" (UID: \"8d5d040c-eb14-42eb-a3f2-109684d29873\") "
Jul 23 00:35:53.460320 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:53.460163    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d5d040c-eb14-42eb-a3f2-109684d29873-istiod-ca-cert\") pod \"8d5d040c-eb14-42eb-a3f2-109684d29873\" (UID: \"8d5d040c-eb14-42eb-a3f2-109684d29873\") "
Jul 23 00:35:53.460320 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:53.460207    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d5d040c-eb14-42eb-a3f2-109684d29873-workload-socket\") pod \"8d5d040c-eb14-42eb-a3f2-109684d29873\" (UID: \"8d5d040c-eb14-42eb-a3f2-109684d29873\") "
Jul 23 00:35:53.460320 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:53.460227    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d5d040c-eb14-42eb-a3f2-109684d29873-istio-envoy\") pod \"8d5d040c-eb14-42eb-a3f2-109684d29873\" (UID: \"8d5d040c-eb14-42eb-a3f2-109684d29873\") "
Jul 23 00:35:53.460320 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:53.460245    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d5d040c-eb14-42eb-a3f2-109684d29873-workload-certs\") pod \"8d5d040c-eb14-42eb-a3f2-109684d29873\" (UID: \"8d5d040c-eb14-42eb-a3f2-109684d29873\") "
Jul 23 00:35:53.460320 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:53.460262    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d5d040c-eb14-42eb-a3f2-109684d29873-credential-socket\") pod \"8d5d040c-eb14-42eb-a3f2-109684d29873\" (UID: \"8d5d040c-eb14-42eb-a3f2-109684d29873\") "
Jul 23 00:35:53.460320 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:53.460299    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcm2l\" (UniqueName: \"kubernetes.io/projected/8d5d040c-eb14-42eb-a3f2-109684d29873-kube-api-access-xcm2l\") pod \"8d5d040c-eb14-42eb-a3f2-109684d29873\" (UID: \"8d5d040c-eb14-42eb-a3f2-109684d29873\") "
Jul 23 00:35:53.460320 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:53.460322    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d5d040c-eb14-42eb-a3f2-109684d29873-istio-data\") pod \"8d5d040c-eb14-42eb-a3f2-109684d29873\" (UID: \"8d5d040c-eb14-42eb-a3f2-109684d29873\") "
Jul 23 00:35:53.460739 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:53.460381    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d5d040c-eb14-42eb-a3f2-109684d29873-istio-podinfo\") pod \"8d5d040c-eb14-42eb-a3f2-109684d29873\" (UID: \"8d5d040c-eb14-42eb-a3f2-109684d29873\") "
Jul 23 00:35:53.460739 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:53.460597    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d5d040c-eb14-42eb-a3f2-109684d29873-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8d5d040c-eb14-42eb-a3f2-109684d29873" (UID: "8d5d040c-eb14-42eb-a3f2-109684d29873"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:35:53.460739 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:53.460619    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d5d040c-eb14-42eb-a3f2-109684d29873-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8d5d040c-eb14-42eb-a3f2-109684d29873" (UID: "8d5d040c-eb14-42eb-a3f2-109684d29873"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:35:53.460883 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:53.460737    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d5d040c-eb14-42eb-a3f2-109684d29873-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8d5d040c-eb14-42eb-a3f2-109684d29873" (UID: "8d5d040c-eb14-42eb-a3f2-109684d29873"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:35:53.460883 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:53.460759    2549 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d5d040c-eb14-42eb-a3f2-109684d29873-workload-socket\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:35:53.460990 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:53.460880    2549 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d5d040c-eb14-42eb-a3f2-109684d29873-workload-certs\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:35:53.460990 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:53.460943    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d5d040c-eb14-42eb-a3f2-109684d29873-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8d5d040c-eb14-42eb-a3f2-109684d29873" (UID: "8d5d040c-eb14-42eb-a3f2-109684d29873"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:35:53.461650 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:53.461620    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d5d040c-eb14-42eb-a3f2-109684d29873-istio-data" (OuterVolumeSpecName: "istio-data") pod "8d5d040c-eb14-42eb-a3f2-109684d29873" (UID: "8d5d040c-eb14-42eb-a3f2-109684d29873"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:35:53.462747 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:53.462713    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d5d040c-eb14-42eb-a3f2-109684d29873-kube-api-access-xcm2l" (OuterVolumeSpecName: "kube-api-access-xcm2l") pod "8d5d040c-eb14-42eb-a3f2-109684d29873" (UID: "8d5d040c-eb14-42eb-a3f2-109684d29873"). InnerVolumeSpecName "kube-api-access-xcm2l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:35:53.462849 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:53.462784    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8d5d040c-eb14-42eb-a3f2-109684d29873-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8d5d040c-eb14-42eb-a3f2-109684d29873" (UID: "8d5d040c-eb14-42eb-a3f2-109684d29873"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 00:35:53.462849 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:53.462797    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d5d040c-eb14-42eb-a3f2-109684d29873-istio-token" (OuterVolumeSpecName: "istio-token") pod "8d5d040c-eb14-42eb-a3f2-109684d29873" (UID: "8d5d040c-eb14-42eb-a3f2-109684d29873"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:35:53.462849 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:53.462802    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d5d040c-eb14-42eb-a3f2-109684d29873-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8d5d040c-eb14-42eb-a3f2-109684d29873" (UID: "8d5d040c-eb14-42eb-a3f2-109684d29873"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:35:53.561938 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:53.561898    2549 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d5d040c-eb14-42eb-a3f2-109684d29873-istiod-ca-cert\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:35:53.561938 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:53.561933    2549 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d5d040c-eb14-42eb-a3f2-109684d29873-istio-envoy\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:35:53.561938 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:53.561942    2549 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d5d040c-eb14-42eb-a3f2-109684d29873-credential-socket\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:35:53.562184 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:53.561953    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcm2l\" (UniqueName: \"kubernetes.io/projected/8d5d040c-eb14-42eb-a3f2-109684d29873-kube-api-access-xcm2l\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:35:53.562184 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:53.561963    2549 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d5d040c-eb14-42eb-a3f2-109684d29873-istio-data\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:35:53.562184 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:53.561971    2549 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d5d040c-eb14-42eb-a3f2-109684d29873-istio-podinfo\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:35:53.562184 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:53.561978    2549 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d5d040c-eb14-42eb-a3f2-109684d29873-istio-token\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:35:54.003966 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:54.003933    2549 generic.go:356] "Generic (PLEG): container finished" podID="8d5d040c-eb14-42eb-a3f2-109684d29873" containerID="2d853024d55d7adb92dfb58882513333cf10bf9443e2b670a38b9b1f18681cf3" exitCode=0
Jul 23 00:35:54.004131 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:54.003977    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"
Jul 23 00:35:54.004131 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:54.004020    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd" event={"ID":"8d5d040c-eb14-42eb-a3f2-109684d29873","Type":"ContainerDied","Data":"2d853024d55d7adb92dfb58882513333cf10bf9443e2b670a38b9b1f18681cf3"}
Jul 23 00:35:54.004131 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:54.004074    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd" event={"ID":"8d5d040c-eb14-42eb-a3f2-109684d29873","Type":"ContainerDied","Data":"ada6e589f69ce4621e33cd09fb306d1a5e12dfadb5ab391f63f7efc8ac33908a"}
Jul 23 00:35:54.004131 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:54.004099    2549 scope.go:117] "RemoveContainer" containerID="2d853024d55d7adb92dfb58882513333cf10bf9443e2b670a38b9b1f18681cf3"
Jul 23 00:35:54.012783 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:54.012766    2549 scope.go:117] "RemoveContainer" containerID="8511650a6a3a267f007b67b08bcbc5e6a553755c11f65afdab2a78ef9fbd1863"
Jul 23 00:35:54.020311 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:54.020271    2549 scope.go:117] "RemoveContainer" containerID="2d853024d55d7adb92dfb58882513333cf10bf9443e2b670a38b9b1f18681cf3"
Jul 23 00:35:54.021099 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:35:54.021077    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d853024d55d7adb92dfb58882513333cf10bf9443e2b670a38b9b1f18681cf3\": container with ID starting with 2d853024d55d7adb92dfb58882513333cf10bf9443e2b670a38b9b1f18681cf3 not found: ID does not exist" containerID="2d853024d55d7adb92dfb58882513333cf10bf9443e2b670a38b9b1f18681cf3"
Jul 23 00:35:54.021174 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:54.021107    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d853024d55d7adb92dfb58882513333cf10bf9443e2b670a38b9b1f18681cf3"} err="failed to get container status \"2d853024d55d7adb92dfb58882513333cf10bf9443e2b670a38b9b1f18681cf3\": rpc error: code = NotFound desc = could not find container \"2d853024d55d7adb92dfb58882513333cf10bf9443e2b670a38b9b1f18681cf3\": container with ID starting with 2d853024d55d7adb92dfb58882513333cf10bf9443e2b670a38b9b1f18681cf3 not found: ID does not exist"
Jul 23 00:35:54.021174 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:54.021126    2549 scope.go:117] "RemoveContainer" containerID="8511650a6a3a267f007b67b08bcbc5e6a553755c11f65afdab2a78ef9fbd1863"
Jul 23 00:35:54.021409 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:35:54.021390    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8511650a6a3a267f007b67b08bcbc5e6a553755c11f65afdab2a78ef9fbd1863\": container with ID starting with 8511650a6a3a267f007b67b08bcbc5e6a553755c11f65afdab2a78ef9fbd1863 not found: ID does not exist" containerID="8511650a6a3a267f007b67b08bcbc5e6a553755c11f65afdab2a78ef9fbd1863"
Jul 23 00:35:54.021488 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:54.021418    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8511650a6a3a267f007b67b08bcbc5e6a553755c11f65afdab2a78ef9fbd1863"} err="failed to get container status \"8511650a6a3a267f007b67b08bcbc5e6a553755c11f65afdab2a78ef9fbd1863\": rpc error: code = NotFound desc = could not find container \"8511650a6a3a267f007b67b08bcbc5e6a553755c11f65afdab2a78ef9fbd1863\": container with ID starting with 8511650a6a3a267f007b67b08bcbc5e6a553755c11f65afdab2a78ef9fbd1863 not found: ID does not exist"
Jul 23 00:35:54.023364 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:54.023346    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"]
Jul 23 00:35:54.026951 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:54.026923    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-4bcf43ed-openshift-default-74dd585fc-sxhsd"]
Jul 23 00:35:55.802800 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:35:55.802770    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d5d040c-eb14-42eb-a3f2-109684d29873" path="/var/lib/kubelet/pods/8d5d040c-eb14-42eb-a3f2-109684d29873/volumes"
Jul 23 00:36:06.411819 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:06.411780    2549 patch_prober.go:28] interesting pod/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": read tcp 10.133.0.2:57188->10.133.0.41:15021: read: connection reset by peer" start-of-body=
Jul 23 00:36:06.412214 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:06.411858    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb" podUID="218d9e74-4fd3-43b3-9411-53203a6231e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": read tcp 10.133.0.2:57188->10.133.0.41:15021: read: connection reset by peer"
Jul 23 00:36:07.075146 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:07.075107    2549 generic.go:356] "Generic (PLEG): container finished" podID="218d9e74-4fd3-43b3-9411-53203a6231e4" containerID="03820cc1aa8b8ea90bb94e74b8ff86b11c242d02d078ba7c2a84ec8e01975611" exitCode=0
Jul 23 00:36:07.075314 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:07.075181    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb" event={"ID":"218d9e74-4fd3-43b3-9411-53203a6231e4","Type":"ContainerDied","Data":"03820cc1aa8b8ea90bb94e74b8ff86b11c242d02d078ba7c2a84ec8e01975611"}
Jul 23 00:36:07.075676 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:07.075657    2549 scope.go:117] "RemoveContainer" containerID="03820cc1aa8b8ea90bb94e74b8ff86b11c242d02d078ba7c2a84ec8e01975611"
Jul 23 00:36:07.076771 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:07.076744    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:36:07.076834 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:07.076813    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:36:07.076871 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:07.076844    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:36:08.082231 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:08.082197    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb" event={"ID":"218d9e74-4fd3-43b3-9411-53203a6231e4","Type":"ContainerStarted","Data":"13b3fe8a81f69eac35dd3e647be25fd7f8e7c3a5cd6f3aa1d02c140d0946f027"}
Jul 23 00:36:08.494533 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:08.494418    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"
Jul 23 00:36:08.494849 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:08.494819    2549 patch_prober.go:28] interesting pod/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 23 00:36:08.495835 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:08.495792    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb" podUID="218d9e74-4fd3-43b3-9411-53203a6231e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 23 00:36:09.494066 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:09.494022    2549 patch_prober.go:28] interesting pod/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 23 00:36:09.494584 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:09.494091    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb" podUID="218d9e74-4fd3-43b3-9411-53203a6231e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 23 00:36:10.494034 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:10.493988    2549 patch_prober.go:28] interesting pod/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 23 00:36:10.494355 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:10.494314    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb" podUID="218d9e74-4fd3-43b3-9411-53203a6231e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 23 00:36:11.494762 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:11.494720    2549 patch_prober.go:28] interesting pod/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 23 00:36:11.495286 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:11.494793    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb" podUID="218d9e74-4fd3-43b3-9411-53203a6231e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 23 00:36:12.497536 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:12.497499    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"
Jul 23 00:36:12.497941 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:12.497861    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"
Jul 23 00:36:12.498474 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:12.498441    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"
Jul 23 00:36:31.755716 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:31.755676    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"]
Jul 23 00:36:31.756132 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:31.755996    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb" podUID="218d9e74-4fd3-43b3-9411-53203a6231e4" containerName="istio-proxy" containerID="cri-o://13b3fe8a81f69eac35dd3e647be25fd7f8e7c3a5cd6f3aa1d02c140d0946f027" gracePeriod=30
Jul 23 00:36:32.569185 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:32.569153    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"]
Jul 23 00:36:32.569554 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:32.569540    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d5d040c-eb14-42eb-a3f2-109684d29873" containerName="istio-proxy"
Jul 23 00:36:32.569602 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:32.569555    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d5d040c-eb14-42eb-a3f2-109684d29873" containerName="istio-proxy"
Jul 23 00:36:32.569602 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:32.569568    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d5d040c-eb14-42eb-a3f2-109684d29873" containerName="istio-proxy"
Jul 23 00:36:32.569602 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:32.569574    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d5d040c-eb14-42eb-a3f2-109684d29873" containerName="istio-proxy"
Jul 23 00:36:32.569695 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:32.569630    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d5d040c-eb14-42eb-a3f2-109684d29873" containerName="istio-proxy"
Jul 23 00:36:32.572768 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:32.572744    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"
Jul 23 00:36:32.576018 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:32.575996    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-55ea1e47-openshift-default-dockercfg-dc8t6\""
Jul 23 00:36:32.587058 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:32.587034    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"]
Jul 23 00:36:32.701966 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:32.701933    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc8xz\" (UniqueName: \"kubernetes.io/projected/164c8f94-e30a-4031-a504-8d93b12abde0-kube-api-access-mc8xz\") pod \"e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7\" (UID: \"164c8f94-e30a-4031-a504-8d93b12abde0\") " pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"
Jul 23 00:36:32.702134 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:32.701972    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/164c8f94-e30a-4031-a504-8d93b12abde0-istiod-ca-cert\") pod \"e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7\" (UID: \"164c8f94-e30a-4031-a504-8d93b12abde0\") " pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"
Jul 23 00:36:32.702134 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:32.702002    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/164c8f94-e30a-4031-a504-8d93b12abde0-workload-certs\") pod \"e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7\" (UID: \"164c8f94-e30a-4031-a504-8d93b12abde0\") " pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"
Jul 23 00:36:32.702134 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:32.702077    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/164c8f94-e30a-4031-a504-8d93b12abde0-istio-data\") pod \"e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7\" (UID: \"164c8f94-e30a-4031-a504-8d93b12abde0\") " pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"
Jul 23 00:36:32.702239 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:32.702133    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/164c8f94-e30a-4031-a504-8d93b12abde0-istio-podinfo\") pod \"e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7\" (UID: \"164c8f94-e30a-4031-a504-8d93b12abde0\") " pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"
Jul 23 00:36:32.702239 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:32.702155    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/164c8f94-e30a-4031-a504-8d93b12abde0-workload-socket\") pod \"e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7\" (UID: \"164c8f94-e30a-4031-a504-8d93b12abde0\") " pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"
Jul 23 00:36:32.702239 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:32.702180    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/164c8f94-e30a-4031-a504-8d93b12abde0-istio-envoy\") pod \"e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7\" (UID: \"164c8f94-e30a-4031-a504-8d93b12abde0\") " pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"
Jul 23 00:36:32.702239 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:32.702211    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/164c8f94-e30a-4031-a504-8d93b12abde0-credential-socket\") pod \"e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7\" (UID: \"164c8f94-e30a-4031-a504-8d93b12abde0\") " pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"
Jul 23 00:36:32.702365 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:32.702240    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/164c8f94-e30a-4031-a504-8d93b12abde0-istio-token\") pod \"e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7\" (UID: \"164c8f94-e30a-4031-a504-8d93b12abde0\") " pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"
Jul 23 00:36:32.802809 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:32.802776    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/164c8f94-e30a-4031-a504-8d93b12abde0-istio-envoy\") pod \"e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7\" (UID: \"164c8f94-e30a-4031-a504-8d93b12abde0\") " pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"
Jul 23 00:36:32.802809 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:32.802813    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/164c8f94-e30a-4031-a504-8d93b12abde0-credential-socket\") pod \"e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7\" (UID: \"164c8f94-e30a-4031-a504-8d93b12abde0\") " pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"
Jul 23 00:36:32.803326 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:32.802834    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/164c8f94-e30a-4031-a504-8d93b12abde0-istio-token\") pod \"e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7\" (UID: \"164c8f94-e30a-4031-a504-8d93b12abde0\") " pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"
Jul 23 00:36:32.803326 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:32.802863    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc8xz\" (UniqueName: \"kubernetes.io/projected/164c8f94-e30a-4031-a504-8d93b12abde0-kube-api-access-mc8xz\") pod \"e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7\" (UID: \"164c8f94-e30a-4031-a504-8d93b12abde0\") " pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"
Jul 23 00:36:32.803326 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:32.802889    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/164c8f94-e30a-4031-a504-8d93b12abde0-istiod-ca-cert\") pod \"e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7\" (UID: \"164c8f94-e30a-4031-a504-8d93b12abde0\") " pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"
Jul 23 00:36:32.803326 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:32.802917    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/164c8f94-e30a-4031-a504-8d93b12abde0-workload-certs\") pod \"e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7\" (UID: \"164c8f94-e30a-4031-a504-8d93b12abde0\") " pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"
Jul 23 00:36:32.803326 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:32.802979    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/164c8f94-e30a-4031-a504-8d93b12abde0-istio-data\") pod \"e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7\" (UID: \"164c8f94-e30a-4031-a504-8d93b12abde0\") " pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"
Jul 23 00:36:32.803326 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:32.803017    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/164c8f94-e30a-4031-a504-8d93b12abde0-istio-podinfo\") pod \"e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7\" (UID: \"164c8f94-e30a-4031-a504-8d93b12abde0\") " pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"
Jul 23 00:36:32.803326 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:32.803040    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/164c8f94-e30a-4031-a504-8d93b12abde0-workload-socket\") pod \"e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7\" (UID: \"164c8f94-e30a-4031-a504-8d93b12abde0\") " pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"
Jul 23 00:36:32.803747 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:32.803463    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/164c8f94-e30a-4031-a504-8d93b12abde0-credential-socket\") pod \"e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7\" (UID: \"164c8f94-e30a-4031-a504-8d93b12abde0\") " pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"
Jul 23 00:36:32.803747 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:32.803502    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/164c8f94-e30a-4031-a504-8d93b12abde0-workload-certs\") pod \"e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7\" (UID: \"164c8f94-e30a-4031-a504-8d93b12abde0\") " pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"
Jul 23 00:36:32.803747 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:32.803564    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/164c8f94-e30a-4031-a504-8d93b12abde0-workload-socket\") pod \"e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7\" (UID: \"164c8f94-e30a-4031-a504-8d93b12abde0\") " pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"
Jul 23 00:36:32.803747 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:32.803598    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/164c8f94-e30a-4031-a504-8d93b12abde0-istio-data\") pod \"e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7\" (UID: \"164c8f94-e30a-4031-a504-8d93b12abde0\") " pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"
Jul 23 00:36:32.803747 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:32.803742    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/164c8f94-e30a-4031-a504-8d93b12abde0-istiod-ca-cert\") pod \"e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7\" (UID: \"164c8f94-e30a-4031-a504-8d93b12abde0\") " pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"
Jul 23 00:36:32.805253 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:32.805231    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/164c8f94-e30a-4031-a504-8d93b12abde0-istio-envoy\") pod \"e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7\" (UID: \"164c8f94-e30a-4031-a504-8d93b12abde0\") " pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"
Jul 23 00:36:32.805587 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:32.805566    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/164c8f94-e30a-4031-a504-8d93b12abde0-istio-podinfo\") pod \"e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7\" (UID: \"164c8f94-e30a-4031-a504-8d93b12abde0\") " pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"
Jul 23 00:36:32.811559 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:32.811538    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/164c8f94-e30a-4031-a504-8d93b12abde0-istio-token\") pod \"e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7\" (UID: \"164c8f94-e30a-4031-a504-8d93b12abde0\") " pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"
Jul 23 00:36:32.811769 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:32.811751    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc8xz\" (UniqueName: \"kubernetes.io/projected/164c8f94-e30a-4031-a504-8d93b12abde0-kube-api-access-mc8xz\") pod \"e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7\" (UID: \"164c8f94-e30a-4031-a504-8d93b12abde0\") " pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"
Jul 23 00:36:32.882595 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:32.882527    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"
Jul 23 00:36:33.021524 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:33.021491    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"]
Jul 23 00:36:33.024516 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:36:33.024491    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod164c8f94_e30a_4031_a504_8d93b12abde0.slice/crio-098323a8105e3dc5a199fa049e21fad04c6b3bfb47c96fbe603c3bcfb58aff48 WatchSource:0}: Error finding container 098323a8105e3dc5a199fa049e21fad04c6b3bfb47c96fbe603c3bcfb58aff48: Status 404 returned error can't find the container with id 098323a8105e3dc5a199fa049e21fad04c6b3bfb47c96fbe603c3bcfb58aff48
Jul 23 00:36:33.026699 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:33.026649    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:36:33.026786 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:33.026725    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:36:33.026786 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:33.026752    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:36:33.212142 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:33.212045    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7" event={"ID":"164c8f94-e30a-4031-a504-8d93b12abde0","Type":"ContainerStarted","Data":"fc01636d029cc475b6582258712fae7785811302adf8a3713bdddbab047010ab"}
Jul 23 00:36:33.212142 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:33.212105    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7" event={"ID":"164c8f94-e30a-4031-a504-8d93b12abde0","Type":"ContainerStarted","Data":"098323a8105e3dc5a199fa049e21fad04c6b3bfb47c96fbe603c3bcfb58aff48"}
Jul 23 00:36:33.235950 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:33.235901    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7" podStartSLOduration=1.235885626 podStartE2EDuration="1.235885626s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:36:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:36:33.234413494 +0000 UTC m=+1935.995611796" watchObservedRunningTime="2026-07-23 00:36:33.235885626 +0000 UTC m=+1935.997083989"
Jul 23 00:36:33.882963 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:33.882927    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"
Jul 23 00:36:34.900559 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:34.900527    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"
Jul 23 00:36:35.221784 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:35.221701    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"
Jul 23 00:36:35.222848 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:35.222823    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"
Jul 23 00:36:37.023330 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:37.023268    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"
Jul 23 00:36:37.141366 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:37.141329    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/218d9e74-4fd3-43b3-9411-53203a6231e4-istiod-ca-cert\") pod \"218d9e74-4fd3-43b3-9411-53203a6231e4\" (UID: \"218d9e74-4fd3-43b3-9411-53203a6231e4\") "
Jul 23 00:36:37.141567 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:37.141387    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/218d9e74-4fd3-43b3-9411-53203a6231e4-istio-envoy\") pod \"218d9e74-4fd3-43b3-9411-53203a6231e4\" (UID: \"218d9e74-4fd3-43b3-9411-53203a6231e4\") "
Jul 23 00:36:37.141567 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:37.141412    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/218d9e74-4fd3-43b3-9411-53203a6231e4-istio-token\") pod \"218d9e74-4fd3-43b3-9411-53203a6231e4\" (UID: \"218d9e74-4fd3-43b3-9411-53203a6231e4\") "
Jul 23 00:36:37.141567 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:37.141437    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/218d9e74-4fd3-43b3-9411-53203a6231e4-istio-podinfo\") pod \"218d9e74-4fd3-43b3-9411-53203a6231e4\" (UID: \"218d9e74-4fd3-43b3-9411-53203a6231e4\") "
Jul 23 00:36:37.141567 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:37.141506    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/218d9e74-4fd3-43b3-9411-53203a6231e4-workload-certs\") pod \"218d9e74-4fd3-43b3-9411-53203a6231e4\" (UID: \"218d9e74-4fd3-43b3-9411-53203a6231e4\") "
Jul 23 00:36:37.141567 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:37.141562    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gl4p7\" (UniqueName: \"kubernetes.io/projected/218d9e74-4fd3-43b3-9411-53203a6231e4-kube-api-access-gl4p7\") pod \"218d9e74-4fd3-43b3-9411-53203a6231e4\" (UID: \"218d9e74-4fd3-43b3-9411-53203a6231e4\") "
Jul 23 00:36:37.141823 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:37.141621    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/218d9e74-4fd3-43b3-9411-53203a6231e4-workload-socket\") pod \"218d9e74-4fd3-43b3-9411-53203a6231e4\" (UID: \"218d9e74-4fd3-43b3-9411-53203a6231e4\") "
Jul 23 00:36:37.141823 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:37.141658    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/218d9e74-4fd3-43b3-9411-53203a6231e4-credential-socket\") pod \"218d9e74-4fd3-43b3-9411-53203a6231e4\" (UID: \"218d9e74-4fd3-43b3-9411-53203a6231e4\") "
Jul 23 00:36:37.141823 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:37.141693    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/218d9e74-4fd3-43b3-9411-53203a6231e4-istio-data\") pod \"218d9e74-4fd3-43b3-9411-53203a6231e4\" (UID: \"218d9e74-4fd3-43b3-9411-53203a6231e4\") "
Jul 23 00:36:37.141823 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:37.141800    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/218d9e74-4fd3-43b3-9411-53203a6231e4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "218d9e74-4fd3-43b3-9411-53203a6231e4" (UID: "218d9e74-4fd3-43b3-9411-53203a6231e4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:36:37.142032 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:37.141845    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/218d9e74-4fd3-43b3-9411-53203a6231e4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "218d9e74-4fd3-43b3-9411-53203a6231e4" (UID: "218d9e74-4fd3-43b3-9411-53203a6231e4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:36:37.142089 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:37.142056    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/218d9e74-4fd3-43b3-9411-53203a6231e4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "218d9e74-4fd3-43b3-9411-53203a6231e4" (UID: "218d9e74-4fd3-43b3-9411-53203a6231e4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:36:37.142141 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:37.142087    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/218d9e74-4fd3-43b3-9411-53203a6231e4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "218d9e74-4fd3-43b3-9411-53203a6231e4" (UID: "218d9e74-4fd3-43b3-9411-53203a6231e4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:36:37.142196 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:37.142166    2549 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/218d9e74-4fd3-43b3-9411-53203a6231e4-workload-socket\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:36:37.142196 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:37.142185    2549 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/218d9e74-4fd3-43b3-9411-53203a6231e4-credential-socket\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:36:37.142293 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:37.142200    2549 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/218d9e74-4fd3-43b3-9411-53203a6231e4-istiod-ca-cert\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:36:37.142293 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:37.142213    2549 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/218d9e74-4fd3-43b3-9411-53203a6231e4-workload-certs\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:36:37.142672 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:37.142649    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/218d9e74-4fd3-43b3-9411-53203a6231e4-istio-data" (OuterVolumeSpecName: "istio-data") pod "218d9e74-4fd3-43b3-9411-53203a6231e4" (UID: "218d9e74-4fd3-43b3-9411-53203a6231e4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:36:37.143835 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:37.143810    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/218d9e74-4fd3-43b3-9411-53203a6231e4-istio-token" (OuterVolumeSpecName: "istio-token") pod "218d9e74-4fd3-43b3-9411-53203a6231e4" (UID: "218d9e74-4fd3-43b3-9411-53203a6231e4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:36:37.143939 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:37.143895    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/218d9e74-4fd3-43b3-9411-53203a6231e4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "218d9e74-4fd3-43b3-9411-53203a6231e4" (UID: "218d9e74-4fd3-43b3-9411-53203a6231e4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 00:36:37.144007 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:37.143988    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/218d9e74-4fd3-43b3-9411-53203a6231e4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "218d9e74-4fd3-43b3-9411-53203a6231e4" (UID: "218d9e74-4fd3-43b3-9411-53203a6231e4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:36:37.144063 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:37.143991    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/218d9e74-4fd3-43b3-9411-53203a6231e4-kube-api-access-gl4p7" (OuterVolumeSpecName: "kube-api-access-gl4p7") pod "218d9e74-4fd3-43b3-9411-53203a6231e4" (UID: "218d9e74-4fd3-43b3-9411-53203a6231e4"). InnerVolumeSpecName "kube-api-access-gl4p7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:36:37.233240 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:37.233203    2549 generic.go:356] "Generic (PLEG): container finished" podID="218d9e74-4fd3-43b3-9411-53203a6231e4" containerID="13b3fe8a81f69eac35dd3e647be25fd7f8e7c3a5cd6f3aa1d02c140d0946f027" exitCode=0
Jul 23 00:36:37.233403 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:37.233264    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"
Jul 23 00:36:37.233403 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:37.233289    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb" event={"ID":"218d9e74-4fd3-43b3-9411-53203a6231e4","Type":"ContainerDied","Data":"13b3fe8a81f69eac35dd3e647be25fd7f8e7c3a5cd6f3aa1d02c140d0946f027"}
Jul 23 00:36:37.233403 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:37.233379    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb" event={"ID":"218d9e74-4fd3-43b3-9411-53203a6231e4","Type":"ContainerDied","Data":"2a0bf0cf4a8c505d6f2eb89bef01ef7cf049a94bee96c9c3607dda42726b38ba"}
Jul 23 00:36:37.233557 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:37.233410    2549 scope.go:117] "RemoveContainer" containerID="13b3fe8a81f69eac35dd3e647be25fd7f8e7c3a5cd6f3aa1d02c140d0946f027"
Jul 23 00:36:37.242231 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:37.242213    2549 scope.go:117] "RemoveContainer" containerID="03820cc1aa8b8ea90bb94e74b8ff86b11c242d02d078ba7c2a84ec8e01975611"
Jul 23 00:36:37.242649 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:37.242632    2549 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/218d9e74-4fd3-43b3-9411-53203a6231e4-istio-envoy\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:36:37.242714 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:37.242652    2549 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/218d9e74-4fd3-43b3-9411-53203a6231e4-istio-token\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:36:37.242714 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:37.242661    2549 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/218d9e74-4fd3-43b3-9411-53203a6231e4-istio-podinfo\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:36:37.242714 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:37.242674    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gl4p7\" (UniqueName: \"kubernetes.io/projected/218d9e74-4fd3-43b3-9411-53203a6231e4-kube-api-access-gl4p7\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:36:37.242714 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:37.242689    2549 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/218d9e74-4fd3-43b3-9411-53203a6231e4-istio-data\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:36:37.250058 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:37.250043    2549 scope.go:117] "RemoveContainer" containerID="13b3fe8a81f69eac35dd3e647be25fd7f8e7c3a5cd6f3aa1d02c140d0946f027"
Jul 23 00:36:37.250306 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:36:37.250290    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13b3fe8a81f69eac35dd3e647be25fd7f8e7c3a5cd6f3aa1d02c140d0946f027\": container with ID starting with 13b3fe8a81f69eac35dd3e647be25fd7f8e7c3a5cd6f3aa1d02c140d0946f027 not found: ID does not exist" containerID="13b3fe8a81f69eac35dd3e647be25fd7f8e7c3a5cd6f3aa1d02c140d0946f027"
Jul 23 00:36:37.250348 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:37.250315    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13b3fe8a81f69eac35dd3e647be25fd7f8e7c3a5cd6f3aa1d02c140d0946f027"} err="failed to get container status \"13b3fe8a81f69eac35dd3e647be25fd7f8e7c3a5cd6f3aa1d02c140d0946f027\": rpc error: code = NotFound desc = could not find container \"13b3fe8a81f69eac35dd3e647be25fd7f8e7c3a5cd6f3aa1d02c140d0946f027\": container with ID starting with 13b3fe8a81f69eac35dd3e647be25fd7f8e7c3a5cd6f3aa1d02c140d0946f027 not found: ID does not exist"
Jul 23 00:36:37.250348 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:37.250331    2549 scope.go:117] "RemoveContainer" containerID="03820cc1aa8b8ea90bb94e74b8ff86b11c242d02d078ba7c2a84ec8e01975611"
Jul 23 00:36:37.250602 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:36:37.250587    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03820cc1aa8b8ea90bb94e74b8ff86b11c242d02d078ba7c2a84ec8e01975611\": container with ID starting with 03820cc1aa8b8ea90bb94e74b8ff86b11c242d02d078ba7c2a84ec8e01975611 not found: ID does not exist" containerID="03820cc1aa8b8ea90bb94e74b8ff86b11c242d02d078ba7c2a84ec8e01975611"
Jul 23 00:36:37.250660 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:37.250606    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03820cc1aa8b8ea90bb94e74b8ff86b11c242d02d078ba7c2a84ec8e01975611"} err="failed to get container status \"03820cc1aa8b8ea90bb94e74b8ff86b11c242d02d078ba7c2a84ec8e01975611\": rpc error: code = NotFound desc = could not find container \"03820cc1aa8b8ea90bb94e74b8ff86b11c242d02d078ba7c2a84ec8e01975611\": container with ID starting with 03820cc1aa8b8ea90bb94e74b8ff86b11c242d02d078ba7c2a84ec8e01975611 not found: ID does not exist"
Jul 23 00:36:37.266252 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:37.266225    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"]
Jul 23 00:36:37.277791 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:37.277736    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-04b6cb45-gw-openshift-default-79bf764b95-zjwcb"]
Jul 23 00:36:37.802487 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:37.802437    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="218d9e74-4fd3-43b3-9411-53203a6231e4" path="/var/lib/kubelet/pods/218d9e74-4fd3-43b3-9411-53203a6231e4/volumes"
Jul 23 00:36:50.223647 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:50.223614    2549 patch_prober.go:28] interesting pod/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 23 00:36:50.224048 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:50.223669    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7" podUID="164c8f94-e30a-4031-a504-8d93b12abde0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 23 00:36:50.297424 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:50.297392    2549 generic.go:356] "Generic (PLEG): container finished" podID="164c8f94-e30a-4031-a504-8d93b12abde0" containerID="fc01636d029cc475b6582258712fae7785811302adf8a3713bdddbab047010ab" exitCode=0
Jul 23 00:36:50.297599 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:50.297481    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7" event={"ID":"164c8f94-e30a-4031-a504-8d93b12abde0","Type":"ContainerDied","Data":"fc01636d029cc475b6582258712fae7785811302adf8a3713bdddbab047010ab"}
Jul 23 00:36:50.297850 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:50.297836    2549 scope.go:117] "RemoveContainer" containerID="fc01636d029cc475b6582258712fae7785811302adf8a3713bdddbab047010ab"
Jul 23 00:36:50.298885 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:50.298856    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:36:50.298999 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:50.298942    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:36:50.299061 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:50.299002    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:36:51.308602 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:51.308551    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7" event={"ID":"164c8f94-e30a-4031-a504-8d93b12abde0","Type":"ContainerStarted","Data":"f690d4673b1c52aafb9c499beb817c33649a22168ec8653196868b8a5720c827"}
Jul 23 00:36:51.883509 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:51.883478    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"
Jul 23 00:36:51.883682 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:51.883656    2549 patch_prober.go:28] interesting pod/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 23 00:36:51.883726 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:51.883710    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7" podUID="164c8f94-e30a-4031-a504-8d93b12abde0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 23 00:36:52.883631 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:52.883596    2549 patch_prober.go:28] interesting pod/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 23 00:36:52.884044 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:52.883657    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7" podUID="164c8f94-e30a-4031-a504-8d93b12abde0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 23 00:36:53.883132 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:53.883101    2549 patch_prober.go:28] interesting pod/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 23 00:36:53.883318 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:53.883166    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7" podUID="164c8f94-e30a-4031-a504-8d93b12abde0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 23 00:36:54.883135 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:54.883103    2549 patch_prober.go:28] interesting pod/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 23 00:36:54.883619 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:54.883159    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7" podUID="164c8f94-e30a-4031-a504-8d93b12abde0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 23 00:36:55.887144 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:55.887113    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"
Jul 23 00:36:55.887631 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:55.887439    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"
Jul 23 00:36:55.888243 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:36:55.888223    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"
Jul 23 00:37:16.853301 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:16.853267    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"]
Jul 23 00:37:16.853880 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:16.853493    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7" podUID="164c8f94-e30a-4031-a504-8d93b12abde0" containerName="istio-proxy" containerID="cri-o://f690d4673b1c52aafb9c499beb817c33649a22168ec8653196868b8a5720c827" gracePeriod=30
Jul 23 00:37:17.712496 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:17.712435    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"]
Jul 23 00:37:17.712927 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:17.712912    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="218d9e74-4fd3-43b3-9411-53203a6231e4" containerName="istio-proxy"
Jul 23 00:37:17.712973 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:17.712929    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="218d9e74-4fd3-43b3-9411-53203a6231e4" containerName="istio-proxy"
Jul 23 00:37:17.712973 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:17.712948    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="218d9e74-4fd3-43b3-9411-53203a6231e4" containerName="istio-proxy"
Jul 23 00:37:17.712973 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:17.712954    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="218d9e74-4fd3-43b3-9411-53203a6231e4" containerName="istio-proxy"
Jul 23 00:37:17.713067 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:17.713028    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="218d9e74-4fd3-43b3-9411-53203a6231e4" containerName="istio-proxy"
Jul 23 00:37:17.713067 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:17.713038    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d5d040c-eb14-42eb-a3f2-109684d29873" containerName="istio-proxy"
Jul 23 00:37:17.713067 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:17.713046    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="218d9e74-4fd3-43b3-9411-53203a6231e4" containerName="istio-proxy"
Jul 23 00:37:17.715942 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:17.715922    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"
Jul 23 00:37:17.719212 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:17.719190    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-41658efc-openshift-default-dockercfg-bmvsx\""
Jul 23 00:37:17.730829 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:17.730807    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"]
Jul 23 00:37:17.830233 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:17.830199    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac0cfe93-6c72-459b-925d-261e83801185-istiod-ca-cert\") pod \"e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2\" (UID: \"ac0cfe93-6c72-459b-925d-261e83801185\") " pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"
Jul 23 00:37:17.830390 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:17.830252    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac0cfe93-6c72-459b-925d-261e83801185-workload-certs\") pod \"e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2\" (UID: \"ac0cfe93-6c72-459b-925d-261e83801185\") " pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"
Jul 23 00:37:17.830390 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:17.830319    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac0cfe93-6c72-459b-925d-261e83801185-istio-podinfo\") pod \"e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2\" (UID: \"ac0cfe93-6c72-459b-925d-261e83801185\") " pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"
Jul 23 00:37:17.830390 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:17.830373    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac0cfe93-6c72-459b-925d-261e83801185-workload-socket\") pod \"e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2\" (UID: \"ac0cfe93-6c72-459b-925d-261e83801185\") " pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"
Jul 23 00:37:17.830543 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:17.830398    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp8n2\" (UniqueName: \"kubernetes.io/projected/ac0cfe93-6c72-459b-925d-261e83801185-kube-api-access-rp8n2\") pod \"e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2\" (UID: \"ac0cfe93-6c72-459b-925d-261e83801185\") " pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"
Jul 23 00:37:17.830543 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:17.830421    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac0cfe93-6c72-459b-925d-261e83801185-istio-envoy\") pod \"e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2\" (UID: \"ac0cfe93-6c72-459b-925d-261e83801185\") " pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"
Jul 23 00:37:17.830543 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:17.830483    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac0cfe93-6c72-459b-925d-261e83801185-credential-socket\") pod \"e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2\" (UID: \"ac0cfe93-6c72-459b-925d-261e83801185\") " pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"
Jul 23 00:37:17.830543 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:17.830514    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac0cfe93-6c72-459b-925d-261e83801185-istio-token\") pod \"e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2\" (UID: \"ac0cfe93-6c72-459b-925d-261e83801185\") " pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"
Jul 23 00:37:17.830682 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:17.830548    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac0cfe93-6c72-459b-925d-261e83801185-istio-data\") pod \"e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2\" (UID: \"ac0cfe93-6c72-459b-925d-261e83801185\") " pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"
Jul 23 00:37:17.931187 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:17.931151    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac0cfe93-6c72-459b-925d-261e83801185-istiod-ca-cert\") pod \"e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2\" (UID: \"ac0cfe93-6c72-459b-925d-261e83801185\") " pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"
Jul 23 00:37:17.931187 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:17.931191    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac0cfe93-6c72-459b-925d-261e83801185-workload-certs\") pod \"e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2\" (UID: \"ac0cfe93-6c72-459b-925d-261e83801185\") " pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"
Jul 23 00:37:17.931725 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:17.931225    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac0cfe93-6c72-459b-925d-261e83801185-istio-podinfo\") pod \"e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2\" (UID: \"ac0cfe93-6c72-459b-925d-261e83801185\") " pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"
Jul 23 00:37:17.931725 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:17.931264    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac0cfe93-6c72-459b-925d-261e83801185-workload-socket\") pod \"e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2\" (UID: \"ac0cfe93-6c72-459b-925d-261e83801185\") " pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"
Jul 23 00:37:17.931725 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:17.931287    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp8n2\" (UniqueName: \"kubernetes.io/projected/ac0cfe93-6c72-459b-925d-261e83801185-kube-api-access-rp8n2\") pod \"e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2\" (UID: \"ac0cfe93-6c72-459b-925d-261e83801185\") " pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"
Jul 23 00:37:17.931725 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:17.931318    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac0cfe93-6c72-459b-925d-261e83801185-istio-envoy\") pod \"e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2\" (UID: \"ac0cfe93-6c72-459b-925d-261e83801185\") " pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"
Jul 23 00:37:17.931725 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:17.931351    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac0cfe93-6c72-459b-925d-261e83801185-credential-socket\") pod \"e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2\" (UID: \"ac0cfe93-6c72-459b-925d-261e83801185\") " pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"
Jul 23 00:37:17.931725 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:17.931379    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac0cfe93-6c72-459b-925d-261e83801185-istio-token\") pod \"e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2\" (UID: \"ac0cfe93-6c72-459b-925d-261e83801185\") " pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"
Jul 23 00:37:17.931725 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:17.931416    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac0cfe93-6c72-459b-925d-261e83801185-istio-data\") pod \"e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2\" (UID: \"ac0cfe93-6c72-459b-925d-261e83801185\") " pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"
Jul 23 00:37:17.932273 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:17.931724    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac0cfe93-6c72-459b-925d-261e83801185-workload-socket\") pod \"e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2\" (UID: \"ac0cfe93-6c72-459b-925d-261e83801185\") " pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"
Jul 23 00:37:17.932273 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:17.931793    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac0cfe93-6c72-459b-925d-261e83801185-credential-socket\") pod \"e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2\" (UID: \"ac0cfe93-6c72-459b-925d-261e83801185\") " pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"
Jul 23 00:37:17.932273 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:17.931882    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac0cfe93-6c72-459b-925d-261e83801185-istio-data\") pod \"e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2\" (UID: \"ac0cfe93-6c72-459b-925d-261e83801185\") " pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"
Jul 23 00:37:17.932273 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:17.932032    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac0cfe93-6c72-459b-925d-261e83801185-istiod-ca-cert\") pod \"e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2\" (UID: \"ac0cfe93-6c72-459b-925d-261e83801185\") " pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"
Jul 23 00:37:17.932273 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:17.932042    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac0cfe93-6c72-459b-925d-261e83801185-workload-certs\") pod \"e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2\" (UID: \"ac0cfe93-6c72-459b-925d-261e83801185\") " pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"
Jul 23 00:37:17.933558 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:17.933537    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac0cfe93-6c72-459b-925d-261e83801185-istio-envoy\") pod \"e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2\" (UID: \"ac0cfe93-6c72-459b-925d-261e83801185\") " pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"
Jul 23 00:37:17.933774 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:17.933756    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac0cfe93-6c72-459b-925d-261e83801185-istio-podinfo\") pod \"e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2\" (UID: \"ac0cfe93-6c72-459b-925d-261e83801185\") " pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"
Jul 23 00:37:17.940613 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:17.940577    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac0cfe93-6c72-459b-925d-261e83801185-istio-token\") pod \"e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2\" (UID: \"ac0cfe93-6c72-459b-925d-261e83801185\") " pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"
Jul 23 00:37:17.940779 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:17.940759    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp8n2\" (UniqueName: \"kubernetes.io/projected/ac0cfe93-6c72-459b-925d-261e83801185-kube-api-access-rp8n2\") pod \"e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2\" (UID: \"ac0cfe93-6c72-459b-925d-261e83801185\") " pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"
Jul 23 00:37:18.026804 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:18.026719    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"
Jul 23 00:37:18.164050 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:18.164021    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"]
Jul 23 00:37:18.165853 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:37:18.165823    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac0cfe93_6c72_459b_925d_261e83801185.slice/crio-8fc99458e0ca1e292e1af377d51a244f3508d4645f68b90c1e588db09ceb43fd WatchSource:0}: Error finding container 8fc99458e0ca1e292e1af377d51a244f3508d4645f68b90c1e588db09ceb43fd: Status 404 returned error can't find the container with id 8fc99458e0ca1e292e1af377d51a244f3508d4645f68b90c1e588db09ceb43fd
Jul 23 00:37:18.168066 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:18.168028    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:37:18.168161 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:18.168118    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:37:18.168226 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:18.168160    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:37:18.439522 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:18.439482    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2" event={"ID":"ac0cfe93-6c72-459b-925d-261e83801185","Type":"ContainerStarted","Data":"3d527a9b07c1f7f2e20eec36c1c0dfe8681838753e90a7bf1e576994858c2427"}
Jul 23 00:37:18.439728 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:18.439540    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2" event={"ID":"ac0cfe93-6c72-459b-925d-261e83801185","Type":"ContainerStarted","Data":"8fc99458e0ca1e292e1af377d51a244f3508d4645f68b90c1e588db09ceb43fd"}
Jul 23 00:37:18.465760 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:18.465696    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2" podStartSLOduration=1.465679594 podStartE2EDuration="1.465679594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:37:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:37:18.464019767 +0000 UTC m=+1981.225218077" watchObservedRunningTime="2026-07-23 00:37:18.465679594 +0000 UTC m=+1981.226877904"
Jul 23 00:37:19.027126 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:19.027092    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"
Jul 23 00:37:19.032064 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:19.032041    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"
Jul 23 00:37:19.444135 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:19.444105    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"
Jul 23 00:37:19.445135 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:19.445116    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"
Jul 23 00:37:22.123464 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:22.123378    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"
Jul 23 00:37:22.269293 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:22.269260    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/164c8f94-e30a-4031-a504-8d93b12abde0-istio-envoy\") pod \"164c8f94-e30a-4031-a504-8d93b12abde0\" (UID: \"164c8f94-e30a-4031-a504-8d93b12abde0\") "
Jul 23 00:37:22.269522 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:22.269310    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/164c8f94-e30a-4031-a504-8d93b12abde0-workload-socket\") pod \"164c8f94-e30a-4031-a504-8d93b12abde0\" (UID: \"164c8f94-e30a-4031-a504-8d93b12abde0\") "
Jul 23 00:37:22.269522 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:22.269343    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mc8xz\" (UniqueName: \"kubernetes.io/projected/164c8f94-e30a-4031-a504-8d93b12abde0-kube-api-access-mc8xz\") pod \"164c8f94-e30a-4031-a504-8d93b12abde0\" (UID: \"164c8f94-e30a-4031-a504-8d93b12abde0\") "
Jul 23 00:37:22.269522 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:22.269377    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/164c8f94-e30a-4031-a504-8d93b12abde0-workload-certs\") pod \"164c8f94-e30a-4031-a504-8d93b12abde0\" (UID: \"164c8f94-e30a-4031-a504-8d93b12abde0\") "
Jul 23 00:37:22.269522 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:22.269402    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/164c8f94-e30a-4031-a504-8d93b12abde0-istio-token\") pod \"164c8f94-e30a-4031-a504-8d93b12abde0\" (UID: \"164c8f94-e30a-4031-a504-8d93b12abde0\") "
Jul 23 00:37:22.269522 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:22.269425    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/164c8f94-e30a-4031-a504-8d93b12abde0-istio-podinfo\") pod \"164c8f94-e30a-4031-a504-8d93b12abde0\" (UID: \"164c8f94-e30a-4031-a504-8d93b12abde0\") "
Jul 23 00:37:22.269522 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:22.269444    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/164c8f94-e30a-4031-a504-8d93b12abde0-credential-socket\") pod \"164c8f94-e30a-4031-a504-8d93b12abde0\" (UID: \"164c8f94-e30a-4031-a504-8d93b12abde0\") "
Jul 23 00:37:22.269874 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:22.269673    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/164c8f94-e30a-4031-a504-8d93b12abde0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "164c8f94-e30a-4031-a504-8d93b12abde0" (UID: "164c8f94-e30a-4031-a504-8d93b12abde0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:37:22.269874 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:22.269761    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/164c8f94-e30a-4031-a504-8d93b12abde0-istio-data\") pod \"164c8f94-e30a-4031-a504-8d93b12abde0\" (UID: \"164c8f94-e30a-4031-a504-8d93b12abde0\") "
Jul 23 00:37:22.269874 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:22.269778    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/164c8f94-e30a-4031-a504-8d93b12abde0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "164c8f94-e30a-4031-a504-8d93b12abde0" (UID: "164c8f94-e30a-4031-a504-8d93b12abde0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:37:22.269874 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:22.269858    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/164c8f94-e30a-4031-a504-8d93b12abde0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "164c8f94-e30a-4031-a504-8d93b12abde0" (UID: "164c8f94-e30a-4031-a504-8d93b12abde0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:37:22.270073 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:22.269901    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/164c8f94-e30a-4031-a504-8d93b12abde0-istiod-ca-cert\") pod \"164c8f94-e30a-4031-a504-8d93b12abde0\" (UID: \"164c8f94-e30a-4031-a504-8d93b12abde0\") "
Jul 23 00:37:22.270225 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:22.270203    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/164c8f94-e30a-4031-a504-8d93b12abde0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "164c8f94-e30a-4031-a504-8d93b12abde0" (UID: "164c8f94-e30a-4031-a504-8d93b12abde0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:37:22.270345 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:22.270217    2549 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/164c8f94-e30a-4031-a504-8d93b12abde0-workload-socket\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:37:22.270345 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:22.270274    2549 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/164c8f94-e30a-4031-a504-8d93b12abde0-workload-certs\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:37:22.270345 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:22.270304    2549 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/164c8f94-e30a-4031-a504-8d93b12abde0-credential-socket\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:37:22.270656 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:22.270633    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/164c8f94-e30a-4031-a504-8d93b12abde0-istio-data" (OuterVolumeSpecName: "istio-data") pod "164c8f94-e30a-4031-a504-8d93b12abde0" (UID: "164c8f94-e30a-4031-a504-8d93b12abde0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:37:22.271854 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:22.271820    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/164c8f94-e30a-4031-a504-8d93b12abde0-kube-api-access-mc8xz" (OuterVolumeSpecName: "kube-api-access-mc8xz") pod "164c8f94-e30a-4031-a504-8d93b12abde0" (UID: "164c8f94-e30a-4031-a504-8d93b12abde0"). InnerVolumeSpecName "kube-api-access-mc8xz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:37:22.271939 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:22.271877    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/164c8f94-e30a-4031-a504-8d93b12abde0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "164c8f94-e30a-4031-a504-8d93b12abde0" (UID: "164c8f94-e30a-4031-a504-8d93b12abde0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 00:37:22.272043 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:22.272015    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/164c8f94-e30a-4031-a504-8d93b12abde0-istio-token" (OuterVolumeSpecName: "istio-token") pod "164c8f94-e30a-4031-a504-8d93b12abde0" (UID: "164c8f94-e30a-4031-a504-8d93b12abde0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:37:22.272090 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:22.272037    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/164c8f94-e30a-4031-a504-8d93b12abde0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "164c8f94-e30a-4031-a504-8d93b12abde0" (UID: "164c8f94-e30a-4031-a504-8d93b12abde0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:37:22.371374 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:22.371339    2549 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/164c8f94-e30a-4031-a504-8d93b12abde0-istio-token\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:37:22.371374 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:22.371376    2549 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/164c8f94-e30a-4031-a504-8d93b12abde0-istio-podinfo\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:37:22.371585 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:22.371385    2549 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/164c8f94-e30a-4031-a504-8d93b12abde0-istio-data\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:37:22.371585 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:22.371394    2549 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/164c8f94-e30a-4031-a504-8d93b12abde0-istiod-ca-cert\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:37:22.371585 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:22.371402    2549 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/164c8f94-e30a-4031-a504-8d93b12abde0-istio-envoy\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:37:22.371585 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:22.371409    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mc8xz\" (UniqueName: \"kubernetes.io/projected/164c8f94-e30a-4031-a504-8d93b12abde0-kube-api-access-mc8xz\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:37:22.459802 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:22.459718    2549 generic.go:356] "Generic (PLEG): container finished" podID="164c8f94-e30a-4031-a504-8d93b12abde0" containerID="f690d4673b1c52aafb9c499beb817c33649a22168ec8653196868b8a5720c827" exitCode=0
Jul 23 00:37:22.459802 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:22.459769    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"
Jul 23 00:37:22.459802 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:22.459784    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7" event={"ID":"164c8f94-e30a-4031-a504-8d93b12abde0","Type":"ContainerDied","Data":"f690d4673b1c52aafb9c499beb817c33649a22168ec8653196868b8a5720c827"}
Jul 23 00:37:22.460042 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:22.459829    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7" event={"ID":"164c8f94-e30a-4031-a504-8d93b12abde0","Type":"ContainerDied","Data":"098323a8105e3dc5a199fa049e21fad04c6b3bfb47c96fbe603c3bcfb58aff48"}
Jul 23 00:37:22.460042 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:22.459850    2549 scope.go:117] "RemoveContainer" containerID="f690d4673b1c52aafb9c499beb817c33649a22168ec8653196868b8a5720c827"
Jul 23 00:37:22.469158 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:22.469135    2549 scope.go:117] "RemoveContainer" containerID="fc01636d029cc475b6582258712fae7785811302adf8a3713bdddbab047010ab"
Jul 23 00:37:22.479175 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:22.479155    2549 scope.go:117] "RemoveContainer" containerID="f690d4673b1c52aafb9c499beb817c33649a22168ec8653196868b8a5720c827"
Jul 23 00:37:22.479578 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:37:22.479554    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f690d4673b1c52aafb9c499beb817c33649a22168ec8653196868b8a5720c827\": container with ID starting with f690d4673b1c52aafb9c499beb817c33649a22168ec8653196868b8a5720c827 not found: ID does not exist" containerID="f690d4673b1c52aafb9c499beb817c33649a22168ec8653196868b8a5720c827"
Jul 23 00:37:22.479692 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:22.479587    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f690d4673b1c52aafb9c499beb817c33649a22168ec8653196868b8a5720c827"} err="failed to get container status \"f690d4673b1c52aafb9c499beb817c33649a22168ec8653196868b8a5720c827\": rpc error: code = NotFound desc = could not find container \"f690d4673b1c52aafb9c499beb817c33649a22168ec8653196868b8a5720c827\": container with ID starting with f690d4673b1c52aafb9c499beb817c33649a22168ec8653196868b8a5720c827 not found: ID does not exist"
Jul 23 00:37:22.479692 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:22.479612    2549 scope.go:117] "RemoveContainer" containerID="fc01636d029cc475b6582258712fae7785811302adf8a3713bdddbab047010ab"
Jul 23 00:37:22.479883 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:37:22.479865    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc01636d029cc475b6582258712fae7785811302adf8a3713bdddbab047010ab\": container with ID starting with fc01636d029cc475b6582258712fae7785811302adf8a3713bdddbab047010ab not found: ID does not exist" containerID="fc01636d029cc475b6582258712fae7785811302adf8a3713bdddbab047010ab"
Jul 23 00:37:22.479928 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:22.479889    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc01636d029cc475b6582258712fae7785811302adf8a3713bdddbab047010ab"} err="failed to get container status \"fc01636d029cc475b6582258712fae7785811302adf8a3713bdddbab047010ab\": rpc error: code = NotFound desc = could not find container \"fc01636d029cc475b6582258712fae7785811302adf8a3713bdddbab047010ab\": container with ID starting with fc01636d029cc475b6582258712fae7785811302adf8a3713bdddbab047010ab not found: ID does not exist"
Jul 23 00:37:22.489011 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:22.488990    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"]
Jul 23 00:37:22.492978 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:22.492954    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-55ea1e47-openshift-default-78c8449fb9-gspj7"]
Jul 23 00:37:23.802379 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:23.802346    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="164c8f94-e30a-4031-a504-8d93b12abde0" path="/var/lib/kubelet/pods/164c8f94-e30a-4031-a504-8d93b12abde0/volumes"
Jul 23 00:37:35.485638 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:35.485594    2549 patch_prober.go:28] interesting pod/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 23 00:37:35.486023 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:35.485685    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2" podUID="ac0cfe93-6c72-459b-925d-261e83801185" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 23 00:37:37.543551 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:37.543516    2549 generic.go:356] "Generic (PLEG): container finished" podID="ac0cfe93-6c72-459b-925d-261e83801185" containerID="3d527a9b07c1f7f2e20eec36c1c0dfe8681838753e90a7bf1e576994858c2427" exitCode=0
Jul 23 00:37:37.543971 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:37.543588    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2" event={"ID":"ac0cfe93-6c72-459b-925d-261e83801185","Type":"ContainerDied","Data":"3d527a9b07c1f7f2e20eec36c1c0dfe8681838753e90a7bf1e576994858c2427"}
Jul 23 00:37:37.543971 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:37.543966    2549 scope.go:117] "RemoveContainer" containerID="3d527a9b07c1f7f2e20eec36c1c0dfe8681838753e90a7bf1e576994858c2427"
Jul 23 00:37:37.544980 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:37.544949    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:37:37.545096 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:37.545021    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:37:37.545096 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:37.545054    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:37:38.549641 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:38.549598    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2" event={"ID":"ac0cfe93-6c72-459b-925d-261e83801185","Type":"ContainerStarted","Data":"e8ea39e25908b05fb0693391e62f268f94de375882a5684f1272f1bb237b126f"}
Jul 23 00:37:39.027496 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:39.027429    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"
Jul 23 00:37:39.027858 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:39.027833    2549 patch_prober.go:28] interesting pod/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 23 00:37:39.027920 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:39.027898    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2" podUID="ac0cfe93-6c72-459b-925d-261e83801185" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 23 00:37:40.027130 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:40.027091    2549 patch_prober.go:28] interesting pod/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 23 00:37:40.027546 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:40.027143    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2" podUID="ac0cfe93-6c72-459b-925d-261e83801185" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 23 00:37:41.027566 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:41.027522    2549 patch_prober.go:28] interesting pod/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 23 00:37:41.027985 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:41.027583    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2" podUID="ac0cfe93-6c72-459b-925d-261e83801185" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 23 00:37:42.027282 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:42.027244    2549 patch_prober.go:28] interesting pod/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 23 00:37:42.027491 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:42.027304    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2" podUID="ac0cfe93-6c72-459b-925d-261e83801185" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 23 00:37:43.031081 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:43.031051    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"
Jul 23 00:37:43.031520 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:43.031463    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"
Jul 23 00:37:43.032056 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:37:43.032040    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"
Jul 23 00:38:00.114206 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:00.114169    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"]
Jul 23 00:38:00.114763 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:00.114374    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2" podUID="ac0cfe93-6c72-459b-925d-261e83801185" containerName="istio-proxy" containerID="cri-o://e8ea39e25908b05fb0693391e62f268f94de375882a5684f1272f1bb237b126f" gracePeriod=30
Jul 23 00:38:05.382379 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:05.382319    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"
Jul 23 00:38:05.453378 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:05.453334    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac0cfe93-6c72-459b-925d-261e83801185-workload-socket\") pod \"ac0cfe93-6c72-459b-925d-261e83801185\" (UID: \"ac0cfe93-6c72-459b-925d-261e83801185\") "
Jul 23 00:38:05.453554 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:05.453403    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac0cfe93-6c72-459b-925d-261e83801185-workload-certs\") pod \"ac0cfe93-6c72-459b-925d-261e83801185\" (UID: \"ac0cfe93-6c72-459b-925d-261e83801185\") "
Jul 23 00:38:05.453554 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:05.453472    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac0cfe93-6c72-459b-925d-261e83801185-istio-podinfo\") pod \"ac0cfe93-6c72-459b-925d-261e83801185\" (UID: \"ac0cfe93-6c72-459b-925d-261e83801185\") "
Jul 23 00:38:05.453554 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:05.453502    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac0cfe93-6c72-459b-925d-261e83801185-istiod-ca-cert\") pod \"ac0cfe93-6c72-459b-925d-261e83801185\" (UID: \"ac0cfe93-6c72-459b-925d-261e83801185\") "
Jul 23 00:38:05.453554 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:05.453548    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac0cfe93-6c72-459b-925d-261e83801185-istio-token\") pod \"ac0cfe93-6c72-459b-925d-261e83801185\" (UID: \"ac0cfe93-6c72-459b-925d-261e83801185\") "
Jul 23 00:38:05.453781 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:05.453590    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rp8n2\" (UniqueName: \"kubernetes.io/projected/ac0cfe93-6c72-459b-925d-261e83801185-kube-api-access-rp8n2\") pod \"ac0cfe93-6c72-459b-925d-261e83801185\" (UID: \"ac0cfe93-6c72-459b-925d-261e83801185\") "
Jul 23 00:38:05.453781 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:05.453614    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac0cfe93-6c72-459b-925d-261e83801185-credential-socket\") pod \"ac0cfe93-6c72-459b-925d-261e83801185\" (UID: \"ac0cfe93-6c72-459b-925d-261e83801185\") "
Jul 23 00:38:05.453781 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:05.453642    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac0cfe93-6c72-459b-925d-261e83801185-istio-data\") pod \"ac0cfe93-6c72-459b-925d-261e83801185\" (UID: \"ac0cfe93-6c72-459b-925d-261e83801185\") "
Jul 23 00:38:05.453781 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:05.453645    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac0cfe93-6c72-459b-925d-261e83801185-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ac0cfe93-6c72-459b-925d-261e83801185" (UID: "ac0cfe93-6c72-459b-925d-261e83801185"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:38:05.453781 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:05.453713    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac0cfe93-6c72-459b-925d-261e83801185-istio-envoy\") pod \"ac0cfe93-6c72-459b-925d-261e83801185\" (UID: \"ac0cfe93-6c72-459b-925d-261e83801185\") "
Jul 23 00:38:05.453781 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:05.453747    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac0cfe93-6c72-459b-925d-261e83801185-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ac0cfe93-6c72-459b-925d-261e83801185" (UID: "ac0cfe93-6c72-459b-925d-261e83801185"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:38:05.454093 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:05.453899    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac0cfe93-6c72-459b-925d-261e83801185-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ac0cfe93-6c72-459b-925d-261e83801185" (UID: "ac0cfe93-6c72-459b-925d-261e83801185"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:38:05.454093 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:05.454075    2549 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac0cfe93-6c72-459b-925d-261e83801185-credential-socket\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:38:05.454199 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:05.454097    2549 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac0cfe93-6c72-459b-925d-261e83801185-workload-socket\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:38:05.454199 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:05.454096    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac0cfe93-6c72-459b-925d-261e83801185-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ac0cfe93-6c72-459b-925d-261e83801185" (UID: "ac0cfe93-6c72-459b-925d-261e83801185"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:38:05.454199 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:05.454112    2549 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac0cfe93-6c72-459b-925d-261e83801185-workload-certs\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:38:05.454557 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:05.454530    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac0cfe93-6c72-459b-925d-261e83801185-istio-data" (OuterVolumeSpecName: "istio-data") pod "ac0cfe93-6c72-459b-925d-261e83801185" (UID: "ac0cfe93-6c72-459b-925d-261e83801185"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:38:05.455894 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:05.455866    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac0cfe93-6c72-459b-925d-261e83801185-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ac0cfe93-6c72-459b-925d-261e83801185" (UID: "ac0cfe93-6c72-459b-925d-261e83801185"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:38:05.455995 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:05.455926    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac0cfe93-6c72-459b-925d-261e83801185-istio-token" (OuterVolumeSpecName: "istio-token") pod "ac0cfe93-6c72-459b-925d-261e83801185" (UID: "ac0cfe93-6c72-459b-925d-261e83801185"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:38:05.455995 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:05.455943    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ac0cfe93-6c72-459b-925d-261e83801185-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ac0cfe93-6c72-459b-925d-261e83801185" (UID: "ac0cfe93-6c72-459b-925d-261e83801185"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 00:38:05.456070 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:05.455997    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac0cfe93-6c72-459b-925d-261e83801185-kube-api-access-rp8n2" (OuterVolumeSpecName: "kube-api-access-rp8n2") pod "ac0cfe93-6c72-459b-925d-261e83801185" (UID: "ac0cfe93-6c72-459b-925d-261e83801185"). InnerVolumeSpecName "kube-api-access-rp8n2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:38:05.554598 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:05.554558    2549 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac0cfe93-6c72-459b-925d-261e83801185-istio-envoy\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:38:05.554598 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:05.554591    2549 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac0cfe93-6c72-459b-925d-261e83801185-istio-podinfo\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:38:05.554598 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:05.554601    2549 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac0cfe93-6c72-459b-925d-261e83801185-istiod-ca-cert\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:38:05.554598 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:05.554610    2549 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac0cfe93-6c72-459b-925d-261e83801185-istio-token\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:38:05.554879 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:05.554619    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rp8n2\" (UniqueName: \"kubernetes.io/projected/ac0cfe93-6c72-459b-925d-261e83801185-kube-api-access-rp8n2\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:38:05.554879 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:05.554628    2549 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac0cfe93-6c72-459b-925d-261e83801185-istio-data\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:38:05.681282 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:05.681169    2549 generic.go:356] "Generic (PLEG): container finished" podID="ac0cfe93-6c72-459b-925d-261e83801185" containerID="e8ea39e25908b05fb0693391e62f268f94de375882a5684f1272f1bb237b126f" exitCode=0
Jul 23 00:38:05.681282 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:05.681218    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"
Jul 23 00:38:05.681282 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:05.681261    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2" event={"ID":"ac0cfe93-6c72-459b-925d-261e83801185","Type":"ContainerDied","Data":"e8ea39e25908b05fb0693391e62f268f94de375882a5684f1272f1bb237b126f"}
Jul 23 00:38:05.681622 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:05.681341    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2" event={"ID":"ac0cfe93-6c72-459b-925d-261e83801185","Type":"ContainerDied","Data":"8fc99458e0ca1e292e1af377d51a244f3508d4645f68b90c1e588db09ceb43fd"}
Jul 23 00:38:05.681622 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:05.681374    2549 scope.go:117] "RemoveContainer" containerID="e8ea39e25908b05fb0693391e62f268f94de375882a5684f1272f1bb237b126f"
Jul 23 00:38:05.691850 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:05.691822    2549 scope.go:117] "RemoveContainer" containerID="3d527a9b07c1f7f2e20eec36c1c0dfe8681838753e90a7bf1e576994858c2427"
Jul 23 00:38:05.699945 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:05.699924    2549 scope.go:117] "RemoveContainer" containerID="e8ea39e25908b05fb0693391e62f268f94de375882a5684f1272f1bb237b126f"
Jul 23 00:38:05.700215 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:38:05.700195    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8ea39e25908b05fb0693391e62f268f94de375882a5684f1272f1bb237b126f\": container with ID starting with e8ea39e25908b05fb0693391e62f268f94de375882a5684f1272f1bb237b126f not found: ID does not exist" containerID="e8ea39e25908b05fb0693391e62f268f94de375882a5684f1272f1bb237b126f"
Jul 23 00:38:05.700273 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:05.700225    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8ea39e25908b05fb0693391e62f268f94de375882a5684f1272f1bb237b126f"} err="failed to get container status \"e8ea39e25908b05fb0693391e62f268f94de375882a5684f1272f1bb237b126f\": rpc error: code = NotFound desc = could not find container \"e8ea39e25908b05fb0693391e62f268f94de375882a5684f1272f1bb237b126f\": container with ID starting with e8ea39e25908b05fb0693391e62f268f94de375882a5684f1272f1bb237b126f not found: ID does not exist"
Jul 23 00:38:05.700273 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:05.700243    2549 scope.go:117] "RemoveContainer" containerID="3d527a9b07c1f7f2e20eec36c1c0dfe8681838753e90a7bf1e576994858c2427"
Jul 23 00:38:05.700492 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:38:05.700473    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d527a9b07c1f7f2e20eec36c1c0dfe8681838753e90a7bf1e576994858c2427\": container with ID starting with 3d527a9b07c1f7f2e20eec36c1c0dfe8681838753e90a7bf1e576994858c2427 not found: ID does not exist" containerID="3d527a9b07c1f7f2e20eec36c1c0dfe8681838753e90a7bf1e576994858c2427"
Jul 23 00:38:05.700543 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:05.700500    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d527a9b07c1f7f2e20eec36c1c0dfe8681838753e90a7bf1e576994858c2427"} err="failed to get container status \"3d527a9b07c1f7f2e20eec36c1c0dfe8681838753e90a7bf1e576994858c2427\": rpc error: code = NotFound desc = could not find container \"3d527a9b07c1f7f2e20eec36c1c0dfe8681838753e90a7bf1e576994858c2427\": container with ID starting with 3d527a9b07c1f7f2e20eec36c1c0dfe8681838753e90a7bf1e576994858c2427 not found: ID does not exist"
Jul 23 00:38:05.706167 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:05.706145    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"]
Jul 23 00:38:05.710564 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:05.710539    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-41658efc-openshift-default-6dd6959459-dqvv2"]
Jul 23 00:38:05.804410 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:38:05.804376    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac0cfe93-6c72-459b-925d-261e83801185" path="/var/lib/kubelet/pods/ac0cfe93-6c72-459b-925d-261e83801185/volumes"
Jul 23 00:39:45.137339 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.137308    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"]
Jul 23 00:39:45.137829 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.137665    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac0cfe93-6c72-459b-925d-261e83801185" containerName="istio-proxy"
Jul 23 00:39:45.137829 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.137679    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac0cfe93-6c72-459b-925d-261e83801185" containerName="istio-proxy"
Jul 23 00:39:45.137829 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.137687    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac0cfe93-6c72-459b-925d-261e83801185" containerName="istio-proxy"
Jul 23 00:39:45.137829 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.137692    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac0cfe93-6c72-459b-925d-261e83801185" containerName="istio-proxy"
Jul 23 00:39:45.137829 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.137709    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="164c8f94-e30a-4031-a504-8d93b12abde0" containerName="istio-proxy"
Jul 23 00:39:45.137829 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.137716    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="164c8f94-e30a-4031-a504-8d93b12abde0" containerName="istio-proxy"
Jul 23 00:39:45.137829 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.137774    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="164c8f94-e30a-4031-a504-8d93b12abde0" containerName="istio-proxy"
Jul 23 00:39:45.137829 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.137781    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="164c8f94-e30a-4031-a504-8d93b12abde0" containerName="istio-proxy"
Jul 23 00:39:45.137829 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.137787    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac0cfe93-6c72-459b-925d-261e83801185" containerName="istio-proxy"
Jul 23 00:39:45.137829 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.137795    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac0cfe93-6c72-459b-925d-261e83801185" containerName="istio-proxy"
Jul 23 00:39:45.140679 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.140661    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"
Jul 23 00:39:45.143253 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.143235    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-dfb539bb-openshift-default-dockercfg-x42vk\""
Jul 23 00:39:45.168949 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.168922    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"]
Jul 23 00:39:45.235746 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.235713    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0aee-6cce-4ea1-af20-719ab6983520-istio-data\") pod \"e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k\" (UID: \"2a7c0aee-6cce-4ea1-af20-719ab6983520\") " pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"
Jul 23 00:39:45.235746 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.235749    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm2tt\" (UniqueName: \"kubernetes.io/projected/2a7c0aee-6cce-4ea1-af20-719ab6983520-kube-api-access-tm2tt\") pod \"e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k\" (UID: \"2a7c0aee-6cce-4ea1-af20-719ab6983520\") " pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"
Jul 23 00:39:45.235977 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.235788    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0aee-6cce-4ea1-af20-719ab6983520-workload-certs\") pod \"e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k\" (UID: \"2a7c0aee-6cce-4ea1-af20-719ab6983520\") " pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"
Jul 23 00:39:45.235977 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.235877    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a7c0aee-6cce-4ea1-af20-719ab6983520-istio-podinfo\") pod \"e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k\" (UID: \"2a7c0aee-6cce-4ea1-af20-719ab6983520\") " pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"
Jul 23 00:39:45.235977 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.235928    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0aee-6cce-4ea1-af20-719ab6983520-workload-socket\") pod \"e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k\" (UID: \"2a7c0aee-6cce-4ea1-af20-719ab6983520\") " pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"
Jul 23 00:39:45.235977 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.235972    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0aee-6cce-4ea1-af20-719ab6983520-credential-socket\") pod \"e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k\" (UID: \"2a7c0aee-6cce-4ea1-af20-719ab6983520\") " pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"
Jul 23 00:39:45.236181 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.235990    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a7c0aee-6cce-4ea1-af20-719ab6983520-istiod-ca-cert\") pod \"e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k\" (UID: \"2a7c0aee-6cce-4ea1-af20-719ab6983520\") " pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"
Jul 23 00:39:45.236181 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.236021    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a7c0aee-6cce-4ea1-af20-719ab6983520-istio-token\") pod \"e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k\" (UID: \"2a7c0aee-6cce-4ea1-af20-719ab6983520\") " pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"
Jul 23 00:39:45.236181 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.236042    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0aee-6cce-4ea1-af20-719ab6983520-istio-envoy\") pod \"e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k\" (UID: \"2a7c0aee-6cce-4ea1-af20-719ab6983520\") " pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"
Jul 23 00:39:45.336736 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.336682    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0aee-6cce-4ea1-af20-719ab6983520-workload-certs\") pod \"e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k\" (UID: \"2a7c0aee-6cce-4ea1-af20-719ab6983520\") " pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"
Jul 23 00:39:45.336736 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.336734    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a7c0aee-6cce-4ea1-af20-719ab6983520-istio-podinfo\") pod \"e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k\" (UID: \"2a7c0aee-6cce-4ea1-af20-719ab6983520\") " pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"
Jul 23 00:39:45.337028 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.336763    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0aee-6cce-4ea1-af20-719ab6983520-workload-socket\") pod \"e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k\" (UID: \"2a7c0aee-6cce-4ea1-af20-719ab6983520\") " pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"
Jul 23 00:39:45.337028 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.336803    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0aee-6cce-4ea1-af20-719ab6983520-credential-socket\") pod \"e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k\" (UID: \"2a7c0aee-6cce-4ea1-af20-719ab6983520\") " pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"
Jul 23 00:39:45.337028 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.336831    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a7c0aee-6cce-4ea1-af20-719ab6983520-istiod-ca-cert\") pod \"e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k\" (UID: \"2a7c0aee-6cce-4ea1-af20-719ab6983520\") " pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"
Jul 23 00:39:45.337028 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.336858    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a7c0aee-6cce-4ea1-af20-719ab6983520-istio-token\") pod \"e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k\" (UID: \"2a7c0aee-6cce-4ea1-af20-719ab6983520\") " pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"
Jul 23 00:39:45.337028 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.336891    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0aee-6cce-4ea1-af20-719ab6983520-istio-envoy\") pod \"e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k\" (UID: \"2a7c0aee-6cce-4ea1-af20-719ab6983520\") " pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"
Jul 23 00:39:45.337028 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.336940    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0aee-6cce-4ea1-af20-719ab6983520-istio-data\") pod \"e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k\" (UID: \"2a7c0aee-6cce-4ea1-af20-719ab6983520\") " pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"
Jul 23 00:39:45.337028 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.336963    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm2tt\" (UniqueName: \"kubernetes.io/projected/2a7c0aee-6cce-4ea1-af20-719ab6983520-kube-api-access-tm2tt\") pod \"e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k\" (UID: \"2a7c0aee-6cce-4ea1-af20-719ab6983520\") " pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"
Jul 23 00:39:45.337496 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.337273    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0aee-6cce-4ea1-af20-719ab6983520-credential-socket\") pod \"e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k\" (UID: \"2a7c0aee-6cce-4ea1-af20-719ab6983520\") " pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"
Jul 23 00:39:45.337496 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.337391    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0aee-6cce-4ea1-af20-719ab6983520-workload-certs\") pod \"e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k\" (UID: \"2a7c0aee-6cce-4ea1-af20-719ab6983520\") " pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"
Jul 23 00:39:45.337696 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.337669    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0aee-6cce-4ea1-af20-719ab6983520-istio-data\") pod \"e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k\" (UID: \"2a7c0aee-6cce-4ea1-af20-719ab6983520\") " pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"
Jul 23 00:39:45.337774 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.337700    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0aee-6cce-4ea1-af20-719ab6983520-workload-socket\") pod \"e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k\" (UID: \"2a7c0aee-6cce-4ea1-af20-719ab6983520\") " pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"
Jul 23 00:39:45.338374 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.338347    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a7c0aee-6cce-4ea1-af20-719ab6983520-istiod-ca-cert\") pod \"e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k\" (UID: \"2a7c0aee-6cce-4ea1-af20-719ab6983520\") " pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"
Jul 23 00:39:45.339940 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.339918    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0aee-6cce-4ea1-af20-719ab6983520-istio-envoy\") pod \"e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k\" (UID: \"2a7c0aee-6cce-4ea1-af20-719ab6983520\") " pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"
Jul 23 00:39:45.340093 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.340071    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a7c0aee-6cce-4ea1-af20-719ab6983520-istio-podinfo\") pod \"e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k\" (UID: \"2a7c0aee-6cce-4ea1-af20-719ab6983520\") " pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"
Jul 23 00:39:45.345699 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.345679    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm2tt\" (UniqueName: \"kubernetes.io/projected/2a7c0aee-6cce-4ea1-af20-719ab6983520-kube-api-access-tm2tt\") pod \"e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k\" (UID: \"2a7c0aee-6cce-4ea1-af20-719ab6983520\") " pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"
Jul 23 00:39:45.346191 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.346173    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a7c0aee-6cce-4ea1-af20-719ab6983520-istio-token\") pod \"e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k\" (UID: \"2a7c0aee-6cce-4ea1-af20-719ab6983520\") " pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"
Jul 23 00:39:45.451690 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.451593    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"
Jul 23 00:39:45.590497 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.590469    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"]
Jul 23 00:39:45.593214 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:39:45.593176    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a7c0aee_6cce_4ea1_af20_719ab6983520.slice/crio-6009ca239258b94a4c46ec806c51445c211415f0d61276cd42c3aad1d2ac1420 WatchSource:0}: Error finding container 6009ca239258b94a4c46ec806c51445c211415f0d61276cd42c3aad1d2ac1420: Status 404 returned error can't find the container with id 6009ca239258b94a4c46ec806c51445c211415f0d61276cd42c3aad1d2ac1420
Jul 23 00:39:45.595513 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.595475    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:39:45.595607 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.595559    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:39:45.595646 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:45.595628    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:39:46.161668 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:46.161627    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k" event={"ID":"2a7c0aee-6cce-4ea1-af20-719ab6983520","Type":"ContainerStarted","Data":"6eee1dee4dc761c11ca3f3f0c27e7c3a825711f8fd12ab5b6ccd49b6ed47adbc"}
Jul 23 00:39:46.162165 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:46.161700    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k" event={"ID":"2a7c0aee-6cce-4ea1-af20-719ab6983520","Type":"ContainerStarted","Data":"6009ca239258b94a4c46ec806c51445c211415f0d61276cd42c3aad1d2ac1420"}
Jul 23 00:39:46.183763 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:46.183716    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k" podStartSLOduration=1.18370212 podStartE2EDuration="1.18370212s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:39:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:39:46.182269615 +0000 UTC m=+2128.943467926" watchObservedRunningTime="2026-07-23 00:39:46.18370212 +0000 UTC m=+2128.944900429"
Jul 23 00:39:46.452134 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:46.452043    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"
Jul 23 00:39:46.456974 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:46.456944    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"
Jul 23 00:39:47.166059 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:47.166026    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"
Jul 23 00:39:47.166987 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:47.166965    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"
Jul 23 00:39:48.354743 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:48.354708    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dfb539bb-65997b6cd5-xlqf2"]
Jul 23 00:39:48.355129 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:48.355105    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="164c8f94-e30a-4031-a504-8d93b12abde0" containerName="istio-proxy"
Jul 23 00:39:48.355129 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:48.355117    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="164c8f94-e30a-4031-a504-8d93b12abde0" containerName="istio-proxy"
Jul 23 00:39:48.357763 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:48.357742    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dfb539bb-65997b6cd5-xlqf2"
Jul 23 00:39:48.360620 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:48.360597    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-dfb539bb-serving-cert\""
Jul 23 00:39:48.391420 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:48.391387    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dfb539bb-65997b6cd5-xlqf2"]
Jul 23 00:39:48.465461 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:48.465410    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/daadbebf-9d48-4dd1-9a58-b2fb70bd952a-maas-api-tls\") pod \"maas-api-e2e-mt-dfb539bb-65997b6cd5-xlqf2\" (UID: \"daadbebf-9d48-4dd1-9a58-b2fb70bd952a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dfb539bb-65997b6cd5-xlqf2"
Jul 23 00:39:48.465632 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:48.465520    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/daadbebf-9d48-4dd1-9a58-b2fb70bd952a-openshift-service-ca\") pod \"maas-api-e2e-mt-dfb539bb-65997b6cd5-xlqf2\" (UID: \"daadbebf-9d48-4dd1-9a58-b2fb70bd952a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dfb539bb-65997b6cd5-xlqf2"
Jul 23 00:39:48.465632 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:48.465562    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkplh\" (UniqueName: \"kubernetes.io/projected/daadbebf-9d48-4dd1-9a58-b2fb70bd952a-kube-api-access-xkplh\") pod \"maas-api-e2e-mt-dfb539bb-65997b6cd5-xlqf2\" (UID: \"daadbebf-9d48-4dd1-9a58-b2fb70bd952a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dfb539bb-65997b6cd5-xlqf2"
Jul 23 00:39:48.566391 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:48.566349    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/daadbebf-9d48-4dd1-9a58-b2fb70bd952a-openshift-service-ca\") pod \"maas-api-e2e-mt-dfb539bb-65997b6cd5-xlqf2\" (UID: \"daadbebf-9d48-4dd1-9a58-b2fb70bd952a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dfb539bb-65997b6cd5-xlqf2"
Jul 23 00:39:48.566615 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:48.566406    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkplh\" (UniqueName: \"kubernetes.io/projected/daadbebf-9d48-4dd1-9a58-b2fb70bd952a-kube-api-access-xkplh\") pod \"maas-api-e2e-mt-dfb539bb-65997b6cd5-xlqf2\" (UID: \"daadbebf-9d48-4dd1-9a58-b2fb70bd952a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dfb539bb-65997b6cd5-xlqf2"
Jul 23 00:39:48.566615 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:48.566535    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/daadbebf-9d48-4dd1-9a58-b2fb70bd952a-maas-api-tls\") pod \"maas-api-e2e-mt-dfb539bb-65997b6cd5-xlqf2\" (UID: \"daadbebf-9d48-4dd1-9a58-b2fb70bd952a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dfb539bb-65997b6cd5-xlqf2"
Jul 23 00:39:48.566718 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:39:48.566692    2549 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-dfb539bb-serving-cert: secret "maas-api-e2e-mt-dfb539bb-serving-cert" not found
Jul 23 00:39:48.566797 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:39:48.566782    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daadbebf-9d48-4dd1-9a58-b2fb70bd952a-maas-api-tls podName:daadbebf-9d48-4dd1-9a58-b2fb70bd952a nodeName:}" failed. No retries permitted until 2026-07-23 00:39:49.066757616 +0000 UTC m=+2131.827955921 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/daadbebf-9d48-4dd1-9a58-b2fb70bd952a-maas-api-tls") pod "maas-api-e2e-mt-dfb539bb-65997b6cd5-xlqf2" (UID: "daadbebf-9d48-4dd1-9a58-b2fb70bd952a") : secret "maas-api-e2e-mt-dfb539bb-serving-cert" not found
Jul 23 00:39:48.567123 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:48.567104    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/daadbebf-9d48-4dd1-9a58-b2fb70bd952a-openshift-service-ca\") pod \"maas-api-e2e-mt-dfb539bb-65997b6cd5-xlqf2\" (UID: \"daadbebf-9d48-4dd1-9a58-b2fb70bd952a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dfb539bb-65997b6cd5-xlqf2"
Jul 23 00:39:48.584435 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:48.584407    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkplh\" (UniqueName: \"kubernetes.io/projected/daadbebf-9d48-4dd1-9a58-b2fb70bd952a-kube-api-access-xkplh\") pod \"maas-api-e2e-mt-dfb539bb-65997b6cd5-xlqf2\" (UID: \"daadbebf-9d48-4dd1-9a58-b2fb70bd952a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dfb539bb-65997b6cd5-xlqf2"
Jul 23 00:39:49.071547 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:49.071513    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/daadbebf-9d48-4dd1-9a58-b2fb70bd952a-maas-api-tls\") pod \"maas-api-e2e-mt-dfb539bb-65997b6cd5-xlqf2\" (UID: \"daadbebf-9d48-4dd1-9a58-b2fb70bd952a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dfb539bb-65997b6cd5-xlqf2"
Jul 23 00:39:49.073942 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:49.073912    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/daadbebf-9d48-4dd1-9a58-b2fb70bd952a-maas-api-tls\") pod \"maas-api-e2e-mt-dfb539bb-65997b6cd5-xlqf2\" (UID: \"daadbebf-9d48-4dd1-9a58-b2fb70bd952a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dfb539bb-65997b6cd5-xlqf2"
Jul 23 00:39:49.269069 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:49.269027    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dfb539bb-65997b6cd5-xlqf2"
Jul 23 00:39:49.414130 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:49.414096    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dfb539bb-65997b6cd5-xlqf2"]
Jul 23 00:39:49.415901 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:39:49.415872    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaadbebf_9d48_4dd1_9a58_b2fb70bd952a.slice/crio-7df6eb3e9706ee20df38e9f9d5c37a36d1bc9faf4fed35450d70ddd9ec12ed0d WatchSource:0}: Error finding container 7df6eb3e9706ee20df38e9f9d5c37a36d1bc9faf4fed35450d70ddd9ec12ed0d: Status 404 returned error can't find the container with id 7df6eb3e9706ee20df38e9f9d5c37a36d1bc9faf4fed35450d70ddd9ec12ed0d
Jul 23 00:39:50.183882 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:50.183798    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dfb539bb-65997b6cd5-xlqf2" event={"ID":"daadbebf-9d48-4dd1-9a58-b2fb70bd952a","Type":"ContainerStarted","Data":"8fd54d2269337440c9869c3c7efff96f354347164ea2e5fc9d68ac91dccb3778"}
Jul 23 00:39:50.183882 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:50.183848    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dfb539bb-65997b6cd5-xlqf2" event={"ID":"daadbebf-9d48-4dd1-9a58-b2fb70bd952a","Type":"ContainerStarted","Data":"7df6eb3e9706ee20df38e9f9d5c37a36d1bc9faf4fed35450d70ddd9ec12ed0d"}
Jul 23 00:39:50.184083 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:50.183888    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dfb539bb-65997b6cd5-xlqf2"
Jul 23 00:39:50.201814 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:50.201756    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dfb539bb-65997b6cd5-xlqf2" podStartSLOduration=1.7415972119999998 podStartE2EDuration="2.201742777s" totalImagesPullingTime="460.145565ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:39:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:39:50.200765139 +0000 UTC m=+2132.961963462" watchObservedRunningTime="2026-07-23 00:39:50.201742777 +0000 UTC m=+2132.962941149"
Jul 23 00:39:56.203729 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:39:56.203690    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dfb539bb-65997b6cd5-xlqf2"
Jul 23 00:40:01.245169 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:01.245063    2549 generic.go:356] "Generic (PLEG): container finished" podID="2a7c0aee-6cce-4ea1-af20-719ab6983520" containerID="6eee1dee4dc761c11ca3f3f0c27e7c3a825711f8fd12ab5b6ccd49b6ed47adbc" exitCode=0
Jul 23 00:40:01.245169 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:01.245137    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k" event={"ID":"2a7c0aee-6cce-4ea1-af20-719ab6983520","Type":"ContainerDied","Data":"6eee1dee4dc761c11ca3f3f0c27e7c3a825711f8fd12ab5b6ccd49b6ed47adbc"}
Jul 23 00:40:01.245721 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:01.245548    2549 scope.go:117] "RemoveContainer" containerID="6eee1dee4dc761c11ca3f3f0c27e7c3a825711f8fd12ab5b6ccd49b6ed47adbc"
Jul 23 00:40:01.246667 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:01.246637    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:40:01.246775 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:01.246706    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:40:01.246775 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:01.246738    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:40:02.166120 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:02.166075    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"
Jul 23 00:40:02.252985 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:02.252943    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k" event={"ID":"2a7c0aee-6cce-4ea1-af20-719ab6983520","Type":"ContainerStarted","Data":"618e021d7355c6737ccf3fad52a1f487796e976f8e6e0bf188966ca06c7729f7"}
Jul 23 00:40:02.451877 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:02.451772    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"
Jul 23 00:40:02.452988 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:02.452964    2549 patch_prober.go:28] interesting pod/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 23 00:40:02.453048 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:02.453014    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k" podUID="2a7c0aee-6cce-4ea1-af20-719ab6983520" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 23 00:40:03.452509 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:03.452471    2549 patch_prober.go:28] interesting pod/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 23 00:40:03.452893 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:03.452527    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k" podUID="2a7c0aee-6cce-4ea1-af20-719ab6983520" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 23 00:40:04.451934 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:04.451898    2549 patch_prober.go:28] interesting pod/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 23 00:40:04.452102 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:04.451957    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k" podUID="2a7c0aee-6cce-4ea1-af20-719ab6983520" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 23 00:40:05.453039 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:05.452993    2549 patch_prober.go:28] interesting pod/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 23 00:40:05.453433 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:05.453069    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k" podUID="2a7c0aee-6cce-4ea1-af20-719ab6983520" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 23 00:40:06.456302 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:06.456265    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"
Jul 23 00:40:06.456766 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:06.456583    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"
Jul 23 00:40:06.457186 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:06.457170    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"
Jul 23 00:40:10.654140 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:10.654063    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dfb539bb-65997b6cd5-xlqf2"]
Jul 23 00:40:10.654495 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:10.654325    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dfb539bb-65997b6cd5-xlqf2" podUID="daadbebf-9d48-4dd1-9a58-b2fb70bd952a" containerName="maas-api" containerID="cri-o://8fd54d2269337440c9869c3c7efff96f354347164ea2e5fc9d68ac91dccb3778" gracePeriod=30
Jul 23 00:40:10.906255 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:10.906200    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dfb539bb-65997b6cd5-xlqf2"
Jul 23 00:40:10.964012 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:10.963985    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/daadbebf-9d48-4dd1-9a58-b2fb70bd952a-openshift-service-ca\") pod \"daadbebf-9d48-4dd1-9a58-b2fb70bd952a\" (UID: \"daadbebf-9d48-4dd1-9a58-b2fb70bd952a\") "
Jul 23 00:40:10.964153 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:10.964044    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkplh\" (UniqueName: \"kubernetes.io/projected/daadbebf-9d48-4dd1-9a58-b2fb70bd952a-kube-api-access-xkplh\") pod \"daadbebf-9d48-4dd1-9a58-b2fb70bd952a\" (UID: \"daadbebf-9d48-4dd1-9a58-b2fb70bd952a\") "
Jul 23 00:40:10.964153 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:10.964087    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/daadbebf-9d48-4dd1-9a58-b2fb70bd952a-maas-api-tls\") pod \"daadbebf-9d48-4dd1-9a58-b2fb70bd952a\" (UID: \"daadbebf-9d48-4dd1-9a58-b2fb70bd952a\") "
Jul 23 00:40:10.964317 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:10.964296    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/daadbebf-9d48-4dd1-9a58-b2fb70bd952a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "daadbebf-9d48-4dd1-9a58-b2fb70bd952a" (UID: "daadbebf-9d48-4dd1-9a58-b2fb70bd952a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:40:10.964394 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:10.964380    2549 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/daadbebf-9d48-4dd1-9a58-b2fb70bd952a-openshift-service-ca\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:40:10.966177 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:10.966145    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/daadbebf-9d48-4dd1-9a58-b2fb70bd952a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "daadbebf-9d48-4dd1-9a58-b2fb70bd952a" (UID: "daadbebf-9d48-4dd1-9a58-b2fb70bd952a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 00:40:10.966272 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:10.966230    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/daadbebf-9d48-4dd1-9a58-b2fb70bd952a-kube-api-access-xkplh" (OuterVolumeSpecName: "kube-api-access-xkplh") pod "daadbebf-9d48-4dd1-9a58-b2fb70bd952a" (UID: "daadbebf-9d48-4dd1-9a58-b2fb70bd952a"). InnerVolumeSpecName "kube-api-access-xkplh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:40:11.065674 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:11.065643    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkplh\" (UniqueName: \"kubernetes.io/projected/daadbebf-9d48-4dd1-9a58-b2fb70bd952a-kube-api-access-xkplh\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:40:11.065674 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:11.065671    2549 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/daadbebf-9d48-4dd1-9a58-b2fb70bd952a-maas-api-tls\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:40:11.297880 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:11.297790    2549 generic.go:356] "Generic (PLEG): container finished" podID="daadbebf-9d48-4dd1-9a58-b2fb70bd952a" containerID="8fd54d2269337440c9869c3c7efff96f354347164ea2e5fc9d68ac91dccb3778" exitCode=0
Jul 23 00:40:11.297880 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:11.297836    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dfb539bb-65997b6cd5-xlqf2"
Jul 23 00:40:11.298063 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:11.297875    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dfb539bb-65997b6cd5-xlqf2" event={"ID":"daadbebf-9d48-4dd1-9a58-b2fb70bd952a","Type":"ContainerDied","Data":"8fd54d2269337440c9869c3c7efff96f354347164ea2e5fc9d68ac91dccb3778"}
Jul 23 00:40:11.298063 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:11.297933    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dfb539bb-65997b6cd5-xlqf2" event={"ID":"daadbebf-9d48-4dd1-9a58-b2fb70bd952a","Type":"ContainerDied","Data":"7df6eb3e9706ee20df38e9f9d5c37a36d1bc9faf4fed35450d70ddd9ec12ed0d"}
Jul 23 00:40:11.298063 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:11.297955    2549 scope.go:117] "RemoveContainer" containerID="8fd54d2269337440c9869c3c7efff96f354347164ea2e5fc9d68ac91dccb3778"
Jul 23 00:40:11.307238 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:11.307224    2549 scope.go:117] "RemoveContainer" containerID="8fd54d2269337440c9869c3c7efff96f354347164ea2e5fc9d68ac91dccb3778"
Jul 23 00:40:11.307500 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:40:11.307481    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fd54d2269337440c9869c3c7efff96f354347164ea2e5fc9d68ac91dccb3778\": container with ID starting with 8fd54d2269337440c9869c3c7efff96f354347164ea2e5fc9d68ac91dccb3778 not found: ID does not exist" containerID="8fd54d2269337440c9869c3c7efff96f354347164ea2e5fc9d68ac91dccb3778"
Jul 23 00:40:11.307568 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:11.307510    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fd54d2269337440c9869c3c7efff96f354347164ea2e5fc9d68ac91dccb3778"} err="failed to get container status \"8fd54d2269337440c9869c3c7efff96f354347164ea2e5fc9d68ac91dccb3778\": rpc error: code = NotFound desc = could not find container \"8fd54d2269337440c9869c3c7efff96f354347164ea2e5fc9d68ac91dccb3778\": container with ID starting with 8fd54d2269337440c9869c3c7efff96f354347164ea2e5fc9d68ac91dccb3778 not found: ID does not exist"
Jul 23 00:40:11.320576 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:11.320552    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dfb539bb-65997b6cd5-xlqf2"]
Jul 23 00:40:11.324489 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:11.324466    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dfb539bb-65997b6cd5-xlqf2"]
Jul 23 00:40:11.802187 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:11.802151    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="daadbebf-9d48-4dd1-9a58-b2fb70bd952a" path="/var/lib/kubelet/pods/daadbebf-9d48-4dd1-9a58-b2fb70bd952a/volumes"
Jul 23 00:40:21.818903 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:21.818867    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"]
Jul 23 00:40:21.819347 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:21.819070    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k" podUID="2a7c0aee-6cce-4ea1-af20-719ab6983520" containerName="istio-proxy" containerID="cri-o://618e021d7355c6737ccf3fad52a1f487796e976f8e6e0bf188966ca06c7729f7" gracePeriod=30
Jul 23 00:40:27.065847 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:27.065821    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"
Jul 23 00:40:27.212095 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:27.212001    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0aee-6cce-4ea1-af20-719ab6983520-istio-data\") pod \"2a7c0aee-6cce-4ea1-af20-719ab6983520\" (UID: \"2a7c0aee-6cce-4ea1-af20-719ab6983520\") "
Jul 23 00:40:27.212095 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:27.212044    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a7c0aee-6cce-4ea1-af20-719ab6983520-istio-podinfo\") pod \"2a7c0aee-6cce-4ea1-af20-719ab6983520\" (UID: \"2a7c0aee-6cce-4ea1-af20-719ab6983520\") "
Jul 23 00:40:27.212095 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:27.212068    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a7c0aee-6cce-4ea1-af20-719ab6983520-istio-token\") pod \"2a7c0aee-6cce-4ea1-af20-719ab6983520\" (UID: \"2a7c0aee-6cce-4ea1-af20-719ab6983520\") "
Jul 23 00:40:27.212383 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:27.212109    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a7c0aee-6cce-4ea1-af20-719ab6983520-istiod-ca-cert\") pod \"2a7c0aee-6cce-4ea1-af20-719ab6983520\" (UID: \"2a7c0aee-6cce-4ea1-af20-719ab6983520\") "
Jul 23 00:40:27.212383 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:27.212138    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0aee-6cce-4ea1-af20-719ab6983520-workload-socket\") pod \"2a7c0aee-6cce-4ea1-af20-719ab6983520\" (UID: \"2a7c0aee-6cce-4ea1-af20-719ab6983520\") "
Jul 23 00:40:27.212383 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:27.212166    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0aee-6cce-4ea1-af20-719ab6983520-workload-certs\") pod \"2a7c0aee-6cce-4ea1-af20-719ab6983520\" (UID: \"2a7c0aee-6cce-4ea1-af20-719ab6983520\") "
Jul 23 00:40:27.212383 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:27.212194    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tm2tt\" (UniqueName: \"kubernetes.io/projected/2a7c0aee-6cce-4ea1-af20-719ab6983520-kube-api-access-tm2tt\") pod \"2a7c0aee-6cce-4ea1-af20-719ab6983520\" (UID: \"2a7c0aee-6cce-4ea1-af20-719ab6983520\") "
Jul 23 00:40:27.212383 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:27.212251    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0aee-6cce-4ea1-af20-719ab6983520-istio-envoy\") pod \"2a7c0aee-6cce-4ea1-af20-719ab6983520\" (UID: \"2a7c0aee-6cce-4ea1-af20-719ab6983520\") "
Jul 23 00:40:27.212383 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:27.212323    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0aee-6cce-4ea1-af20-719ab6983520-credential-socket\") pod \"2a7c0aee-6cce-4ea1-af20-719ab6983520\" (UID: \"2a7c0aee-6cce-4ea1-af20-719ab6983520\") "
Jul 23 00:40:27.212721 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:27.212524    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a7c0aee-6cce-4ea1-af20-719ab6983520-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2a7c0aee-6cce-4ea1-af20-719ab6983520" (UID: "2a7c0aee-6cce-4ea1-af20-719ab6983520"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:40:27.212721 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:27.212559    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a7c0aee-6cce-4ea1-af20-719ab6983520-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2a7c0aee-6cce-4ea1-af20-719ab6983520" (UID: "2a7c0aee-6cce-4ea1-af20-719ab6983520"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:40:27.212721 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:27.212680    2549 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0aee-6cce-4ea1-af20-719ab6983520-workload-socket\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:40:27.212721 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:27.212700    2549 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0aee-6cce-4ea1-af20-719ab6983520-workload-certs\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:40:27.212926 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:27.212749    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a7c0aee-6cce-4ea1-af20-719ab6983520-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2a7c0aee-6cce-4ea1-af20-719ab6983520" (UID: "2a7c0aee-6cce-4ea1-af20-719ab6983520"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:40:27.212926 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:27.212900    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a7c0aee-6cce-4ea1-af20-719ab6983520-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2a7c0aee-6cce-4ea1-af20-719ab6983520" (UID: "2a7c0aee-6cce-4ea1-af20-719ab6983520"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:40:27.213159 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:27.213132    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a7c0aee-6cce-4ea1-af20-719ab6983520-istio-data" (OuterVolumeSpecName: "istio-data") pod "2a7c0aee-6cce-4ea1-af20-719ab6983520" (UID: "2a7c0aee-6cce-4ea1-af20-719ab6983520"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:40:27.214516 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:27.214489    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2a7c0aee-6cce-4ea1-af20-719ab6983520-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2a7c0aee-6cce-4ea1-af20-719ab6983520" (UID: "2a7c0aee-6cce-4ea1-af20-719ab6983520"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 00:40:27.214516 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:27.214493    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a7c0aee-6cce-4ea1-af20-719ab6983520-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2a7c0aee-6cce-4ea1-af20-719ab6983520" (UID: "2a7c0aee-6cce-4ea1-af20-719ab6983520"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:40:27.214844 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:27.214825    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a7c0aee-6cce-4ea1-af20-719ab6983520-istio-token" (OuterVolumeSpecName: "istio-token") pod "2a7c0aee-6cce-4ea1-af20-719ab6983520" (UID: "2a7c0aee-6cce-4ea1-af20-719ab6983520"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:40:27.214899 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:27.214839    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a7c0aee-6cce-4ea1-af20-719ab6983520-kube-api-access-tm2tt" (OuterVolumeSpecName: "kube-api-access-tm2tt") pod "2a7c0aee-6cce-4ea1-af20-719ab6983520" (UID: "2a7c0aee-6cce-4ea1-af20-719ab6983520"). InnerVolumeSpecName "kube-api-access-tm2tt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:40:27.313702 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:27.313664    2549 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0aee-6cce-4ea1-af20-719ab6983520-istio-data\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:40:27.313702 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:27.313696    2549 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a7c0aee-6cce-4ea1-af20-719ab6983520-istio-podinfo\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:40:27.313702 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:27.313707    2549 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a7c0aee-6cce-4ea1-af20-719ab6983520-istio-token\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:40:27.313942 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:27.313715    2549 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a7c0aee-6cce-4ea1-af20-719ab6983520-istiod-ca-cert\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:40:27.313942 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:27.313724    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tm2tt\" (UniqueName: \"kubernetes.io/projected/2a7c0aee-6cce-4ea1-af20-719ab6983520-kube-api-access-tm2tt\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:40:27.313942 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:27.313733    2549 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0aee-6cce-4ea1-af20-719ab6983520-istio-envoy\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:40:27.313942 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:27.313742    2549 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a7c0aee-6cce-4ea1-af20-719ab6983520-credential-socket\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:40:27.375873 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:27.375833    2549 generic.go:356] "Generic (PLEG): container finished" podID="2a7c0aee-6cce-4ea1-af20-719ab6983520" containerID="618e021d7355c6737ccf3fad52a1f487796e976f8e6e0bf188966ca06c7729f7" exitCode=0
Jul 23 00:40:27.376071 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:27.375888    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"
Jul 23 00:40:27.376071 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:27.375922    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k" event={"ID":"2a7c0aee-6cce-4ea1-af20-719ab6983520","Type":"ContainerDied","Data":"618e021d7355c6737ccf3fad52a1f487796e976f8e6e0bf188966ca06c7729f7"}
Jul 23 00:40:27.376071 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:27.375992    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k" event={"ID":"2a7c0aee-6cce-4ea1-af20-719ab6983520","Type":"ContainerDied","Data":"6009ca239258b94a4c46ec806c51445c211415f0d61276cd42c3aad1d2ac1420"}
Jul 23 00:40:27.376071 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:27.376023    2549 scope.go:117] "RemoveContainer" containerID="618e021d7355c6737ccf3fad52a1f487796e976f8e6e0bf188966ca06c7729f7"
Jul 23 00:40:27.385799 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:27.385782    2549 scope.go:117] "RemoveContainer" containerID="6eee1dee4dc761c11ca3f3f0c27e7c3a825711f8fd12ab5b6ccd49b6ed47adbc"
Jul 23 00:40:27.393989 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:27.393969    2549 scope.go:117] "RemoveContainer" containerID="618e021d7355c6737ccf3fad52a1f487796e976f8e6e0bf188966ca06c7729f7"
Jul 23 00:40:27.394281 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:40:27.394256    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"618e021d7355c6737ccf3fad52a1f487796e976f8e6e0bf188966ca06c7729f7\": container with ID starting with 618e021d7355c6737ccf3fad52a1f487796e976f8e6e0bf188966ca06c7729f7 not found: ID does not exist" containerID="618e021d7355c6737ccf3fad52a1f487796e976f8e6e0bf188966ca06c7729f7"
Jul 23 00:40:27.394367 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:27.394287    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"618e021d7355c6737ccf3fad52a1f487796e976f8e6e0bf188966ca06c7729f7"} err="failed to get container status \"618e021d7355c6737ccf3fad52a1f487796e976f8e6e0bf188966ca06c7729f7\": rpc error: code = NotFound desc = could not find container \"618e021d7355c6737ccf3fad52a1f487796e976f8e6e0bf188966ca06c7729f7\": container with ID starting with 618e021d7355c6737ccf3fad52a1f487796e976f8e6e0bf188966ca06c7729f7 not found: ID does not exist"
Jul 23 00:40:27.394367 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:27.394305    2549 scope.go:117] "RemoveContainer" containerID="6eee1dee4dc761c11ca3f3f0c27e7c3a825711f8fd12ab5b6ccd49b6ed47adbc"
Jul 23 00:40:27.394589 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:40:27.394570    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6eee1dee4dc761c11ca3f3f0c27e7c3a825711f8fd12ab5b6ccd49b6ed47adbc\": container with ID starting with 6eee1dee4dc761c11ca3f3f0c27e7c3a825711f8fd12ab5b6ccd49b6ed47adbc not found: ID does not exist" containerID="6eee1dee4dc761c11ca3f3f0c27e7c3a825711f8fd12ab5b6ccd49b6ed47adbc"
Jul 23 00:40:27.394639 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:27.394597    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6eee1dee4dc761c11ca3f3f0c27e7c3a825711f8fd12ab5b6ccd49b6ed47adbc"} err="failed to get container status \"6eee1dee4dc761c11ca3f3f0c27e7c3a825711f8fd12ab5b6ccd49b6ed47adbc\": rpc error: code = NotFound desc = could not find container \"6eee1dee4dc761c11ca3f3f0c27e7c3a825711f8fd12ab5b6ccd49b6ed47adbc\": container with ID starting with 6eee1dee4dc761c11ca3f3f0c27e7c3a825711f8fd12ab5b6ccd49b6ed47adbc not found: ID does not exist"
Jul 23 00:40:27.398375 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:27.398356    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"]
Jul 23 00:40:27.402579 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:27.402560    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-dfb539bb-openshift-default-c6d67fc79-8fr7k"]
Jul 23 00:40:27.807978 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:27.807943    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a7c0aee-6cce-4ea1-af20-719ab6983520" path="/var/lib/kubelet/pods/2a7c0aee-6cce-4ea1-af20-719ab6983520/volumes"
Jul 23 00:40:41.967043 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:41.967006    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"]
Jul 23 00:40:41.968326 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:41.968297    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a7c0aee-6cce-4ea1-af20-719ab6983520" containerName="istio-proxy"
Jul 23 00:40:41.968506 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:41.968493    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a7c0aee-6cce-4ea1-af20-719ab6983520" containerName="istio-proxy"
Jul 23 00:40:41.968615 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:41.968605    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a7c0aee-6cce-4ea1-af20-719ab6983520" containerName="istio-proxy"
Jul 23 00:40:41.968700 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:41.968691    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a7c0aee-6cce-4ea1-af20-719ab6983520" containerName="istio-proxy"
Jul 23 00:40:41.968777 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:41.968768    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daadbebf-9d48-4dd1-9a58-b2fb70bd952a" containerName="maas-api"
Jul 23 00:40:41.968842 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:41.968834    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="daadbebf-9d48-4dd1-9a58-b2fb70bd952a" containerName="maas-api"
Jul 23 00:40:41.969117 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:41.969103    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a7c0aee-6cce-4ea1-af20-719ab6983520" containerName="istio-proxy"
Jul 23 00:40:41.969226 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:41.969215    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a7c0aee-6cce-4ea1-af20-719ab6983520" containerName="istio-proxy"
Jul 23 00:40:41.969321 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:41.969311    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="daadbebf-9d48-4dd1-9a58-b2fb70bd952a" containerName="maas-api"
Jul 23 00:40:41.973340 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:41.973305    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"
Jul 23 00:40:41.976153 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:41.976131    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-244e255b-openshift-default-dockercfg-ffzch\""
Jul 23 00:40:41.982270 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:41.982248    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"]
Jul 23 00:40:42.040198 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:42.040167    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0723fd9f-6bd9-420f-912a-562d4c1a91df-workload-socket\") pod \"e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2\" (UID: \"0723fd9f-6bd9-420f-912a-562d4c1a91df\") " pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"
Jul 23 00:40:42.040198 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:42.040207    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0723fd9f-6bd9-420f-912a-562d4c1a91df-workload-certs\") pod \"e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2\" (UID: \"0723fd9f-6bd9-420f-912a-562d4c1a91df\") " pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"
Jul 23 00:40:42.040390 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:42.040244    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0723fd9f-6bd9-420f-912a-562d4c1a91df-istio-envoy\") pod \"e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2\" (UID: \"0723fd9f-6bd9-420f-912a-562d4c1a91df\") " pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"
Jul 23 00:40:42.040390 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:42.040278    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0723fd9f-6bd9-420f-912a-562d4c1a91df-credential-socket\") pod \"e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2\" (UID: \"0723fd9f-6bd9-420f-912a-562d4c1a91df\") " pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"
Jul 23 00:40:42.040390 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:42.040296    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0723fd9f-6bd9-420f-912a-562d4c1a91df-istio-data\") pod \"e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2\" (UID: \"0723fd9f-6bd9-420f-912a-562d4c1a91df\") " pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"
Jul 23 00:40:42.040390 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:42.040310    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n4j7\" (UniqueName: \"kubernetes.io/projected/0723fd9f-6bd9-420f-912a-562d4c1a91df-kube-api-access-4n4j7\") pod \"e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2\" (UID: \"0723fd9f-6bd9-420f-912a-562d4c1a91df\") " pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"
Jul 23 00:40:42.040390 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:42.040366    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0723fd9f-6bd9-420f-912a-562d4c1a91df-istiod-ca-cert\") pod \"e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2\" (UID: \"0723fd9f-6bd9-420f-912a-562d4c1a91df\") " pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"
Jul 23 00:40:42.040571 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:42.040392    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0723fd9f-6bd9-420f-912a-562d4c1a91df-istio-podinfo\") pod \"e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2\" (UID: \"0723fd9f-6bd9-420f-912a-562d4c1a91df\") " pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"
Jul 23 00:40:42.040571 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:42.040443    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0723fd9f-6bd9-420f-912a-562d4c1a91df-istio-token\") pod \"e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2\" (UID: \"0723fd9f-6bd9-420f-912a-562d4c1a91df\") " pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"
Jul 23 00:40:42.140989 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:42.140953    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0723fd9f-6bd9-420f-912a-562d4c1a91df-istio-token\") pod \"e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2\" (UID: \"0723fd9f-6bd9-420f-912a-562d4c1a91df\") " pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"
Jul 23 00:40:42.141155 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:42.141006    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0723fd9f-6bd9-420f-912a-562d4c1a91df-workload-socket\") pod \"e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2\" (UID: \"0723fd9f-6bd9-420f-912a-562d4c1a91df\") " pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"
Jul 23 00:40:42.141155 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:42.141028    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0723fd9f-6bd9-420f-912a-562d4c1a91df-workload-certs\") pod \"e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2\" (UID: \"0723fd9f-6bd9-420f-912a-562d4c1a91df\") " pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"
Jul 23 00:40:42.141155 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:42.141057    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0723fd9f-6bd9-420f-912a-562d4c1a91df-istio-envoy\") pod \"e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2\" (UID: \"0723fd9f-6bd9-420f-912a-562d4c1a91df\") " pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"
Jul 23 00:40:42.141155 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:42.141080    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0723fd9f-6bd9-420f-912a-562d4c1a91df-credential-socket\") pod \"e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2\" (UID: \"0723fd9f-6bd9-420f-912a-562d4c1a91df\") " pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"
Jul 23 00:40:42.141155 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:42.141096    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0723fd9f-6bd9-420f-912a-562d4c1a91df-istio-data\") pod \"e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2\" (UID: \"0723fd9f-6bd9-420f-912a-562d4c1a91df\") " pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"
Jul 23 00:40:42.141155 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:42.141112    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n4j7\" (UniqueName: \"kubernetes.io/projected/0723fd9f-6bd9-420f-912a-562d4c1a91df-kube-api-access-4n4j7\") pod \"e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2\" (UID: \"0723fd9f-6bd9-420f-912a-562d4c1a91df\") " pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"
Jul 23 00:40:42.141155 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:42.141140    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0723fd9f-6bd9-420f-912a-562d4c1a91df-istiod-ca-cert\") pod \"e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2\" (UID: \"0723fd9f-6bd9-420f-912a-562d4c1a91df\") " pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"
Jul 23 00:40:42.141572 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:42.141170    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0723fd9f-6bd9-420f-912a-562d4c1a91df-istio-podinfo\") pod \"e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2\" (UID: \"0723fd9f-6bd9-420f-912a-562d4c1a91df\") " pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"
Jul 23 00:40:42.141572 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:42.141531    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0723fd9f-6bd9-420f-912a-562d4c1a91df-workload-socket\") pod \"e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2\" (UID: \"0723fd9f-6bd9-420f-912a-562d4c1a91df\") " pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"
Jul 23 00:40:42.141651 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:42.141577    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0723fd9f-6bd9-420f-912a-562d4c1a91df-credential-socket\") pod \"e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2\" (UID: \"0723fd9f-6bd9-420f-912a-562d4c1a91df\") " pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"
Jul 23 00:40:42.141651 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:42.141606    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0723fd9f-6bd9-420f-912a-562d4c1a91df-istio-data\") pod \"e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2\" (UID: \"0723fd9f-6bd9-420f-912a-562d4c1a91df\") " pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"
Jul 23 00:40:42.141776 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:42.141758    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0723fd9f-6bd9-420f-912a-562d4c1a91df-workload-certs\") pod \"e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2\" (UID: \"0723fd9f-6bd9-420f-912a-562d4c1a91df\") " pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"
Jul 23 00:40:42.141932 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:42.141913    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0723fd9f-6bd9-420f-912a-562d4c1a91df-istiod-ca-cert\") pod \"e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2\" (UID: \"0723fd9f-6bd9-420f-912a-562d4c1a91df\") " pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"
Jul 23 00:40:42.143933 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:42.143910    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0723fd9f-6bd9-420f-912a-562d4c1a91df-istio-envoy\") pod \"e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2\" (UID: \"0723fd9f-6bd9-420f-912a-562d4c1a91df\") " pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"
Jul 23 00:40:42.144174 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:42.144155    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0723fd9f-6bd9-420f-912a-562d4c1a91df-istio-podinfo\") pod \"e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2\" (UID: \"0723fd9f-6bd9-420f-912a-562d4c1a91df\") " pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"
Jul 23 00:40:42.148986 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:42.148961    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0723fd9f-6bd9-420f-912a-562d4c1a91df-istio-token\") pod \"e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2\" (UID: \"0723fd9f-6bd9-420f-912a-562d4c1a91df\") " pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"
Jul 23 00:40:42.149261 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:42.149244    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n4j7\" (UniqueName: \"kubernetes.io/projected/0723fd9f-6bd9-420f-912a-562d4c1a91df-kube-api-access-4n4j7\") pod \"e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2\" (UID: \"0723fd9f-6bd9-420f-912a-562d4c1a91df\") " pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"
Jul 23 00:40:42.285206 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:42.285142    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"
Jul 23 00:40:42.421014 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:42.420989    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"]
Jul 23 00:40:42.422530 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:40:42.422506    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0723fd9f_6bd9_420f_912a_562d4c1a91df.slice/crio-fc9d814ca1f9cdd2cdd51699dd6dde294e0b1000f837471440f77a918e5c9730 WatchSource:0}: Error finding container fc9d814ca1f9cdd2cdd51699dd6dde294e0b1000f837471440f77a918e5c9730: Status 404 returned error can't find the container with id fc9d814ca1f9cdd2cdd51699dd6dde294e0b1000f837471440f77a918e5c9730
Jul 23 00:40:42.424615 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:42.424585    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:40:42.424714 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:42.424659    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:40:42.424714 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:42.424703    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:40:42.445245 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:42.445223    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2" event={"ID":"0723fd9f-6bd9-420f-912a-562d4c1a91df","Type":"ContainerStarted","Data":"fc9d814ca1f9cdd2cdd51699dd6dde294e0b1000f837471440f77a918e5c9730"}
Jul 23 00:40:43.451655 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:43.451620    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2" event={"ID":"0723fd9f-6bd9-420f-912a-562d4c1a91df","Type":"ContainerStarted","Data":"50f15180c32dbec0d758fb7ccb921bb67075496cc2a7978157337b861a589a52"}
Jul 23 00:40:43.473390 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:43.473329    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2" podStartSLOduration=2.473310796 podStartE2EDuration="2.473310796s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:40:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:40:43.472369833 +0000 UTC m=+2186.233568159" watchObservedRunningTime="2026-07-23 00:40:43.473310796 +0000 UTC m=+2186.234509108"
Jul 23 00:40:44.285671 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:44.285632    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"
Jul 23 00:40:44.290751 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:44.290726    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"
Jul 23 00:40:44.456629 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:44.456596    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"
Jul 23 00:40:44.457656 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:44.457633    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"
Jul 23 00:40:45.657298 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:45.657263    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-244e255b-cbffd5745-dbp96"]
Jul 23 00:40:45.659873 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:45.659849    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-244e255b-cbffd5745-dbp96"
Jul 23 00:40:45.662356 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:45.662336    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-244e255b-serving-cert\""
Jul 23 00:40:45.672099 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:45.672074    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-244e255b-cbffd5745-dbp96"]
Jul 23 00:40:45.674021 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:45.673998    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25w9g\" (UniqueName: \"kubernetes.io/projected/79f496fb-0756-4b3d-bac6-d205cd6403cc-kube-api-access-25w9g\") pod \"maas-api-e2e-mt-244e255b-cbffd5745-dbp96\" (UID: \"79f496fb-0756-4b3d-bac6-d205cd6403cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-244e255b-cbffd5745-dbp96"
Jul 23 00:40:45.674125 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:45.674086    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79f496fb-0756-4b3d-bac6-d205cd6403cc-openshift-service-ca\") pod \"maas-api-e2e-mt-244e255b-cbffd5745-dbp96\" (UID: \"79f496fb-0756-4b3d-bac6-d205cd6403cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-244e255b-cbffd5745-dbp96"
Jul 23 00:40:45.674193 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:45.674122    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79f496fb-0756-4b3d-bac6-d205cd6403cc-maas-api-tls\") pod \"maas-api-e2e-mt-244e255b-cbffd5745-dbp96\" (UID: \"79f496fb-0756-4b3d-bac6-d205cd6403cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-244e255b-cbffd5745-dbp96"
Jul 23 00:40:45.775073 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:45.775036    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79f496fb-0756-4b3d-bac6-d205cd6403cc-openshift-service-ca\") pod \"maas-api-e2e-mt-244e255b-cbffd5745-dbp96\" (UID: \"79f496fb-0756-4b3d-bac6-d205cd6403cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-244e255b-cbffd5745-dbp96"
Jul 23 00:40:45.775073 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:45.775078    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79f496fb-0756-4b3d-bac6-d205cd6403cc-maas-api-tls\") pod \"maas-api-e2e-mt-244e255b-cbffd5745-dbp96\" (UID: \"79f496fb-0756-4b3d-bac6-d205cd6403cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-244e255b-cbffd5745-dbp96"
Jul 23 00:40:45.775307 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:45.775136    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25w9g\" (UniqueName: \"kubernetes.io/projected/79f496fb-0756-4b3d-bac6-d205cd6403cc-kube-api-access-25w9g\") pod \"maas-api-e2e-mt-244e255b-cbffd5745-dbp96\" (UID: \"79f496fb-0756-4b3d-bac6-d205cd6403cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-244e255b-cbffd5745-dbp96"
Jul 23 00:40:45.775307 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:40:45.775274    2549 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-244e255b-serving-cert: secret "maas-api-e2e-mt-244e255b-serving-cert" not found
Jul 23 00:40:45.775415 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:40:45.775351    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79f496fb-0756-4b3d-bac6-d205cd6403cc-maas-api-tls podName:79f496fb-0756-4b3d-bac6-d205cd6403cc nodeName:}" failed. No retries permitted until 2026-07-23 00:40:46.275328818 +0000 UTC m=+2189.036527123 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/79f496fb-0756-4b3d-bac6-d205cd6403cc-maas-api-tls") pod "maas-api-e2e-mt-244e255b-cbffd5745-dbp96" (UID: "79f496fb-0756-4b3d-bac6-d205cd6403cc") : secret "maas-api-e2e-mt-244e255b-serving-cert" not found
Jul 23 00:40:45.775770 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:45.775748    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79f496fb-0756-4b3d-bac6-d205cd6403cc-openshift-service-ca\") pod \"maas-api-e2e-mt-244e255b-cbffd5745-dbp96\" (UID: \"79f496fb-0756-4b3d-bac6-d205cd6403cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-244e255b-cbffd5745-dbp96"
Jul 23 00:40:45.788127 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:45.788102    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25w9g\" (UniqueName: \"kubernetes.io/projected/79f496fb-0756-4b3d-bac6-d205cd6403cc-kube-api-access-25w9g\") pod \"maas-api-e2e-mt-244e255b-cbffd5745-dbp96\" (UID: \"79f496fb-0756-4b3d-bac6-d205cd6403cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-244e255b-cbffd5745-dbp96"
Jul 23 00:40:46.279440 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:46.279403    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79f496fb-0756-4b3d-bac6-d205cd6403cc-maas-api-tls\") pod \"maas-api-e2e-mt-244e255b-cbffd5745-dbp96\" (UID: \"79f496fb-0756-4b3d-bac6-d205cd6403cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-244e255b-cbffd5745-dbp96"
Jul 23 00:40:46.281824 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:46.281804    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79f496fb-0756-4b3d-bac6-d205cd6403cc-maas-api-tls\") pod \"maas-api-e2e-mt-244e255b-cbffd5745-dbp96\" (UID: \"79f496fb-0756-4b3d-bac6-d205cd6403cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-244e255b-cbffd5745-dbp96"
Jul 23 00:40:46.571131 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:46.571102    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-244e255b-cbffd5745-dbp96"
Jul 23 00:40:46.704807 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:46.704766    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-244e255b-cbffd5745-dbp96"]
Jul 23 00:40:46.708439 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:40:46.708414    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79f496fb_0756_4b3d_bac6_d205cd6403cc.slice/crio-bc88c87de975abd78fbfb68fb71cfd2a7c39a805d70e9a87260acd89b3628c30 WatchSource:0}: Error finding container bc88c87de975abd78fbfb68fb71cfd2a7c39a805d70e9a87260acd89b3628c30: Status 404 returned error can't find the container with id bc88c87de975abd78fbfb68fb71cfd2a7c39a805d70e9a87260acd89b3628c30
Jul 23 00:40:46.709880 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:46.709862    2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 00:40:47.471734 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:47.471697    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-244e255b-cbffd5745-dbp96" event={"ID":"79f496fb-0756-4b3d-bac6-d205cd6403cc","Type":"ContainerStarted","Data":"07172f0a6286db0e78daddebf9ae34a72c876d7e7de79613ee6505053eef00db"}
Jul 23 00:40:47.471903 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:47.471750    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-244e255b-cbffd5745-dbp96" event={"ID":"79f496fb-0756-4b3d-bac6-d205cd6403cc","Type":"ContainerStarted","Data":"bc88c87de975abd78fbfb68fb71cfd2a7c39a805d70e9a87260acd89b3628c30"}
Jul 23 00:40:47.471903 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:47.471805    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-244e255b-cbffd5745-dbp96"
Jul 23 00:40:47.490710 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:47.490660    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-244e255b-cbffd5745-dbp96" podStartSLOduration=2.158035311 podStartE2EDuration="2.490647902s" totalImagesPullingTime="332.612591ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:40:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:40:47.489296176 +0000 UTC m=+2190.250494532" watchObservedRunningTime="2026-07-23 00:40:47.490647902 +0000 UTC m=+2190.251846211"
Jul 23 00:40:53.482829 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:53.482799    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-244e255b-cbffd5745-dbp96"
Jul 23 00:40:59.758791 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:59.757935    2549 patch_prober.go:28] interesting pod/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": read tcp 10.133.0.2:54940->10.133.0.46:15021: read: connection reset by peer" start-of-body=
Jul 23 00:40:59.758791 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:40:59.758007    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2" podUID="0723fd9f-6bd9-420f-912a-562d4c1a91df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": read tcp 10.133.0.2:54940->10.133.0.46:15021: read: connection reset by peer"
Jul 23 00:41:00.547614 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:00.547577    2549 generic.go:356] "Generic (PLEG): container finished" podID="0723fd9f-6bd9-420f-912a-562d4c1a91df" containerID="50f15180c32dbec0d758fb7ccb921bb67075496cc2a7978157337b861a589a52" exitCode=0
Jul 23 00:41:00.547797 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:00.547651    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2" event={"ID":"0723fd9f-6bd9-420f-912a-562d4c1a91df","Type":"ContainerDied","Data":"50f15180c32dbec0d758fb7ccb921bb67075496cc2a7978157337b861a589a52"}
Jul 23 00:41:00.548114 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:00.548094    2549 scope.go:117] "RemoveContainer" containerID="50f15180c32dbec0d758fb7ccb921bb67075496cc2a7978157337b861a589a52"
Jul 23 00:41:00.549087 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:00.549061    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:41:00.549143 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:00.549131    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:41:00.549183 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:00.549165    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:41:01.554820 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:01.554786    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2" event={"ID":"0723fd9f-6bd9-420f-912a-562d4c1a91df","Type":"ContainerStarted","Data":"0fc81efffbb67dcbfa056d4a913e4ea715e29f508bff8d09ee65b27f6868d454"}
Jul 23 00:41:02.286041 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:02.285998    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"
Jul 23 00:41:02.286248 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:02.286223    2549 patch_prober.go:28] interesting pod/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 23 00:41:02.286297 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:02.286279    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2" podUID="0723fd9f-6bd9-420f-912a-562d4c1a91df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 23 00:41:03.286051 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:03.286017    2549 patch_prober.go:28] interesting pod/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 23 00:41:03.286425 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:03.286072    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2" podUID="0723fd9f-6bd9-420f-912a-562d4c1a91df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 23 00:41:04.286188 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:04.286149    2549 patch_prober.go:28] interesting pod/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 23 00:41:04.286698 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:04.286213    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2" podUID="0723fd9f-6bd9-420f-912a-562d4c1a91df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 23 00:41:05.286090 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:05.286052    2549 patch_prober.go:28] interesting pod/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 23 00:41:05.286275 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:05.286102    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2" podUID="0723fd9f-6bd9-420f-912a-562d4c1a91df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 23 00:41:06.289547 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:06.289515    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"
Jul 23 00:41:06.289944 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:06.289808    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"
Jul 23 00:41:06.290592 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:06.290571    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"
Jul 23 00:41:33.828601 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:33.828568    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-244e255b-bcq6f"]
Jul 23 00:41:33.832075 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:33.832057    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-244e255b-bcq6f"
Jul 23 00:41:33.836772 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:33.836752    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5dc6x\""
Jul 23 00:41:33.853229 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:33.853208    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-244e255b-bcq6f"]
Jul 23 00:41:33.990126 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:33.990085    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05bc5352-7320-445d-ab07-377886e62f05-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-244e255b-bcq6f\" (UID: \"05bc5352-7320-445d-ab07-377886e62f05\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-244e255b-bcq6f"
Jul 23 00:41:34.090916 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:34.090839    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05bc5352-7320-445d-ab07-377886e62f05-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-244e255b-bcq6f\" (UID: \"05bc5352-7320-445d-ab07-377886e62f05\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-244e255b-bcq6f"
Jul 23 00:41:34.091422 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:34.091402    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05bc5352-7320-445d-ab07-377886e62f05-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-244e255b-bcq6f\" (UID: \"05bc5352-7320-445d-ab07-377886e62f05\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-244e255b-bcq6f"
Jul 23 00:41:34.141510 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:34.141483    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-244e255b-bcq6f"
Jul 23 00:41:34.277621 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:34.277596    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-244e255b-bcq6f"]
Jul 23 00:41:34.279853 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:41:34.279822    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05bc5352_7320_445d_ab07_377886e62f05.slice/crio-90231b6a342fe401e284778aae555b213405e279adf59ba5cc81323b93985ba2 WatchSource:0}: Error finding container 90231b6a342fe401e284778aae555b213405e279adf59ba5cc81323b93985ba2: Status 404 returned error can't find the container with id 90231b6a342fe401e284778aae555b213405e279adf59ba5cc81323b93985ba2
Jul 23 00:41:34.711303 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:34.711264    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-244e255b-bcq6f" event={"ID":"05bc5352-7320-445d-ab07-377886e62f05","Type":"ContainerStarted","Data":"90231b6a342fe401e284778aae555b213405e279adf59ba5cc81323b93985ba2"}
Jul 23 00:41:36.723443 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:36.723413    2549 generic.go:356] "Generic (PLEG): container finished" podID="05bc5352-7320-445d-ab07-377886e62f05" containerID="b2543a5153f28c15cad8128ce195cb3de30f3b28fe76feff1ac76c426c11af5a" exitCode=0
Jul 23 00:41:36.723778 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:36.723473    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-244e255b-bcq6f" event={"ID":"05bc5352-7320-445d-ab07-377886e62f05","Type":"ContainerDied","Data":"b2543a5153f28c15cad8128ce195cb3de30f3b28fe76feff1ac76c426c11af5a"}
Jul 23 00:41:37.866909 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:37.866878    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-244e255b-bcq6f"
Jul 23 00:41:38.028017 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:38.027887    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05bc5352-7320-445d-ab07-377886e62f05-maas-api-service-ca\") pod \"05bc5352-7320-445d-ab07-377886e62f05\" (UID: \"05bc5352-7320-445d-ab07-377886e62f05\") "
Jul 23 00:41:38.028172 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:38.028152    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05bc5352-7320-445d-ab07-377886e62f05-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "05bc5352-7320-445d-ab07-377886e62f05" (UID: "05bc5352-7320-445d-ab07-377886e62f05"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:41:38.128948 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:38.128925    2549 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05bc5352-7320-445d-ab07-377886e62f05-maas-api-service-ca\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:41:38.734134 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:38.734096    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-244e255b-bcq6f" event={"ID":"05bc5352-7320-445d-ab07-377886e62f05","Type":"ContainerDied","Data":"90231b6a342fe401e284778aae555b213405e279adf59ba5cc81323b93985ba2"}
Jul 23 00:41:38.734300 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:38.734153    2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="90231b6a342fe401e284778aae555b213405e279adf59ba5cc81323b93985ba2"
Jul 23 00:41:38.734300 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:38.734115    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-244e255b-bcq6f"
Jul 23 00:41:49.349960 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:49.349924    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-244e255b-cbffd5745-dbp96"]
Jul 23 00:41:49.350566 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:49.350177    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-244e255b-cbffd5745-dbp96" podUID="79f496fb-0756-4b3d-bac6-d205cd6403cc" containerName="maas-api" containerID="cri-o://07172f0a6286db0e78daddebf9ae34a72c876d7e7de79613ee6505053eef00db" gracePeriod=30
Jul 23 00:41:49.608971 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:49.608913    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-244e255b-cbffd5745-dbp96"
Jul 23 00:41:49.618847 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:49.618826    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-25w9g\" (UniqueName: \"kubernetes.io/projected/79f496fb-0756-4b3d-bac6-d205cd6403cc-kube-api-access-25w9g\") pod \"79f496fb-0756-4b3d-bac6-d205cd6403cc\" (UID: \"79f496fb-0756-4b3d-bac6-d205cd6403cc\") "
Jul 23 00:41:49.618965 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:49.618910    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79f496fb-0756-4b3d-bac6-d205cd6403cc-openshift-service-ca\") pod \"79f496fb-0756-4b3d-bac6-d205cd6403cc\" (UID: \"79f496fb-0756-4b3d-bac6-d205cd6403cc\") "
Jul 23 00:41:49.618965 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:49.618938    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79f496fb-0756-4b3d-bac6-d205cd6403cc-maas-api-tls\") pod \"79f496fb-0756-4b3d-bac6-d205cd6403cc\" (UID: \"79f496fb-0756-4b3d-bac6-d205cd6403cc\") "
Jul 23 00:41:49.619277 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:49.619253    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79f496fb-0756-4b3d-bac6-d205cd6403cc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "79f496fb-0756-4b3d-bac6-d205cd6403cc" (UID: "79f496fb-0756-4b3d-bac6-d205cd6403cc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:41:49.620879 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:49.620860    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79f496fb-0756-4b3d-bac6-d205cd6403cc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "79f496fb-0756-4b3d-bac6-d205cd6403cc" (UID: "79f496fb-0756-4b3d-bac6-d205cd6403cc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 00:41:49.620978 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:49.620965    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79f496fb-0756-4b3d-bac6-d205cd6403cc-kube-api-access-25w9g" (OuterVolumeSpecName: "kube-api-access-25w9g") pod "79f496fb-0756-4b3d-bac6-d205cd6403cc" (UID: "79f496fb-0756-4b3d-bac6-d205cd6403cc"). InnerVolumeSpecName "kube-api-access-25w9g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:41:49.719989 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:49.719961    2549 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79f496fb-0756-4b3d-bac6-d205cd6403cc-openshift-service-ca\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:41:49.719989 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:49.719987    2549 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79f496fb-0756-4b3d-bac6-d205cd6403cc-maas-api-tls\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:41:49.719989 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:49.719996    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-25w9g\" (UniqueName: \"kubernetes.io/projected/79f496fb-0756-4b3d-bac6-d205cd6403cc-kube-api-access-25w9g\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:41:49.795833 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:49.795780    2549 generic.go:356] "Generic (PLEG): container finished" podID="79f496fb-0756-4b3d-bac6-d205cd6403cc" containerID="07172f0a6286db0e78daddebf9ae34a72c876d7e7de79613ee6505053eef00db" exitCode=0
Jul 23 00:41:49.796032 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:49.795849    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-244e255b-cbffd5745-dbp96"
Jul 23 00:41:49.796032 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:49.795871    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-244e255b-cbffd5745-dbp96" event={"ID":"79f496fb-0756-4b3d-bac6-d205cd6403cc","Type":"ContainerDied","Data":"07172f0a6286db0e78daddebf9ae34a72c876d7e7de79613ee6505053eef00db"}
Jul 23 00:41:49.796032 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:49.795945    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-244e255b-cbffd5745-dbp96" event={"ID":"79f496fb-0756-4b3d-bac6-d205cd6403cc","Type":"ContainerDied","Data":"bc88c87de975abd78fbfb68fb71cfd2a7c39a805d70e9a87260acd89b3628c30"}
Jul 23 00:41:49.796032 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:49.795984    2549 scope.go:117] "RemoveContainer" containerID="07172f0a6286db0e78daddebf9ae34a72c876d7e7de79613ee6505053eef00db"
Jul 23 00:41:49.807944 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:49.807915    2549 scope.go:117] "RemoveContainer" containerID="07172f0a6286db0e78daddebf9ae34a72c876d7e7de79613ee6505053eef00db"
Jul 23 00:41:49.808248 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:41:49.808220    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07172f0a6286db0e78daddebf9ae34a72c876d7e7de79613ee6505053eef00db\": container with ID starting with 07172f0a6286db0e78daddebf9ae34a72c876d7e7de79613ee6505053eef00db not found: ID does not exist" containerID="07172f0a6286db0e78daddebf9ae34a72c876d7e7de79613ee6505053eef00db"
Jul 23 00:41:49.808365 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:49.808258    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07172f0a6286db0e78daddebf9ae34a72c876d7e7de79613ee6505053eef00db"} err="failed to get container status \"07172f0a6286db0e78daddebf9ae34a72c876d7e7de79613ee6505053eef00db\": rpc error: code = NotFound desc = could not find container \"07172f0a6286db0e78daddebf9ae34a72c876d7e7de79613ee6505053eef00db\": container with ID starting with 07172f0a6286db0e78daddebf9ae34a72c876d7e7de79613ee6505053eef00db not found: ID does not exist"
Jul 23 00:41:49.824357 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:49.824326    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-244e255b-cbffd5745-dbp96"]
Jul 23 00:41:49.830359 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:49.830330    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-244e255b-cbffd5745-dbp96"]
Jul 23 00:41:51.803186 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:51.803146    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79f496fb-0756-4b3d-bac6-d205cd6403cc" path="/var/lib/kubelet/pods/79f496fb-0756-4b3d-bac6-d205cd6403cc/volumes"
Jul 23 00:41:53.903428 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:53.903395    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-244e255b-bcq6f"]
Jul 23 00:41:53.906122 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:53.906089    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-244e255b-bcq6f"]
Jul 23 00:41:55.802969 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:41:55.802920    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05bc5352-7320-445d-ab07-377886e62f05" path="/var/lib/kubelet/pods/05bc5352-7320-445d-ab07-377886e62f05/volumes"
Jul 23 00:42:45.501252 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:45.501214    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"]
Jul 23 00:42:45.501855 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:45.501427    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2" podUID="0723fd9f-6bd9-420f-912a-562d4c1a91df" containerName="istio-proxy" containerID="cri-o://0fc81efffbb67dcbfa056d4a913e4ea715e29f508bff8d09ee65b27f6868d454" gracePeriod=30
Jul 23 00:42:50.747009 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:50.746981    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"
Jul 23 00:42:50.835581 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:50.835557    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0723fd9f-6bd9-420f-912a-562d4c1a91df-credential-socket\") pod \"0723fd9f-6bd9-420f-912a-562d4c1a91df\" (UID: \"0723fd9f-6bd9-420f-912a-562d4c1a91df\") "
Jul 23 00:42:50.835737 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:50.835591    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0723fd9f-6bd9-420f-912a-562d4c1a91df-workload-socket\") pod \"0723fd9f-6bd9-420f-912a-562d4c1a91df\" (UID: \"0723fd9f-6bd9-420f-912a-562d4c1a91df\") "
Jul 23 00:42:50.835737 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:50.835620    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0723fd9f-6bd9-420f-912a-562d4c1a91df-istiod-ca-cert\") pod \"0723fd9f-6bd9-420f-912a-562d4c1a91df\" (UID: \"0723fd9f-6bd9-420f-912a-562d4c1a91df\") "
Jul 23 00:42:50.835737 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:50.835674    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0723fd9f-6bd9-420f-912a-562d4c1a91df-istio-data\") pod \"0723fd9f-6bd9-420f-912a-562d4c1a91df\" (UID: \"0723fd9f-6bd9-420f-912a-562d4c1a91df\") "
Jul 23 00:42:50.835737 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:50.835700    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4n4j7\" (UniqueName: \"kubernetes.io/projected/0723fd9f-6bd9-420f-912a-562d4c1a91df-kube-api-access-4n4j7\") pod \"0723fd9f-6bd9-420f-912a-562d4c1a91df\" (UID: \"0723fd9f-6bd9-420f-912a-562d4c1a91df\") "
Jul 23 00:42:50.835737 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:50.835725    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0723fd9f-6bd9-420f-912a-562d4c1a91df-istio-token\") pod \"0723fd9f-6bd9-420f-912a-562d4c1a91df\" (UID: \"0723fd9f-6bd9-420f-912a-562d4c1a91df\") "
Jul 23 00:42:50.836015 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:50.835770    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0723fd9f-6bd9-420f-912a-562d4c1a91df-workload-certs\") pod \"0723fd9f-6bd9-420f-912a-562d4c1a91df\" (UID: \"0723fd9f-6bd9-420f-912a-562d4c1a91df\") "
Jul 23 00:42:50.836015 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:50.835888    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0723fd9f-6bd9-420f-912a-562d4c1a91df-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0723fd9f-6bd9-420f-912a-562d4c1a91df" (UID: "0723fd9f-6bd9-420f-912a-562d4c1a91df"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:42:50.836015 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:50.835897    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0723fd9f-6bd9-420f-912a-562d4c1a91df-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0723fd9f-6bd9-420f-912a-562d4c1a91df" (UID: "0723fd9f-6bd9-420f-912a-562d4c1a91df"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:42:50.836015 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:50.835945    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0723fd9f-6bd9-420f-912a-562d4c1a91df-istio-podinfo\") pod \"0723fd9f-6bd9-420f-912a-562d4c1a91df\" (UID: \"0723fd9f-6bd9-420f-912a-562d4c1a91df\") "
Jul 23 00:42:50.836015 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:50.835976    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0723fd9f-6bd9-420f-912a-562d4c1a91df-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0723fd9f-6bd9-420f-912a-562d4c1a91df" (UID: "0723fd9f-6bd9-420f-912a-562d4c1a91df"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:42:50.836015 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:50.835985    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0723fd9f-6bd9-420f-912a-562d4c1a91df-istio-envoy\") pod \"0723fd9f-6bd9-420f-912a-562d4c1a91df\" (UID: \"0723fd9f-6bd9-420f-912a-562d4c1a91df\") "
Jul 23 00:42:50.836305 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:50.836076    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0723fd9f-6bd9-420f-912a-562d4c1a91df-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0723fd9f-6bd9-420f-912a-562d4c1a91df" (UID: "0723fd9f-6bd9-420f-912a-562d4c1a91df"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:42:50.836305 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:50.836285    2549 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0723fd9f-6bd9-420f-912a-562d4c1a91df-workload-certs\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:42:50.836305 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:50.836301    2549 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0723fd9f-6bd9-420f-912a-562d4c1a91df-credential-socket\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:42:50.836412 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:50.836316    2549 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0723fd9f-6bd9-420f-912a-562d4c1a91df-workload-socket\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:42:50.836412 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:50.836329    2549 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0723fd9f-6bd9-420f-912a-562d4c1a91df-istiod-ca-cert\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:42:50.836619 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:50.836590    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0723fd9f-6bd9-420f-912a-562d4c1a91df-istio-data" (OuterVolumeSpecName: "istio-data") pod "0723fd9f-6bd9-420f-912a-562d4c1a91df" (UID: "0723fd9f-6bd9-420f-912a-562d4c1a91df"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:42:50.837998 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:50.837967    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0723fd9f-6bd9-420f-912a-562d4c1a91df-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0723fd9f-6bd9-420f-912a-562d4c1a91df" (UID: "0723fd9f-6bd9-420f-912a-562d4c1a91df"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:42:50.838098 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:50.838000    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0723fd9f-6bd9-420f-912a-562d4c1a91df-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0723fd9f-6bd9-420f-912a-562d4c1a91df" (UID: "0723fd9f-6bd9-420f-912a-562d4c1a91df"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 00:42:50.838296 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:50.838268    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0723fd9f-6bd9-420f-912a-562d4c1a91df-istio-token" (OuterVolumeSpecName: "istio-token") pod "0723fd9f-6bd9-420f-912a-562d4c1a91df" (UID: "0723fd9f-6bd9-420f-912a-562d4c1a91df"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:42:50.838296 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:50.838282    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0723fd9f-6bd9-420f-912a-562d4c1a91df-kube-api-access-4n4j7" (OuterVolumeSpecName: "kube-api-access-4n4j7") pod "0723fd9f-6bd9-420f-912a-562d4c1a91df" (UID: "0723fd9f-6bd9-420f-912a-562d4c1a91df"). InnerVolumeSpecName "kube-api-access-4n4j7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:42:50.937618 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:50.937596    2549 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0723fd9f-6bd9-420f-912a-562d4c1a91df-istio-podinfo\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:42:50.937618 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:50.937617    2549 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0723fd9f-6bd9-420f-912a-562d4c1a91df-istio-envoy\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:42:50.937765 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:50.937626    2549 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0723fd9f-6bd9-420f-912a-562d4c1a91df-istio-data\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:42:50.937765 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:50.937634    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4n4j7\" (UniqueName: \"kubernetes.io/projected/0723fd9f-6bd9-420f-912a-562d4c1a91df-kube-api-access-4n4j7\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:42:50.937765 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:50.937643    2549 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0723fd9f-6bd9-420f-912a-562d4c1a91df-istio-token\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:42:51.082056 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:51.082023    2549 generic.go:356] "Generic (PLEG): container finished" podID="0723fd9f-6bd9-420f-912a-562d4c1a91df" containerID="0fc81efffbb67dcbfa056d4a913e4ea715e29f508bff8d09ee65b27f6868d454" exitCode=0
Jul 23 00:42:51.082183 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:51.082079    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"
Jul 23 00:42:51.082183 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:51.082108    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2" event={"ID":"0723fd9f-6bd9-420f-912a-562d4c1a91df","Type":"ContainerDied","Data":"0fc81efffbb67dcbfa056d4a913e4ea715e29f508bff8d09ee65b27f6868d454"}
Jul 23 00:42:51.082183 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:51.082165    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2" event={"ID":"0723fd9f-6bd9-420f-912a-562d4c1a91df","Type":"ContainerDied","Data":"fc9d814ca1f9cdd2cdd51699dd6dde294e0b1000f837471440f77a918e5c9730"}
Jul 23 00:42:51.082306 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:51.082196    2549 scope.go:117] "RemoveContainer" containerID="0fc81efffbb67dcbfa056d4a913e4ea715e29f508bff8d09ee65b27f6868d454"
Jul 23 00:42:51.091353 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:51.091337    2549 scope.go:117] "RemoveContainer" containerID="50f15180c32dbec0d758fb7ccb921bb67075496cc2a7978157337b861a589a52"
Jul 23 00:42:51.098842 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:51.098826    2549 scope.go:117] "RemoveContainer" containerID="0fc81efffbb67dcbfa056d4a913e4ea715e29f508bff8d09ee65b27f6868d454"
Jul 23 00:42:51.099114 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:42:51.099094    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fc81efffbb67dcbfa056d4a913e4ea715e29f508bff8d09ee65b27f6868d454\": container with ID starting with 0fc81efffbb67dcbfa056d4a913e4ea715e29f508bff8d09ee65b27f6868d454 not found: ID does not exist" containerID="0fc81efffbb67dcbfa056d4a913e4ea715e29f508bff8d09ee65b27f6868d454"
Jul 23 00:42:51.099184 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:51.099126    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fc81efffbb67dcbfa056d4a913e4ea715e29f508bff8d09ee65b27f6868d454"} err="failed to get container status \"0fc81efffbb67dcbfa056d4a913e4ea715e29f508bff8d09ee65b27f6868d454\": rpc error: code = NotFound desc = could not find container \"0fc81efffbb67dcbfa056d4a913e4ea715e29f508bff8d09ee65b27f6868d454\": container with ID starting with 0fc81efffbb67dcbfa056d4a913e4ea715e29f508bff8d09ee65b27f6868d454 not found: ID does not exist"
Jul 23 00:42:51.099184 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:51.099150    2549 scope.go:117] "RemoveContainer" containerID="50f15180c32dbec0d758fb7ccb921bb67075496cc2a7978157337b861a589a52"
Jul 23 00:42:51.099407 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:42:51.099387    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50f15180c32dbec0d758fb7ccb921bb67075496cc2a7978157337b861a589a52\": container with ID starting with 50f15180c32dbec0d758fb7ccb921bb67075496cc2a7978157337b861a589a52 not found: ID does not exist" containerID="50f15180c32dbec0d758fb7ccb921bb67075496cc2a7978157337b861a589a52"
Jul 23 00:42:51.099514 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:51.099413    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50f15180c32dbec0d758fb7ccb921bb67075496cc2a7978157337b861a589a52"} err="failed to get container status \"50f15180c32dbec0d758fb7ccb921bb67075496cc2a7978157337b861a589a52\": rpc error: code = NotFound desc = could not find container \"50f15180c32dbec0d758fb7ccb921bb67075496cc2a7978157337b861a589a52\": container with ID starting with 50f15180c32dbec0d758fb7ccb921bb67075496cc2a7978157337b861a589a52 not found: ID does not exist"
Jul 23 00:42:51.112667 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:51.112642    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"]
Jul 23 00:42:51.121139 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:51.121120    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-244e255b-openshift-default-6b77cc6795-pdgx2"]
Jul 23 00:42:51.802299 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:42:51.802267    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0723fd9f-6bd9-420f-912a-562d4c1a91df" path="/var/lib/kubelet/pods/0723fd9f-6bd9-420f-912a-562d4c1a91df/volumes"
Jul 23 00:43:43.392413 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.392375    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"]
Jul 23 00:43:43.393005 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.392745    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0723fd9f-6bd9-420f-912a-562d4c1a91df" containerName="istio-proxy"
Jul 23 00:43:43.393005 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.392758    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="0723fd9f-6bd9-420f-912a-562d4c1a91df" containerName="istio-proxy"
Jul 23 00:43:43.393005 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.392768    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79f496fb-0756-4b3d-bac6-d205cd6403cc" containerName="maas-api"
Jul 23 00:43:43.393005 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.392774    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="79f496fb-0756-4b3d-bac6-d205cd6403cc" containerName="maas-api"
Jul 23 00:43:43.393005 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.392780    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05bc5352-7320-445d-ab07-377886e62f05" containerName="revoke-keys"
Jul 23 00:43:43.393005 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.392786    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="05bc5352-7320-445d-ab07-377886e62f05" containerName="revoke-keys"
Jul 23 00:43:43.393005 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.392848    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="0723fd9f-6bd9-420f-912a-562d4c1a91df" containerName="istio-proxy"
Jul 23 00:43:43.393005 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.392859    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="79f496fb-0756-4b3d-bac6-d205cd6403cc" containerName="maas-api"
Jul 23 00:43:43.393005 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.392865    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="05bc5352-7320-445d-ab07-377886e62f05" containerName="revoke-keys"
Jul 23 00:43:43.396164 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.396140    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"
Jul 23 00:43:43.399608 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.399578    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-e94467-openshift-default-dockercfg-d2wsf\""
Jul 23 00:43:43.430223 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.430195    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"]
Jul 23 00:43:43.467134 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.467104    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41ff2c02-f7c5-400d-bcc4-59c974126b44-credential-socket\") pod \"e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b\" (UID: \"41ff2c02-f7c5-400d-bcc4-59c974126b44\") " pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"
Jul 23 00:43:43.467280 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.467140    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41ff2c02-f7c5-400d-bcc4-59c974126b44-workload-certs\") pod \"e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b\" (UID: \"41ff2c02-f7c5-400d-bcc4-59c974126b44\") " pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"
Jul 23 00:43:43.467280 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.467161    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41ff2c02-f7c5-400d-bcc4-59c974126b44-istio-envoy\") pod \"e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b\" (UID: \"41ff2c02-f7c5-400d-bcc4-59c974126b44\") " pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"
Jul 23 00:43:43.467280 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.467212    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sm94\" (UniqueName: \"kubernetes.io/projected/41ff2c02-f7c5-400d-bcc4-59c974126b44-kube-api-access-4sm94\") pod \"e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b\" (UID: \"41ff2c02-f7c5-400d-bcc4-59c974126b44\") " pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"
Jul 23 00:43:43.467280 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.467262    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41ff2c02-f7c5-400d-bcc4-59c974126b44-workload-socket\") pod \"e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b\" (UID: \"41ff2c02-f7c5-400d-bcc4-59c974126b44\") " pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"
Jul 23 00:43:43.467421 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.467290    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41ff2c02-f7c5-400d-bcc4-59c974126b44-istio-data\") pod \"e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b\" (UID: \"41ff2c02-f7c5-400d-bcc4-59c974126b44\") " pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"
Jul 23 00:43:43.467421 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.467319    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41ff2c02-f7c5-400d-bcc4-59c974126b44-istiod-ca-cert\") pod \"e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b\" (UID: \"41ff2c02-f7c5-400d-bcc4-59c974126b44\") " pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"
Jul 23 00:43:43.467421 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.467405    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41ff2c02-f7c5-400d-bcc4-59c974126b44-istio-podinfo\") pod \"e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b\" (UID: \"41ff2c02-f7c5-400d-bcc4-59c974126b44\") " pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"
Jul 23 00:43:43.467535 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.467424    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41ff2c02-f7c5-400d-bcc4-59c974126b44-istio-token\") pod \"e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b\" (UID: \"41ff2c02-f7c5-400d-bcc4-59c974126b44\") " pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"
Jul 23 00:43:43.568821 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.568787    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41ff2c02-f7c5-400d-bcc4-59c974126b44-istio-envoy\") pod \"e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b\" (UID: \"41ff2c02-f7c5-400d-bcc4-59c974126b44\") " pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"
Jul 23 00:43:43.569023 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.568831    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sm94\" (UniqueName: \"kubernetes.io/projected/41ff2c02-f7c5-400d-bcc4-59c974126b44-kube-api-access-4sm94\") pod \"e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b\" (UID: \"41ff2c02-f7c5-400d-bcc4-59c974126b44\") " pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"
Jul 23 00:43:43.569023 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.568865    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41ff2c02-f7c5-400d-bcc4-59c974126b44-workload-socket\") pod \"e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b\" (UID: \"41ff2c02-f7c5-400d-bcc4-59c974126b44\") " pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"
Jul 23 00:43:43.569023 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.568881    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41ff2c02-f7c5-400d-bcc4-59c974126b44-istio-data\") pod \"e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b\" (UID: \"41ff2c02-f7c5-400d-bcc4-59c974126b44\") " pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"
Jul 23 00:43:43.569023 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.568913    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41ff2c02-f7c5-400d-bcc4-59c974126b44-istiod-ca-cert\") pod \"e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b\" (UID: \"41ff2c02-f7c5-400d-bcc4-59c974126b44\") " pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"
Jul 23 00:43:43.569023 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.568964    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41ff2c02-f7c5-400d-bcc4-59c974126b44-istio-podinfo\") pod \"e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b\" (UID: \"41ff2c02-f7c5-400d-bcc4-59c974126b44\") " pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"
Jul 23 00:43:43.569023 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.568984    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41ff2c02-f7c5-400d-bcc4-59c974126b44-istio-token\") pod \"e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b\" (UID: \"41ff2c02-f7c5-400d-bcc4-59c974126b44\") " pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"
Jul 23 00:43:43.569023 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.569021    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41ff2c02-f7c5-400d-bcc4-59c974126b44-credential-socket\") pod \"e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b\" (UID: \"41ff2c02-f7c5-400d-bcc4-59c974126b44\") " pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"
Jul 23 00:43:43.569375 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.569047    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41ff2c02-f7c5-400d-bcc4-59c974126b44-workload-certs\") pod \"e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b\" (UID: \"41ff2c02-f7c5-400d-bcc4-59c974126b44\") " pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"
Jul 23 00:43:43.569375 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.569306    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41ff2c02-f7c5-400d-bcc4-59c974126b44-istio-data\") pod \"e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b\" (UID: \"41ff2c02-f7c5-400d-bcc4-59c974126b44\") " pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"
Jul 23 00:43:43.569535 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.569480    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41ff2c02-f7c5-400d-bcc4-59c974126b44-workload-socket\") pod \"e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b\" (UID: \"41ff2c02-f7c5-400d-bcc4-59c974126b44\") " pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"
Jul 23 00:43:43.569596 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.569542    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41ff2c02-f7c5-400d-bcc4-59c974126b44-credential-socket\") pod \"e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b\" (UID: \"41ff2c02-f7c5-400d-bcc4-59c974126b44\") " pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"
Jul 23 00:43:43.569641 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.569587    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41ff2c02-f7c5-400d-bcc4-59c974126b44-workload-certs\") pod \"e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b\" (UID: \"41ff2c02-f7c5-400d-bcc4-59c974126b44\") " pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"
Jul 23 00:43:43.569887 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.569863    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41ff2c02-f7c5-400d-bcc4-59c974126b44-istiod-ca-cert\") pod \"e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b\" (UID: \"41ff2c02-f7c5-400d-bcc4-59c974126b44\") " pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"
Jul 23 00:43:43.571265 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.571242    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41ff2c02-f7c5-400d-bcc4-59c974126b44-istio-envoy\") pod \"e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b\" (UID: \"41ff2c02-f7c5-400d-bcc4-59c974126b44\") " pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"
Jul 23 00:43:43.571492 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.571472    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41ff2c02-f7c5-400d-bcc4-59c974126b44-istio-podinfo\") pod \"e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b\" (UID: \"41ff2c02-f7c5-400d-bcc4-59c974126b44\") " pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"
Jul 23 00:43:43.593646 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.593611    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41ff2c02-f7c5-400d-bcc4-59c974126b44-istio-token\") pod \"e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b\" (UID: \"41ff2c02-f7c5-400d-bcc4-59c974126b44\") " pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"
Jul 23 00:43:43.593757 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.593725    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sm94\" (UniqueName: \"kubernetes.io/projected/41ff2c02-f7c5-400d-bcc4-59c974126b44-kube-api-access-4sm94\") pod \"e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b\" (UID: \"41ff2c02-f7c5-400d-bcc4-59c974126b44\") " pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"
Jul 23 00:43:43.708963 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.708897    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"
Jul 23 00:43:43.862758 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.862716    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"]
Jul 23 00:43:43.866336 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:43:43.866314    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41ff2c02_f7c5_400d_bcc4_59c974126b44.slice/crio-81c6a77af58e849457e36de43ee7c4dff9539937eaab28caa77cdf127829277e WatchSource:0}: Error finding container 81c6a77af58e849457e36de43ee7c4dff9539937eaab28caa77cdf127829277e: Status 404 returned error can't find the container with id 81c6a77af58e849457e36de43ee7c4dff9539937eaab28caa77cdf127829277e
Jul 23 00:43:43.868407 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.868380    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:43:43.868522 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.868437    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:43:43.868522 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:43.868498    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:43:44.336604 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:44.336561    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b" event={"ID":"41ff2c02-f7c5-400d-bcc4-59c974126b44","Type":"ContainerStarted","Data":"d2edf8106a8c5835fd4bf956314129a2e683d15fedee39a108ec9e711be45a17"}
Jul 23 00:43:44.336808 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:44.336630    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b" event={"ID":"41ff2c02-f7c5-400d-bcc4-59c974126b44","Type":"ContainerStarted","Data":"81c6a77af58e849457e36de43ee7c4dff9539937eaab28caa77cdf127829277e"}
Jul 23 00:43:44.365276 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:44.365226    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b" podStartSLOduration=1.365210205 podStartE2EDuration="1.365210205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:43:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:43:44.365194569 +0000 UTC m=+2367.126392882" watchObservedRunningTime="2026-07-23 00:43:44.365210205 +0000 UTC m=+2367.126408516"
Jul 23 00:43:44.709235 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:44.709157    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"
Jul 23 00:43:44.713939 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:44.713915    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"
Jul 23 00:43:45.341353 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:45.341322    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"
Jul 23 00:43:45.342096 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:45.342077    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"
Jul 23 00:43:46.755959 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:46.755925    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e94467-895bcd979-hh2dd"]
Jul 23 00:43:46.756341 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:46.756327    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0723fd9f-6bd9-420f-912a-562d4c1a91df" containerName="istio-proxy"
Jul 23 00:43:46.756385 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:46.756343    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="0723fd9f-6bd9-420f-912a-562d4c1a91df" containerName="istio-proxy"
Jul 23 00:43:46.756421 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:46.756411    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="0723fd9f-6bd9-420f-912a-562d4c1a91df" containerName="istio-proxy"
Jul 23 00:43:46.759601 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:46.759581    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e94467-895bcd979-hh2dd"
Jul 23 00:43:46.762057 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:46.762035    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-e94467-serving-cert\""
Jul 23 00:43:46.785867 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:46.785836    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e94467-895bcd979-hh2dd"]
Jul 23 00:43:46.796589 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:46.796563    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034-openshift-service-ca\") pod \"maas-api-e2e-inf-a-e94467-895bcd979-hh2dd\" (UID: \"93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e94467-895bcd979-hh2dd"
Jul 23 00:43:46.796694 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:46.796631    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbkg6\" (UniqueName: \"kubernetes.io/projected/93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034-kube-api-access-wbkg6\") pod \"maas-api-e2e-inf-a-e94467-895bcd979-hh2dd\" (UID: \"93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e94467-895bcd979-hh2dd"
Jul 23 00:43:46.796773 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:46.796750    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034-maas-api-tls\") pod \"maas-api-e2e-inf-a-e94467-895bcd979-hh2dd\" (UID: \"93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e94467-895bcd979-hh2dd"
Jul 23 00:43:46.897198 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:46.897165    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034-openshift-service-ca\") pod \"maas-api-e2e-inf-a-e94467-895bcd979-hh2dd\" (UID: \"93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e94467-895bcd979-hh2dd"
Jul 23 00:43:46.897378 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:46.897232    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbkg6\" (UniqueName: \"kubernetes.io/projected/93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034-kube-api-access-wbkg6\") pod \"maas-api-e2e-inf-a-e94467-895bcd979-hh2dd\" (UID: \"93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e94467-895bcd979-hh2dd"
Jul 23 00:43:46.897378 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:46.897291    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034-maas-api-tls\") pod \"maas-api-e2e-inf-a-e94467-895bcd979-hh2dd\" (UID: \"93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e94467-895bcd979-hh2dd"
Jul 23 00:43:46.897582 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:43:46.897538    2549 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-e94467-serving-cert: secret "maas-api-e2e-inf-a-e94467-serving-cert" not found
Jul 23 00:43:46.897649 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:43:46.897599    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034-maas-api-tls podName:93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034 nodeName:}" failed. No retries permitted until 2026-07-23 00:43:47.397583165 +0000 UTC m=+2370.158781456 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034-maas-api-tls") pod "maas-api-e2e-inf-a-e94467-895bcd979-hh2dd" (UID: "93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034") : secret "maas-api-e2e-inf-a-e94467-serving-cert" not found
Jul 23 00:43:46.897940 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:46.897916    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034-openshift-service-ca\") pod \"maas-api-e2e-inf-a-e94467-895bcd979-hh2dd\" (UID: \"93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e94467-895bcd979-hh2dd"
Jul 23 00:43:46.919352 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:46.919319    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbkg6\" (UniqueName: \"kubernetes.io/projected/93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034-kube-api-access-wbkg6\") pod \"maas-api-e2e-inf-a-e94467-895bcd979-hh2dd\" (UID: \"93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e94467-895bcd979-hh2dd"
Jul 23 00:43:47.401598 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:47.401567    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034-maas-api-tls\") pod \"maas-api-e2e-inf-a-e94467-895bcd979-hh2dd\" (UID: \"93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e94467-895bcd979-hh2dd"
Jul 23 00:43:47.403912 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:47.403882    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034-maas-api-tls\") pod \"maas-api-e2e-inf-a-e94467-895bcd979-hh2dd\" (UID: \"93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e94467-895bcd979-hh2dd"
Jul 23 00:43:47.670468 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:47.670364    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e94467-895bcd979-hh2dd"
Jul 23 00:43:48.034417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:48.034334    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e94467-895bcd979-hh2dd"]
Jul 23 00:43:48.040047 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:43:48.040012    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93c2e2a5_1707_4cf9_8db1_1aa4f5f5d034.slice/crio-32f27421c05daad02d04f576b5522a68a466c60d2986fe78d04657a20caefdfc WatchSource:0}: Error finding container 32f27421c05daad02d04f576b5522a68a466c60d2986fe78d04657a20caefdfc: Status 404 returned error can't find the container with id 32f27421c05daad02d04f576b5522a68a466c60d2986fe78d04657a20caefdfc
Jul 23 00:43:48.357342 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:48.357310    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e94467-895bcd979-hh2dd" event={"ID":"93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034","Type":"ContainerStarted","Data":"32f27421c05daad02d04f576b5522a68a466c60d2986fe78d04657a20caefdfc"}
Jul 23 00:43:49.363872 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:49.363836    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e94467-895bcd979-hh2dd" event={"ID":"93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034","Type":"ContainerStarted","Data":"f5e5c10456da94d898babd747b2a93267fe2a3dc211dabbdd76dc08f7eca004c"}
Jul 23 00:43:49.364356 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:49.363955    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e94467-895bcd979-hh2dd"
Jul 23 00:43:49.405613 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:49.405566    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e94467-895bcd979-hh2dd" podStartSLOduration=3.066604497 podStartE2EDuration="3.405549777s" totalImagesPullingTime="338.94528ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:43:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:43:49.405165015 +0000 UTC m=+2372.166363324" watchObservedRunningTime="2026-07-23 00:43:49.405549777 +0000 UTC m=+2372.166748088"
Jul 23 00:43:54.561749 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:54.561714    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2f7578-57db84b4bb-lblpj"]
Jul 23 00:43:54.565116 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:54.565086    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2f7578-57db84b4bb-lblpj"
Jul 23 00:43:54.567916 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:54.567886    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-2f7578-serving-cert\""
Jul 23 00:43:54.578267 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:54.578201    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2f7578-57db84b4bb-lblpj"]
Jul 23 00:43:54.668426 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:54.668384    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/317e519e-194f-471a-a21c-407a3bdc42a2-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2f7578-57db84b4bb-lblpj\" (UID: \"317e519e-194f-471a-a21c-407a3bdc42a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2f7578-57db84b4bb-lblpj"
Jul 23 00:43:54.668657 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:54.668515    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bbk8\" (UniqueName: \"kubernetes.io/projected/317e519e-194f-471a-a21c-407a3bdc42a2-kube-api-access-2bbk8\") pod \"maas-api-e2e-inf-b-2f7578-57db84b4bb-lblpj\" (UID: \"317e519e-194f-471a-a21c-407a3bdc42a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2f7578-57db84b4bb-lblpj"
Jul 23 00:43:54.668657 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:54.668588    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/317e519e-194f-471a-a21c-407a3bdc42a2-maas-api-tls\") pod \"maas-api-e2e-inf-b-2f7578-57db84b4bb-lblpj\" (UID: \"317e519e-194f-471a-a21c-407a3bdc42a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2f7578-57db84b4bb-lblpj"
Jul 23 00:43:54.769296 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:54.769262    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/317e519e-194f-471a-a21c-407a3bdc42a2-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2f7578-57db84b4bb-lblpj\" (UID: \"317e519e-194f-471a-a21c-407a3bdc42a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2f7578-57db84b4bb-lblpj"
Jul 23 00:43:54.769474 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:54.769321    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bbk8\" (UniqueName: \"kubernetes.io/projected/317e519e-194f-471a-a21c-407a3bdc42a2-kube-api-access-2bbk8\") pod \"maas-api-e2e-inf-b-2f7578-57db84b4bb-lblpj\" (UID: \"317e519e-194f-471a-a21c-407a3bdc42a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2f7578-57db84b4bb-lblpj"
Jul 23 00:43:54.769527 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:54.769499    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/317e519e-194f-471a-a21c-407a3bdc42a2-maas-api-tls\") pod \"maas-api-e2e-inf-b-2f7578-57db84b4bb-lblpj\" (UID: \"317e519e-194f-471a-a21c-407a3bdc42a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2f7578-57db84b4bb-lblpj"
Jul 23 00:43:54.769630 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:43:54.769615    2549 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-2f7578-serving-cert: secret "maas-api-e2e-inf-b-2f7578-serving-cert" not found
Jul 23 00:43:54.769681 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:43:54.769672    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/317e519e-194f-471a-a21c-407a3bdc42a2-maas-api-tls podName:317e519e-194f-471a-a21c-407a3bdc42a2 nodeName:}" failed. No retries permitted until 2026-07-23 00:43:55.269657866 +0000 UTC m=+2378.030856157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/317e519e-194f-471a-a21c-407a3bdc42a2-maas-api-tls") pod "maas-api-e2e-inf-b-2f7578-57db84b4bb-lblpj" (UID: "317e519e-194f-471a-a21c-407a3bdc42a2") : secret "maas-api-e2e-inf-b-2f7578-serving-cert" not found
Jul 23 00:43:54.769930 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:54.769911    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/317e519e-194f-471a-a21c-407a3bdc42a2-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2f7578-57db84b4bb-lblpj\" (UID: \"317e519e-194f-471a-a21c-407a3bdc42a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2f7578-57db84b4bb-lblpj"
Jul 23 00:43:54.786796 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:54.786769    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bbk8\" (UniqueName: \"kubernetes.io/projected/317e519e-194f-471a-a21c-407a3bdc42a2-kube-api-access-2bbk8\") pod \"maas-api-e2e-inf-b-2f7578-57db84b4bb-lblpj\" (UID: \"317e519e-194f-471a-a21c-407a3bdc42a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2f7578-57db84b4bb-lblpj"
Jul 23 00:43:55.275652 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:55.275610    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/317e519e-194f-471a-a21c-407a3bdc42a2-maas-api-tls\") pod \"maas-api-e2e-inf-b-2f7578-57db84b4bb-lblpj\" (UID: \"317e519e-194f-471a-a21c-407a3bdc42a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2f7578-57db84b4bb-lblpj"
Jul 23 00:43:55.277957 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:55.277937    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/317e519e-194f-471a-a21c-407a3bdc42a2-maas-api-tls\") pod \"maas-api-e2e-inf-b-2f7578-57db84b4bb-lblpj\" (UID: \"317e519e-194f-471a-a21c-407a3bdc42a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2f7578-57db84b4bb-lblpj"
Jul 23 00:43:55.374137 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:55.374050    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e94467-895bcd979-hh2dd"
Jul 23 00:43:55.476461 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:55.476423    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2f7578-57db84b4bb-lblpj"
Jul 23 00:43:55.662117 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:55.662088    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2f7578-57db84b4bb-lblpj"]
Jul 23 00:43:55.663486 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:43:55.663435    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod317e519e_194f_471a_a21c_407a3bdc42a2.slice/crio-04691550de604a2625b588fa954fde1beb337c35616025933551a5b7867332ab WatchSource:0}: Error finding container 04691550de604a2625b588fa954fde1beb337c35616025933551a5b7867332ab: Status 404 returned error can't find the container with id 04691550de604a2625b588fa954fde1beb337c35616025933551a5b7867332ab
Jul 23 00:43:56.404688 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:56.404643    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2f7578-57db84b4bb-lblpj" event={"ID":"317e519e-194f-471a-a21c-407a3bdc42a2","Type":"ContainerStarted","Data":"b5d8efda8d62eefc632a5f1d8e3383de14a072e3385fe31b422cd128a90dacfa"}
Jul 23 00:43:56.404869 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:56.404717    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2f7578-57db84b4bb-lblpj"
Jul 23 00:43:56.404869 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:56.404743    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2f7578-57db84b4bb-lblpj" event={"ID":"317e519e-194f-471a-a21c-407a3bdc42a2","Type":"ContainerStarted","Data":"04691550de604a2625b588fa954fde1beb337c35616025933551a5b7867332ab"}
Jul 23 00:43:56.424635 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:56.424582    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2f7578-57db84b4bb-lblpj" podStartSLOduration=2.080471837 podStartE2EDuration="2.424562722s" totalImagesPullingTime="344.090885ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:43:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:43:56.422283925 +0000 UTC m=+2379.183482237" watchObservedRunningTime="2026-07-23 00:43:56.424562722 +0000 UTC m=+2379.185761033"
Jul 23 00:43:59.421604 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:59.421566    2549 generic.go:356] "Generic (PLEG): container finished" podID="41ff2c02-f7c5-400d-bcc4-59c974126b44" containerID="d2edf8106a8c5835fd4bf956314129a2e683d15fedee39a108ec9e711be45a17" exitCode=0
Jul 23 00:43:59.422055 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:59.421640    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b" event={"ID":"41ff2c02-f7c5-400d-bcc4-59c974126b44","Type":"ContainerDied","Data":"d2edf8106a8c5835fd4bf956314129a2e683d15fedee39a108ec9e711be45a17"}
Jul 23 00:43:59.422055 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:59.422036    2549 scope.go:117] "RemoveContainer" containerID="d2edf8106a8c5835fd4bf956314129a2e683d15fedee39a108ec9e711be45a17"
Jul 23 00:43:59.423057 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:59.423028    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:43:59.423166 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:59.423111    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:43:59.423226 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:43:59.423186    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:44:00.341467 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:44:00.341408    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"
Jul 23 00:44:00.428645 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:44:00.428604    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b" event={"ID":"41ff2c02-f7c5-400d-bcc4-59c974126b44","Type":"ContainerStarted","Data":"f8d4d0904553112f59b2358e57fd6b2ae22ee774b77af7e475657a1ecc7a7a6b"}
Jul 23 00:44:00.709905 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:44:00.709800    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"
Jul 23 00:44:00.711198 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:44:00.711167    2549 patch_prober.go:28] interesting pod/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 23 00:44:00.711426 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:44:00.711397    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b" podUID="41ff2c02-f7c5-400d-bcc4-59c974126b44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 23 00:44:01.710227 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:44:01.710190    2549 patch_prober.go:28] interesting pod/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 23 00:44:01.710839 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:44:01.710804    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b" podUID="41ff2c02-f7c5-400d-bcc4-59c974126b44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 23 00:44:02.417847 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:44:02.417815    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2f7578-57db84b4bb-lblpj"
Jul 23 00:44:02.710766 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:44:02.710217    2549 patch_prober.go:28] interesting pod/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 23 00:44:02.710766 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:44:02.710293    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b" podUID="41ff2c02-f7c5-400d-bcc4-59c974126b44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 23 00:44:03.709819 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:44:03.709785    2549 patch_prober.go:28] interesting pod/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 23 00:44:03.710124 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:44:03.710079    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b" podUID="41ff2c02-f7c5-400d-bcc4-59c974126b44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 23 00:44:04.713522 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:44:04.713485    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"
Jul 23 00:44:04.713926 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:44:04.713766    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"
Jul 23 00:44:04.714439 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:44:04.714420    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"
Jul 23 00:45:00.135108 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:00.135073    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e94467-29746125-wvf27"]
Jul 23 00:45:00.140979 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:00.140932    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e94467-29746125-wvf27"
Jul 23 00:45:00.141384 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:00.141351    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29746125-4sgns"]
Jul 23 00:45:00.144092 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:00.144068    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5dc6x\""
Jul 23 00:45:00.149800 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:00.149600    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e94467-29746125-wvf27"]
Jul 23 00:45:00.149800 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:00.149702    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746125-4sgns"
Jul 23 00:45:00.155263 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:00.155242    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e94467-29746125-wvf27"
Jul 23 00:45:00.164350 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:00.164326    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746125-4sgns"
Jul 23 00:45:00.170177 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:00.170147    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29746125-4sgns"]
Jul 23 00:45:00.348574 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:00.348549    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29746125-4sgns"]
Jul 23 00:45:00.349635 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:45:00.349610    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53a53da2_e245_409a_a8ff_45dad9a10cb8.slice/crio-2d8653f14e4b076bc72c6b67308b2a68e0923fed4cf18ff9a6b84ddc711388ba WatchSource:0}: Error finding container 2d8653f14e4b076bc72c6b67308b2a68e0923fed4cf18ff9a6b84ddc711388ba: Status 404 returned error can't find the container with id 2d8653f14e4b076bc72c6b67308b2a68e0923fed4cf18ff9a6b84ddc711388ba
Jul 23 00:45:00.536546 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:00.536525    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e94467-29746125-wvf27"]
Jul 23 00:45:00.538887 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:45:00.538856    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c25ee99_f43e_4ff5_8ae4_e109a8350c8b.slice/crio-b7f7b1186762552d08f75a4a67e12a7ab4c3f81bba4c701b3bb82fc3746f87fa WatchSource:0}: Error finding container b7f7b1186762552d08f75a4a67e12a7ab4c3f81bba4c701b3bb82fc3746f87fa: Status 404 returned error can't find the container with id b7f7b1186762552d08f75a4a67e12a7ab4c3f81bba4c701b3bb82fc3746f87fa
Jul 23 00:45:00.728972 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:00.728938    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e94467-29746125-wvf27" event={"ID":"0c25ee99-f43e-4ff5-8ae4-e109a8350c8b","Type":"ContainerStarted","Data":"b7f7b1186762552d08f75a4a67e12a7ab4c3f81bba4c701b3bb82fc3746f87fa"}
Jul 23 00:45:00.730402 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:00.730362    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746125-4sgns" event={"ID":"53a53da2-e245-409a-a8ff-45dad9a10cb8","Type":"ContainerStarted","Data":"1d4542169243916417272746f6a89d82424a58e143b641908e6c3a72f6d84b48"}
Jul 23 00:45:00.730556 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:00.730411    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746125-4sgns" event={"ID":"53a53da2-e245-409a-a8ff-45dad9a10cb8","Type":"ContainerStarted","Data":"2d8653f14e4b076bc72c6b67308b2a68e0923fed4cf18ff9a6b84ddc711388ba"}
Jul 23 00:45:01.738582 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:01.738503    2549 generic.go:356] "Generic (PLEG): container finished" podID="53a53da2-e245-409a-a8ff-45dad9a10cb8" containerID="1d4542169243916417272746f6a89d82424a58e143b641908e6c3a72f6d84b48" exitCode=0
Jul 23 00:45:01.738983 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:01.738590    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746125-4sgns" event={"ID":"53a53da2-e245-409a-a8ff-45dad9a10cb8","Type":"ContainerDied","Data":"1d4542169243916417272746f6a89d82424a58e143b641908e6c3a72f6d84b48"}
Jul 23 00:45:01.740067 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:01.740046    2549 generic.go:356] "Generic (PLEG): container finished" podID="0c25ee99-f43e-4ff5-8ae4-e109a8350c8b" containerID="a6415f6b3246cd4907b0c53446be2ef1941187bacafa6643d0c1288a02c0c98c" exitCode=0
Jul 23 00:45:01.740169 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:01.740092    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e94467-29746125-wvf27" event={"ID":"0c25ee99-f43e-4ff5-8ae4-e109a8350c8b","Type":"ContainerDied","Data":"a6415f6b3246cd4907b0c53446be2ef1941187bacafa6643d0c1288a02c0c98c"}
Jul 23 00:45:02.889028 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:02.889006    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e94467-29746125-wvf27"
Jul 23 00:45:02.915968 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:02.915943    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746125-4sgns"
Jul 23 00:45:03.750965 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:03.750923    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746125-4sgns"
Jul 23 00:45:03.751152 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:03.750965    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746125-4sgns" event={"ID":"53a53da2-e245-409a-a8ff-45dad9a10cb8","Type":"ContainerDied","Data":"2d8653f14e4b076bc72c6b67308b2a68e0923fed4cf18ff9a6b84ddc711388ba"}
Jul 23 00:45:03.751152 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:03.751055    2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2d8653f14e4b076bc72c6b67308b2a68e0923fed4cf18ff9a6b84ddc711388ba"
Jul 23 00:45:03.752283 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:03.752254    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e94467-29746125-wvf27" event={"ID":"0c25ee99-f43e-4ff5-8ae4-e109a8350c8b","Type":"ContainerDied","Data":"b7f7b1186762552d08f75a4a67e12a7ab4c3f81bba4c701b3bb82fc3746f87fa"}
Jul 23 00:45:03.752283 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:03.752273    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e94467-29746125-wvf27"
Jul 23 00:45:03.752487 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:03.752294    2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b7f7b1186762552d08f75a4a67e12a7ab4c3f81bba4c701b3bb82fc3746f87fa"
Jul 23 00:45:50.740950 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:50.740918    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e94467-xdjlb"]
Jul 23 00:45:50.741398 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:50.741313    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c25ee99-f43e-4ff5-8ae4-e109a8350c8b" containerName="cleanup"
Jul 23 00:45:50.741398 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:50.741326    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c25ee99-f43e-4ff5-8ae4-e109a8350c8b" containerName="cleanup"
Jul 23 00:45:50.741398 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:50.741337    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53a53da2-e245-409a-a8ff-45dad9a10cb8" containerName="cleanup"
Jul 23 00:45:50.741398 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:50.741343    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="53a53da2-e245-409a-a8ff-45dad9a10cb8" containerName="cleanup"
Jul 23 00:45:50.741398 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:50.741399    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="53a53da2-e245-409a-a8ff-45dad9a10cb8" containerName="cleanup"
Jul 23 00:45:50.741584 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:50.741412    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c25ee99-f43e-4ff5-8ae4-e109a8350c8b" containerName="cleanup"
Jul 23 00:45:50.746440 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:50.746416    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e94467-xdjlb"
Jul 23 00:45:50.749099 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:50.749077    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5dc6x\""
Jul 23 00:45:50.753348 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:50.753326    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e94467-xdjlb"]
Jul 23 00:45:50.789126 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:50.789098    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9aca68db-3b6b-4c63-abab-79a9f271d3a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-e94467-xdjlb\" (UID: \"9aca68db-3b6b-4c63-abab-79a9f271d3a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e94467-xdjlb"
Jul 23 00:45:50.889743 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:50.889709    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9aca68db-3b6b-4c63-abab-79a9f271d3a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-e94467-xdjlb\" (UID: \"9aca68db-3b6b-4c63-abab-79a9f271d3a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e94467-xdjlb"
Jul 23 00:45:50.890801 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:50.890773    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9aca68db-3b6b-4c63-abab-79a9f271d3a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-e94467-xdjlb\" (UID: \"9aca68db-3b6b-4c63-abab-79a9f271d3a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e94467-xdjlb"
Jul 23 00:45:51.060928 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:51.060825    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e94467-xdjlb"
Jul 23 00:45:51.212902 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:51.212877    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e94467-xdjlb"]
Jul 23 00:45:51.215178 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:45:51.215152    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aca68db_3b6b_4c63_abab_79a9f271d3a0.slice/crio-c05a20d255693e7919ff6e9a4b2b7433bea9b0979155927bf9c2b92ecddf8492 WatchSource:0}: Error finding container c05a20d255693e7919ff6e9a4b2b7433bea9b0979155927bf9c2b92ecddf8492: Status 404 returned error can't find the container with id c05a20d255693e7919ff6e9a4b2b7433bea9b0979155927bf9c2b92ecddf8492
Jul 23 00:45:51.988172 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:51.988138    2549 generic.go:356] "Generic (PLEG): container finished" podID="9aca68db-3b6b-4c63-abab-79a9f271d3a0" containerID="a10fcc1566d2677e339cd2d3c1b3e9d6c47629f49149aa3ac5d58d2eb0fdadbc" exitCode=0
Jul 23 00:45:51.988618 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:51.988237    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e94467-xdjlb" event={"ID":"9aca68db-3b6b-4c63-abab-79a9f271d3a0","Type":"ContainerDied","Data":"a10fcc1566d2677e339cd2d3c1b3e9d6c47629f49149aa3ac5d58d2eb0fdadbc"}
Jul 23 00:45:51.988618 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:51.988299    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e94467-xdjlb" event={"ID":"9aca68db-3b6b-4c63-abab-79a9f271d3a0","Type":"ContainerStarted","Data":"c05a20d255693e7919ff6e9a4b2b7433bea9b0979155927bf9c2b92ecddf8492"}
Jul 23 00:45:53.126806 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:53.126781    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e94467-xdjlb"
Jul 23 00:45:53.214676 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:53.214642    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9aca68db-3b6b-4c63-abab-79a9f271d3a0-maas-api-service-ca\") pod \"9aca68db-3b6b-4c63-abab-79a9f271d3a0\" (UID: \"9aca68db-3b6b-4c63-abab-79a9f271d3a0\") "
Jul 23 00:45:53.215031 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:53.215006    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9aca68db-3b6b-4c63-abab-79a9f271d3a0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9aca68db-3b6b-4c63-abab-79a9f271d3a0" (UID: "9aca68db-3b6b-4c63-abab-79a9f271d3a0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:45:53.316167 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:53.316135    2549 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9aca68db-3b6b-4c63-abab-79a9f271d3a0-maas-api-service-ca\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:45:53.999476 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:53.999437    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e94467-xdjlb"
Jul 23 00:45:53.999625 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:53.999439    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e94467-xdjlb" event={"ID":"9aca68db-3b6b-4c63-abab-79a9f271d3a0","Type":"ContainerDied","Data":"c05a20d255693e7919ff6e9a4b2b7433bea9b0979155927bf9c2b92ecddf8492"}
Jul 23 00:45:53.999625 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:45:53.999570    2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c05a20d255693e7919ff6e9a4b2b7433bea9b0979155927bf9c2b92ecddf8492"
Jul 23 00:46:01.220850 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:01.220192    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e94467-895bcd979-hh2dd"]
Jul 23 00:46:01.220850 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:01.220689    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e94467-895bcd979-hh2dd" podUID="93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034" containerName="maas-api" containerID="cri-o://f5e5c10456da94d898babd747b2a93267fe2a3dc211dabbdd76dc08f7eca004c" gracePeriod=30
Jul 23 00:46:01.249895 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:01.249867    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e94467-29746125-wvf27"]
Jul 23 00:46:01.252878 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:01.252854    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e94467-29746125-wvf27"]
Jul 23 00:46:01.482774 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:01.482710    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e94467-895bcd979-hh2dd"
Jul 23 00:46:01.593571 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:01.593529    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034-openshift-service-ca\") pod \"93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034\" (UID: \"93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034\") "
Jul 23 00:46:01.593761 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:01.593592    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034-maas-api-tls\") pod \"93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034\" (UID: \"93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034\") "
Jul 23 00:46:01.593761 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:01.593660    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbkg6\" (UniqueName: \"kubernetes.io/projected/93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034-kube-api-access-wbkg6\") pod \"93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034\" (UID: \"93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034\") "
Jul 23 00:46:01.593919 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:01.593897    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034" (UID: "93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:46:01.593990 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:01.593973    2549 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034-openshift-service-ca\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:46:01.595775 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:01.595747    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034-kube-api-access-wbkg6" (OuterVolumeSpecName: "kube-api-access-wbkg6") pod "93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034" (UID: "93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034"). InnerVolumeSpecName "kube-api-access-wbkg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:46:01.595906 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:01.595895    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034" (UID: "93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 00:46:01.694736 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:01.694698    2549 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034-maas-api-tls\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:46:01.694736 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:01.694736    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbkg6\" (UniqueName: \"kubernetes.io/projected/93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034-kube-api-access-wbkg6\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:46:01.803687 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:01.803613    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c25ee99-f43e-4ff5-8ae4-e109a8350c8b" path="/var/lib/kubelet/pods/0c25ee99-f43e-4ff5-8ae4-e109a8350c8b/volumes"
Jul 23 00:46:02.045600 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:02.045562    2549 generic.go:356] "Generic (PLEG): container finished" podID="93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034" containerID="f5e5c10456da94d898babd747b2a93267fe2a3dc211dabbdd76dc08f7eca004c" exitCode=0
Jul 23 00:46:02.045788 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:02.045612    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e94467-895bcd979-hh2dd"
Jul 23 00:46:02.045788 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:02.045630    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e94467-895bcd979-hh2dd" event={"ID":"93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034","Type":"ContainerDied","Data":"f5e5c10456da94d898babd747b2a93267fe2a3dc211dabbdd76dc08f7eca004c"}
Jul 23 00:46:02.045788 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:02.045674    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e94467-895bcd979-hh2dd" event={"ID":"93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034","Type":"ContainerDied","Data":"32f27421c05daad02d04f576b5522a68a466c60d2986fe78d04657a20caefdfc"}
Jul 23 00:46:02.045788 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:02.045694    2549 scope.go:117] "RemoveContainer" containerID="f5e5c10456da94d898babd747b2a93267fe2a3dc211dabbdd76dc08f7eca004c"
Jul 23 00:46:02.054075 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:02.054051    2549 scope.go:117] "RemoveContainer" containerID="f5e5c10456da94d898babd747b2a93267fe2a3dc211dabbdd76dc08f7eca004c"
Jul 23 00:46:02.054334 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:46:02.054316    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5e5c10456da94d898babd747b2a93267fe2a3dc211dabbdd76dc08f7eca004c\": container with ID starting with f5e5c10456da94d898babd747b2a93267fe2a3dc211dabbdd76dc08f7eca004c not found: ID does not exist" containerID="f5e5c10456da94d898babd747b2a93267fe2a3dc211dabbdd76dc08f7eca004c"
Jul 23 00:46:02.054379 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:02.054343    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5e5c10456da94d898babd747b2a93267fe2a3dc211dabbdd76dc08f7eca004c"} err="failed to get container status \"f5e5c10456da94d898babd747b2a93267fe2a3dc211dabbdd76dc08f7eca004c\": rpc error: code = NotFound desc = could not find container \"f5e5c10456da94d898babd747b2a93267fe2a3dc211dabbdd76dc08f7eca004c\": container with ID starting with f5e5c10456da94d898babd747b2a93267fe2a3dc211dabbdd76dc08f7eca004c not found: ID does not exist"
Jul 23 00:46:02.072681 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:02.072659    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e94467-895bcd979-hh2dd"]
Jul 23 00:46:02.078705 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:02.078683    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e94467-895bcd979-hh2dd"]
Jul 23 00:46:03.803298 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:03.803262    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034" path="/var/lib/kubelet/pods/93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034/volumes"
Jul 23 00:46:05.833767 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:05.833731    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e94467-xdjlb"]
Jul 23 00:46:05.835442 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:05.835421    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e94467-xdjlb"]
Jul 23 00:46:07.803032 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:07.802998    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9aca68db-3b6b-4c63-abab-79a9f271d3a0" path="/var/lib/kubelet/pods/9aca68db-3b6b-4c63-abab-79a9f271d3a0/volumes"
Jul 23 00:46:12.528610 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:12.528528    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"]
Jul 23 00:46:12.528986 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:12.528757    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b" podUID="41ff2c02-f7c5-400d-bcc4-59c974126b44" containerName="istio-proxy" containerID="cri-o://f8d4d0904553112f59b2358e57fd6b2ae22ee774b77af7e475657a1ecc7a7a6b" gracePeriod=30
Jul 23 00:46:12.906582 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:12.906546    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f7578-hhqbx"]
Jul 23 00:46:12.907016 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:12.906997    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034" containerName="maas-api"
Jul 23 00:46:12.907109 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:12.907018    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034" containerName="maas-api"
Jul 23 00:46:12.907109 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:12.907044    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9aca68db-3b6b-4c63-abab-79a9f271d3a0" containerName="revoke-keys"
Jul 23 00:46:12.907109 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:12.907055    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="9aca68db-3b6b-4c63-abab-79a9f271d3a0" containerName="revoke-keys"
Jul 23 00:46:12.907334 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:12.907140    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="93c2e2a5-1707-4cf9-8db1-1aa4f5f5d034" containerName="maas-api"
Jul 23 00:46:12.907334 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:12.907153    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="9aca68db-3b6b-4c63-abab-79a9f271d3a0" containerName="revoke-keys"
Jul 23 00:46:12.911486 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:12.911464    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f7578-hhqbx"
Jul 23 00:46:12.914250 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:12.914225    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5dc6x\""
Jul 23 00:46:12.919597 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:12.919110    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f7578-hhqbx"]
Jul 23 00:46:13.094377 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:13.094342    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c4a9cbf-b123-4449-8e90-dd00ef5825cc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-2f7578-hhqbx\" (UID: \"0c4a9cbf-b123-4449-8e90-dd00ef5825cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f7578-hhqbx"
Jul 23 00:46:13.194822 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:13.194744    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c4a9cbf-b123-4449-8e90-dd00ef5825cc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-2f7578-hhqbx\" (UID: \"0c4a9cbf-b123-4449-8e90-dd00ef5825cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f7578-hhqbx"
Jul 23 00:46:13.195360 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:13.195335    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c4a9cbf-b123-4449-8e90-dd00ef5825cc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-2f7578-hhqbx\" (UID: \"0c4a9cbf-b123-4449-8e90-dd00ef5825cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f7578-hhqbx"
Jul 23 00:46:13.224551 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:13.224526    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f7578-hhqbx"
Jul 23 00:46:13.356264 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:13.356229    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f7578-hhqbx"]
Jul 23 00:46:13.359167 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:46:13.359139    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c4a9cbf_b123_4449_8e90_dd00ef5825cc.slice/crio-336c00306b1152a16d196d764a1bc54be7ced6c1386d5cecb960c3761d7330a2 WatchSource:0}: Error finding container 336c00306b1152a16d196d764a1bc54be7ced6c1386d5cecb960c3761d7330a2: Status 404 returned error can't find the container with id 336c00306b1152a16d196d764a1bc54be7ced6c1386d5cecb960c3761d7330a2
Jul 23 00:46:14.107801 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:14.107772    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f7578-hhqbx" event={"ID":"0c4a9cbf-b123-4449-8e90-dd00ef5825cc","Type":"ContainerStarted","Data":"016397df0e5285158fad5da00328fbc25c2d7a2f19869a569e9a322881fd6e5f"}
Jul 23 00:46:14.108121 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:14.107828    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f7578-hhqbx" event={"ID":"0c4a9cbf-b123-4449-8e90-dd00ef5825cc","Type":"ContainerStarted","Data":"336c00306b1152a16d196d764a1bc54be7ced6c1386d5cecb960c3761d7330a2"}
Jul 23 00:46:14.124441 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:14.124387    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f7578-hhqbx" podStartSLOduration=2.124372699 podStartE2EDuration="2.124372699s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:46:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:46:14.123559773 +0000 UTC m=+2516.884758095" watchObservedRunningTime="2026-07-23 00:46:14.124372699 +0000 UTC m=+2516.885571008"
Jul 23 00:46:15.114105 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:15.114070    2549 generic.go:356] "Generic (PLEG): container finished" podID="0c4a9cbf-b123-4449-8e90-dd00ef5825cc" containerID="016397df0e5285158fad5da00328fbc25c2d7a2f19869a569e9a322881fd6e5f" exitCode=0
Jul 23 00:46:15.114505 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:15.114143    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f7578-hhqbx" event={"ID":"0c4a9cbf-b123-4449-8e90-dd00ef5825cc","Type":"ContainerDied","Data":"016397df0e5285158fad5da00328fbc25c2d7a2f19869a569e9a322881fd6e5f"}
Jul 23 00:46:16.252529 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:16.252500    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f7578-hhqbx"
Jul 23 00:46:16.421964 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:16.421868    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c4a9cbf-b123-4449-8e90-dd00ef5825cc-maas-api-service-ca\") pod \"0c4a9cbf-b123-4449-8e90-dd00ef5825cc\" (UID: \"0c4a9cbf-b123-4449-8e90-dd00ef5825cc\") "
Jul 23 00:46:16.422259 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:16.422233    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c4a9cbf-b123-4449-8e90-dd00ef5825cc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0c4a9cbf-b123-4449-8e90-dd00ef5825cc" (UID: "0c4a9cbf-b123-4449-8e90-dd00ef5825cc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:46:16.523252 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:16.523229    2549 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c4a9cbf-b123-4449-8e90-dd00ef5825cc-maas-api-service-ca\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:46:17.126066 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:17.126037    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f7578-hhqbx"
Jul 23 00:46:17.126240 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:17.126076    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f7578-hhqbx" event={"ID":"0c4a9cbf-b123-4449-8e90-dd00ef5825cc","Type":"ContainerDied","Data":"336c00306b1152a16d196d764a1bc54be7ced6c1386d5cecb960c3761d7330a2"}
Jul 23 00:46:17.126240 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:17.126127    2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="336c00306b1152a16d196d764a1bc54be7ced6c1386d5cecb960c3761d7330a2"
Jul 23 00:46:17.783637 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:17.783610    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"
Jul 23 00:46:17.933819 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:17.933792    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41ff2c02-f7c5-400d-bcc4-59c974126b44-istio-token\") pod \"41ff2c02-f7c5-400d-bcc4-59c974126b44\" (UID: \"41ff2c02-f7c5-400d-bcc4-59c974126b44\") "
Jul 23 00:46:17.933985 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:17.933837    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41ff2c02-f7c5-400d-bcc4-59c974126b44-istio-data\") pod \"41ff2c02-f7c5-400d-bcc4-59c974126b44\" (UID: \"41ff2c02-f7c5-400d-bcc4-59c974126b44\") "
Jul 23 00:46:17.933985 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:17.933874    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41ff2c02-f7c5-400d-bcc4-59c974126b44-workload-certs\") pod \"41ff2c02-f7c5-400d-bcc4-59c974126b44\" (UID: \"41ff2c02-f7c5-400d-bcc4-59c974126b44\") "
Jul 23 00:46:17.933985 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:17.933893    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4sm94\" (UniqueName: \"kubernetes.io/projected/41ff2c02-f7c5-400d-bcc4-59c974126b44-kube-api-access-4sm94\") pod \"41ff2c02-f7c5-400d-bcc4-59c974126b44\" (UID: \"41ff2c02-f7c5-400d-bcc4-59c974126b44\") "
Jul 23 00:46:17.933985 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:17.933946    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41ff2c02-f7c5-400d-bcc4-59c974126b44-istio-podinfo\") pod \"41ff2c02-f7c5-400d-bcc4-59c974126b44\" (UID: \"41ff2c02-f7c5-400d-bcc4-59c974126b44\") "
Jul 23 00:46:17.933985 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:17.933976    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41ff2c02-f7c5-400d-bcc4-59c974126b44-credential-socket\") pod \"41ff2c02-f7c5-400d-bcc4-59c974126b44\" (UID: \"41ff2c02-f7c5-400d-bcc4-59c974126b44\") "
Jul 23 00:46:17.934271 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:17.934007    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41ff2c02-f7c5-400d-bcc4-59c974126b44-workload-socket\") pod \"41ff2c02-f7c5-400d-bcc4-59c974126b44\" (UID: \"41ff2c02-f7c5-400d-bcc4-59c974126b44\") "
Jul 23 00:46:17.934271 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:17.934022    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41ff2c02-f7c5-400d-bcc4-59c974126b44-istiod-ca-cert\") pod \"41ff2c02-f7c5-400d-bcc4-59c974126b44\" (UID: \"41ff2c02-f7c5-400d-bcc4-59c974126b44\") "
Jul 23 00:46:17.934271 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:17.934049    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41ff2c02-f7c5-400d-bcc4-59c974126b44-istio-envoy\") pod \"41ff2c02-f7c5-400d-bcc4-59c974126b44\" (UID: \"41ff2c02-f7c5-400d-bcc4-59c974126b44\") "
Jul 23 00:46:17.934271 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:17.934223    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41ff2c02-f7c5-400d-bcc4-59c974126b44-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "41ff2c02-f7c5-400d-bcc4-59c974126b44" (UID: "41ff2c02-f7c5-400d-bcc4-59c974126b44"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:46:17.934488 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:17.934278    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41ff2c02-f7c5-400d-bcc4-59c974126b44-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "41ff2c02-f7c5-400d-bcc4-59c974126b44" (UID: "41ff2c02-f7c5-400d-bcc4-59c974126b44"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:46:17.934488 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:17.934333    2549 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41ff2c02-f7c5-400d-bcc4-59c974126b44-credential-socket\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:46:17.934488 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:17.934354    2549 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41ff2c02-f7c5-400d-bcc4-59c974126b44-workload-certs\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:46:17.934488 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:17.934417    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41ff2c02-f7c5-400d-bcc4-59c974126b44-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "41ff2c02-f7c5-400d-bcc4-59c974126b44" (UID: "41ff2c02-f7c5-400d-bcc4-59c974126b44"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:46:17.934688 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:17.934576    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41ff2c02-f7c5-400d-bcc4-59c974126b44-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "41ff2c02-f7c5-400d-bcc4-59c974126b44" (UID: "41ff2c02-f7c5-400d-bcc4-59c974126b44"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:46:17.934875 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:17.934851    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41ff2c02-f7c5-400d-bcc4-59c974126b44-istio-data" (OuterVolumeSpecName: "istio-data") pod "41ff2c02-f7c5-400d-bcc4-59c974126b44" (UID: "41ff2c02-f7c5-400d-bcc4-59c974126b44"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:46:17.936265 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:17.936240    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41ff2c02-f7c5-400d-bcc4-59c974126b44-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "41ff2c02-f7c5-400d-bcc4-59c974126b44" (UID: "41ff2c02-f7c5-400d-bcc4-59c974126b44"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:46:17.936430 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:17.936411    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/41ff2c02-f7c5-400d-bcc4-59c974126b44-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "41ff2c02-f7c5-400d-bcc4-59c974126b44" (UID: "41ff2c02-f7c5-400d-bcc4-59c974126b44"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 00:46:17.936570 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:17.936544    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41ff2c02-f7c5-400d-bcc4-59c974126b44-istio-token" (OuterVolumeSpecName: "istio-token") pod "41ff2c02-f7c5-400d-bcc4-59c974126b44" (UID: "41ff2c02-f7c5-400d-bcc4-59c974126b44"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:46:17.936570 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:17.936556    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41ff2c02-f7c5-400d-bcc4-59c974126b44-kube-api-access-4sm94" (OuterVolumeSpecName: "kube-api-access-4sm94") pod "41ff2c02-f7c5-400d-bcc4-59c974126b44" (UID: "41ff2c02-f7c5-400d-bcc4-59c974126b44"). InnerVolumeSpecName "kube-api-access-4sm94". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:46:18.035155 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:18.035126    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4sm94\" (UniqueName: \"kubernetes.io/projected/41ff2c02-f7c5-400d-bcc4-59c974126b44-kube-api-access-4sm94\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:46:18.035155 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:18.035153    2549 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41ff2c02-f7c5-400d-bcc4-59c974126b44-istio-podinfo\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:46:18.035322 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:18.035163    2549 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41ff2c02-f7c5-400d-bcc4-59c974126b44-workload-socket\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:46:18.035322 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:18.035172    2549 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41ff2c02-f7c5-400d-bcc4-59c974126b44-istiod-ca-cert\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:46:18.035322 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:18.035180    2549 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41ff2c02-f7c5-400d-bcc4-59c974126b44-istio-envoy\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:46:18.035322 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:18.035189    2549 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41ff2c02-f7c5-400d-bcc4-59c974126b44-istio-token\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:46:18.035322 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:18.035196    2549 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41ff2c02-f7c5-400d-bcc4-59c974126b44-istio-data\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:46:18.133132 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:18.133099    2549 generic.go:356] "Generic (PLEG): container finished" podID="41ff2c02-f7c5-400d-bcc4-59c974126b44" containerID="f8d4d0904553112f59b2358e57fd6b2ae22ee774b77af7e475657a1ecc7a7a6b" exitCode=0
Jul 23 00:46:18.133309 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:18.133148    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"
Jul 23 00:46:18.133309 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:18.133189    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b" event={"ID":"41ff2c02-f7c5-400d-bcc4-59c974126b44","Type":"ContainerDied","Data":"f8d4d0904553112f59b2358e57fd6b2ae22ee774b77af7e475657a1ecc7a7a6b"}
Jul 23 00:46:18.133309 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:18.133252    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b" event={"ID":"41ff2c02-f7c5-400d-bcc4-59c974126b44","Type":"ContainerDied","Data":"81c6a77af58e849457e36de43ee7c4dff9539937eaab28caa77cdf127829277e"}
Jul 23 00:46:18.133309 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:18.133284    2549 scope.go:117] "RemoveContainer" containerID="f8d4d0904553112f59b2358e57fd6b2ae22ee774b77af7e475657a1ecc7a7a6b"
Jul 23 00:46:18.143101 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:18.143082    2549 scope.go:117] "RemoveContainer" containerID="d2edf8106a8c5835fd4bf956314129a2e683d15fedee39a108ec9e711be45a17"
Jul 23 00:46:18.151681 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:18.151660    2549 scope.go:117] "RemoveContainer" containerID="f8d4d0904553112f59b2358e57fd6b2ae22ee774b77af7e475657a1ecc7a7a6b"
Jul 23 00:46:18.151951 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:46:18.151930    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8d4d0904553112f59b2358e57fd6b2ae22ee774b77af7e475657a1ecc7a7a6b\": container with ID starting with f8d4d0904553112f59b2358e57fd6b2ae22ee774b77af7e475657a1ecc7a7a6b not found: ID does not exist" containerID="f8d4d0904553112f59b2358e57fd6b2ae22ee774b77af7e475657a1ecc7a7a6b"
Jul 23 00:46:18.152000 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:18.151961    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8d4d0904553112f59b2358e57fd6b2ae22ee774b77af7e475657a1ecc7a7a6b"} err="failed to get container status \"f8d4d0904553112f59b2358e57fd6b2ae22ee774b77af7e475657a1ecc7a7a6b\": rpc error: code = NotFound desc = could not find container \"f8d4d0904553112f59b2358e57fd6b2ae22ee774b77af7e475657a1ecc7a7a6b\": container with ID starting with f8d4d0904553112f59b2358e57fd6b2ae22ee774b77af7e475657a1ecc7a7a6b not found: ID does not exist"
Jul 23 00:46:18.152000 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:18.151979    2549 scope.go:117] "RemoveContainer" containerID="d2edf8106a8c5835fd4bf956314129a2e683d15fedee39a108ec9e711be45a17"
Jul 23 00:46:18.152237 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:46:18.152213    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2edf8106a8c5835fd4bf956314129a2e683d15fedee39a108ec9e711be45a17\": container with ID starting with d2edf8106a8c5835fd4bf956314129a2e683d15fedee39a108ec9e711be45a17 not found: ID does not exist" containerID="d2edf8106a8c5835fd4bf956314129a2e683d15fedee39a108ec9e711be45a17"
Jul 23 00:46:18.152300 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:18.152247    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2edf8106a8c5835fd4bf956314129a2e683d15fedee39a108ec9e711be45a17"} err="failed to get container status \"d2edf8106a8c5835fd4bf956314129a2e683d15fedee39a108ec9e711be45a17\": rpc error: code = NotFound desc = could not find container \"d2edf8106a8c5835fd4bf956314129a2e683d15fedee39a108ec9e711be45a17\": container with ID starting with d2edf8106a8c5835fd4bf956314129a2e683d15fedee39a108ec9e711be45a17 not found: ID does not exist"
Jul 23 00:46:18.156343 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:18.156322    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"]
Jul 23 00:46:18.162148 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:18.162130    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-e94467-openshift-default-699c8fff8c-2kg7b"]
Jul 23 00:46:19.803378 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:19.803342    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41ff2c02-f7c5-400d-bcc4-59c974126b44" path="/var/lib/kubelet/pods/41ff2c02-f7c5-400d-bcc4-59c974126b44/volumes"
Jul 23 00:46:23.391977 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:23.391942    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2f7578-57db84b4bb-lblpj"]
Jul 23 00:46:23.392505 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:23.392166    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2f7578-57db84b4bb-lblpj" podUID="317e519e-194f-471a-a21c-407a3bdc42a2" containerName="maas-api" containerID="cri-o://b5d8efda8d62eefc632a5f1d8e3383de14a072e3385fe31b422cd128a90dacfa" gracePeriod=30
Jul 23 00:46:23.652738 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:23.652673    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2f7578-57db84b4bb-lblpj"
Jul 23 00:46:23.681034 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:23.681007    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/317e519e-194f-471a-a21c-407a3bdc42a2-maas-api-tls\") pod \"317e519e-194f-471a-a21c-407a3bdc42a2\" (UID: \"317e519e-194f-471a-a21c-407a3bdc42a2\") "
Jul 23 00:46:23.681177 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:23.681061    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bbk8\" (UniqueName: \"kubernetes.io/projected/317e519e-194f-471a-a21c-407a3bdc42a2-kube-api-access-2bbk8\") pod \"317e519e-194f-471a-a21c-407a3bdc42a2\" (UID: \"317e519e-194f-471a-a21c-407a3bdc42a2\") "
Jul 23 00:46:23.681177 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:23.681149    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/317e519e-194f-471a-a21c-407a3bdc42a2-openshift-service-ca\") pod \"317e519e-194f-471a-a21c-407a3bdc42a2\" (UID: \"317e519e-194f-471a-a21c-407a3bdc42a2\") "
Jul 23 00:46:23.681603 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:23.681573    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/317e519e-194f-471a-a21c-407a3bdc42a2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "317e519e-194f-471a-a21c-407a3bdc42a2" (UID: "317e519e-194f-471a-a21c-407a3bdc42a2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:46:23.683189 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:23.683164    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/317e519e-194f-471a-a21c-407a3bdc42a2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "317e519e-194f-471a-a21c-407a3bdc42a2" (UID: "317e519e-194f-471a-a21c-407a3bdc42a2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 00:46:23.683266 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:23.683206    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/317e519e-194f-471a-a21c-407a3bdc42a2-kube-api-access-2bbk8" (OuterVolumeSpecName: "kube-api-access-2bbk8") pod "317e519e-194f-471a-a21c-407a3bdc42a2" (UID: "317e519e-194f-471a-a21c-407a3bdc42a2"). InnerVolumeSpecName "kube-api-access-2bbk8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:46:23.781982 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:23.781928    2549 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/317e519e-194f-471a-a21c-407a3bdc42a2-openshift-service-ca\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:46:23.781982 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:23.781975    2549 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/317e519e-194f-471a-a21c-407a3bdc42a2-maas-api-tls\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:46:23.781982 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:23.781985    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bbk8\" (UniqueName: \"kubernetes.io/projected/317e519e-194f-471a-a21c-407a3bdc42a2-kube-api-access-2bbk8\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:46:24.164106 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:24.164068    2549 generic.go:356] "Generic (PLEG): container finished" podID="317e519e-194f-471a-a21c-407a3bdc42a2" containerID="b5d8efda8d62eefc632a5f1d8e3383de14a072e3385fe31b422cd128a90dacfa" exitCode=0
Jul 23 00:46:24.164328 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:24.164111    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2f7578-57db84b4bb-lblpj"
Jul 23 00:46:24.164328 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:24.164140    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2f7578-57db84b4bb-lblpj" event={"ID":"317e519e-194f-471a-a21c-407a3bdc42a2","Type":"ContainerDied","Data":"b5d8efda8d62eefc632a5f1d8e3383de14a072e3385fe31b422cd128a90dacfa"}
Jul 23 00:46:24.164328 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:24.164191    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2f7578-57db84b4bb-lblpj" event={"ID":"317e519e-194f-471a-a21c-407a3bdc42a2","Type":"ContainerDied","Data":"04691550de604a2625b588fa954fde1beb337c35616025933551a5b7867332ab"}
Jul 23 00:46:24.164328 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:24.164221    2549 scope.go:117] "RemoveContainer" containerID="b5d8efda8d62eefc632a5f1d8e3383de14a072e3385fe31b422cd128a90dacfa"
Jul 23 00:46:24.172846 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:24.172825    2549 scope.go:117] "RemoveContainer" containerID="b5d8efda8d62eefc632a5f1d8e3383de14a072e3385fe31b422cd128a90dacfa"
Jul 23 00:46:24.173106 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:46:24.173076    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5d8efda8d62eefc632a5f1d8e3383de14a072e3385fe31b422cd128a90dacfa\": container with ID starting with b5d8efda8d62eefc632a5f1d8e3383de14a072e3385fe31b422cd128a90dacfa not found: ID does not exist" containerID="b5d8efda8d62eefc632a5f1d8e3383de14a072e3385fe31b422cd128a90dacfa"
Jul 23 00:46:24.173156 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:24.173114    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5d8efda8d62eefc632a5f1d8e3383de14a072e3385fe31b422cd128a90dacfa"} err="failed to get container status \"b5d8efda8d62eefc632a5f1d8e3383de14a072e3385fe31b422cd128a90dacfa\": rpc error: code = NotFound desc = could not find container \"b5d8efda8d62eefc632a5f1d8e3383de14a072e3385fe31b422cd128a90dacfa\": container with ID starting with b5d8efda8d62eefc632a5f1d8e3383de14a072e3385fe31b422cd128a90dacfa not found: ID does not exist"
Jul 23 00:46:24.181222 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:24.181200    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2f7578-57db84b4bb-lblpj"]
Jul 23 00:46:24.187347 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:24.187327    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2f7578-57db84b4bb-lblpj"]
Jul 23 00:46:25.802060 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:25.802025    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="317e519e-194f-471a-a21c-407a3bdc42a2" path="/var/lib/kubelet/pods/317e519e-194f-471a-a21c-407a3bdc42a2/volumes"
Jul 23 00:46:27.998288 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:27.998245    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f7578-hhqbx"]
Jul 23 00:46:28.001030 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:28.001001    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2f7578-hhqbx"]
Jul 23 00:46:29.803596 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:29.803560    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c4a9cbf-b123-4449-8e90-dd00ef5825cc" path="/var/lib/kubelet/pods/0c4a9cbf-b123-4449-8e90-dd00ef5825cc/volumes"
Jul 23 00:46:35.791524 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:35.791488    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"]
Jul 23 00:46:35.792096 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:35.792000    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="317e519e-194f-471a-a21c-407a3bdc42a2" containerName="maas-api"
Jul 23 00:46:35.792096 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:35.792016    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="317e519e-194f-471a-a21c-407a3bdc42a2" containerName="maas-api"
Jul 23 00:46:35.792096 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:35.792036    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41ff2c02-f7c5-400d-bcc4-59c974126b44" containerName="istio-proxy"
Jul 23 00:46:35.792096 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:35.792042    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="41ff2c02-f7c5-400d-bcc4-59c974126b44" containerName="istio-proxy"
Jul 23 00:46:35.792096 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:35.792050    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41ff2c02-f7c5-400d-bcc4-59c974126b44" containerName="istio-proxy"
Jul 23 00:46:35.792096 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:35.792055    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="41ff2c02-f7c5-400d-bcc4-59c974126b44" containerName="istio-proxy"
Jul 23 00:46:35.792096 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:35.792065    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c4a9cbf-b123-4449-8e90-dd00ef5825cc" containerName="revoke-keys"
Jul 23 00:46:35.792096 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:35.792070    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c4a9cbf-b123-4449-8e90-dd00ef5825cc" containerName="revoke-keys"
Jul 23 00:46:35.792510 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:35.792131    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="41ff2c02-f7c5-400d-bcc4-59c974126b44" containerName="istio-proxy"
Jul 23 00:46:35.792510 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:35.792140    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="41ff2c02-f7c5-400d-bcc4-59c974126b44" containerName="istio-proxy"
Jul 23 00:46:35.792510 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:35.792146    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c4a9cbf-b123-4449-8e90-dd00ef5825cc" containerName="revoke-keys"
Jul 23 00:46:35.792510 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:35.792152    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="317e519e-194f-471a-a21c-407a3bdc42a2" containerName="maas-api"
Jul 23 00:46:35.796073 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:35.796051    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"
Jul 23 00:46:35.798694 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:35.798668    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-1abde1-openshift-default-dockercfg-bhg8s\""
Jul 23 00:46:35.809723 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:35.809687    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"]
Jul 23 00:46:35.889300 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:35.889265    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a714a5c-ec1f-4531-8b86-d503ffae669e-istio-token\") pod \"e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt\" (UID: \"4a714a5c-ec1f-4531-8b86-d503ffae669e\") " pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"
Jul 23 00:46:35.889300 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:35.889315    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a714a5c-ec1f-4531-8b86-d503ffae669e-istio-envoy\") pod \"e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt\" (UID: \"4a714a5c-ec1f-4531-8b86-d503ffae669e\") " pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"
Jul 23 00:46:35.889596 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:35.889351    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a714a5c-ec1f-4531-8b86-d503ffae669e-workload-socket\") pod \"e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt\" (UID: \"4a714a5c-ec1f-4531-8b86-d503ffae669e\") " pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"
Jul 23 00:46:35.889596 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:35.889397    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a714a5c-ec1f-4531-8b86-d503ffae669e-workload-certs\") pod \"e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt\" (UID: \"4a714a5c-ec1f-4531-8b86-d503ffae669e\") " pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"
Jul 23 00:46:35.889596 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:35.889429    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a714a5c-ec1f-4531-8b86-d503ffae669e-istiod-ca-cert\") pod \"e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt\" (UID: \"4a714a5c-ec1f-4531-8b86-d503ffae669e\") " pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"
Jul 23 00:46:35.889596 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:35.889547    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a714a5c-ec1f-4531-8b86-d503ffae669e-istio-podinfo\") pod \"e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt\" (UID: \"4a714a5c-ec1f-4531-8b86-d503ffae669e\") " pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"
Jul 23 00:46:35.889868 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:35.889611    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a714a5c-ec1f-4531-8b86-d503ffae669e-credential-socket\") pod \"e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt\" (UID: \"4a714a5c-ec1f-4531-8b86-d503ffae669e\") " pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"
Jul 23 00:46:35.889868 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:35.889631    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkkc2\" (UniqueName: \"kubernetes.io/projected/4a714a5c-ec1f-4531-8b86-d503ffae669e-kube-api-access-hkkc2\") pod \"e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt\" (UID: \"4a714a5c-ec1f-4531-8b86-d503ffae669e\") " pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"
Jul 23 00:46:35.889868 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:35.889681    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a714a5c-ec1f-4531-8b86-d503ffae669e-istio-data\") pod \"e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt\" (UID: \"4a714a5c-ec1f-4531-8b86-d503ffae669e\") " pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"
Jul 23 00:46:35.990688 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:35.990650    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a714a5c-ec1f-4531-8b86-d503ffae669e-istio-podinfo\") pod \"e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt\" (UID: \"4a714a5c-ec1f-4531-8b86-d503ffae669e\") " pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"
Jul 23 00:46:35.990881 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:35.990705    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a714a5c-ec1f-4531-8b86-d503ffae669e-credential-socket\") pod \"e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt\" (UID: \"4a714a5c-ec1f-4531-8b86-d503ffae669e\") " pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"
Jul 23 00:46:35.990881 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:35.990724    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkkc2\" (UniqueName: \"kubernetes.io/projected/4a714a5c-ec1f-4531-8b86-d503ffae669e-kube-api-access-hkkc2\") pod \"e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt\" (UID: \"4a714a5c-ec1f-4531-8b86-d503ffae669e\") " pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"
Jul 23 00:46:35.990881 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:35.990750    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a714a5c-ec1f-4531-8b86-d503ffae669e-istio-data\") pod \"e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt\" (UID: \"4a714a5c-ec1f-4531-8b86-d503ffae669e\") " pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"
Jul 23 00:46:35.990881 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:35.990774    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a714a5c-ec1f-4531-8b86-d503ffae669e-istio-token\") pod \"e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt\" (UID: \"4a714a5c-ec1f-4531-8b86-d503ffae669e\") " pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"
Jul 23 00:46:35.990881 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:35.990792    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a714a5c-ec1f-4531-8b86-d503ffae669e-istio-envoy\") pod \"e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt\" (UID: \"4a714a5c-ec1f-4531-8b86-d503ffae669e\") " pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"
Jul 23 00:46:35.990881 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:35.990820    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a714a5c-ec1f-4531-8b86-d503ffae669e-workload-socket\") pod \"e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt\" (UID: \"4a714a5c-ec1f-4531-8b86-d503ffae669e\") " pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"
Jul 23 00:46:35.990881 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:35.990854    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a714a5c-ec1f-4531-8b86-d503ffae669e-workload-certs\") pod \"e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt\" (UID: \"4a714a5c-ec1f-4531-8b86-d503ffae669e\") " pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"
Jul 23 00:46:35.991274 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:35.990894    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a714a5c-ec1f-4531-8b86-d503ffae669e-istiod-ca-cert\") pod \"e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt\" (UID: \"4a714a5c-ec1f-4531-8b86-d503ffae669e\") " pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"
Jul 23 00:46:35.991274 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:35.991244    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a714a5c-ec1f-4531-8b86-d503ffae669e-credential-socket\") pod \"e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt\" (UID: \"4a714a5c-ec1f-4531-8b86-d503ffae669e\") " pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"
Jul 23 00:46:35.991419 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:35.991283    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a714a5c-ec1f-4531-8b86-d503ffae669e-istio-data\") pod \"e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt\" (UID: \"4a714a5c-ec1f-4531-8b86-d503ffae669e\") " pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"
Jul 23 00:46:35.991567 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:35.991544    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a714a5c-ec1f-4531-8b86-d503ffae669e-workload-certs\") pod \"e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt\" (UID: \"4a714a5c-ec1f-4531-8b86-d503ffae669e\") " pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"
Jul 23 00:46:35.991643 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:35.991609    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a714a5c-ec1f-4531-8b86-d503ffae669e-workload-socket\") pod \"e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt\" (UID: \"4a714a5c-ec1f-4531-8b86-d503ffae669e\") " pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"
Jul 23 00:46:35.991905 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:35.991879    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a714a5c-ec1f-4531-8b86-d503ffae669e-istiod-ca-cert\") pod \"e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt\" (UID: \"4a714a5c-ec1f-4531-8b86-d503ffae669e\") " pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"
Jul 23 00:46:35.993208 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:35.993181    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a714a5c-ec1f-4531-8b86-d503ffae669e-istio-envoy\") pod \"e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt\" (UID: \"4a714a5c-ec1f-4531-8b86-d503ffae669e\") " pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"
Jul 23 00:46:35.993394 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:35.993372    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a714a5c-ec1f-4531-8b86-d503ffae669e-istio-podinfo\") pod \"e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt\" (UID: \"4a714a5c-ec1f-4531-8b86-d503ffae669e\") " pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"
Jul 23 00:46:36.001241 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:36.001213    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkkc2\" (UniqueName: \"kubernetes.io/projected/4a714a5c-ec1f-4531-8b86-d503ffae669e-kube-api-access-hkkc2\") pod \"e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt\" (UID: \"4a714a5c-ec1f-4531-8b86-d503ffae669e\") " pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"
Jul 23 00:46:36.001647 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:36.001630    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a714a5c-ec1f-4531-8b86-d503ffae669e-istio-token\") pod \"e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt\" (UID: \"4a714a5c-ec1f-4531-8b86-d503ffae669e\") " pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"
Jul 23 00:46:36.107697 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:36.107663    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"
Jul 23 00:46:36.245158 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:36.245129    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"]
Jul 23 00:46:36.246952 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:46:36.246929    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a714a5c_ec1f_4531_8b86_d503ffae669e.slice/crio-1d83bb3f643c0c4650b7f0d6440c33abba0f6124c3170f139c7b7ffb90f3ba26 WatchSource:0}: Error finding container 1d83bb3f643c0c4650b7f0d6440c33abba0f6124c3170f139c7b7ffb90f3ba26: Status 404 returned error can't find the container with id 1d83bb3f643c0c4650b7f0d6440c33abba0f6124c3170f139c7b7ffb90f3ba26
Jul 23 00:46:36.248956 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:36.248925    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:46:36.249040 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:36.248987    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:46:36.249040 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:36.249016    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:46:37.234690 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:37.234652    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt" event={"ID":"4a714a5c-ec1f-4531-8b86-d503ffae669e","Type":"ContainerStarted","Data":"a0c5d56d36a2e8e4e6cf818742210cfe2fae353b28a182260f8c5562b2fb5121"}
Jul 23 00:46:37.235083 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:37.234704    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt" event={"ID":"4a714a5c-ec1f-4531-8b86-d503ffae669e","Type":"ContainerStarted","Data":"1d83bb3f643c0c4650b7f0d6440c33abba0f6124c3170f139c7b7ffb90f3ba26"}
Jul 23 00:46:37.262422 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:37.262369    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt" podStartSLOduration=2.26235394 podStartE2EDuration="2.26235394s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:46:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:46:37.259840601 +0000 UTC m=+2540.021038911" watchObservedRunningTime="2026-07-23 00:46:37.26235394 +0000 UTC m=+2540.023552250"
Jul 23 00:46:38.108253 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:38.108211    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"
Jul 23 00:46:38.113696 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:38.113669    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"
Jul 23 00:46:38.240334 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:38.240297    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"
Jul 23 00:46:38.241231 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:38.241211    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"
Jul 23 00:46:39.349435 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:39.349402    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1abde1-d6bccc4fc-74qzl"]
Jul 23 00:46:39.352665 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:39.352645    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1abde1-d6bccc4fc-74qzl"
Jul 23 00:46:39.355588 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:39.355565    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-1abde1-serving-cert\""
Jul 23 00:46:39.364928 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:39.364905    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1abde1-d6bccc4fc-74qzl"]
Jul 23 00:46:39.426620 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:39.426591    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee6d67e3-dec4-4fac-9044-7b060cd96563-maas-api-tls\") pod \"maas-api-e2e-api-a-1abde1-d6bccc4fc-74qzl\" (UID: \"ee6d67e3-dec4-4fac-9044-7b060cd96563\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1abde1-d6bccc4fc-74qzl"
Jul 23 00:46:39.426766 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:39.426655    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t56d5\" (UniqueName: \"kubernetes.io/projected/ee6d67e3-dec4-4fac-9044-7b060cd96563-kube-api-access-t56d5\") pod \"maas-api-e2e-api-a-1abde1-d6bccc4fc-74qzl\" (UID: \"ee6d67e3-dec4-4fac-9044-7b060cd96563\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1abde1-d6bccc4fc-74qzl"
Jul 23 00:46:39.426766 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:39.426709    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee6d67e3-dec4-4fac-9044-7b060cd96563-openshift-service-ca\") pod \"maas-api-e2e-api-a-1abde1-d6bccc4fc-74qzl\" (UID: \"ee6d67e3-dec4-4fac-9044-7b060cd96563\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1abde1-d6bccc4fc-74qzl"
Jul 23 00:46:39.527971 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:39.527932    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee6d67e3-dec4-4fac-9044-7b060cd96563-maas-api-tls\") pod \"maas-api-e2e-api-a-1abde1-d6bccc4fc-74qzl\" (UID: \"ee6d67e3-dec4-4fac-9044-7b060cd96563\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1abde1-d6bccc4fc-74qzl"
Jul 23 00:46:39.528172 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:39.528021    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t56d5\" (UniqueName: \"kubernetes.io/projected/ee6d67e3-dec4-4fac-9044-7b060cd96563-kube-api-access-t56d5\") pod \"maas-api-e2e-api-a-1abde1-d6bccc4fc-74qzl\" (UID: \"ee6d67e3-dec4-4fac-9044-7b060cd96563\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1abde1-d6bccc4fc-74qzl"
Jul 23 00:46:39.528172 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:39.528078    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee6d67e3-dec4-4fac-9044-7b060cd96563-openshift-service-ca\") pod \"maas-api-e2e-api-a-1abde1-d6bccc4fc-74qzl\" (UID: \"ee6d67e3-dec4-4fac-9044-7b060cd96563\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1abde1-d6bccc4fc-74qzl"
Jul 23 00:46:39.528815 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:39.528792    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee6d67e3-dec4-4fac-9044-7b060cd96563-openshift-service-ca\") pod \"maas-api-e2e-api-a-1abde1-d6bccc4fc-74qzl\" (UID: \"ee6d67e3-dec4-4fac-9044-7b060cd96563\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1abde1-d6bccc4fc-74qzl"
Jul 23 00:46:39.533308 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:39.533278    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee6d67e3-dec4-4fac-9044-7b060cd96563-maas-api-tls\") pod \"maas-api-e2e-api-a-1abde1-d6bccc4fc-74qzl\" (UID: \"ee6d67e3-dec4-4fac-9044-7b060cd96563\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1abde1-d6bccc4fc-74qzl"
Jul 23 00:46:39.537502 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:39.537478    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t56d5\" (UniqueName: \"kubernetes.io/projected/ee6d67e3-dec4-4fac-9044-7b060cd96563-kube-api-access-t56d5\") pod \"maas-api-e2e-api-a-1abde1-d6bccc4fc-74qzl\" (UID: \"ee6d67e3-dec4-4fac-9044-7b060cd96563\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1abde1-d6bccc4fc-74qzl"
Jul 23 00:46:39.663344 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:39.663278    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1abde1-d6bccc4fc-74qzl"
Jul 23 00:46:39.810871 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:39.810846    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1abde1-d6bccc4fc-74qzl"]
Jul 23 00:46:39.813069 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:46:39.813040    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee6d67e3_dec4_4fac_9044_7b060cd96563.slice/crio-4b7d77ed084a61810f119c0b831770556853e519c54fae1743d56844654f1703 WatchSource:0}: Error finding container 4b7d77ed084a61810f119c0b831770556853e519c54fae1743d56844654f1703: Status 404 returned error can't find the container with id 4b7d77ed084a61810f119c0b831770556853e519c54fae1743d56844654f1703
Jul 23 00:46:39.814495 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:39.814440    2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 00:46:40.253978 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:40.253937    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1abde1-d6bccc4fc-74qzl" event={"ID":"ee6d67e3-dec4-4fac-9044-7b060cd96563","Type":"ContainerStarted","Data":"4b7d77ed084a61810f119c0b831770556853e519c54fae1743d56844654f1703"}
Jul 23 00:46:41.261018 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:41.260982    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1abde1-d6bccc4fc-74qzl" event={"ID":"ee6d67e3-dec4-4fac-9044-7b060cd96563","Type":"ContainerStarted","Data":"98f22ff91b0d2429fdcbe4beb891fdb43886242df1762e34b6d45bba89a86ad6"}
Jul 23 00:46:41.261478 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:41.261113    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1abde1-d6bccc4fc-74qzl"
Jul 23 00:46:41.310115 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:41.310061    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1abde1-d6bccc4fc-74qzl" podStartSLOduration=1.9233649769999999 podStartE2EDuration="2.310045264s" totalImagesPullingTime="386.680287ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:46:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:46:41.309041688 +0000 UTC m=+2544.070239997" watchObservedRunningTime="2026-07-23 00:46:41.310045264 +0000 UTC m=+2544.071243612"
Jul 23 00:46:47.271753 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:47.271724    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1abde1-d6bccc4fc-74qzl"
Jul 23 00:46:47.535231 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:47.535149    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-00cf30-7447f6444b-z8p82"]
Jul 23 00:46:47.539058 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:47.539031    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00cf30-7447f6444b-z8p82"
Jul 23 00:46:47.541687 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:47.541665    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-00cf30-serving-cert\""
Jul 23 00:46:47.557748 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:47.557723    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-00cf30-7447f6444b-z8p82"]
Jul 23 00:46:47.710844 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:47.710793    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4qg8\" (UniqueName: \"kubernetes.io/projected/df5f1a58-5cd3-4f16-87ff-d135b973c337-kube-api-access-p4qg8\") pod \"maas-api-e2e-api-b-00cf30-7447f6444b-z8p82\" (UID: \"df5f1a58-5cd3-4f16-87ff-d135b973c337\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00cf30-7447f6444b-z8p82"
Jul 23 00:46:47.711071 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:47.710868    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df5f1a58-5cd3-4f16-87ff-d135b973c337-openshift-service-ca\") pod \"maas-api-e2e-api-b-00cf30-7447f6444b-z8p82\" (UID: \"df5f1a58-5cd3-4f16-87ff-d135b973c337\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00cf30-7447f6444b-z8p82"
Jul 23 00:46:47.711071 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:47.710949    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df5f1a58-5cd3-4f16-87ff-d135b973c337-maas-api-tls\") pod \"maas-api-e2e-api-b-00cf30-7447f6444b-z8p82\" (UID: \"df5f1a58-5cd3-4f16-87ff-d135b973c337\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00cf30-7447f6444b-z8p82"
Jul 23 00:46:47.812276 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:47.812242    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4qg8\" (UniqueName: \"kubernetes.io/projected/df5f1a58-5cd3-4f16-87ff-d135b973c337-kube-api-access-p4qg8\") pod \"maas-api-e2e-api-b-00cf30-7447f6444b-z8p82\" (UID: \"df5f1a58-5cd3-4f16-87ff-d135b973c337\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00cf30-7447f6444b-z8p82"
Jul 23 00:46:47.812541 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:47.812309    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df5f1a58-5cd3-4f16-87ff-d135b973c337-openshift-service-ca\") pod \"maas-api-e2e-api-b-00cf30-7447f6444b-z8p82\" (UID: \"df5f1a58-5cd3-4f16-87ff-d135b973c337\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00cf30-7447f6444b-z8p82"
Jul 23 00:46:47.812541 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:47.812377    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df5f1a58-5cd3-4f16-87ff-d135b973c337-maas-api-tls\") pod \"maas-api-e2e-api-b-00cf30-7447f6444b-z8p82\" (UID: \"df5f1a58-5cd3-4f16-87ff-d135b973c337\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00cf30-7447f6444b-z8p82"
Jul 23 00:46:47.812541 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:46:47.812528    2549 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-00cf30-serving-cert: secret "maas-api-e2e-api-b-00cf30-serving-cert" not found
Jul 23 00:46:47.812736 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:46:47.812590    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df5f1a58-5cd3-4f16-87ff-d135b973c337-maas-api-tls podName:df5f1a58-5cd3-4f16-87ff-d135b973c337 nodeName:}" failed. No retries permitted until 2026-07-23 00:46:48.312568768 +0000 UTC m=+2551.073767058 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/df5f1a58-5cd3-4f16-87ff-d135b973c337-maas-api-tls") pod "maas-api-e2e-api-b-00cf30-7447f6444b-z8p82" (UID: "df5f1a58-5cd3-4f16-87ff-d135b973c337") : secret "maas-api-e2e-api-b-00cf30-serving-cert" not found
Jul 23 00:46:47.813354 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:47.813326    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df5f1a58-5cd3-4f16-87ff-d135b973c337-openshift-service-ca\") pod \"maas-api-e2e-api-b-00cf30-7447f6444b-z8p82\" (UID: \"df5f1a58-5cd3-4f16-87ff-d135b973c337\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00cf30-7447f6444b-z8p82"
Jul 23 00:46:47.823233 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:47.823203    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4qg8\" (UniqueName: \"kubernetes.io/projected/df5f1a58-5cd3-4f16-87ff-d135b973c337-kube-api-access-p4qg8\") pod \"maas-api-e2e-api-b-00cf30-7447f6444b-z8p82\" (UID: \"df5f1a58-5cd3-4f16-87ff-d135b973c337\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00cf30-7447f6444b-z8p82"
Jul 23 00:46:48.316343 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:48.316306    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df5f1a58-5cd3-4f16-87ff-d135b973c337-maas-api-tls\") pod \"maas-api-e2e-api-b-00cf30-7447f6444b-z8p82\" (UID: \"df5f1a58-5cd3-4f16-87ff-d135b973c337\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00cf30-7447f6444b-z8p82"
Jul 23 00:46:48.318815 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:48.318790    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df5f1a58-5cd3-4f16-87ff-d135b973c337-maas-api-tls\") pod \"maas-api-e2e-api-b-00cf30-7447f6444b-z8p82\" (UID: \"df5f1a58-5cd3-4f16-87ff-d135b973c337\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00cf30-7447f6444b-z8p82"
Jul 23 00:46:48.453039 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:48.452998    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00cf30-7447f6444b-z8p82"
Jul 23 00:46:48.644048 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:48.644021    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-00cf30-7447f6444b-z8p82"]
Jul 23 00:46:48.645917 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:46:48.645866    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf5f1a58_5cd3_4f16_87ff_d135b973c337.slice/crio-313d52b37158f6b3cd8a0caf26c623be69309e6ceae1ce2a2428dda197584e41 WatchSource:0}: Error finding container 313d52b37158f6b3cd8a0caf26c623be69309e6ceae1ce2a2428dda197584e41: Status 404 returned error can't find the container with id 313d52b37158f6b3cd8a0caf26c623be69309e6ceae1ce2a2428dda197584e41
Jul 23 00:46:49.309659 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:49.309562    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00cf30-7447f6444b-z8p82" event={"ID":"df5f1a58-5cd3-4f16-87ff-d135b973c337","Type":"ContainerStarted","Data":"65ec3114e034f403520c9193be0b99e32f7c3ad5ea55816cc47d484554f82c02"}
Jul 23 00:46:49.309659 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:49.309634    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00cf30-7447f6444b-z8p82" event={"ID":"df5f1a58-5cd3-4f16-87ff-d135b973c337","Type":"ContainerStarted","Data":"313d52b37158f6b3cd8a0caf26c623be69309e6ceae1ce2a2428dda197584e41"}
Jul 23 00:46:49.310501 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:49.310474    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00cf30-7447f6444b-z8p82"
Jul 23 00:46:49.368346 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:49.368301    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00cf30-7447f6444b-z8p82" podStartSLOduration=2.059101005 podStartE2EDuration="2.368287894s" totalImagesPullingTime="309.186889ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:46:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:46:49.364984884 +0000 UTC m=+2552.126183194" watchObservedRunningTime="2026-07-23 00:46:49.368287894 +0000 UTC m=+2552.129486204"
Jul 23 00:46:53.242483 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:53.242364    2549 patch_prober.go:28] interesting pod/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 23 00:46:53.242483 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:53.242417    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt" podUID="4a714a5c-ec1f-4531-8b86-d503ffae669e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 23 00:46:53.338216 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:53.338185    2549 generic.go:356] "Generic (PLEG): container finished" podID="4a714a5c-ec1f-4531-8b86-d503ffae669e" containerID="a0c5d56d36a2e8e4e6cf818742210cfe2fae353b28a182260f8c5562b2fb5121" exitCode=0
Jul 23 00:46:53.338356 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:53.338248    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt" event={"ID":"4a714a5c-ec1f-4531-8b86-d503ffae669e","Type":"ContainerDied","Data":"a0c5d56d36a2e8e4e6cf818742210cfe2fae353b28a182260f8c5562b2fb5121"}
Jul 23 00:46:53.338640 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:53.338626    2549 scope.go:117] "RemoveContainer" containerID="a0c5d56d36a2e8e4e6cf818742210cfe2fae353b28a182260f8c5562b2fb5121"
Jul 23 00:46:53.339725 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:53.339674    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:46:53.339804 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:53.339769    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:46:53.339804 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:53.339799    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:46:54.345513 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:54.345480    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt" event={"ID":"4a714a5c-ec1f-4531-8b86-d503ffae669e","Type":"ContainerStarted","Data":"41f65cffe370fc51c209ceaa7ccbefc56bfc3b81fca9a8e0a42293b558cae74c"}
Jul 23 00:46:55.108303 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:55.108259    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"
Jul 23 00:46:55.108625 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:55.108589    2549 patch_prober.go:28] interesting pod/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 23 00:46:55.108718 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:55.108663    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt" podUID="4a714a5c-ec1f-4531-8b86-d503ffae669e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 23 00:46:56.108287 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:56.108251    2549 patch_prober.go:28] interesting pod/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 23 00:46:56.109364 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:56.109327    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt" podUID="4a714a5c-ec1f-4531-8b86-d503ffae669e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 23 00:46:56.331575 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:56.331545    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00cf30-7447f6444b-z8p82"
Jul 23 00:46:57.108531 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:57.108490    2549 patch_prober.go:28] interesting pod/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 23 00:46:57.109018 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:57.108556    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt" podUID="4a714a5c-ec1f-4531-8b86-d503ffae669e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 23 00:46:58.109115 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:58.109070    2549 patch_prober.go:28] interesting pod/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 23 00:46:58.109650 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:58.109147    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt" podUID="4a714a5c-ec1f-4531-8b86-d503ffae669e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 23 00:46:59.111901 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:59.111868    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"
Jul 23 00:46:59.112270 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:59.112128    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"
Jul 23 00:46:59.112907 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:46:59.112891    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"
Jul 23 00:47:00.214402 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:00.214368    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1abde1-ktggb"]
Jul 23 00:47:00.218176 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:00.218157    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1abde1-ktggb"
Jul 23 00:47:00.220615 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:00.220593    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5dc6x\""
Jul 23 00:47:00.227330 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:00.227307    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1abde1-ktggb"]
Jul 23 00:47:00.340055 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:00.340017    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c930942e-193d-4909-84d9-ff001f2a4c0c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-1abde1-ktggb\" (UID: \"c930942e-193d-4909-84d9-ff001f2a4c0c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1abde1-ktggb"
Jul 23 00:47:00.441074 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:00.441042    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c930942e-193d-4909-84d9-ff001f2a4c0c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-1abde1-ktggb\" (UID: \"c930942e-193d-4909-84d9-ff001f2a4c0c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1abde1-ktggb"
Jul 23 00:47:00.441682 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:00.441661    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c930942e-193d-4909-84d9-ff001f2a4c0c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-1abde1-ktggb\" (UID: \"c930942e-193d-4909-84d9-ff001f2a4c0c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1abde1-ktggb"
Jul 23 00:47:00.530547 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:00.530477    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1abde1-ktggb"
Jul 23 00:47:00.662618 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:00.662575    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1abde1-ktggb"]
Jul 23 00:47:01.381997 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:01.381954    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1abde1-ktggb" event={"ID":"c930942e-193d-4909-84d9-ff001f2a4c0c","Type":"ContainerStarted","Data":"073d112bd803048a9235ae2ec9f08d36252152213d1592b69e81fcae3f14440d"}
Jul 23 00:47:01.382392 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:01.382011    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1abde1-ktggb" event={"ID":"c930942e-193d-4909-84d9-ff001f2a4c0c","Type":"ContainerStarted","Data":"b4155fac36eacd47f483cc3d5ff2fd3fd3bd2e4bb0cf0ad907968a95abe5e2a5"}
Jul 23 00:47:01.416545 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:01.416493    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1abde1-ktggb" podStartSLOduration=1.416476861 podStartE2EDuration="1.416476861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:47:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:47:01.41435836 +0000 UTC m=+2564.175556670" watchObservedRunningTime="2026-07-23 00:47:01.416476861 +0000 UTC m=+2564.177675168"
Jul 23 00:47:02.388784 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:02.388751    2549 generic.go:356] "Generic (PLEG): container finished" podID="c930942e-193d-4909-84d9-ff001f2a4c0c" containerID="073d112bd803048a9235ae2ec9f08d36252152213d1592b69e81fcae3f14440d" exitCode=0
Jul 23 00:47:02.389149 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:02.388812    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1abde1-ktggb" event={"ID":"c930942e-193d-4909-84d9-ff001f2a4c0c","Type":"ContainerDied","Data":"073d112bd803048a9235ae2ec9f08d36252152213d1592b69e81fcae3f14440d"}
Jul 23 00:47:03.528273 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:03.528248    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1abde1-ktggb"
Jul 23 00:47:03.567460 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:03.567405    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c930942e-193d-4909-84d9-ff001f2a4c0c-maas-api-service-ca\") pod \"c930942e-193d-4909-84d9-ff001f2a4c0c\" (UID: \"c930942e-193d-4909-84d9-ff001f2a4c0c\") "
Jul 23 00:47:03.567927 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:03.567791    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c930942e-193d-4909-84d9-ff001f2a4c0c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c930942e-193d-4909-84d9-ff001f2a4c0c" (UID: "c930942e-193d-4909-84d9-ff001f2a4c0c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:47:03.669052 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:03.668967    2549 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c930942e-193d-4909-84d9-ff001f2a4c0c-maas-api-service-ca\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:47:04.400556 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:04.400526    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1abde1-ktggb"
Jul 23 00:47:04.400727 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:04.400556    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1abde1-ktggb" event={"ID":"c930942e-193d-4909-84d9-ff001f2a4c0c","Type":"ContainerDied","Data":"b4155fac36eacd47f483cc3d5ff2fd3fd3bd2e4bb0cf0ad907968a95abe5e2a5"}
Jul 23 00:47:04.400727 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:04.400597    2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b4155fac36eacd47f483cc3d5ff2fd3fd3bd2e4bb0cf0ad907968a95abe5e2a5"
Jul 23 00:47:16.074767 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:16.074728    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1abde1-d6bccc4fc-74qzl"]
Jul 23 00:47:16.075255 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:16.074964    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1abde1-d6bccc4fc-74qzl" podUID="ee6d67e3-dec4-4fac-9044-7b060cd96563" containerName="maas-api" containerID="cri-o://98f22ff91b0d2429fdcbe4beb891fdb43886242df1762e34b6d45bba89a86ad6" gracePeriod=30
Jul 23 00:47:16.366103 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:16.366077    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1abde1-d6bccc4fc-74qzl"
Jul 23 00:47:16.462309 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:16.462273    2549 generic.go:356] "Generic (PLEG): container finished" podID="ee6d67e3-dec4-4fac-9044-7b060cd96563" containerID="98f22ff91b0d2429fdcbe4beb891fdb43886242df1762e34b6d45bba89a86ad6" exitCode=0
Jul 23 00:47:16.462508 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:16.462315    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1abde1-d6bccc4fc-74qzl"
Jul 23 00:47:16.462508 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:16.462360    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1abde1-d6bccc4fc-74qzl" event={"ID":"ee6d67e3-dec4-4fac-9044-7b060cd96563","Type":"ContainerDied","Data":"98f22ff91b0d2429fdcbe4beb891fdb43886242df1762e34b6d45bba89a86ad6"}
Jul 23 00:47:16.462508 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:16.462415    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1abde1-d6bccc4fc-74qzl" event={"ID":"ee6d67e3-dec4-4fac-9044-7b060cd96563","Type":"ContainerDied","Data":"4b7d77ed084a61810f119c0b831770556853e519c54fae1743d56844654f1703"}
Jul 23 00:47:16.462508 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:16.462445    2549 scope.go:117] "RemoveContainer" containerID="98f22ff91b0d2429fdcbe4beb891fdb43886242df1762e34b6d45bba89a86ad6"
Jul 23 00:47:16.470769 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:16.470752    2549 scope.go:117] "RemoveContainer" containerID="98f22ff91b0d2429fdcbe4beb891fdb43886242df1762e34b6d45bba89a86ad6"
Jul 23 00:47:16.471021 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:47:16.471004    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98f22ff91b0d2429fdcbe4beb891fdb43886242df1762e34b6d45bba89a86ad6\": container with ID starting with 98f22ff91b0d2429fdcbe4beb891fdb43886242df1762e34b6d45bba89a86ad6 not found: ID does not exist" containerID="98f22ff91b0d2429fdcbe4beb891fdb43886242df1762e34b6d45bba89a86ad6"
Jul 23 00:47:16.471067 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:16.471029    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98f22ff91b0d2429fdcbe4beb891fdb43886242df1762e34b6d45bba89a86ad6"} err="failed to get container status \"98f22ff91b0d2429fdcbe4beb891fdb43886242df1762e34b6d45bba89a86ad6\": rpc error: code = NotFound desc = could not find container \"98f22ff91b0d2429fdcbe4beb891fdb43886242df1762e34b6d45bba89a86ad6\": container with ID starting with 98f22ff91b0d2429fdcbe4beb891fdb43886242df1762e34b6d45bba89a86ad6 not found: ID does not exist"
Jul 23 00:47:16.489395 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:16.489374    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee6d67e3-dec4-4fac-9044-7b060cd96563-maas-api-tls\") pod \"ee6d67e3-dec4-4fac-9044-7b060cd96563\" (UID: \"ee6d67e3-dec4-4fac-9044-7b060cd96563\") "
Jul 23 00:47:16.489508 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:16.489400    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t56d5\" (UniqueName: \"kubernetes.io/projected/ee6d67e3-dec4-4fac-9044-7b060cd96563-kube-api-access-t56d5\") pod \"ee6d67e3-dec4-4fac-9044-7b060cd96563\" (UID: \"ee6d67e3-dec4-4fac-9044-7b060cd96563\") "
Jul 23 00:47:16.489508 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:16.489474    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee6d67e3-dec4-4fac-9044-7b060cd96563-openshift-service-ca\") pod \"ee6d67e3-dec4-4fac-9044-7b060cd96563\" (UID: \"ee6d67e3-dec4-4fac-9044-7b060cd96563\") "
Jul 23 00:47:16.489854 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:16.489818    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee6d67e3-dec4-4fac-9044-7b060cd96563-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ee6d67e3-dec4-4fac-9044-7b060cd96563" (UID: "ee6d67e3-dec4-4fac-9044-7b060cd96563"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:47:16.491546 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:16.491520    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee6d67e3-dec4-4fac-9044-7b060cd96563-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ee6d67e3-dec4-4fac-9044-7b060cd96563" (UID: "ee6d67e3-dec4-4fac-9044-7b060cd96563"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 00:47:16.491652 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:16.491634    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee6d67e3-dec4-4fac-9044-7b060cd96563-kube-api-access-t56d5" (OuterVolumeSpecName: "kube-api-access-t56d5") pod "ee6d67e3-dec4-4fac-9044-7b060cd96563" (UID: "ee6d67e3-dec4-4fac-9044-7b060cd96563"). InnerVolumeSpecName "kube-api-access-t56d5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:47:16.590370 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:16.590339    2549 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee6d67e3-dec4-4fac-9044-7b060cd96563-maas-api-tls\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:47:16.590488 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:16.590376    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t56d5\" (UniqueName: \"kubernetes.io/projected/ee6d67e3-dec4-4fac-9044-7b060cd96563-kube-api-access-t56d5\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:47:16.590488 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:16.590393    2549 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee6d67e3-dec4-4fac-9044-7b060cd96563-openshift-service-ca\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:47:16.794538 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:16.794506    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1abde1-d6bccc4fc-74qzl"]
Jul 23 00:47:16.799399 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:16.799376    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1abde1-d6bccc4fc-74qzl"]
Jul 23 00:47:17.803190 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:17.803155    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee6d67e3-dec4-4fac-9044-7b060cd96563" path="/var/lib/kubelet/pods/ee6d67e3-dec4-4fac-9044-7b060cd96563/volumes"
Jul 23 00:47:20.312304 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:20.312267    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1abde1-ktggb"]
Jul 23 00:47:20.315518 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:20.315488    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1abde1-ktggb"]
Jul 23 00:47:21.802486 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:21.802433    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c930942e-193d-4909-84d9-ff001f2a4c0c" path="/var/lib/kubelet/pods/c930942e-193d-4909-84d9-ff001f2a4c0c/volumes"
Jul 23 00:47:27.663417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:27.663386    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"]
Jul 23 00:47:27.663847 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:27.663602    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt" podUID="4a714a5c-ec1f-4531-8b86-d503ffae669e" containerName="istio-proxy" containerID="cri-o://41f65cffe370fc51c209ceaa7ccbefc56bfc3b81fca9a8e0a42293b558cae74c" gracePeriod=30
Jul 23 00:47:28.056319 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:28.056234    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-00cf30-xrhp2"]
Jul 23 00:47:28.056613 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:28.056600    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c930942e-193d-4909-84d9-ff001f2a4c0c" containerName="revoke-keys"
Jul 23 00:47:28.056661 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:28.056617    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="c930942e-193d-4909-84d9-ff001f2a4c0c" containerName="revoke-keys"
Jul 23 00:47:28.056661 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:28.056629    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee6d67e3-dec4-4fac-9044-7b060cd96563" containerName="maas-api"
Jul 23 00:47:28.056661 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:28.056634    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee6d67e3-dec4-4fac-9044-7b060cd96563" containerName="maas-api"
Jul 23 00:47:28.056759 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:28.056690    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee6d67e3-dec4-4fac-9044-7b060cd96563" containerName="maas-api"
Jul 23 00:47:28.056759 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:28.056702    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="c930942e-193d-4909-84d9-ff001f2a4c0c" containerName="revoke-keys"
Jul 23 00:47:28.059682 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:28.059662    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-00cf30-xrhp2"
Jul 23 00:47:28.062133 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:28.062111    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5dc6x\""
Jul 23 00:47:28.068330 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:28.068308    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-00cf30-xrhp2"]
Jul 23 00:47:28.201036 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:28.201003    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d13e5ba-d75d-4f63-8e19-693aa5e10eed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-00cf30-xrhp2\" (UID: \"8d13e5ba-d75d-4f63-8e19-693aa5e10eed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-00cf30-xrhp2"
Jul 23 00:47:28.302411 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:28.302317    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d13e5ba-d75d-4f63-8e19-693aa5e10eed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-00cf30-xrhp2\" (UID: \"8d13e5ba-d75d-4f63-8e19-693aa5e10eed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-00cf30-xrhp2"
Jul 23 00:47:28.302991 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:28.302968    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d13e5ba-d75d-4f63-8e19-693aa5e10eed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-00cf30-xrhp2\" (UID: \"8d13e5ba-d75d-4f63-8e19-693aa5e10eed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-00cf30-xrhp2"
Jul 23 00:47:28.371129 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:28.371106    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-00cf30-xrhp2"
Jul 23 00:47:28.506143 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:28.506115    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-00cf30-xrhp2"]
Jul 23 00:47:28.508509 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:47:28.508482    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d13e5ba_d75d_4f63_8e19_693aa5e10eed.slice/crio-7dd7b0cc847983ec719dd171e1fcd3efab4a33ea886daceaa66513242ba91140 WatchSource:0}: Error finding container 7dd7b0cc847983ec719dd171e1fcd3efab4a33ea886daceaa66513242ba91140: Status 404 returned error can't find the container with id 7dd7b0cc847983ec719dd171e1fcd3efab4a33ea886daceaa66513242ba91140
Jul 23 00:47:28.523799 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:28.523768    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-00cf30-xrhp2" event={"ID":"8d13e5ba-d75d-4f63-8e19-693aa5e10eed","Type":"ContainerStarted","Data":"7dd7b0cc847983ec719dd171e1fcd3efab4a33ea886daceaa66513242ba91140"}
Jul 23 00:47:29.115086 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:29.115048    2549 patch_prober.go:28] interesting pod/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 00:47:29.115480 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:29.115117    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt" podUID="4a714a5c-ec1f-4531-8b86-d503ffae669e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 00:47:29.530870 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:29.530769    2549 generic.go:356] "Generic (PLEG): container finished" podID="8d13e5ba-d75d-4f63-8e19-693aa5e10eed" containerID="06627254cb09ba214b52bb327aea05879b4bb91fab8af7cb12e0f1a4fb25aa2a" exitCode=0
Jul 23 00:47:29.530870 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:29.530858    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-00cf30-xrhp2" event={"ID":"8d13e5ba-d75d-4f63-8e19-693aa5e10eed","Type":"ContainerDied","Data":"06627254cb09ba214b52bb327aea05879b4bb91fab8af7cb12e0f1a4fb25aa2a"}
Jul 23 00:47:30.667258 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:30.667235    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-00cf30-xrhp2"
Jul 23 00:47:30.826191 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:30.826158    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d13e5ba-d75d-4f63-8e19-693aa5e10eed-maas-api-service-ca\") pod \"8d13e5ba-d75d-4f63-8e19-693aa5e10eed\" (UID: \"8d13e5ba-d75d-4f63-8e19-693aa5e10eed\") "
Jul 23 00:47:30.826446 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:30.826425    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d13e5ba-d75d-4f63-8e19-693aa5e10eed-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8d13e5ba-d75d-4f63-8e19-693aa5e10eed" (UID: "8d13e5ba-d75d-4f63-8e19-693aa5e10eed"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:47:30.926816 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:30.926789    2549 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d13e5ba-d75d-4f63-8e19-693aa5e10eed-maas-api-service-ca\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:47:31.542310 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:31.542281    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-00cf30-xrhp2"
Jul 23 00:47:31.542532 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:31.542308    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-00cf30-xrhp2" event={"ID":"8d13e5ba-d75d-4f63-8e19-693aa5e10eed","Type":"ContainerDied","Data":"7dd7b0cc847983ec719dd171e1fcd3efab4a33ea886daceaa66513242ba91140"}
Jul 23 00:47:31.542532 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:31.542350    2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7dd7b0cc847983ec719dd171e1fcd3efab4a33ea886daceaa66513242ba91140"
Jul 23 00:47:32.918480 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:32.918459    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"
Jul 23 00:47:33.045144 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:33.045078    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a714a5c-ec1f-4531-8b86-d503ffae669e-workload-certs\") pod \"4a714a5c-ec1f-4531-8b86-d503ffae669e\" (UID: \"4a714a5c-ec1f-4531-8b86-d503ffae669e\") "
Jul 23 00:47:33.045144 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:33.045115    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkkc2\" (UniqueName: \"kubernetes.io/projected/4a714a5c-ec1f-4531-8b86-d503ffae669e-kube-api-access-hkkc2\") pod \"4a714a5c-ec1f-4531-8b86-d503ffae669e\" (UID: \"4a714a5c-ec1f-4531-8b86-d503ffae669e\") "
Jul 23 00:47:33.045348 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:33.045149    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a714a5c-ec1f-4531-8b86-d503ffae669e-istio-podinfo\") pod \"4a714a5c-ec1f-4531-8b86-d503ffae669e\" (UID: \"4a714a5c-ec1f-4531-8b86-d503ffae669e\") "
Jul 23 00:47:33.045348 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:33.045265    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a714a5c-ec1f-4531-8b86-d503ffae669e-istio-data\") pod \"4a714a5c-ec1f-4531-8b86-d503ffae669e\" (UID: \"4a714a5c-ec1f-4531-8b86-d503ffae669e\") "
Jul 23 00:47:33.045348 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:33.045324    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a714a5c-ec1f-4531-8b86-d503ffae669e-istio-token\") pod \"4a714a5c-ec1f-4531-8b86-d503ffae669e\" (UID: \"4a714a5c-ec1f-4531-8b86-d503ffae669e\") "
Jul 23 00:47:33.045548 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:33.045365    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a714a5c-ec1f-4531-8b86-d503ffae669e-workload-socket\") pod \"4a714a5c-ec1f-4531-8b86-d503ffae669e\" (UID: \"4a714a5c-ec1f-4531-8b86-d503ffae669e\") "
Jul 23 00:47:33.045548 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:33.045414    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a714a5c-ec1f-4531-8b86-d503ffae669e-istiod-ca-cert\") pod \"4a714a5c-ec1f-4531-8b86-d503ffae669e\" (UID: \"4a714a5c-ec1f-4531-8b86-d503ffae669e\") "
Jul 23 00:47:33.045548 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:33.045364    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a714a5c-ec1f-4531-8b86-d503ffae669e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4a714a5c-ec1f-4531-8b86-d503ffae669e" (UID: "4a714a5c-ec1f-4531-8b86-d503ffae669e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:47:33.045548 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:33.045444    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a714a5c-ec1f-4531-8b86-d503ffae669e-credential-socket\") pod \"4a714a5c-ec1f-4531-8b86-d503ffae669e\" (UID: \"4a714a5c-ec1f-4531-8b86-d503ffae669e\") "
Jul 23 00:47:33.045548 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:33.045498    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a714a5c-ec1f-4531-8b86-d503ffae669e-istio-envoy\") pod \"4a714a5c-ec1f-4531-8b86-d503ffae669e\" (UID: \"4a714a5c-ec1f-4531-8b86-d503ffae669e\") "
Jul 23 00:47:33.045800 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:33.045618    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a714a5c-ec1f-4531-8b86-d503ffae669e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4a714a5c-ec1f-4531-8b86-d503ffae669e" (UID: "4a714a5c-ec1f-4531-8b86-d503ffae669e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:47:33.045800 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:33.045701    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a714a5c-ec1f-4531-8b86-d503ffae669e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4a714a5c-ec1f-4531-8b86-d503ffae669e" (UID: "4a714a5c-ec1f-4531-8b86-d503ffae669e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:47:33.045800 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:33.045782    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a714a5c-ec1f-4531-8b86-d503ffae669e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4a714a5c-ec1f-4531-8b86-d503ffae669e" (UID: "4a714a5c-ec1f-4531-8b86-d503ffae669e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:47:33.045963 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:33.045858    2549 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a714a5c-ec1f-4531-8b86-d503ffae669e-credential-socket\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:47:33.045963 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:33.045879    2549 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a714a5c-ec1f-4531-8b86-d503ffae669e-workload-certs\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:47:33.045963 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:33.045893    2549 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a714a5c-ec1f-4531-8b86-d503ffae669e-workload-socket\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:47:33.046090 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:33.046071    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a714a5c-ec1f-4531-8b86-d503ffae669e-istio-data" (OuterVolumeSpecName: "istio-data") pod "4a714a5c-ec1f-4531-8b86-d503ffae669e" (UID: "4a714a5c-ec1f-4531-8b86-d503ffae669e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:47:33.047794 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:33.047770    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a714a5c-ec1f-4531-8b86-d503ffae669e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4a714a5c-ec1f-4531-8b86-d503ffae669e" (UID: "4a714a5c-ec1f-4531-8b86-d503ffae669e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:47:33.047920 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:33.047891    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a714a5c-ec1f-4531-8b86-d503ffae669e-istio-token" (OuterVolumeSpecName: "istio-token") pod "4a714a5c-ec1f-4531-8b86-d503ffae669e" (UID: "4a714a5c-ec1f-4531-8b86-d503ffae669e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:47:33.047920 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:33.047901    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4a714a5c-ec1f-4531-8b86-d503ffae669e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4a714a5c-ec1f-4531-8b86-d503ffae669e" (UID: "4a714a5c-ec1f-4531-8b86-d503ffae669e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 00:47:33.048005 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:33.047983    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a714a5c-ec1f-4531-8b86-d503ffae669e-kube-api-access-hkkc2" (OuterVolumeSpecName: "kube-api-access-hkkc2") pod "4a714a5c-ec1f-4531-8b86-d503ffae669e" (UID: "4a714a5c-ec1f-4531-8b86-d503ffae669e"). InnerVolumeSpecName "kube-api-access-hkkc2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:47:33.146796 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:33.146773    2549 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a714a5c-ec1f-4531-8b86-d503ffae669e-istio-data\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:47:33.146796 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:33.146793    2549 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a714a5c-ec1f-4531-8b86-d503ffae669e-istio-token\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:47:33.146933 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:33.146803    2549 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a714a5c-ec1f-4531-8b86-d503ffae669e-istiod-ca-cert\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:47:33.146933 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:33.146817    2549 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a714a5c-ec1f-4531-8b86-d503ffae669e-istio-envoy\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:47:33.146933 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:33.146827    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkkc2\" (UniqueName: \"kubernetes.io/projected/4a714a5c-ec1f-4531-8b86-d503ffae669e-kube-api-access-hkkc2\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:47:33.146933 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:33.146837    2549 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a714a5c-ec1f-4531-8b86-d503ffae669e-istio-podinfo\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:47:33.553848 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:33.553814    2549 generic.go:356] "Generic (PLEG): container finished" podID="4a714a5c-ec1f-4531-8b86-d503ffae669e" containerID="41f65cffe370fc51c209ceaa7ccbefc56bfc3b81fca9a8e0a42293b558cae74c" exitCode=0
Jul 23 00:47:33.554007 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:33.553868    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"
Jul 23 00:47:33.554007 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:33.553888    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt" event={"ID":"4a714a5c-ec1f-4531-8b86-d503ffae669e","Type":"ContainerDied","Data":"41f65cffe370fc51c209ceaa7ccbefc56bfc3b81fca9a8e0a42293b558cae74c"}
Jul 23 00:47:33.554007 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:33.553941    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt" event={"ID":"4a714a5c-ec1f-4531-8b86-d503ffae669e","Type":"ContainerDied","Data":"1d83bb3f643c0c4650b7f0d6440c33abba0f6124c3170f139c7b7ffb90f3ba26"}
Jul 23 00:47:33.554007 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:33.553964    2549 scope.go:117] "RemoveContainer" containerID="41f65cffe370fc51c209ceaa7ccbefc56bfc3b81fca9a8e0a42293b558cae74c"
Jul 23 00:47:33.562968 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:33.562949    2549 scope.go:117] "RemoveContainer" containerID="a0c5d56d36a2e8e4e6cf818742210cfe2fae353b28a182260f8c5562b2fb5121"
Jul 23 00:47:33.570521 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:33.570505    2549 scope.go:117] "RemoveContainer" containerID="41f65cffe370fc51c209ceaa7ccbefc56bfc3b81fca9a8e0a42293b558cae74c"
Jul 23 00:47:33.570756 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:47:33.570738    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41f65cffe370fc51c209ceaa7ccbefc56bfc3b81fca9a8e0a42293b558cae74c\": container with ID starting with 41f65cffe370fc51c209ceaa7ccbefc56bfc3b81fca9a8e0a42293b558cae74c not found: ID does not exist" containerID="41f65cffe370fc51c209ceaa7ccbefc56bfc3b81fca9a8e0a42293b558cae74c"
Jul 23 00:47:33.570802 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:33.570763    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41f65cffe370fc51c209ceaa7ccbefc56bfc3b81fca9a8e0a42293b558cae74c"} err="failed to get container status \"41f65cffe370fc51c209ceaa7ccbefc56bfc3b81fca9a8e0a42293b558cae74c\": rpc error: code = NotFound desc = could not find container \"41f65cffe370fc51c209ceaa7ccbefc56bfc3b81fca9a8e0a42293b558cae74c\": container with ID starting with 41f65cffe370fc51c209ceaa7ccbefc56bfc3b81fca9a8e0a42293b558cae74c not found: ID does not exist"
Jul 23 00:47:33.570802 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:33.570778    2549 scope.go:117] "RemoveContainer" containerID="a0c5d56d36a2e8e4e6cf818742210cfe2fae353b28a182260f8c5562b2fb5121"
Jul 23 00:47:33.571019 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:47:33.571004    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0c5d56d36a2e8e4e6cf818742210cfe2fae353b28a182260f8c5562b2fb5121\": container with ID starting with a0c5d56d36a2e8e4e6cf818742210cfe2fae353b28a182260f8c5562b2fb5121 not found: ID does not exist" containerID="a0c5d56d36a2e8e4e6cf818742210cfe2fae353b28a182260f8c5562b2fb5121"
Jul 23 00:47:33.571057 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:33.571022    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0c5d56d36a2e8e4e6cf818742210cfe2fae353b28a182260f8c5562b2fb5121"} err="failed to get container status \"a0c5d56d36a2e8e4e6cf818742210cfe2fae353b28a182260f8c5562b2fb5121\": rpc error: code = NotFound desc = could not find container \"a0c5d56d36a2e8e4e6cf818742210cfe2fae353b28a182260f8c5562b2fb5121\": container with ID starting with a0c5d56d36a2e8e4e6cf818742210cfe2fae353b28a182260f8c5562b2fb5121 not found: ID does not exist"
Jul 23 00:47:33.581942 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:33.581918    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"]
Jul 23 00:47:33.587255 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:33.587230    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-1abde1-openshift-default-69d4bf4c79-xtxgt"]
Jul 23 00:47:33.802185 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:33.802155    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a714a5c-ec1f-4531-8b86-d503ffae669e" path="/var/lib/kubelet/pods/4a714a5c-ec1f-4531-8b86-d503ffae669e/volumes"
Jul 23 00:47:43.899161 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:43.899068    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-00cf30-7447f6444b-z8p82"]
Jul 23 00:47:43.899616 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:43.899327    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00cf30-7447f6444b-z8p82" podUID="df5f1a58-5cd3-4f16-87ff-d135b973c337" containerName="maas-api" containerID="cri-o://65ec3114e034f403520c9193be0b99e32f7c3ad5ea55816cc47d484554f82c02" gracePeriod=30
Jul 23 00:47:44.151790 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:44.151731    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00cf30-7447f6444b-z8p82"
Jul 23 00:47:44.238074 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:44.238046    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df5f1a58-5cd3-4f16-87ff-d135b973c337-openshift-service-ca\") pod \"df5f1a58-5cd3-4f16-87ff-d135b973c337\" (UID: \"df5f1a58-5cd3-4f16-87ff-d135b973c337\") "
Jul 23 00:47:44.238245 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:44.238120    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4qg8\" (UniqueName: \"kubernetes.io/projected/df5f1a58-5cd3-4f16-87ff-d135b973c337-kube-api-access-p4qg8\") pod \"df5f1a58-5cd3-4f16-87ff-d135b973c337\" (UID: \"df5f1a58-5cd3-4f16-87ff-d135b973c337\") "
Jul 23 00:47:44.238245 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:44.238146    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df5f1a58-5cd3-4f16-87ff-d135b973c337-maas-api-tls\") pod \"df5f1a58-5cd3-4f16-87ff-d135b973c337\" (UID: \"df5f1a58-5cd3-4f16-87ff-d135b973c337\") "
Jul 23 00:47:44.238366 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:44.238347    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df5f1a58-5cd3-4f16-87ff-d135b973c337-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "df5f1a58-5cd3-4f16-87ff-d135b973c337" (UID: "df5f1a58-5cd3-4f16-87ff-d135b973c337"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:47:44.240197 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:44.240172    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df5f1a58-5cd3-4f16-87ff-d135b973c337-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "df5f1a58-5cd3-4f16-87ff-d135b973c337" (UID: "df5f1a58-5cd3-4f16-87ff-d135b973c337"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 00:47:44.240197 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:44.240178    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df5f1a58-5cd3-4f16-87ff-d135b973c337-kube-api-access-p4qg8" (OuterVolumeSpecName: "kube-api-access-p4qg8") pod "df5f1a58-5cd3-4f16-87ff-d135b973c337" (UID: "df5f1a58-5cd3-4f16-87ff-d135b973c337"). InnerVolumeSpecName "kube-api-access-p4qg8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:47:44.339384 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:44.339360    2549 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df5f1a58-5cd3-4f16-87ff-d135b973c337-maas-api-tls\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:47:44.339384 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:44.339381    2549 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df5f1a58-5cd3-4f16-87ff-d135b973c337-openshift-service-ca\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:47:44.339543 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:44.339391    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4qg8\" (UniqueName: \"kubernetes.io/projected/df5f1a58-5cd3-4f16-87ff-d135b973c337-kube-api-access-p4qg8\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:47:44.611809 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:44.611774    2549 generic.go:356] "Generic (PLEG): container finished" podID="df5f1a58-5cd3-4f16-87ff-d135b973c337" containerID="65ec3114e034f403520c9193be0b99e32f7c3ad5ea55816cc47d484554f82c02" exitCode=0
Jul 23 00:47:44.611962 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:44.611822    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00cf30-7447f6444b-z8p82"
Jul 23 00:47:44.611962 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:44.611860    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00cf30-7447f6444b-z8p82" event={"ID":"df5f1a58-5cd3-4f16-87ff-d135b973c337","Type":"ContainerDied","Data":"65ec3114e034f403520c9193be0b99e32f7c3ad5ea55816cc47d484554f82c02"}
Jul 23 00:47:44.611962 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:44.611915    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00cf30-7447f6444b-z8p82" event={"ID":"df5f1a58-5cd3-4f16-87ff-d135b973c337","Type":"ContainerDied","Data":"313d52b37158f6b3cd8a0caf26c623be69309e6ceae1ce2a2428dda197584e41"}
Jul 23 00:47:44.611962 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:44.611937    2549 scope.go:117] "RemoveContainer" containerID="65ec3114e034f403520c9193be0b99e32f7c3ad5ea55816cc47d484554f82c02"
Jul 23 00:47:44.620803 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:44.620784    2549 scope.go:117] "RemoveContainer" containerID="65ec3114e034f403520c9193be0b99e32f7c3ad5ea55816cc47d484554f82c02"
Jul 23 00:47:44.621053 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:47:44.621024    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65ec3114e034f403520c9193be0b99e32f7c3ad5ea55816cc47d484554f82c02\": container with ID starting with 65ec3114e034f403520c9193be0b99e32f7c3ad5ea55816cc47d484554f82c02 not found: ID does not exist" containerID="65ec3114e034f403520c9193be0b99e32f7c3ad5ea55816cc47d484554f82c02"
Jul 23 00:47:44.621149 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:44.621054    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65ec3114e034f403520c9193be0b99e32f7c3ad5ea55816cc47d484554f82c02"} err="failed to get container status \"65ec3114e034f403520c9193be0b99e32f7c3ad5ea55816cc47d484554f82c02\": rpc error: code = NotFound desc = could not find container \"65ec3114e034f403520c9193be0b99e32f7c3ad5ea55816cc47d484554f82c02\": container with ID starting with 65ec3114e034f403520c9193be0b99e32f7c3ad5ea55816cc47d484554f82c02 not found: ID does not exist"
Jul 23 00:47:44.636253 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:44.636226    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-00cf30-7447f6444b-z8p82"]
Jul 23 00:47:44.638917 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:44.638889    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-00cf30-7447f6444b-z8p82"]
Jul 23 00:47:45.802373 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:45.802343    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df5f1a58-5cd3-4f16-87ff-d135b973c337" path="/var/lib/kubelet/pods/df5f1a58-5cd3-4f16-87ff-d135b973c337/volumes"
Jul 23 00:47:48.135109 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:48.135069    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-00cf30-xrhp2"]
Jul 23 00:47:48.137040 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:48.137017    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-00cf30-xrhp2"]
Jul 23 00:47:49.803177 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:49.803134    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d13e5ba-d75d-4f63-8e19-693aa5e10eed" path="/var/lib/kubelet/pods/8d13e5ba-d75d-4f63-8e19-693aa5e10eed/volumes"
Jul 23 00:47:56.271607 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.271573    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"]
Jul 23 00:47:56.272018 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.271943    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d13e5ba-d75d-4f63-8e19-693aa5e10eed" containerName="revoke-keys"
Jul 23 00:47:56.272018 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.271961    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d13e5ba-d75d-4f63-8e19-693aa5e10eed" containerName="revoke-keys"
Jul 23 00:47:56.272018 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.271990    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df5f1a58-5cd3-4f16-87ff-d135b973c337" containerName="maas-api"
Jul 23 00:47:56.272018 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.271998    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="df5f1a58-5cd3-4f16-87ff-d135b973c337" containerName="maas-api"
Jul 23 00:47:56.272162 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.272026    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a714a5c-ec1f-4531-8b86-d503ffae669e" containerName="istio-proxy"
Jul 23 00:47:56.272162 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.272036    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a714a5c-ec1f-4531-8b86-d503ffae669e" containerName="istio-proxy"
Jul 23 00:47:56.272162 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.272046    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a714a5c-ec1f-4531-8b86-d503ffae669e" containerName="istio-proxy"
Jul 23 00:47:56.272162 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.272054    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a714a5c-ec1f-4531-8b86-d503ffae669e" containerName="istio-proxy"
Jul 23 00:47:56.272162 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.272140    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a714a5c-ec1f-4531-8b86-d503ffae669e" containerName="istio-proxy"
Jul 23 00:47:56.272162 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.272153    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="df5f1a58-5cd3-4f16-87ff-d135b973c337" containerName="maas-api"
Jul 23 00:47:56.272355 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.272166    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a714a5c-ec1f-4531-8b86-d503ffae669e" containerName="istio-proxy"
Jul 23 00:47:56.272355 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.272175    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d13e5ba-d75d-4f63-8e19-693aa5e10eed" containerName="revoke-keys"
Jul 23 00:47:56.275122 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.275104    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"
Jul 23 00:47:56.277619 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.277594    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-59a77d-openshift-default-dockercfg-zr29d\""
Jul 23 00:47:56.288386 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.288366    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"]
Jul 23 00:47:56.334464 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.334420    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f474000-4d65-4ca2-be3a-314dc85fc62a-istio-envoy\") pod \"e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl\" (UID: \"5f474000-4d65-4ca2-be3a-314dc85fc62a\") " pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"
Jul 23 00:47:56.334583 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.334479    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f474000-4d65-4ca2-be3a-314dc85fc62a-istiod-ca-cert\") pod \"e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl\" (UID: \"5f474000-4d65-4ca2-be3a-314dc85fc62a\") " pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"
Jul 23 00:47:56.334583 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.334502    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f474000-4d65-4ca2-be3a-314dc85fc62a-workload-certs\") pod \"e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl\" (UID: \"5f474000-4d65-4ca2-be3a-314dc85fc62a\") " pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"
Jul 23 00:47:56.334583 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.334539    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f474000-4d65-4ca2-be3a-314dc85fc62a-credential-socket\") pod \"e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl\" (UID: \"5f474000-4d65-4ca2-be3a-314dc85fc62a\") " pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"
Jul 23 00:47:56.334583 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.334565    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f474000-4d65-4ca2-be3a-314dc85fc62a-istio-token\") pod \"e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl\" (UID: \"5f474000-4d65-4ca2-be3a-314dc85fc62a\") " pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"
Jul 23 00:47:56.334583 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.334579    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqbvj\" (UniqueName: \"kubernetes.io/projected/5f474000-4d65-4ca2-be3a-314dc85fc62a-kube-api-access-jqbvj\") pod \"e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl\" (UID: \"5f474000-4d65-4ca2-be3a-314dc85fc62a\") " pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"
Jul 23 00:47:56.334749 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.334633    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f474000-4d65-4ca2-be3a-314dc85fc62a-istio-data\") pod \"e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl\" (UID: \"5f474000-4d65-4ca2-be3a-314dc85fc62a\") " pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"
Jul 23 00:47:56.334749 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.334661    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f474000-4d65-4ca2-be3a-314dc85fc62a-workload-socket\") pod \"e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl\" (UID: \"5f474000-4d65-4ca2-be3a-314dc85fc62a\") " pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"
Jul 23 00:47:56.334749 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.334690    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f474000-4d65-4ca2-be3a-314dc85fc62a-istio-podinfo\") pod \"e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl\" (UID: \"5f474000-4d65-4ca2-be3a-314dc85fc62a\") " pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"
Jul 23 00:47:56.435905 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.435871    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f474000-4d65-4ca2-be3a-314dc85fc62a-workload-socket\") pod \"e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl\" (UID: \"5f474000-4d65-4ca2-be3a-314dc85fc62a\") " pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"
Jul 23 00:47:56.436075 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.435917    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f474000-4d65-4ca2-be3a-314dc85fc62a-istio-podinfo\") pod \"e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl\" (UID: \"5f474000-4d65-4ca2-be3a-314dc85fc62a\") " pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"
Jul 23 00:47:56.436075 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.436050    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f474000-4d65-4ca2-be3a-314dc85fc62a-istio-envoy\") pod \"e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl\" (UID: \"5f474000-4d65-4ca2-be3a-314dc85fc62a\") " pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"
Jul 23 00:47:56.436205 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.436091    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f474000-4d65-4ca2-be3a-314dc85fc62a-istiod-ca-cert\") pod \"e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl\" (UID: \"5f474000-4d65-4ca2-be3a-314dc85fc62a\") " pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"
Jul 23 00:47:56.436205 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.436131    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f474000-4d65-4ca2-be3a-314dc85fc62a-workload-certs\") pod \"e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl\" (UID: \"5f474000-4d65-4ca2-be3a-314dc85fc62a\") " pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"
Jul 23 00:47:56.436205 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.436165    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f474000-4d65-4ca2-be3a-314dc85fc62a-credential-socket\") pod \"e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl\" (UID: \"5f474000-4d65-4ca2-be3a-314dc85fc62a\") " pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"
Jul 23 00:47:56.436364 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.436247    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f474000-4d65-4ca2-be3a-314dc85fc62a-workload-socket\") pod \"e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl\" (UID: \"5f474000-4d65-4ca2-be3a-314dc85fc62a\") " pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"
Jul 23 00:47:56.436364 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.436298    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f474000-4d65-4ca2-be3a-314dc85fc62a-istio-token\") pod \"e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl\" (UID: \"5f474000-4d65-4ca2-be3a-314dc85fc62a\") " pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"
Jul 23 00:47:56.436364 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.436324    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqbvj\" (UniqueName: \"kubernetes.io/projected/5f474000-4d65-4ca2-be3a-314dc85fc62a-kube-api-access-jqbvj\") pod \"e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl\" (UID: \"5f474000-4d65-4ca2-be3a-314dc85fc62a\") " pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"
Jul 23 00:47:56.436560 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.436392    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f474000-4d65-4ca2-be3a-314dc85fc62a-istio-data\") pod \"e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl\" (UID: \"5f474000-4d65-4ca2-be3a-314dc85fc62a\") " pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"
Jul 23 00:47:56.436560 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.436482    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f474000-4d65-4ca2-be3a-314dc85fc62a-credential-socket\") pod \"e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl\" (UID: \"5f474000-4d65-4ca2-be3a-314dc85fc62a\") " pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"
Jul 23 00:47:56.436560 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.436514    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f474000-4d65-4ca2-be3a-314dc85fc62a-workload-certs\") pod \"e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl\" (UID: \"5f474000-4d65-4ca2-be3a-314dc85fc62a\") " pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"
Jul 23 00:47:56.436709 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.436688    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f474000-4d65-4ca2-be3a-314dc85fc62a-istio-data\") pod \"e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl\" (UID: \"5f474000-4d65-4ca2-be3a-314dc85fc62a\") " pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"
Jul 23 00:47:56.436923 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.436900    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f474000-4d65-4ca2-be3a-314dc85fc62a-istiod-ca-cert\") pod \"e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl\" (UID: \"5f474000-4d65-4ca2-be3a-314dc85fc62a\") " pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"
Jul 23 00:47:56.438295 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.438274    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f474000-4d65-4ca2-be3a-314dc85fc62a-istio-envoy\") pod \"e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl\" (UID: \"5f474000-4d65-4ca2-be3a-314dc85fc62a\") " pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"
Jul 23 00:47:56.438532 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.438516    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f474000-4d65-4ca2-be3a-314dc85fc62a-istio-podinfo\") pod \"e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl\" (UID: \"5f474000-4d65-4ca2-be3a-314dc85fc62a\") " pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"
Jul 23 00:47:56.446526 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.446500    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqbvj\" (UniqueName: \"kubernetes.io/projected/5f474000-4d65-4ca2-be3a-314dc85fc62a-kube-api-access-jqbvj\") pod \"e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl\" (UID: \"5f474000-4d65-4ca2-be3a-314dc85fc62a\") " pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"
Jul 23 00:47:56.446747 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.446730    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f474000-4d65-4ca2-be3a-314dc85fc62a-istio-token\") pod \"e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl\" (UID: \"5f474000-4d65-4ca2-be3a-314dc85fc62a\") " pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"
Jul 23 00:47:56.585417 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.585393    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"
Jul 23 00:47:56.724551 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.724526    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"]
Jul 23 00:47:56.726140 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:47:56.726110    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f474000_4d65_4ca2_be3a_314dc85fc62a.slice/crio-135740c17f7c6548bd658c04994acf607463622fbe298d6b7c78f07fb4519d7f WatchSource:0}: Error finding container 135740c17f7c6548bd658c04994acf607463622fbe298d6b7c78f07fb4519d7f: Status 404 returned error can't find the container with id 135740c17f7c6548bd658c04994acf607463622fbe298d6b7c78f07fb4519d7f
Jul 23 00:47:56.728256 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.728223    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:47:56.728317 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.728291    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:47:56.728361 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:56.728325    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:47:57.679493 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:57.679436    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl" event={"ID":"5f474000-4d65-4ca2-be3a-314dc85fc62a","Type":"ContainerStarted","Data":"07f17995cd7a06b19e0a2d243d81405304270a4198b37195d19daf9ecdae40cf"}
Jul 23 00:47:57.679858 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:57.679505    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl" event={"ID":"5f474000-4d65-4ca2-be3a-314dc85fc62a","Type":"ContainerStarted","Data":"135740c17f7c6548bd658c04994acf607463622fbe298d6b7c78f07fb4519d7f"}
Jul 23 00:47:57.711650 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:57.711604    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl" podStartSLOduration=1.711589804 podStartE2EDuration="1.711589804s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:47:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:47:57.710681173 +0000 UTC m=+2620.471879484" watchObservedRunningTime="2026-07-23 00:47:57.711589804 +0000 UTC m=+2620.472788113"
Jul 23 00:47:58.586221 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:58.586181    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"
Jul 23 00:47:58.591174 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:58.591151    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"
Jul 23 00:47:58.684587 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:58.684554    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"
Jul 23 00:47:58.685472 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:58.685438    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"
Jul 23 00:47:59.842533 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:59.842488    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-59a77d-6fb799f7b9-qrn6x"]
Jul 23 00:47:59.846101 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:59.846082    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-59a77d-6fb799f7b9-qrn6x"
Jul 23 00:47:59.849393 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:59.849376    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-59a77d-serving-cert\""
Jul 23 00:47:59.859197 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:59.859165    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-59a77d-6fb799f7b9-qrn6x"]
Jul 23 00:47:59.865047 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:59.865027    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/596cd24a-76e3-48cb-81c1-d9da306dd6eb-maas-api-tls\") pod \"maas-api-e2e-shared-a-59a77d-6fb799f7b9-qrn6x\" (UID: \"596cd24a-76e3-48cb-81c1-d9da306dd6eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-59a77d-6fb799f7b9-qrn6x"
Jul 23 00:47:59.865142 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:59.865058    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/596cd24a-76e3-48cb-81c1-d9da306dd6eb-openshift-service-ca\") pod \"maas-api-e2e-shared-a-59a77d-6fb799f7b9-qrn6x\" (UID: \"596cd24a-76e3-48cb-81c1-d9da306dd6eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-59a77d-6fb799f7b9-qrn6x"
Jul 23 00:47:59.865192 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:59.865173    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw5q8\" (UniqueName: \"kubernetes.io/projected/596cd24a-76e3-48cb-81c1-d9da306dd6eb-kube-api-access-rw5q8\") pod \"maas-api-e2e-shared-a-59a77d-6fb799f7b9-qrn6x\" (UID: \"596cd24a-76e3-48cb-81c1-d9da306dd6eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-59a77d-6fb799f7b9-qrn6x"
Jul 23 00:47:59.965989 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:59.965961    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw5q8\" (UniqueName: \"kubernetes.io/projected/596cd24a-76e3-48cb-81c1-d9da306dd6eb-kube-api-access-rw5q8\") pod \"maas-api-e2e-shared-a-59a77d-6fb799f7b9-qrn6x\" (UID: \"596cd24a-76e3-48cb-81c1-d9da306dd6eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-59a77d-6fb799f7b9-qrn6x"
Jul 23 00:47:59.966144 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:59.966030    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/596cd24a-76e3-48cb-81c1-d9da306dd6eb-maas-api-tls\") pod \"maas-api-e2e-shared-a-59a77d-6fb799f7b9-qrn6x\" (UID: \"596cd24a-76e3-48cb-81c1-d9da306dd6eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-59a77d-6fb799f7b9-qrn6x"
Jul 23 00:47:59.966144 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:59.966048    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/596cd24a-76e3-48cb-81c1-d9da306dd6eb-openshift-service-ca\") pod \"maas-api-e2e-shared-a-59a77d-6fb799f7b9-qrn6x\" (UID: \"596cd24a-76e3-48cb-81c1-d9da306dd6eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-59a77d-6fb799f7b9-qrn6x"
Jul 23 00:47:59.966222 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:47:59.966163    2549 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-59a77d-serving-cert: secret "maas-api-e2e-shared-a-59a77d-serving-cert" not found
Jul 23 00:47:59.966318 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:47:59.966224    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/596cd24a-76e3-48cb-81c1-d9da306dd6eb-maas-api-tls podName:596cd24a-76e3-48cb-81c1-d9da306dd6eb nodeName:}" failed. No retries permitted until 2026-07-23 00:48:00.466209279 +0000 UTC m=+2623.227407567 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/596cd24a-76e3-48cb-81c1-d9da306dd6eb-maas-api-tls") pod "maas-api-e2e-shared-a-59a77d-6fb799f7b9-qrn6x" (UID: "596cd24a-76e3-48cb-81c1-d9da306dd6eb") : secret "maas-api-e2e-shared-a-59a77d-serving-cert" not found
Jul 23 00:47:59.966714 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:59.966695    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/596cd24a-76e3-48cb-81c1-d9da306dd6eb-openshift-service-ca\") pod \"maas-api-e2e-shared-a-59a77d-6fb799f7b9-qrn6x\" (UID: \"596cd24a-76e3-48cb-81c1-d9da306dd6eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-59a77d-6fb799f7b9-qrn6x"
Jul 23 00:47:59.978587 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:47:59.978565    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw5q8\" (UniqueName: \"kubernetes.io/projected/596cd24a-76e3-48cb-81c1-d9da306dd6eb-kube-api-access-rw5q8\") pod \"maas-api-e2e-shared-a-59a77d-6fb799f7b9-qrn6x\" (UID: \"596cd24a-76e3-48cb-81c1-d9da306dd6eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-59a77d-6fb799f7b9-qrn6x"
Jul 23 00:48:00.471021 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:00.470982    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/596cd24a-76e3-48cb-81c1-d9da306dd6eb-maas-api-tls\") pod \"maas-api-e2e-shared-a-59a77d-6fb799f7b9-qrn6x\" (UID: \"596cd24a-76e3-48cb-81c1-d9da306dd6eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-59a77d-6fb799f7b9-qrn6x"
Jul 23 00:48:00.473336 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:00.473317    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/596cd24a-76e3-48cb-81c1-d9da306dd6eb-maas-api-tls\") pod \"maas-api-e2e-shared-a-59a77d-6fb799f7b9-qrn6x\" (UID: \"596cd24a-76e3-48cb-81c1-d9da306dd6eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-59a77d-6fb799f7b9-qrn6x"
Jul 23 00:48:00.756863 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:00.756773    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-59a77d-6fb799f7b9-qrn6x"
Jul 23 00:48:01.104318 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:01.101326    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-59a77d-6fb799f7b9-qrn6x"]
Jul 23 00:48:01.105912 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:48:01.105863    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod596cd24a_76e3_48cb_81c1_d9da306dd6eb.slice/crio-d54fa02febb9af8b012456624c5db1895a3e9f981c7e7ef6d3ff513ca0578574 WatchSource:0}: Error finding container d54fa02febb9af8b012456624c5db1895a3e9f981c7e7ef6d3ff513ca0578574: Status 404 returned error can't find the container with id d54fa02febb9af8b012456624c5db1895a3e9f981c7e7ef6d3ff513ca0578574
Jul 23 00:48:01.702684 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:01.702651    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-59a77d-6fb799f7b9-qrn6x" event={"ID":"596cd24a-76e3-48cb-81c1-d9da306dd6eb","Type":"ContainerStarted","Data":"803481287c7d15c6846bf9aeeb73829ba6aa8a7ceb6bcfa03dad0a1685441619"}
Jul 23 00:48:01.702786 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:01.702715    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-59a77d-6fb799f7b9-qrn6x" event={"ID":"596cd24a-76e3-48cb-81c1-d9da306dd6eb","Type":"ContainerStarted","Data":"d54fa02febb9af8b012456624c5db1895a3e9f981c7e7ef6d3ff513ca0578574"}
Jul 23 00:48:01.702846 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:01.702828    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-59a77d-6fb799f7b9-qrn6x"
Jul 23 00:48:07.717350 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:07.717314    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-59a77d-6fb799f7b9-qrn6x"
Jul 23 00:48:07.736752 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:07.736699    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-59a77d-6fb799f7b9-qrn6x" podStartSLOduration=8.20566911 podStartE2EDuration="8.736684269s" totalImagesPullingTime="531.015159ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:47:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:48:01.743643313 +0000 UTC m=+2624.504841623" watchObservedRunningTime="2026-07-23 00:48:07.736684269 +0000 UTC m=+2630.497882578"
Jul 23 00:48:08.017570 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:08.017479    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d50941-56bbb56c44-tt6zg"]
Jul 23 00:48:08.022174 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:08.022139    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d50941-56bbb56c44-tt6zg"
Jul 23 00:48:08.025410 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:08.025385    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-d50941-serving-cert\""
Jul 23 00:48:08.035694 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:08.035667    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d50941-56bbb56c44-tt6zg"]
Jul 23 00:48:08.142336 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:08.142301    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd5b4cdf-2131-4119-9ca7-6d9fcc089831-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d50941-56bbb56c44-tt6zg\" (UID: \"bd5b4cdf-2131-4119-9ca7-6d9fcc089831\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d50941-56bbb56c44-tt6zg"
Jul 23 00:48:08.142532 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:08.142348    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd5b4cdf-2131-4119-9ca7-6d9fcc089831-maas-api-tls\") pod \"maas-api-e2e-shared-b-d50941-56bbb56c44-tt6zg\" (UID: \"bd5b4cdf-2131-4119-9ca7-6d9fcc089831\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d50941-56bbb56c44-tt6zg"
Jul 23 00:48:08.142532 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:08.142377    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flj58\" (UniqueName: \"kubernetes.io/projected/bd5b4cdf-2131-4119-9ca7-6d9fcc089831-kube-api-access-flj58\") pod \"maas-api-e2e-shared-b-d50941-56bbb56c44-tt6zg\" (UID: \"bd5b4cdf-2131-4119-9ca7-6d9fcc089831\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d50941-56bbb56c44-tt6zg"
Jul 23 00:48:08.243695 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:08.243657    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd5b4cdf-2131-4119-9ca7-6d9fcc089831-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d50941-56bbb56c44-tt6zg\" (UID: \"bd5b4cdf-2131-4119-9ca7-6d9fcc089831\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d50941-56bbb56c44-tt6zg"
Jul 23 00:48:08.243892 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:08.243715    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd5b4cdf-2131-4119-9ca7-6d9fcc089831-maas-api-tls\") pod \"maas-api-e2e-shared-b-d50941-56bbb56c44-tt6zg\" (UID: \"bd5b4cdf-2131-4119-9ca7-6d9fcc089831\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d50941-56bbb56c44-tt6zg"
Jul 23 00:48:08.243892 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:08.243744    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flj58\" (UniqueName: \"kubernetes.io/projected/bd5b4cdf-2131-4119-9ca7-6d9fcc089831-kube-api-access-flj58\") pod \"maas-api-e2e-shared-b-d50941-56bbb56c44-tt6zg\" (UID: \"bd5b4cdf-2131-4119-9ca7-6d9fcc089831\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d50941-56bbb56c44-tt6zg"
Jul 23 00:48:08.244328 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:08.244308    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd5b4cdf-2131-4119-9ca7-6d9fcc089831-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d50941-56bbb56c44-tt6zg\" (UID: \"bd5b4cdf-2131-4119-9ca7-6d9fcc089831\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d50941-56bbb56c44-tt6zg"
Jul 23 00:48:08.246115 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:08.246095    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd5b4cdf-2131-4119-9ca7-6d9fcc089831-maas-api-tls\") pod \"maas-api-e2e-shared-b-d50941-56bbb56c44-tt6zg\" (UID: \"bd5b4cdf-2131-4119-9ca7-6d9fcc089831\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d50941-56bbb56c44-tt6zg"
Jul 23 00:48:08.252613 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:08.252588    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flj58\" (UniqueName: \"kubernetes.io/projected/bd5b4cdf-2131-4119-9ca7-6d9fcc089831-kube-api-access-flj58\") pod \"maas-api-e2e-shared-b-d50941-56bbb56c44-tt6zg\" (UID: \"bd5b4cdf-2131-4119-9ca7-6d9fcc089831\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d50941-56bbb56c44-tt6zg"
Jul 23 00:48:08.335751 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:08.335714    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d50941-56bbb56c44-tt6zg"
Jul 23 00:48:08.552161 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:48:08.552130    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd5b4cdf_2131_4119_9ca7_6d9fcc089831.slice/crio-3a4d0e5c882fb6f60833c62eb22cc46eb2be908d4ebd51d705893e91ec22a54c WatchSource:0}: Error finding container 3a4d0e5c882fb6f60833c62eb22cc46eb2be908d4ebd51d705893e91ec22a54c: Status 404 returned error can't find the container with id 3a4d0e5c882fb6f60833c62eb22cc46eb2be908d4ebd51d705893e91ec22a54c
Jul 23 00:48:08.552760 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:08.552738    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d50941-56bbb56c44-tt6zg"]
Jul 23 00:48:08.741886 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:08.741791    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d50941-56bbb56c44-tt6zg" event={"ID":"bd5b4cdf-2131-4119-9ca7-6d9fcc089831","Type":"ContainerStarted","Data":"3a4d0e5c882fb6f60833c62eb22cc46eb2be908d4ebd51d705893e91ec22a54c"}
Jul 23 00:48:11.766557 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:11.766520    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d50941-56bbb56c44-tt6zg" event={"ID":"bd5b4cdf-2131-4119-9ca7-6d9fcc089831","Type":"ContainerStarted","Data":"723a612c3d3c72ef71d07bd96e2bec4dc4bd05f2bec2b7a846b4f9b33885ca26"}
Jul 23 00:48:11.767012 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:11.766622    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d50941-56bbb56c44-tt6zg"
Jul 23 00:48:11.789030 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:11.788977    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d50941-56bbb56c44-tt6zg" podStartSLOduration=2.307952137 podStartE2EDuration="4.788962466s" totalImagesPullingTime="2.481010329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:48:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:48:11.788154792 +0000 UTC m=+2634.549353102" watchObservedRunningTime="2026-07-23 00:48:11.788962466 +0000 UTC m=+2634.550160775"
Jul 23 00:48:13.686082 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:13.686013    2549 patch_prober.go:28] interesting pod/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 23 00:48:13.686082 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:13.686065    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl" podUID="5f474000-4d65-4ca2-be3a-314dc85fc62a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 23 00:48:13.779306 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:13.779278    2549 generic.go:356] "Generic (PLEG): container finished" podID="5f474000-4d65-4ca2-be3a-314dc85fc62a" containerID="07f17995cd7a06b19e0a2d243d81405304270a4198b37195d19daf9ecdae40cf" exitCode=0
Jul 23 00:48:13.779433 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:13.779330    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl" event={"ID":"5f474000-4d65-4ca2-be3a-314dc85fc62a","Type":"ContainerDied","Data":"07f17995cd7a06b19e0a2d243d81405304270a4198b37195d19daf9ecdae40cf"}
Jul 23 00:48:13.779714 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:13.779699    2549 scope.go:117] "RemoveContainer" containerID="07f17995cd7a06b19e0a2d243d81405304270a4198b37195d19daf9ecdae40cf"
Jul 23 00:48:13.780706 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:13.780672    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:48:13.780772 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:13.780758    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:48:13.780811 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:13.780794    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 00:48:14.786662 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:14.786631    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl" event={"ID":"5f474000-4d65-4ca2-be3a-314dc85fc62a","Type":"ContainerStarted","Data":"f4acdc36dffe580aa2375929b629e48a9937634e0ec22ad65a98edd0e56dfce1"}
Jul 23 00:48:15.586342 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:15.586308    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"
Jul 23 00:48:15.586564 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:15.586510    2549 patch_prober.go:28] interesting pod/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 23 00:48:15.586620 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:15.586559    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl" podUID="5f474000-4d65-4ca2-be3a-314dc85fc62a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 23 00:48:16.586338 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:16.586294    2549 patch_prober.go:28] interesting pod/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 23 00:48:16.586768 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:16.586358    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl" podUID="5f474000-4d65-4ca2-be3a-314dc85fc62a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 23 00:48:17.586652 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:17.586617    2549 patch_prober.go:28] interesting pod/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 23 00:48:17.587038 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:17.586667    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl" podUID="5f474000-4d65-4ca2-be3a-314dc85fc62a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 23 00:48:17.777549 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:17.777516    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d50941-56bbb56c44-tt6zg"
Jul 23 00:48:17.977134 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:17.977051    2549 scope.go:117] "RemoveContainer" containerID="b2543a5153f28c15cad8128ce195cb3de30f3b28fe76feff1ac76c426c11af5a"
Jul 23 00:48:18.586319 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:18.586281    2549 patch_prober.go:28] interesting pod/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 23 00:48:18.586528 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:18.586336    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl" podUID="5f474000-4d65-4ca2-be3a-314dc85fc62a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 23 00:48:19.589730 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:19.589696    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"
Jul 23 00:48:19.590102 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:19.589963    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"
Jul 23 00:48:19.590731 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:48:19.590709    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"
Jul 23 00:51:18.033123 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:51:18.033082    2549 scope.go:117] "RemoveContainer" containerID="a6415f6b3246cd4907b0c53446be2ef1941187bacafa6643d0c1288a02c0c98c"
Jul 23 00:52:18.051965 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:52:18.051892    2549 scope.go:117] "RemoveContainer" containerID="016397df0e5285158fad5da00328fbc25c2d7a2f19869a569e9a322881fd6e5f"
Jul 23 00:52:18.059983 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:52:18.059966    2549 scope.go:117] "RemoveContainer" containerID="a10fcc1566d2677e339cd2d3c1b3e9d6c47629f49149aa3ac5d58d2eb0fdadbc"
Jul 23 00:53:18.081026 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:53:18.080992    2549 scope.go:117] "RemoveContainer" containerID="073d112bd803048a9235ae2ec9f08d36252152213d1592b69e81fcae3f14440d"
Jul 23 00:54:18.101155 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:18.101125    2549 scope.go:117] "RemoveContainer" containerID="06627254cb09ba214b52bb327aea05879b4bb91fab8af7cb12e0f1a4fb25aa2a"
Jul 23 00:54:26.035790 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:26.035756    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-59a77d-6fb799f7b9-qrn6x"]
Jul 23 00:54:26.036270 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:26.036138    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-59a77d-6fb799f7b9-qrn6x" podUID="596cd24a-76e3-48cb-81c1-d9da306dd6eb" containerName="maas-api" containerID="cri-o://803481287c7d15c6846bf9aeeb73829ba6aa8a7ceb6bcfa03dad0a1685441619" gracePeriod=30
Jul 23 00:54:26.293440 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:26.293373    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-59a77d-6fb799f7b9-qrn6x"
Jul 23 00:54:26.404604 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:26.404572    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/596cd24a-76e3-48cb-81c1-d9da306dd6eb-maas-api-tls\") pod \"596cd24a-76e3-48cb-81c1-d9da306dd6eb\" (UID: \"596cd24a-76e3-48cb-81c1-d9da306dd6eb\") "
Jul 23 00:54:26.404783 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:26.404633    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rw5q8\" (UniqueName: \"kubernetes.io/projected/596cd24a-76e3-48cb-81c1-d9da306dd6eb-kube-api-access-rw5q8\") pod \"596cd24a-76e3-48cb-81c1-d9da306dd6eb\" (UID: \"596cd24a-76e3-48cb-81c1-d9da306dd6eb\") "
Jul 23 00:54:26.404783 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:26.404664    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/596cd24a-76e3-48cb-81c1-d9da306dd6eb-openshift-service-ca\") pod \"596cd24a-76e3-48cb-81c1-d9da306dd6eb\" (UID: \"596cd24a-76e3-48cb-81c1-d9da306dd6eb\") "
Jul 23 00:54:26.405111 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:26.405086    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/596cd24a-76e3-48cb-81c1-d9da306dd6eb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "596cd24a-76e3-48cb-81c1-d9da306dd6eb" (UID: "596cd24a-76e3-48cb-81c1-d9da306dd6eb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:54:26.406746 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:26.406718    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/596cd24a-76e3-48cb-81c1-d9da306dd6eb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "596cd24a-76e3-48cb-81c1-d9da306dd6eb" (UID: "596cd24a-76e3-48cb-81c1-d9da306dd6eb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 00:54:26.406847 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:26.406797    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/596cd24a-76e3-48cb-81c1-d9da306dd6eb-kube-api-access-rw5q8" (OuterVolumeSpecName: "kube-api-access-rw5q8") pod "596cd24a-76e3-48cb-81c1-d9da306dd6eb" (UID: "596cd24a-76e3-48cb-81c1-d9da306dd6eb"). InnerVolumeSpecName "kube-api-access-rw5q8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:54:26.505329 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:26.505300    2549 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/596cd24a-76e3-48cb-81c1-d9da306dd6eb-maas-api-tls\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:54:26.505329 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:26.505327    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rw5q8\" (UniqueName: \"kubernetes.io/projected/596cd24a-76e3-48cb-81c1-d9da306dd6eb-kube-api-access-rw5q8\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:54:26.505607 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:26.505340    2549 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/596cd24a-76e3-48cb-81c1-d9da306dd6eb-openshift-service-ca\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:54:26.670264 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:26.670233    2549 generic.go:356] "Generic (PLEG): container finished" podID="596cd24a-76e3-48cb-81c1-d9da306dd6eb" containerID="803481287c7d15c6846bf9aeeb73829ba6aa8a7ceb6bcfa03dad0a1685441619" exitCode=0
Jul 23 00:54:26.670444 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:26.670277    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-59a77d-6fb799f7b9-qrn6x"
Jul 23 00:54:26.670444 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:26.670317    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-59a77d-6fb799f7b9-qrn6x" event={"ID":"596cd24a-76e3-48cb-81c1-d9da306dd6eb","Type":"ContainerDied","Data":"803481287c7d15c6846bf9aeeb73829ba6aa8a7ceb6bcfa03dad0a1685441619"}
Jul 23 00:54:26.670444 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:26.670376    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-59a77d-6fb799f7b9-qrn6x" event={"ID":"596cd24a-76e3-48cb-81c1-d9da306dd6eb","Type":"ContainerDied","Data":"d54fa02febb9af8b012456624c5db1895a3e9f981c7e7ef6d3ff513ca0578574"}
Jul 23 00:54:26.670444 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:26.670400    2549 scope.go:117] "RemoveContainer" containerID="803481287c7d15c6846bf9aeeb73829ba6aa8a7ceb6bcfa03dad0a1685441619"
Jul 23 00:54:26.679942 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:26.679916    2549 scope.go:117] "RemoveContainer" containerID="803481287c7d15c6846bf9aeeb73829ba6aa8a7ceb6bcfa03dad0a1685441619"
Jul 23 00:54:26.680191 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:54:26.680173    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"803481287c7d15c6846bf9aeeb73829ba6aa8a7ceb6bcfa03dad0a1685441619\": container with ID starting with 803481287c7d15c6846bf9aeeb73829ba6aa8a7ceb6bcfa03dad0a1685441619 not found: ID does not exist" containerID="803481287c7d15c6846bf9aeeb73829ba6aa8a7ceb6bcfa03dad0a1685441619"
Jul 23 00:54:26.680243 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:26.680201    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"803481287c7d15c6846bf9aeeb73829ba6aa8a7ceb6bcfa03dad0a1685441619"} err="failed to get container status \"803481287c7d15c6846bf9aeeb73829ba6aa8a7ceb6bcfa03dad0a1685441619\": rpc error: code = NotFound desc = could not find container \"803481287c7d15c6846bf9aeeb73829ba6aa8a7ceb6bcfa03dad0a1685441619\": container with ID starting with 803481287c7d15c6846bf9aeeb73829ba6aa8a7ceb6bcfa03dad0a1685441619 not found: ID does not exist"
Jul 23 00:54:26.692835 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:26.692810    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-59a77d-6fb799f7b9-qrn6x"]
Jul 23 00:54:26.696433 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:26.696408    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-59a77d-6fb799f7b9-qrn6x"]
Jul 23 00:54:27.803413 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:27.803378    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="596cd24a-76e3-48cb-81c1-d9da306dd6eb" path="/var/lib/kubelet/pods/596cd24a-76e3-48cb-81c1-d9da306dd6eb/volumes"
Jul 23 00:54:37.373914 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:37.373870    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"]
Jul 23 00:54:37.374436 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:37.374135    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl" podUID="5f474000-4d65-4ca2-be3a-314dc85fc62a" containerName="istio-proxy" containerID="cri-o://f4acdc36dffe580aa2375929b629e48a9937634e0ec22ad65a98edd0e56dfce1" gracePeriod=30
Jul 23 00:54:37.756870 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:37.756767    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d50941-6b65f"]
Jul 23 00:54:37.757154 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:37.757139    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="596cd24a-76e3-48cb-81c1-d9da306dd6eb" containerName="maas-api"
Jul 23 00:54:37.757154 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:37.757154    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="596cd24a-76e3-48cb-81c1-d9da306dd6eb" containerName="maas-api"
Jul 23 00:54:37.757277 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:37.757210    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="596cd24a-76e3-48cb-81c1-d9da306dd6eb" containerName="maas-api"
Jul 23 00:54:37.760406 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:37.760384    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d50941-6b65f"
Jul 23 00:54:37.763509 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:37.763487    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5dc6x\""
Jul 23 00:54:37.777831 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:37.777802    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d50941-6b65f"]
Jul 23 00:54:37.911240 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:37.911200    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/41b31d9b-b066-419f-a6dd-c192fbf25aa8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-d50941-6b65f\" (UID: \"41b31d9b-b066-419f-a6dd-c192fbf25aa8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d50941-6b65f"
Jul 23 00:54:38.012019 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:38.011912    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/41b31d9b-b066-419f-a6dd-c192fbf25aa8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-d50941-6b65f\" (UID: \"41b31d9b-b066-419f-a6dd-c192fbf25aa8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d50941-6b65f"
Jul 23 00:54:38.012582 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:38.012562    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/41b31d9b-b066-419f-a6dd-c192fbf25aa8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-d50941-6b65f\" (UID: \"41b31d9b-b066-419f-a6dd-c192fbf25aa8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d50941-6b65f"
Jul 23 00:54:38.071293 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:38.071262    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d50941-6b65f"
Jul 23 00:54:38.225639 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:38.225614    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d50941-6b65f"]
Jul 23 00:54:38.227244 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:54:38.227195    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41b31d9b_b066_419f_a6dd_c192fbf25aa8.slice/crio-a04fcc6c8d81c297696d5223add860dbebf7ef01fab9f49d198151e2e6e553f5 WatchSource:0}: Error finding container a04fcc6c8d81c297696d5223add860dbebf7ef01fab9f49d198151e2e6e553f5: Status 404 returned error can't find the container with id a04fcc6c8d81c297696d5223add860dbebf7ef01fab9f49d198151e2e6e553f5
Jul 23 00:54:38.732421 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:38.732316    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d50941-6b65f" event={"ID":"41b31d9b-b066-419f-a6dd-c192fbf25aa8","Type":"ContainerStarted","Data":"df0e3a507d39e87f7992b7436b0bb15075add00dfebacd4418c2a8f05558136e"}
Jul 23 00:54:38.732421 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:38.732377    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d50941-6b65f" event={"ID":"41b31d9b-b066-419f-a6dd-c192fbf25aa8","Type":"ContainerStarted","Data":"a04fcc6c8d81c297696d5223add860dbebf7ef01fab9f49d198151e2e6e553f5"}
Jul 23 00:54:38.762399 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:38.762345    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d50941-6b65f" podStartSLOduration=1.76233096 podStartE2EDuration="1.76233096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 00:54:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:54:38.760605116 +0000 UTC m=+3021.521803452" watchObservedRunningTime="2026-07-23 00:54:38.76233096 +0000 UTC m=+3021.523529315"
Jul 23 00:54:39.738788 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:39.738754    2549 generic.go:356] "Generic (PLEG): container finished" podID="41b31d9b-b066-419f-a6dd-c192fbf25aa8" containerID="df0e3a507d39e87f7992b7436b0bb15075add00dfebacd4418c2a8f05558136e" exitCode=0
Jul 23 00:54:39.739180 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:39.738798    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d50941-6b65f" event={"ID":"41b31d9b-b066-419f-a6dd-c192fbf25aa8","Type":"ContainerDied","Data":"df0e3a507d39e87f7992b7436b0bb15075add00dfebacd4418c2a8f05558136e"}
Jul 23 00:54:40.881920 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:40.881889    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d50941-6b65f"
Jul 23 00:54:40.939237 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:40.939205    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/41b31d9b-b066-419f-a6dd-c192fbf25aa8-maas-api-service-ca\") pod \"41b31d9b-b066-419f-a6dd-c192fbf25aa8\" (UID: \"41b31d9b-b066-419f-a6dd-c192fbf25aa8\") "
Jul 23 00:54:40.939583 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:40.939562    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41b31d9b-b066-419f-a6dd-c192fbf25aa8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "41b31d9b-b066-419f-a6dd-c192fbf25aa8" (UID: "41b31d9b-b066-419f-a6dd-c192fbf25aa8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:54:41.039966 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:41.039872    2549 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/41b31d9b-b066-419f-a6dd-c192fbf25aa8-maas-api-service-ca\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:54:41.749531 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:41.749498    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d50941-6b65f"
Jul 23 00:54:41.749531 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:41.749520    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d50941-6b65f" event={"ID":"41b31d9b-b066-419f-a6dd-c192fbf25aa8","Type":"ContainerDied","Data":"a04fcc6c8d81c297696d5223add860dbebf7ef01fab9f49d198151e2e6e553f5"}
Jul 23 00:54:41.749757 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:41.749575    2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a04fcc6c8d81c297696d5223add860dbebf7ef01fab9f49d198151e2e6e553f5"
Jul 23 00:54:42.636688 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:42.636623    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"
Jul 23 00:54:42.653942 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:42.653914    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f474000-4d65-4ca2-be3a-314dc85fc62a-istio-data\") pod \"5f474000-4d65-4ca2-be3a-314dc85fc62a\" (UID: \"5f474000-4d65-4ca2-be3a-314dc85fc62a\") "
Jul 23 00:54:42.653942 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:42.653946    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f474000-4d65-4ca2-be3a-314dc85fc62a-istio-podinfo\") pod \"5f474000-4d65-4ca2-be3a-314dc85fc62a\" (UID: \"5f474000-4d65-4ca2-be3a-314dc85fc62a\") "
Jul 23 00:54:42.654162 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:42.653970    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqbvj\" (UniqueName: \"kubernetes.io/projected/5f474000-4d65-4ca2-be3a-314dc85fc62a-kube-api-access-jqbvj\") pod \"5f474000-4d65-4ca2-be3a-314dc85fc62a\" (UID: \"5f474000-4d65-4ca2-be3a-314dc85fc62a\") "
Jul 23 00:54:42.654162 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:42.653987    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f474000-4d65-4ca2-be3a-314dc85fc62a-istio-token\") pod \"5f474000-4d65-4ca2-be3a-314dc85fc62a\" (UID: \"5f474000-4d65-4ca2-be3a-314dc85fc62a\") "
Jul 23 00:54:42.654162 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:42.654007    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f474000-4d65-4ca2-be3a-314dc85fc62a-istiod-ca-cert\") pod \"5f474000-4d65-4ca2-be3a-314dc85fc62a\" (UID: \"5f474000-4d65-4ca2-be3a-314dc85fc62a\") "
Jul 23 00:54:42.654162 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:42.654049    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f474000-4d65-4ca2-be3a-314dc85fc62a-workload-certs\") pod \"5f474000-4d65-4ca2-be3a-314dc85fc62a\" (UID: \"5f474000-4d65-4ca2-be3a-314dc85fc62a\") "
Jul 23 00:54:42.654162 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:42.654070    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f474000-4d65-4ca2-be3a-314dc85fc62a-credential-socket\") pod \"5f474000-4d65-4ca2-be3a-314dc85fc62a\" (UID: \"5f474000-4d65-4ca2-be3a-314dc85fc62a\") "
Jul 23 00:54:42.654162 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:42.654095    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f474000-4d65-4ca2-be3a-314dc85fc62a-workload-socket\") pod \"5f474000-4d65-4ca2-be3a-314dc85fc62a\" (UID: \"5f474000-4d65-4ca2-be3a-314dc85fc62a\") "
Jul 23 00:54:42.654594 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:42.654187    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f474000-4d65-4ca2-be3a-314dc85fc62a-istio-envoy\") pod \"5f474000-4d65-4ca2-be3a-314dc85fc62a\" (UID: \"5f474000-4d65-4ca2-be3a-314dc85fc62a\") "
Jul 23 00:54:42.654594 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:42.654391    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f474000-4d65-4ca2-be3a-314dc85fc62a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5f474000-4d65-4ca2-be3a-314dc85fc62a" (UID: "5f474000-4d65-4ca2-be3a-314dc85fc62a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:54:42.654594 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:42.654552    2549 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f474000-4d65-4ca2-be3a-314dc85fc62a-workload-certs\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:54:42.654594 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:42.654546    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f474000-4d65-4ca2-be3a-314dc85fc62a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5f474000-4d65-4ca2-be3a-314dc85fc62a" (UID: "5f474000-4d65-4ca2-be3a-314dc85fc62a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:54:42.654813 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:42.654641    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f474000-4d65-4ca2-be3a-314dc85fc62a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5f474000-4d65-4ca2-be3a-314dc85fc62a" (UID: "5f474000-4d65-4ca2-be3a-314dc85fc62a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:54:42.654935 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:42.654902    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f474000-4d65-4ca2-be3a-314dc85fc62a-istio-data" (OuterVolumeSpecName: "istio-data") pod "5f474000-4d65-4ca2-be3a-314dc85fc62a" (UID: "5f474000-4d65-4ca2-be3a-314dc85fc62a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:54:42.655204 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:42.655176    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f474000-4d65-4ca2-be3a-314dc85fc62a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5f474000-4d65-4ca2-be3a-314dc85fc62a" (UID: "5f474000-4d65-4ca2-be3a-314dc85fc62a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:54:42.656489 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:42.656466    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f474000-4d65-4ca2-be3a-314dc85fc62a-istio-token" (OuterVolumeSpecName: "istio-token") pod "5f474000-4d65-4ca2-be3a-314dc85fc62a" (UID: "5f474000-4d65-4ca2-be3a-314dc85fc62a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:54:42.656587 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:42.656531    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f474000-4d65-4ca2-be3a-314dc85fc62a-kube-api-access-jqbvj" (OuterVolumeSpecName: "kube-api-access-jqbvj") pod "5f474000-4d65-4ca2-be3a-314dc85fc62a" (UID: "5f474000-4d65-4ca2-be3a-314dc85fc62a"). InnerVolumeSpecName "kube-api-access-jqbvj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:54:42.656639 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:42.656620    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5f474000-4d65-4ca2-be3a-314dc85fc62a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5f474000-4d65-4ca2-be3a-314dc85fc62a" (UID: "5f474000-4d65-4ca2-be3a-314dc85fc62a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 00:54:42.656674 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:42.656635    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f474000-4d65-4ca2-be3a-314dc85fc62a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5f474000-4d65-4ca2-be3a-314dc85fc62a" (UID: "5f474000-4d65-4ca2-be3a-314dc85fc62a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 00:54:42.755042 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:42.755008    2549 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f474000-4d65-4ca2-be3a-314dc85fc62a-istio-data\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:54:42.755042 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:42.755034    2549 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f474000-4d65-4ca2-be3a-314dc85fc62a-istio-podinfo\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:54:42.755042 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:42.755049    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqbvj\" (UniqueName: \"kubernetes.io/projected/5f474000-4d65-4ca2-be3a-314dc85fc62a-kube-api-access-jqbvj\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:54:42.755305 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:42.755064    2549 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f474000-4d65-4ca2-be3a-314dc85fc62a-istio-token\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:54:42.755305 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:42.755078    2549 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f474000-4d65-4ca2-be3a-314dc85fc62a-istiod-ca-cert\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:54:42.755305 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:42.755089    2549 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f474000-4d65-4ca2-be3a-314dc85fc62a-credential-socket\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:54:42.755305 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:42.755098    2549 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f474000-4d65-4ca2-be3a-314dc85fc62a-workload-socket\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:54:42.755305 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:42.755106    2549 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f474000-4d65-4ca2-be3a-314dc85fc62a-istio-envoy\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:54:42.755816 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:42.755790    2549 generic.go:356] "Generic (PLEG): container finished" podID="5f474000-4d65-4ca2-be3a-314dc85fc62a" containerID="f4acdc36dffe580aa2375929b629e48a9937634e0ec22ad65a98edd0e56dfce1" exitCode=0
Jul 23 00:54:42.755900 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:42.755844    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"
Jul 23 00:54:42.755900 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:42.755875    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl" event={"ID":"5f474000-4d65-4ca2-be3a-314dc85fc62a","Type":"ContainerDied","Data":"f4acdc36dffe580aa2375929b629e48a9937634e0ec22ad65a98edd0e56dfce1"}
Jul 23 00:54:42.755976 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:42.755932    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl" event={"ID":"5f474000-4d65-4ca2-be3a-314dc85fc62a","Type":"ContainerDied","Data":"135740c17f7c6548bd658c04994acf607463622fbe298d6b7c78f07fb4519d7f"}
Jul 23 00:54:42.755976 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:42.755964    2549 scope.go:117] "RemoveContainer" containerID="f4acdc36dffe580aa2375929b629e48a9937634e0ec22ad65a98edd0e56dfce1"
Jul 23 00:54:42.765078 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:42.765061    2549 scope.go:117] "RemoveContainer" containerID="07f17995cd7a06b19e0a2d243d81405304270a4198b37195d19daf9ecdae40cf"
Jul 23 00:54:42.772905 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:42.772888    2549 scope.go:117] "RemoveContainer" containerID="f4acdc36dffe580aa2375929b629e48a9937634e0ec22ad65a98edd0e56dfce1"
Jul 23 00:54:42.773164 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:54:42.773143    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4acdc36dffe580aa2375929b629e48a9937634e0ec22ad65a98edd0e56dfce1\": container with ID starting with f4acdc36dffe580aa2375929b629e48a9937634e0ec22ad65a98edd0e56dfce1 not found: ID does not exist" containerID="f4acdc36dffe580aa2375929b629e48a9937634e0ec22ad65a98edd0e56dfce1"
Jul 23 00:54:42.773250 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:42.773170    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4acdc36dffe580aa2375929b629e48a9937634e0ec22ad65a98edd0e56dfce1"} err="failed to get container status \"f4acdc36dffe580aa2375929b629e48a9937634e0ec22ad65a98edd0e56dfce1\": rpc error: code = NotFound desc = could not find container \"f4acdc36dffe580aa2375929b629e48a9937634e0ec22ad65a98edd0e56dfce1\": container with ID starting with f4acdc36dffe580aa2375929b629e48a9937634e0ec22ad65a98edd0e56dfce1 not found: ID does not exist"
Jul 23 00:54:42.773250 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:42.773186    2549 scope.go:117] "RemoveContainer" containerID="07f17995cd7a06b19e0a2d243d81405304270a4198b37195d19daf9ecdae40cf"
Jul 23 00:54:42.773423 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:54:42.773404    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07f17995cd7a06b19e0a2d243d81405304270a4198b37195d19daf9ecdae40cf\": container with ID starting with 07f17995cd7a06b19e0a2d243d81405304270a4198b37195d19daf9ecdae40cf not found: ID does not exist" containerID="07f17995cd7a06b19e0a2d243d81405304270a4198b37195d19daf9ecdae40cf"
Jul 23 00:54:42.773489 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:42.773429    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07f17995cd7a06b19e0a2d243d81405304270a4198b37195d19daf9ecdae40cf"} err="failed to get container status \"07f17995cd7a06b19e0a2d243d81405304270a4198b37195d19daf9ecdae40cf\": rpc error: code = NotFound desc = could not find container \"07f17995cd7a06b19e0a2d243d81405304270a4198b37195d19daf9ecdae40cf\": container with ID starting with 07f17995cd7a06b19e0a2d243d81405304270a4198b37195d19daf9ecdae40cf not found: ID does not exist"
Jul 23 00:54:42.785795 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:42.785774    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"]
Jul 23 00:54:42.789673 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:42.789652    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-59a77d-openshift-default-7c44fbcdbc-6pdpl"]
Jul 23 00:54:43.803213 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:43.803179    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f474000-4d65-4ca2-be3a-314dc85fc62a" path="/var/lib/kubelet/pods/5f474000-4d65-4ca2-be3a-314dc85fc62a/volumes"
Jul 23 00:54:48.279932 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:48.279894    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d50941-56bbb56c44-tt6zg"]
Jul 23 00:54:48.280750 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:48.280693    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d50941-56bbb56c44-tt6zg" podUID="bd5b4cdf-2131-4119-9ca7-6d9fcc089831" containerName="maas-api" containerID="cri-o://723a612c3d3c72ef71d07bd96e2bec4dc4bd05f2bec2b7a846b4f9b33885ca26" gracePeriod=30
Jul 23 00:54:48.530191 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:48.530128    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d50941-56bbb56c44-tt6zg"
Jul 23 00:54:48.604301 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:48.604272    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd5b4cdf-2131-4119-9ca7-6d9fcc089831-maas-api-tls\") pod \"bd5b4cdf-2131-4119-9ca7-6d9fcc089831\" (UID: \"bd5b4cdf-2131-4119-9ca7-6d9fcc089831\") "
Jul 23 00:54:48.604301 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:48.604307    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd5b4cdf-2131-4119-9ca7-6d9fcc089831-openshift-service-ca\") pod \"bd5b4cdf-2131-4119-9ca7-6d9fcc089831\" (UID: \"bd5b4cdf-2131-4119-9ca7-6d9fcc089831\") "
Jul 23 00:54:48.604520 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:48.604354    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flj58\" (UniqueName: \"kubernetes.io/projected/bd5b4cdf-2131-4119-9ca7-6d9fcc089831-kube-api-access-flj58\") pod \"bd5b4cdf-2131-4119-9ca7-6d9fcc089831\" (UID: \"bd5b4cdf-2131-4119-9ca7-6d9fcc089831\") "
Jul 23 00:54:48.604797 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:48.604773    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd5b4cdf-2131-4119-9ca7-6d9fcc089831-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bd5b4cdf-2131-4119-9ca7-6d9fcc089831" (UID: "bd5b4cdf-2131-4119-9ca7-6d9fcc089831"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 00:54:48.606387 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:48.606359    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd5b4cdf-2131-4119-9ca7-6d9fcc089831-kube-api-access-flj58" (OuterVolumeSpecName: "kube-api-access-flj58") pod "bd5b4cdf-2131-4119-9ca7-6d9fcc089831" (UID: "bd5b4cdf-2131-4119-9ca7-6d9fcc089831"). InnerVolumeSpecName "kube-api-access-flj58". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 00:54:48.606518 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:48.606395    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd5b4cdf-2131-4119-9ca7-6d9fcc089831-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bd5b4cdf-2131-4119-9ca7-6d9fcc089831" (UID: "bd5b4cdf-2131-4119-9ca7-6d9fcc089831"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 00:54:48.705967 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:48.705937    2549 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd5b4cdf-2131-4119-9ca7-6d9fcc089831-maas-api-tls\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:54:48.705967 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:48.705965    2549 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd5b4cdf-2131-4119-9ca7-6d9fcc089831-openshift-service-ca\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:54:48.705967 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:48.705974    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flj58\" (UniqueName: \"kubernetes.io/projected/bd5b4cdf-2131-4119-9ca7-6d9fcc089831-kube-api-access-flj58\") on node \"ip-10-0-138-182.ec2.internal\" DevicePath \"\""
Jul 23 00:54:48.786615 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:48.786544    2549 generic.go:356] "Generic (PLEG): container finished" podID="bd5b4cdf-2131-4119-9ca7-6d9fcc089831" containerID="723a612c3d3c72ef71d07bd96e2bec4dc4bd05f2bec2b7a846b4f9b33885ca26" exitCode=0
Jul 23 00:54:48.786615 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:48.786590    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d50941-56bbb56c44-tt6zg"
Jul 23 00:54:48.786761 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:48.786630    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d50941-56bbb56c44-tt6zg" event={"ID":"bd5b4cdf-2131-4119-9ca7-6d9fcc089831","Type":"ContainerDied","Data":"723a612c3d3c72ef71d07bd96e2bec4dc4bd05f2bec2b7a846b4f9b33885ca26"}
Jul 23 00:54:48.786761 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:48.786688    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d50941-56bbb56c44-tt6zg" event={"ID":"bd5b4cdf-2131-4119-9ca7-6d9fcc089831","Type":"ContainerDied","Data":"3a4d0e5c882fb6f60833c62eb22cc46eb2be908d4ebd51d705893e91ec22a54c"}
Jul 23 00:54:48.786761 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:48.786719    2549 scope.go:117] "RemoveContainer" containerID="723a612c3d3c72ef71d07bd96e2bec4dc4bd05f2bec2b7a846b4f9b33885ca26"
Jul 23 00:54:48.796212 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:48.796193    2549 scope.go:117] "RemoveContainer" containerID="723a612c3d3c72ef71d07bd96e2bec4dc4bd05f2bec2b7a846b4f9b33885ca26"
Jul 23 00:54:48.796480 ip-10-0-138-182 kubenswrapper[2549]: E0723 00:54:48.796461    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"723a612c3d3c72ef71d07bd96e2bec4dc4bd05f2bec2b7a846b4f9b33885ca26\": container with ID starting with 723a612c3d3c72ef71d07bd96e2bec4dc4bd05f2bec2b7a846b4f9b33885ca26 not found: ID does not exist" containerID="723a612c3d3c72ef71d07bd96e2bec4dc4bd05f2bec2b7a846b4f9b33885ca26"
Jul 23 00:54:48.796573 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:48.796487    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"723a612c3d3c72ef71d07bd96e2bec4dc4bd05f2bec2b7a846b4f9b33885ca26"} err="failed to get container status \"723a612c3d3c72ef71d07bd96e2bec4dc4bd05f2bec2b7a846b4f9b33885ca26\": rpc error: code = NotFound desc = could not find container \"723a612c3d3c72ef71d07bd96e2bec4dc4bd05f2bec2b7a846b4f9b33885ca26\": container with ID starting with 723a612c3d3c72ef71d07bd96e2bec4dc4bd05f2bec2b7a846b4f9b33885ca26 not found: ID does not exist"
Jul 23 00:54:48.808943 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:48.808919    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d50941-56bbb56c44-tt6zg"]
Jul 23 00:54:48.812950 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:48.812931    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d50941-56bbb56c44-tt6zg"]
Jul 23 00:54:49.802067 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:49.802025    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd5b4cdf-2131-4119-9ca7-6d9fcc089831" path="/var/lib/kubelet/pods/bd5b4cdf-2131-4119-9ca7-6d9fcc089831/volumes"
Jul 23 00:54:52.819916 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:52.819879    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d50941-6b65f"]
Jul 23 00:54:52.823283 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:52.823256    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d50941-6b65f"]
Jul 23 00:54:53.802259 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:54:53.802222    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41b31d9b-b066-419f-a6dd-c192fbf25aa8" path="/var/lib/kubelet/pods/41b31d9b-b066-419f-a6dd-c192fbf25aa8/volumes"
Jul 23 00:55:05.903424 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:05.903386    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-xzw9f_73228d62-3a86-4121-a620-4c8d76858b92/manager/0.log"
Jul 23 00:55:06.027012 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:06.026982    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-zlrfl_79985d45-c622-41a4-ab3e-e0f3a1ccc115/manager/0.log"
Jul 23 00:55:06.155420 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:06.155339    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-557dfd9f99-bfnk9_2a5ad4a7-0dad-4a7b-8179-4a7e8687521e/manager/0.log"
Jul 23 00:55:06.272543 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:06.272513    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-974kz_f58731df-6dc5-4a7c-afa5-5ad4b91ba278/server/0.log"
Jul 23 00:55:06.400086 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:06.400053    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-jshl7_02c2ed65-f107-4e58-bb14-6828fe419c7c/manager/0.log"
Jul 23 00:55:06.531248 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:06.531170    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86b98fc76f-669vg_a7d7bf86-c01d-4ae8-b7ea-b68a146a69d3/copy-manifests/0.log"
Jul 23 00:55:06.544195 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:06.544171    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86b98fc76f-669vg_a7d7bf86-c01d-4ae8-b7ea-b68a146a69d3/manager/0.log"
Jul 23 00:55:07.178518 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:07.178463    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5bc9bfb844-x77kn_8ed1fd6a-37ef-4ee9-9d75-670f733186d5/maas-api/0.log"
Jul 23 00:55:07.424852 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:07.424822    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29746125-4sgns_53a53da2-e245-409a-a8ff-45dad9a10cb8/cleanup/0.log"
Jul 23 00:55:07.549558 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:07.549476    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-x76l6_d5e00a53-4d46-4336-9af6-47a8b1a23ddb/postgres/0.log"
Jul 23 00:55:10.324627 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:10.324546    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-dldw7_5675f276-0612-45ba-aad7-b636450c7299/discovery/0.log"
Jul 23 00:55:10.582045 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:10.581957    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76d98b647-t5lf9_1eff5a77-e427-4e3f-a811-e95da6d2f12d/kube-auth-proxy/0.log"
Jul 23 00:55:10.710206 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:10.710171    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-bplzb_df3cbd45-9a29-4f51-994a-b04ab3db4a34/istio-proxy/1.log"
Jul 23 00:55:10.831499 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:10.831445    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-fjw84_c96b796b-090f-4144-922f-92ce06689911/payload-pre-processing/0.log"
Jul 23 00:55:10.959202 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:10.959128    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-lstnn_295776fe-d951-4e48-ba46-c16618528f55/payload-processing/0.log"
Jul 23 00:55:11.444339 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:11.444309    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-4r4ld_d20e2b13-51ba-40c1-9bf0-9846a23f6235/main/0.log"
Jul 23 00:55:11.811371 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:11.811286    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gxm8_e00d9856-00b6-4737-be4a-dfa64d98f720/main/0.log"
Jul 23 00:55:20.526172 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:20.526136    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fmqcb_553eb6d0-ca32-4129-99d3-e1459beadee9/global-pull-secret-syncer/0.log"
Jul 23 00:55:20.665392 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:20.665349    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-flsfc_00834f32-b182-4f53-bca5-7188aacc3b2b/konnectivity-agent/0.log"
Jul 23 00:55:20.792014 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:20.791900    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-182.ec2.internal_e75ffd7291292d64f0e4db02c0350a31/haproxy/0.log"
Jul 23 00:55:28.470990 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:28.470957    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-fhfl6_11dd8ecb-e4c0-4632-87df-7557b28abf8d/monitoring-plugin/0.log"
Jul 23 00:55:28.659919 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:28.659890    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r5k8z_6397fbd7-9bf5-4303-94fe-d4f001d98c45/node-exporter/0.log"
Jul 23 00:55:28.684576 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:28.684551    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r5k8z_6397fbd7-9bf5-4303-94fe-d4f001d98c45/kube-rbac-proxy/0.log"
Jul 23 00:55:28.709265 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:28.709247    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r5k8z_6397fbd7-9bf5-4303-94fe-d4f001d98c45/init-textfile/0.log"
Jul 23 00:55:29.002116 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:29.002071    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-dkdpg_bf01ae28-c43e-400c-8123-86ab08e9d518/prometheus-operator/0.log"
Jul 23 00:55:29.025855 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:29.025813    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-dkdpg_bf01ae28-c43e-400c-8123-86ab08e9d518/kube-rbac-proxy/0.log"
Jul 23 00:55:30.190293 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:30.190263    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5lwts/perf-node-gather-daemonset-rcmkc"]
Jul 23 00:55:30.190680 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:30.190618    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f474000-4d65-4ca2-be3a-314dc85fc62a" containerName="istio-proxy"
Jul 23 00:55:30.190680 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:30.190630    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f474000-4d65-4ca2-be3a-314dc85fc62a" containerName="istio-proxy"
Jul 23 00:55:30.190680 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:30.190642    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd5b4cdf-2131-4119-9ca7-6d9fcc089831" containerName="maas-api"
Jul 23 00:55:30.190680 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:30.190647    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd5b4cdf-2131-4119-9ca7-6d9fcc089831" containerName="maas-api"
Jul 23 00:55:30.190680 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:30.190667    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41b31d9b-b066-419f-a6dd-c192fbf25aa8" containerName="revoke-keys"
Jul 23 00:55:30.190680 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:30.190672    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="41b31d9b-b066-419f-a6dd-c192fbf25aa8" containerName="revoke-keys"
Jul 23 00:55:30.190869 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:30.190724    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd5b4cdf-2131-4119-9ca7-6d9fcc089831" containerName="maas-api"
Jul 23 00:55:30.190869 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:30.190732    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f474000-4d65-4ca2-be3a-314dc85fc62a" containerName="istio-proxy"
Jul 23 00:55:30.190869 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:30.190737    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f474000-4d65-4ca2-be3a-314dc85fc62a" containerName="istio-proxy"
Jul 23 00:55:30.190869 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:30.190744    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="41b31d9b-b066-419f-a6dd-c192fbf25aa8" containerName="revoke-keys"
Jul 23 00:55:30.193650 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:30.193634    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-rcmkc"
Jul 23 00:55:30.196131 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:30.196113    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5lwts\"/\"default-dockercfg-mrwpc\""
Jul 23 00:55:30.196131 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:30.196127    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5lwts\"/\"kube-root-ca.crt\""
Jul 23 00:55:30.196901 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:30.196880    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5lwts\"/\"openshift-service-ca.crt\""
Jul 23 00:55:30.202612 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:30.202590    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5lwts/perf-node-gather-daemonset-rcmkc"]
Jul 23 00:55:30.284675 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:30.284636    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/412ca1fa-243a-49cc-aaa2-bfd2ed393388-podres\") pod \"perf-node-gather-daemonset-rcmkc\" (UID: \"412ca1fa-243a-49cc-aaa2-bfd2ed393388\") " pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-rcmkc"
Jul 23 00:55:30.284873 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:30.284680    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/412ca1fa-243a-49cc-aaa2-bfd2ed393388-sys\") pod \"perf-node-gather-daemonset-rcmkc\" (UID: \"412ca1fa-243a-49cc-aaa2-bfd2ed393388\") " pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-rcmkc"
Jul 23 00:55:30.284873 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:30.284754    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/412ca1fa-243a-49cc-aaa2-bfd2ed393388-proc\") pod \"perf-node-gather-daemonset-rcmkc\" (UID: \"412ca1fa-243a-49cc-aaa2-bfd2ed393388\") " pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-rcmkc"
Jul 23 00:55:30.284873 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:30.284794    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwm9x\" (UniqueName: \"kubernetes.io/projected/412ca1fa-243a-49cc-aaa2-bfd2ed393388-kube-api-access-jwm9x\") pod \"perf-node-gather-daemonset-rcmkc\" (UID: \"412ca1fa-243a-49cc-aaa2-bfd2ed393388\") " pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-rcmkc"
Jul 23 00:55:30.284873 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:30.284820    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/412ca1fa-243a-49cc-aaa2-bfd2ed393388-lib-modules\") pod \"perf-node-gather-daemonset-rcmkc\" (UID: \"412ca1fa-243a-49cc-aaa2-bfd2ed393388\") " pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-rcmkc"
Jul 23 00:55:30.385258 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:30.385216    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/412ca1fa-243a-49cc-aaa2-bfd2ed393388-podres\") pod \"perf-node-gather-daemonset-rcmkc\" (UID: \"412ca1fa-243a-49cc-aaa2-bfd2ed393388\") " pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-rcmkc"
Jul 23 00:55:30.385258 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:30.385264    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/412ca1fa-243a-49cc-aaa2-bfd2ed393388-sys\") pod \"perf-node-gather-daemonset-rcmkc\" (UID: \"412ca1fa-243a-49cc-aaa2-bfd2ed393388\") " pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-rcmkc"
Jul 23 00:55:30.385552 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:30.385311    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/412ca1fa-243a-49cc-aaa2-bfd2ed393388-proc\") pod \"perf-node-gather-daemonset-rcmkc\" (UID: \"412ca1fa-243a-49cc-aaa2-bfd2ed393388\") " pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-rcmkc"
Jul 23 00:55:30.385552 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:30.385352    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwm9x\" (UniqueName: \"kubernetes.io/projected/412ca1fa-243a-49cc-aaa2-bfd2ed393388-kube-api-access-jwm9x\") pod \"perf-node-gather-daemonset-rcmkc\" (UID: \"412ca1fa-243a-49cc-aaa2-bfd2ed393388\") " pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-rcmkc"
Jul 23 00:55:30.385552 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:30.385370    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/412ca1fa-243a-49cc-aaa2-bfd2ed393388-lib-modules\") pod \"perf-node-gather-daemonset-rcmkc\" (UID: \"412ca1fa-243a-49cc-aaa2-bfd2ed393388\") " pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-rcmkc"
Jul 23 00:55:30.385552 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:30.385411    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/412ca1fa-243a-49cc-aaa2-bfd2ed393388-podres\") pod \"perf-node-gather-daemonset-rcmkc\" (UID: \"412ca1fa-243a-49cc-aaa2-bfd2ed393388\") " pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-rcmkc"
Jul 23 00:55:30.385552 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:30.385423    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/412ca1fa-243a-49cc-aaa2-bfd2ed393388-sys\") pod \"perf-node-gather-daemonset-rcmkc\" (UID: \"412ca1fa-243a-49cc-aaa2-bfd2ed393388\") " pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-rcmkc"
Jul 23 00:55:30.385552 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:30.385432    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/412ca1fa-243a-49cc-aaa2-bfd2ed393388-proc\") pod \"perf-node-gather-daemonset-rcmkc\" (UID: \"412ca1fa-243a-49cc-aaa2-bfd2ed393388\") " pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-rcmkc"
Jul 23 00:55:30.385552 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:30.385533    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/412ca1fa-243a-49cc-aaa2-bfd2ed393388-lib-modules\") pod \"perf-node-gather-daemonset-rcmkc\" (UID: \"412ca1fa-243a-49cc-aaa2-bfd2ed393388\") " pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-rcmkc"
Jul 23 00:55:30.394819 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:30.394790    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwm9x\" (UniqueName: \"kubernetes.io/projected/412ca1fa-243a-49cc-aaa2-bfd2ed393388-kube-api-access-jwm9x\") pod \"perf-node-gather-daemonset-rcmkc\" (UID: \"412ca1fa-243a-49cc-aaa2-bfd2ed393388\") " pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-rcmkc"
Jul 23 00:55:30.504985 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:30.504895    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-rcmkc"
Jul 23 00:55:30.635479 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:30.635437    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5lwts/perf-node-gather-daemonset-rcmkc"]
Jul 23 00:55:30.637425 ip-10-0-138-182 kubenswrapper[2549]: W0723 00:55:30.637399    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod412ca1fa_243a_49cc_aaa2_bfd2ed393388.slice/crio-66410c017adf5371a0418e36019666b4e7e260fc596c6c1d8d7f65f2ae168128 WatchSource:0}: Error finding container 66410c017adf5371a0418e36019666b4e7e260fc596c6c1d8d7f65f2ae168128: Status 404 returned error can't find the container with id 66410c017adf5371a0418e36019666b4e7e260fc596c6c1d8d7f65f2ae168128
Jul 23 00:55:30.984924 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:30.984887    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-rcmkc" event={"ID":"412ca1fa-243a-49cc-aaa2-bfd2ed393388","Type":"ContainerStarted","Data":"d991558e8cac081b0e5783af261bfbd9ba25cea5da7e9c3fff88f60ef589bfaa"}
Jul 23 00:55:30.985081 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:30.984941    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-rcmkc" event={"ID":"412ca1fa-243a-49cc-aaa2-bfd2ed393388","Type":"ContainerStarted","Data":"66410c017adf5371a0418e36019666b4e7e260fc596c6c1d8d7f65f2ae168128"}
Jul 23 00:55:30.985081 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:30.985005    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-rcmkc"
Jul 23 00:55:31.002750 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:31.002702    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-rcmkc" podStartSLOduration=1.002686458 podStartE2EDuration="1.002686458s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 00:55:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 00:55:31.001519134 +0000 UTC m=+3073.762717479" watchObservedRunningTime="2026-07-23 00:55:31.002686458 +0000 UTC m=+3073.763884767"
Jul 23 00:55:33.368807 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:33.368777    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tnhnq_9b10668c-fed1-431f-bd1e-e18e59098619/dns/0.log"
Jul 23 00:55:33.394233 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:33.394208    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tnhnq_9b10668c-fed1-431f-bd1e-e18e59098619/kube-rbac-proxy/0.log"
Jul 23 00:55:33.495928 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:33.495895    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b42wl_aca54f39-db9c-4e94-b3a1-41680f904cc6/dns-node-resolver/0.log"
Jul 23 00:55:34.087169 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:34.087139    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5d546949f9-hzd8r_340b9647-c773-4998-84f6-4cdcadbc302b/registry/0.log"
Jul 23 00:55:34.097404 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:34.097382    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5d546949f9-hzd8r_340b9647-c773-4998-84f6-4cdcadbc302b/registry/1.log"
Jul 23 00:55:34.174739 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:34.174717    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vfqnm_79f6db91-6406-4b7b-988a-f7b0b35ded81/node-ca/0.log"
Jul 23 00:55:35.258829 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:35.258799    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-dldw7_5675f276-0612-45ba-aad7-b636450c7299/discovery/0.log"
Jul 23 00:55:35.307940 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:35.307913    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76d98b647-t5lf9_1eff5a77-e427-4e3f-a811-e95da6d2f12d/kube-auth-proxy/0.log"
Jul 23 00:55:35.339860 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:35.339829    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-bplzb_df3cbd45-9a29-4f51-994a-b04ab3db4a34/istio-proxy/0.log"
Jul 23 00:55:35.364092 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:35.364057    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-bplzb_df3cbd45-9a29-4f51-994a-b04ab3db4a34/istio-proxy/1.log"
Jul 23 00:55:35.395575 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:35.395528    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-fjw84_c96b796b-090f-4144-922f-92ce06689911/payload-pre-processing/0.log"
Jul 23 00:55:35.428817 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:35.428791    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-lstnn_295776fe-d951-4e48-ba46-c16618528f55/payload-processing/0.log"
Jul 23 00:55:36.129812 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:36.129781    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9zp45_2250b59e-6d47-4ee7-be3a-c2a2849eb1a6/serve-healthcheck-canary/0.log"
Jul 23 00:55:36.851267 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:36.851200    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vgw4k_d7100866-dd6a-42cf-8400-bd2fc033f7af/kube-rbac-proxy/0.log"
Jul 23 00:55:36.900225 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:36.900202    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vgw4k_d7100866-dd6a-42cf-8400-bd2fc033f7af/exporter/0.log"
Jul 23 00:55:36.927010 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:36.926990    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vgw4k_d7100866-dd6a-42cf-8400-bd2fc033f7af/extractor/0.log"
Jul 23 00:55:36.998524 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:36.998502    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5lwts/perf-node-gather-daemonset-rcmkc"
Jul 23 00:55:39.211236 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:39.211213    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-xzw9f_73228d62-3a86-4121-a620-4c8d76858b92/manager/0.log"
Jul 23 00:55:39.404227 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:39.404193    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-zlrfl_79985d45-c622-41a4-ab3e-e0f3a1ccc115/manager/0.log"
Jul 23 00:55:39.541165 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:39.541136    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-557dfd9f99-bfnk9_2a5ad4a7-0dad-4a7b-8179-4a7e8687521e/manager/0.log"
Jul 23 00:55:39.575794 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:39.575773    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-974kz_f58731df-6dc5-4a7c-afa5-5ad4b91ba278/server/0.log"
Jul 23 00:55:39.659371 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:39.659341    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-jshl7_02c2ed65-f107-4e58-bb14-6828fe419c7c/manager/0.log"
Jul 23 00:55:39.754782 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:39.754696    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86b98fc76f-669vg_a7d7bf86-c01d-4ae8-b7ea-b68a146a69d3/manager/0.log"
Jul 23 00:55:39.784499 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:39.784476    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86b98fc76f-669vg_a7d7bf86-c01d-4ae8-b7ea-b68a146a69d3/copy-manifests/0.log"
Jul 23 00:55:40.782304 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:40.782277    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-dldw7_5675f276-0612-45ba-aad7-b636450c7299/discovery/0.log"
Jul 23 00:55:40.811206 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:40.811185    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76d98b647-t5lf9_1eff5a77-e427-4e3f-a811-e95da6d2f12d/kube-auth-proxy/0.log"
Jul 23 00:55:40.830106 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:40.830081    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-bplzb_df3cbd45-9a29-4f51-994a-b04ab3db4a34/istio-proxy/0.log"
Jul 23 00:55:40.855511 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:40.855493    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-bplzb_df3cbd45-9a29-4f51-994a-b04ab3db4a34/istio-proxy/1.log"
Jul 23 00:55:40.876032 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:40.876013    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-fjw84_c96b796b-090f-4144-922f-92ce06689911/payload-pre-processing/0.log"
Jul 23 00:55:40.894798 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:40.894780    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-lstnn_295776fe-d951-4e48-ba46-c16618528f55/payload-processing/0.log"
Jul 23 00:55:42.243724 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:42.243696    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-dldw7_5675f276-0612-45ba-aad7-b636450c7299/discovery/0.log"
Jul 23 00:55:42.269760 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:42.269736    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76d98b647-t5lf9_1eff5a77-e427-4e3f-a811-e95da6d2f12d/kube-auth-proxy/0.log"
Jul 23 00:55:42.292242 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:42.292214    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-bplzb_df3cbd45-9a29-4f51-994a-b04ab3db4a34/istio-proxy/0.log"
Jul 23 00:55:42.322019 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:42.321989    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-bplzb_df3cbd45-9a29-4f51-994a-b04ab3db4a34/istio-proxy/1.log"
Jul 23 00:55:42.341514 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:42.341488    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-fjw84_c96b796b-090f-4144-922f-92ce06689911/payload-pre-processing/0.log"
Jul 23 00:55:42.359847 ip-10-0-138-182 kubenswrapper[2549]: I0723 00:55:42.359825    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-lstnn_295776fe-d951-4e48-ba46-c16618528f55/payload-processing/0.log"